<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Plant Sci.</journal-id>
<journal-title>Frontiers in Plant Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Plant Sci.</abbrev-journal-title>
<issn pub-type="epub">1664-462X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpls.2022.790268</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Plant Science</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Novel Vegetation Indices to Identify Broccoli Plants Infected With <italic>Xanthomonas campestris</italic> pv. <italic>campestris</italic></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Pineda</surname> <given-names>M&#x000F3;nica</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/278866/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>P&#x000E9;rez-Bueno</surname> <given-names>Mar&#x000ED;a Luisa</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c002"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/236289/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Bar&#x000F3;n</surname> <given-names>Matilde</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/236291/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Biochemistry and Molecular and Cell Biology of Plants, Estaci&#x000F3;n Experimental del Zaid&#x000ED;n, Spanish National Research Council (CSIC)</institution>, <addr-line>Granada</addr-line>, <country>Spain</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Plant Physiology, Facultad de Farmacia, University of Granada</institution>, <addr-line>Granada</addr-line>, <country>Spain</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Nam-Hai Chua, Temasek Life Sciences Laboratory, Singapore</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Mohsen Yoosefzadeh Najafabadi, University of Guelph, Canada; Luigi De Bellis, University of Salento, Italy</p></fn>
<corresp id="c001">&#x0002A;Correspondence: M&#x000F3;nica Pineda <email>monica.pineda&#x00040;eez.csic.es</email></corresp>
<corresp id="c002">Mar&#x000ED;a Luisa P&#x000E9;rez-Bueno <email>marisa.perez&#x00040;ugr.es</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Technical Advances in Plant Science, a section of the journal Frontiers in Plant Science</p></fn></author-notes>
<pub-date pub-type="epub">
<day>23</day>
<month>06</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>790268</elocation-id>
<history>
<date date-type="received">
<day>06</day>
<month>10</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>05</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2022 Pineda, P&#x000E9;rez-Bueno and Bar&#x000F3;n.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Pineda, P&#x000E9;rez-Bueno and Bar&#x000F3;n</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license></permissions>
<abstract>
<p>A rapid diagnosis of black rot in brassicas, a devastating disease caused by <italic>Xanthomonas campestris</italic> pv. <italic>campestris</italic> (Xcc), would be desirable to avoid significant crop yield losses. The main aim of this work was to develop a method of detection of Xcc infection on broccoli leaves. Such method is based on the use of imaging sensors that capture information about the optical properties of leaves and provide data that can be implemented on machine learning algorithms capable of learning patterns. Based on this knowledge, the algorithms are able to classify plants into categories (healthy and infected). To ensure the robustness of the detection method upon future alterations in climate conditions, the response of broccoli plants to Xcc infection was analyzed under a range of growing environments, taking current climate conditions as reference. Two projections for years 2081&#x02013;2100 were selected, according to the Assessment Report of Intergovernmental Panel on Climate Change. Thus, the response of broccoli plants to Xcc infection and climate conditions has been monitored using leaf temperature and five conventional vegetation indices (VIs) derived from hyperspectral reflectance. In addition, three novel VIs, named diseased broccoli indices (DBI<sub>1</sub>-DBI<sub>3</sub>), were defined based on the spectral reflectance signature of broccoli leaves upon Xcc infection. Finally, the nine parameters were implemented on several classifying algorithms. The detection method offering the best performance of classification was a multilayer perceptron-based artificial neural network. This model identified infected plants with accuracies of 88.1, 76.9, and 83.3%, depending on the growing conditions. In this model, the three Vis described in this work proved to be very informative parameters for the disease detection. To our best knowledge, this is the first time that future climate conditions have been taken into account to develop a robust detection model using classifying algorithms.</p></abstract>
<kwd-group>
<kwd>biotic stress</kwd>
<kwd>climate change</kwd>
<kwd>hyperspectral reflectance imaging</kwd>
<kwd>machine learning</kwd>
<kwd>thermography</kwd>
</kwd-group>
<contract-sponsor id="cn001">Ministerio de Ciencia, Innovaci&#x000F3;n y Universidades<named-content content-type="fundref-id">10.13039/100014440</named-content></contract-sponsor>
<contract-sponsor id="cn002">Agencia Estatal de Investigaci&#x000F3;n<named-content content-type="fundref-id">10.13039/501100011033</named-content></contract-sponsor>
<contract-sponsor id="cn003">European Regional Development Fund<named-content content-type="fundref-id">10.13039/501100008530</named-content></contract-sponsor>
<counts>
<fig-count count="4"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="69"/>
<page-count count="12"/>
<word-count count="8195"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>The cultivation of broccoli (<italic>Brassica oleracea</italic> var. <italic>italica</italic>) has become increasingly attractive and profitable. It is highly regarded for its nutritional value and also its antioxidant and anticancer properties (Owis, <xref ref-type="bibr" rid="B44">2015</xref>). In Spain, the production of broccoli has increased exponentially in the last decades, and it is expected to continue rising in future. In 2018, broccoli crop yields reached up to 561,000 tons in Spain, and most of them were exported to European countries (latest available data reported by Ministerio de Agricultura, Pesca y Alimentaci&#x000F3;n, <ext-link ext-link-type="uri" xlink:href="http://www.mapa.gob.es">www.mapa.gob.es</ext-link>).</p>
<p>Pests and plant diseases are a great challenge in modern agriculture and the main cause of production and economic losses in agriculture worldwide (Savary et al., <xref ref-type="bibr" rid="B52">2012</xref>). Current practices and social activities, such as intensified monoculture in large areas, the use of genetically uniform plant varieties, and international trading of agricultural commodities, contribute largely to the widespread of plant disease epidemics and rapid pathogen evolution (Zhan et al., <xref ref-type="bibr" rid="B65">2015</xref>). Like other Brassica crops, broccoli plants are susceptible to infection by fungi (Alternaria leaf spot, anthracnose, blackleg, or mildews), some viruses (virus mosaic), and bacteria (black rot, soft rots, bacterial leaf spots). Among the bacterial pathogens, <italic>Xanthomonas campestris</italic> is one of the most important in brassicas (Mansfield et al., <xref ref-type="bibr" rid="B39">2012</xref>; Ekman et al., <xref ref-type="bibr" rid="B16">2014</xref>; Dep. Primary Industries and Regional Development, Government Western Australia 2018, <ext-link ext-link-type="uri" xlink:href="http://www.agric.wa.gov.au/broccoli/diseases-vegetable-brassicas">www.agric.wa.gov.au/broccoli/diseases-vegetable-brassicas</ext-link>). The most notable pathovar of <italic>X. campestris</italic> is <italic>campestris</italic> (Xcc), which is the causal agent of black rot of crucifers and affects all cultivated brassicas. Indeed, and according to the report elaborated by EIP-AGRI Focus Group for the European Commission, Xcc is a threat to the production of broccoli, cauliflower, and cabbage throughout Europe (2016, Integrated Pest Management for Brassica, <ext-link ext-link-type="uri" xlink:href="https://ec.europa.eu/eip/agriculture/en/publications/eip-agri-focus-group-ipm-brassica-final-report">https://ec.europa.eu/eip/agriculture/en/publications/eip-agri-focus-group-ipm-brassica-final-report</ext-link>). Moreover, Xcc can be subdivided into nine races on the basis of the responses they induce on different cultivars. Among the nine races described for Xcc, races 1 and 4 are considered the most virulent and spread worldwide (Fargier and Manceau, <xref ref-type="bibr" rid="B18">2007</xref>; Tortosa et al., <xref ref-type="bibr" rid="B58">2018</xref>).</p>
<p>Precision agriculture demands the development of imaging sensor-based methods of detection and diagnosis of plant stress, including diseases. Several optical sensors are currently implemented to monitor crop fields (Aasen et al., <xref ref-type="bibr" rid="B1">2019</xref>; Gerhards et al., <xref ref-type="bibr" rid="B22">2019</xref>; Maes and Steppe, <xref ref-type="bibr" rid="B36">2019</xref>; P&#x000E9;rez-Bueno et al., <xref ref-type="bibr" rid="B46">2019a</xref>; Kashyap and Kumar, <xref ref-type="bibr" rid="B33">2021</xref>; Pineda et al., <xref ref-type="bibr" rid="B50">2021</xref>). Their applicability at lab scale and in high-throughput platforms by proximal sensing, and in the field by remote sensing, makes them particularly useful. However, the data provided by imaging sensors are large and complex and, consequently, difficult to interpret. Hence, improving our ability to extract useful information from these vast datasets requires the use of machine learning algorithms (Sperschneider, <xref ref-type="bibr" rid="B55">2020</xref>). Machine learning is a subset of artificial intelligence (AI), consisting of algorithms that are able to learn patterns from a database of known samples and, based on those patterns, identify or categorize new samples. In agriculture, these algorithms can assist in the monitoring and decision-making processes of crop management (Chlingaryan et al., <xref ref-type="bibr" rid="B15">2018</xref>; Golhani et al., <xref ref-type="bibr" rid="B25">2018</xref>; Liakos et al., <xref ref-type="bibr" rid="B34">2018</xref>; Gao et al., <xref ref-type="bibr" rid="B21">2020</xref>). Thus, the implementation of imaging sensors and AI is a pivotal tool for crop management based on digital agriculture (Talaviya et al., <xref ref-type="bibr" rid="B56">2020</xref>; Jung et al., <xref ref-type="bibr" rid="B31">2021</xref>). However, alteration in growth conditions due to climate change imposes an additional challenge to plant disease detection methods based on AI. The expected rises in CO<sub>2</sub> concentration and temperature associated to climate change would have an impact on agriculture, affecting plants and pathogen physiology (Trivedi et al., <xref ref-type="bibr" rid="B60">2022</xref>) and their geographical distribution (Aidoo et al., <xref ref-type="bibr" rid="B5">2021</xref>). For that reason, potential future climate should be considered as an experimental variable to develop more robust detection methods.</p>
<p>Thermography and multi/hyperspectral reflectance imaging are the most common sensors applied in agriculture (Zarco-Tejada et al., <xref ref-type="bibr" rid="B64">2018</xref>; Maes and Steppe, <xref ref-type="bibr" rid="B36">2019</xref>; P&#x000E9;rez-Bueno et al., <xref ref-type="bibr" rid="B48">2019b</xref>). On the one hand, canopy to air differential temperature (T<sub>C</sub>-T<sub>A</sub>) is an indirect measurement of the vegetation transpiration rate (Scarth et al., <xref ref-type="bibr" rid="B53">1948</xref>; Milthorpe and Spencer, <xref ref-type="bibr" rid="B41">1957</xref>; Fuchs and Tanner, <xref ref-type="bibr" rid="B19">1966</xref>) and is widely used in proximal and remote sensing for stress detection, as recently reviewed by Pineda et al. (<xref ref-type="bibr" rid="B50">2021</xref>). On the other hand, the high spectral resolution of hyperspectral reflectance imaging allows the creation of a growing collection of vegetation indices (VIs). These VIs are transformations of two or more spectral bands which allow reliable temporal and spatial inter-comparisons of vegetation attributes. Thus, VIs are quite simple and effective parameters to quantitatively and qualitatively evaluate vegetation traits such as vigor, fitness, and pigment composition, among other applications (Huete et al., <xref ref-type="bibr" rid="B28">2002</xref>).</p>
<p>In fact, many VIs can be found in the literature. One of the most widely used is the normalized difference vegetation index (NDVI), which is related to vitality of canopies (Tucker, <xref ref-type="bibr" rid="B61">1979</xref>; Pettorelli, <xref ref-type="bibr" rid="B49">2013</xref>). Other VIs correlate with a wide range of plant physiological traits. For example, the photochemical reflectance index (PRI) correlates with photosynthetic activity (Gamon et al., <xref ref-type="bibr" rid="B20">1992</xref>); the carotenoid reflectance index (CRI) (Gitelson et al., <xref ref-type="bibr" rid="B24">2002</xref>) and the anthocyanin reflectance index (ARI) (Gitelson et al., <xref ref-type="bibr" rid="B23">2001</xref>) are related to pigment contents; and the water balance index (WBI) is connected to water content in leaves (Pe&#x000F1;uelas et al., <xref ref-type="bibr" rid="B45">1993</xref>). Indeed, recent works have implemented VIs to the study of plants infected by <italic>Xanthomonas</italic> spp. Abdulridha et al. (<xref ref-type="bibr" rid="B4">2019</xref>) used a collection of VIs (ARI and NDVI among them) implemented on classifying algorithms to successfully identify tangerine plants infected by <italic>X. citri</italic> pv. <italic>citri</italic>. Similarly, NDVI values correlated well with the extension of the lesions caused by <italic>X. campestris</italic> pv. <italic>oryzae</italic> on rice leaves (Zhang et al., <xref ref-type="bibr" rid="B68">2022</xref>). Moreover, several works have compared the association between climate change and the interannual variability registered on NDVI in several locations around the world (Kalisa et al., <xref ref-type="bibr" rid="B32">2019</xref>; Bagherzadeh et al., <xref ref-type="bibr" rid="B6">2020</xref>; Zhao et al., <xref ref-type="bibr" rid="B69">2021</xref>). Nonetheless, new reflectance parameters could be defined for a given purpose to maximize differences when standard VIs are not sensitive enough (Miao et al., <xref ref-type="bibr" rid="B40">2007</xref>; Mahlein et al., <xref ref-type="bibr" rid="B38">2013</xref>; Zhang et al., <xref ref-type="bibr" rid="B66">2017</xref>; El-Hendawy et al., <xref ref-type="bibr" rid="B17">2019</xref>; Jia et al., <xref ref-type="bibr" rid="B30">2019</xref>; Yuan et al., <xref ref-type="bibr" rid="B63">2019</xref>).</p>
<p>The main aim of this work was to develop an efficient method for the detection of Xcc infection in broccoli plants based on thermal and hyperspectral reflectance imaging on individual leaves. For this purpose, six parameters were recorded: leaf temperature (particularly T<sub>C</sub>-T<sub>A</sub>) and five already known VIs. Moreover, three novel VIs specifically designed for detecting the Xcc infection were extracted from the reflectance spectra of healthy and diseased broccoli leaves. They were named diseased broccoli indices (DBI<sub>1</sub>-DBI<sub>3</sub>). This set of nine parameters were implemented on a selection of algorithms widely used on precision agriculture for their success in classifying infected plants: the multilayer perceptron-based artificial neural network (MLP), the support vector machine (SVM), and the k-nearest neighbor (kNN). Finally, the suitability of the trained models was evaluated by comparing their performances in correctly classifying new samples as healthy or diseased leaves under a range of climate conditions, including intermediate and extreme climate change scenarios, as well as current climate conditions. Furthermore, the relevance of every input parameter for the detection of Xcc infection in broccoli plants was evaluated.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>Materials and Methods</title>
<sec>
<title>Plant Growth at Different Climate Conditions</title>
<p>Growth conditions under two possible future climate change scenarios were chosen taking into account the 5th Assessment Report by the Intergovernmental Panel on Climate Change (AR5; IPCC, <xref ref-type="bibr" rid="B29">2014</xref>). In that assessment, a range of projections of greenhouse gases emissions responding to both socio-economic development and climate policy was considered. Future climate conditions were estimated based on representative concentration pathways (RCPs), depending on potential scenarios of greenhouse gases emissions and their atmospheric concentrations, air pollutant emissions, and land use for the year 2100. Thus, current climate conditions (CCC) were compared to future scenarios, being RCP 8.5 the most extreme scenario, meaning most dramatic increase in CO<sub>2</sub> levels and subsequent global warming. In turn, the so called RCP 4.5 would represent an intermediate scenario between CCC and RCP 8.5 and was considered by the AR5 as the most probable scenario by 2100.</p>
<p>The C<sub>3</sub> broccoli plants (<italic>Brassica oleracea</italic> var. <italic>italic</italic> cv. <italic>calabrese natalino</italic>) were grown in a growth chamber in a 16/8-h day/night regime with 60% relative humidity, 200 mol photon m<sup>&#x02212;2</sup> s<sup>&#x02212;1</sup> of PAR light. The ambient temperature and CO<sub>2</sub> concentrations (<xref ref-type="table" rid="T1">Table 1</xref>) were chosen according to the data regionalized by the Spanish State Meteorology Agency (AEMet) for Region of Murcia (largest Spanish broccoli producer) for current climate conditions and those corresponding to RCP 4.5 and RCP 8.5 in years 2081&#x02013;2100. Day and night temperatures correspond to the average values in Region of Murcia during the growing season. For each experiment, plants were sown and grown at the corresponding CCC, RCP 4.5, or RCP 8.5 conditions.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Climatic conditions assessed for broccoli growth: CCC (current climate conditions), RCP 4.5, and RCP 8.5 (Representative Concentration Pathways 4.5 and 8.5) regionalized for Region of Murcia for years 2081&#x02013;2100.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Climate Scenario</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>Temperature (</bold><bold><bold>&#x000B0;</bold></bold><bold>C)</bold></th>
<th valign="top" align="center"><bold>CO<sub><bold>2</bold></sub> (ppm)</bold></th>
</tr>
<tr>
<th/>
<th valign="top" align="center"><bold>Day</bold></th>
<th valign="top" align="center"><bold>Night</bold></th>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">CCC</td>
<td valign="top" align="center">31</td>
<td valign="top" align="center">17</td>
<td valign="top" align="center">408</td>
</tr>
<tr>
<td valign="top" align="left">RCP 4.5</td>
<td valign="top" align="center">34</td>
<td valign="top" align="center">20</td>
<td valign="top" align="center">650</td>
</tr>
<tr>
<td valign="top" align="left">RCP 8.5</td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">23</td>
<td valign="top" align="center">1000</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Bacterial Growth and Inoculation</title>
<p><italic>Xanthomonas campestris</italic> pv <italic>campestris</italic> (Xcc) race 1 and race 4 were grown for 24 h at 28&#x000B0;C in LB (Luria-Bertani) plates. Bacterial suspensions were prepared in sterile 10 mM MgCl<sub>2</sub> at 10<sup>8</sup> colony-forming units per ml (cfu mL<sup>&#x02212;1</sup>) by adjusting the optical density at 600 nm to 0.1.</p>
<p>The third leaf of four-week-old plants (under CCC or RCP 4.5) or five-week-old plants (in case of RCP 8.5) was mock-inoculated with sterile 10 mM MgCl<sub>2</sub> or inoculated with bacterial suspension by clipping four secondary veins per leaf with rat tooth tweezers previously dipped in the corresponding solution (<xref ref-type="fig" rid="F1">Figure 1</xref>). For each experiment, twelve plants per treatment (CCC and RCP 4.5) and four plants per treatment (RCP 8.5) were inoculated. Leaves were imaged at 1, 2, 3, 6, and 9 days post-inoculation (dpi). At least two experiments per climate condition were carried out, providing similar results.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Timecourse of symptoms evolution of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at current climate conditions (<bold>A</bold>; CCC), and the representative concentration pathways RCP 4.5 <bold>(B)</bold> and RCP 8.5 <bold>(C)</bold>. White arrows indicate the inoculation points. For simplicity, they have only been shown in mock-controls leaves at CCC. Dpi, days post-inoculation.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpls-13-790268-g0001.tif"/>
</fig>
</sec>
<sec>
<title>Thermal Imaging</title>
<p>Thermal images of whole leaves were recorded using a FLIR A305sc camera (FLIR Systems, Wilsonville, OR, USA) vertically positioned 30 cm above the leaf, according to P&#x000E9;rez-Bueno et al. (<xref ref-type="bibr" rid="B47">2016</xref>). For each measurement, 10 thermal images were collected in the plant growth chamber over 10 s. These images were averaged to extract temperature values for whole leaves. Image processing was carried out using the FLIR ResearchIR v. 3.4 software.</p>
</sec>
<sec>
<title>Hyperspectral Reflectance Imaging</title>
<p>Reflectance spectra (400&#x02013;1,000 nm) of broccoli leaves were recorded using a Pika L hyperspectral imaging camera (Resonon, Bozeman, MT, USA) in the visible (400&#x02013;700 nm) to near-infrared spectral range (700&#x02013;1,000 nm), with a spectral sampling at 2.1 nm and a spectral resolution (full width at half maximum) of 3.7 nm. The camera was positioned vertically 45 cm over the sample, which was placed on a translation stage. Thus, a datacube with 281 images was built for each attached leaf.</p>
<p>Leaves were illuminated with four calibrated xenon lamps with homogeneous light intensity between 400 and 1,000 nm, positioned above the samples and around the camera. Previous to leaf measurements, dark and light corrections were made in darkness and illuminating a white homogenous calibration tile provided by Resonon, respectively. Dark and light corrections, build-up of datacubes and analysis, were carried out with the software Spectronon v. 2.134 (Resonon).</p>
<p>Reflectance spectra averaged for whole leaves were obtained and used to calculate images corresponding to several widely used VIs, as summarized in <xref ref-type="table" rid="T2">Table 2</xref>. To avoid overfitting of machine learning models, only not redundant VIs were selected.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Common vegetation indices (VIs) from the literature that were used in this work.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>VIs name</bold></th>
<th valign="top" align="left"><bold>Related to</bold></th>
<th valign="top" align="left"><bold>Equation</bold></th>
<th valign="top" align="left"><bold>References</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Anthocyanins reflectance index 1</td>
<td valign="top" align="left">Anthocyanins</td>
<td valign="top" align="left"><inline-formula><mml:math id="M1"><mml:mtext>ARI</mml:mtext><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>550</mml:mn></mml:mrow></mml:mfrac><mml:mtext>&#x000A0;</mml:mtext><mml:mo>-</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>700</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
<td valign="top" align="left">Gitelson et al., <xref ref-type="bibr" rid="B23">2001</xref></td>
</tr>
<tr>
<td valign="top" align="left">Carotenoids reflectance index 2</td>
<td valign="top" align="left">Carotenoids</td>
<td valign="top" align="left"><inline-formula><mml:math id="M2"><mml:mtext>CRI</mml:mtext><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>510</mml:mn></mml:mrow></mml:mfrac><mml:mtext>&#x000A0;</mml:mtext><mml:mo>-</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>700</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
<td valign="top" align="left">Gitelson et al., <xref ref-type="bibr" rid="B24">2002</xref></td>
</tr>
<tr>
<td valign="top" align="left">Normalized difference vegetation index</td>
<td valign="top" align="left">Vigor</td>
<td valign="top" align="left"><inline-formula><mml:math id="M3"><mml:mtext>NDVI&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>800</mml:mn><mml:mtext>&#x000A0;</mml:mtext><mml:mo>-</mml:mo><mml:mtext>&#x000A0;R</mml:mtext><mml:mn>670</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>800</mml:mn><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x0002B;</mml:mo><mml:mtext>&#x000A0;R</mml:mtext><mml:mn>670</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
<td valign="top" align="left">Tucker, <xref ref-type="bibr" rid="B61">1979</xref></td>
</tr>
<tr>
<td valign="top" align="left">Photochemical reflectance index</td>
<td valign="top" align="left">Photosynthesis</td>
<td valign="top" align="left"><inline-formula><mml:math id="M4"><mml:mtext>PRI&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>531</mml:mn><mml:mtext>&#x000A0;</mml:mtext><mml:mo>-</mml:mo><mml:mtext>&#x000A0;R</mml:mtext><mml:mn>570</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>531</mml:mn><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x0002B;</mml:mo><mml:mtext>&#x000A0;R</mml:mtext><mml:mn>570</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
<td valign="top" align="left">Gamon et al., <xref ref-type="bibr" rid="B20">1992</xref></td>
</tr>
<tr>
<td valign="top" align="left">Water balance index</td>
<td valign="top" align="left">Water</td>
<td valign="top" align="left">WBI &#x0003D; R900&#x02212;R970</td>
<td valign="top" align="left">Pe&#x000F1;uelas et al., <xref ref-type="bibr" rid="B45">1993</xref></td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Data Analysis</title>
<p>Numerical data obtained from thermal and reflectance images (including reflectance spectra and VIs) were managed using Microsoft Office Excel 2016 (Microsoft Corporation, Redmond, WA, USA). Aiming to design a simple method of detection, values were averaged from whole leaves rather than regions of interest.</p>
<p>Two-tailed Student&#x00027;s <italic>t</italic>-test (Microsoft Excel) was performed to compare, for every treatment and at every dpi assayed: (a) spectra reflectance profiles; (b) values of novel VIs (DBIs). The null hypothesis was that there were no differences between treatments. This hypothesis was considered false at <italic>p</italic> &#x0003C; 0.05, and variables were treated as different when p-value was below this value. Figure graphs were plotted using Microsoft Excel.</p>
</sec>
<sec>
<title>Classification Analysis by Machine Learning</title>
<p>Data collected through whole experiments were organized in databases (Microsoft Excel), one per climate condition. Each database contained values of selected parameters (T<sub>C</sub>-T<sub>A</sub>, NDVI, PRI, ARI, CRI, WBI, DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub>) at every dpi (1&#x02013;9 dpi) and treatment (mock-control, Xcc race 1-, and Xcc race 4-infected plants). In addition, data were rescaled from zero to one to ensure comparison between treatments and days, according to the equation: <italic>rescaled value</italic> = <italic>(x-minimum)/maximum</italic>. Then, the three databases were randomly partitioned into training and test datasets, in a proportion of 7:3, respectively (<xref ref-type="table" rid="T3">Table 3</xref>). This partition was carried out using a seed that ensured that every category (treatment and dpi) was well represented in both datasets. The experimental data were analyzed by the free version of KNIME v. 4.3.2 (KNIME AG, Zurich, Switzerland; <ext-link ext-link-type="uri" xlink:href="http://www.knime.com">www.knime.com</ext-link>; Berthold et al., <xref ref-type="bibr" rid="B11">2008</xref>).</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Sample size (n) of the training and test databases created for each growth condition.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Treatment</bold></th>
<th valign="top" align="center"><bold>Training dataset (<italic>n</italic>)</bold></th>
<th valign="top" align="center"><bold>Test dataset (<italic>n</italic>)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">CCC</td>
<td valign="top" align="center">98</td>
<td valign="top" align="center">41</td>
</tr>
<tr>
<td valign="top" align="left">RCP 4.5</td>
<td valign="top" align="center">84</td>
<td valign="top" align="center">39</td>
</tr>
<tr>
<td valign="top" align="left">RCP 8.5</td>
<td valign="top" align="center">42</td>
<td valign="top" align="center">18</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Three models were built for each one of the three growing conditions by analyzing the corresponding databases with three supervised classifying algorithms: MLP, SVM, and kNN. MLP is a network inspired by biological neural networks in which different interconnected nodes (called neurons) organized in layers transmit information to each other, learning from both input and output data (Hahn, <xref ref-type="bibr" rid="B27">2009</xref>; Behmann et al., <xref ref-type="bibr" rid="B10">2015</xref>). In contrast, SVM distributes samples in a high-dimensional feature space defined by support vectors. In this case, new samples are categorized based on what side of hyperplanes they fall on (Behmann et al., <xref ref-type="bibr" rid="B10">2015</xref>). Finally, kNNs assign proportional weights to the contributions of the sample neighbors based on distances. These weights determine to what category a new sample would most likely belong to (Blanzieri and Melgani, <xref ref-type="bibr" rid="B12">2008</xref>).</p>
<p>Broccoli leaves were categorized into mock-control, Xcc race 1-, and Xcc race 4-infected plants using the classifying algorithms MLP, SVM, and kNN. The performance of classification was evaluated in terms of (i) sensitivity (true positive rate); (ii) specificity (true negative rate); (iii) accuracy (percentage of right guesses); and (iv) <italic>F</italic>-measure (harmonic mean of precision and sensitivity; where precision is the number of correct control samples divided by the number of all plants classified as &#x0201C;control&#x0201D;). All the three feedforward backpropagation MLPs tested were designed to have one hidden layer with four neurons (half the number of variables used to feed them). Higher number of hidden layers or their neurons did not result in an improvement of the performance. A polynomial kernel was used for the SVMs, with bias = 1 and gamma = 1. More complex spatial kernels did not improve the performance of the algorithm. Finally, the optimal number of neighbors for the kNN algorithm was <italic>k</italic> = 5 using the Euclidean distance. Regarding SVM and kNN libraries, we have used the basic nodes (SVM learner and K nearest neighbor, respectively) implemented on Knime software v. 4.3.2. This process was performed independently for each of the three climate conditions under study.</p>
<p>Finally, the global variable importance was calculated for each parameter (T<sub>C</sub>-T<sub>A</sub>, NDVI, PRI, ARI, CRI, WBI, DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub>), that is, how informative was a given parameter for the model to make a correct decision. For such a purpose, global surrogate random forest (RF) models were trained to estimate the variable importance using the Global Feature Importance component developed for Knime software (<ext-link ext-link-type="uri" xlink:href="https://hub.knime.com/knime/spaces/Examples/latest/00_Components/Model%20Interpretability/Global%20Feature%20Importance&#x0007E;xsR90ymhRbHOc78Z">https://hub.knime.com/knime/spaces/Examples/latest/00_Components/Model%20Interpretability/Global%20Feature%20Importance&#x0007E;xsR90ymhRbHOc78Z</ext-link>). RF was trained on the standardly pre-processed input data. Feature importance was then calculated by counting how many times it had been selected for a split and at which rank (level) among all available features (candidates) in the trees of the RF.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec>
<title>Evolution of Symptoms Under a Range of Growth Conditions</title>
<p>Plants grown from sowing under CCC, RCP4.5, or RCP8.5 conditions were inoculated with Xcc race 1 or 4, and the evolution of symptoms was followed up to 9 dpi. At CCC and RCP 4.5, Xcc infection on broccoli plants consisted in chlorosis followed by a progressive necrosis of the tissue surrounding the inoculation site to finally reach the V-shaped lesions typical of this bacterial infection (<xref ref-type="fig" rid="F1">Figure 1</xref>). Xcc race 4 caused the most severe symptoms, with necrosis at the clipping point starting at 3 dpi and evident at 6 dpi; chlorosis surrounded the inoculated area at 6 dpi, and V-shaped lesions were patent at 9 dpi. In contrast, Xcc race 1 produced similar symptoms in a slower time course, with a delay of 3 days. Mock-control leaves only displayed the actual lesions. It is worth noticing that there was no evolution in symptoms from 0 to 1 dpi under any of the assayed growth conditions.</p>
<p>The RCP 8.5 conditions affected the growth of broccoli plants, which displayed stunting and early senescence. Moreover, leaves were smaller and thicker than those of plants grown at CCC or RCP 4.5 conditions. At RCP 8.5, the evolution of the infection by either race resembled that described for Xcc race 4 under CCC. Moreover, Xcc race 1 was more virulent than Xcc race 4 at 9 dpi.</p>
</sec>
<sec>
<title>Novel VIs Could Discriminate Between Healthy and Xcc-Infected Broccoli Leaves</title>
<p>For every treatment (mock-control, Xcc race 1-, and Xcc race 4-infected), whole leaf reflectance spectra were registered at 1, 2, 3, 6, and 9 dpi. Those profiles revealed specific spectral patterns for each treatment, showing clear differences between them from the first timepoint measured (<xref ref-type="fig" rid="F2">Figure 2</xref>; <xref ref-type="supplementary-material" rid="SM1">Supplementary Figures 1</xref>, <xref ref-type="supplementary-material" rid="SM2">2</xref>). Thus, the use of VIs based on hyperspectral reflectance measurements seemed to be useful to distinguish between control and Xcc (race 1 or 4)-infected plants. The common VIs ARI, CRI, PRI, NDVI, and WBI were obtained from the spectra for every treatment and dpi measured and recorded in a database for each climate condition.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Spectral profiles of whole leaves of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at current climate conditions and at different days post-inoculation (dpi). Graphs represent mean values for every treatment. Sample size (<italic>n</italic>) is given for each timepoint and treatment: mock-control (green); Xcc race 1-infected (orange); and Xcc race 4-infected broccoli plants (purple). <bold>A, B, C</bold>, and <bold>D</bold>: 1, 3, 6, and 9 dpi, respectively.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpls-13-790268-g0002.tif"/>
</fig>
<p>In addition, novel VIs were designed, based on spectral differences between healthy and Xcc-infected broccoli leaves. Reflectance spectra were compared by Student&#x00027;s t-test in order to determine at which wavelengths reflectance values were statistically different (at least <italic>p</italic> &#x0003C; 0.05) between treatments. Thus, three spectral ranges were found to show maximal differences between treatments at every dpi tested: 400&#x02013;500, 600&#x02013;700, and 900&#x02013;1000 nm. On the contrary, the regions 520&#x02013;570 and 730&#x02013;890 nm were very stable and not affected by the infection until 9 dpi. For this reason, they were selected for &#x0201C;normalization&#x0201D; of the designed parameters. Several wavelengths were chosen within these spectral regions of interest. To avoid redundancy of adjacent wavelengths in the reflectance spectra, only wavelengths separated by at least 40 nm were used in this process. Finally, the selected wavelengths were combined by different mathematical calculations (additions, subtractions, divisions, or combinations thereof) in order to find novel VIs showing statistical differences (<italic>p</italic> &#x0003C; 0.05 according to Student&#x00027;s <italic>t</italic>-test) between treatments along entire experiments at each climate condition. Among the large collection of proposed VIs, three of them, named diseased broccoli indices 1&#x02013;3 (DBI<sub>1&#x02212;3</sub>; <xref ref-type="table" rid="T4">Table 4</xref>), offered maximum significant differences between mock-control and Xcc-infected broccoli plants. It is worth noticing that DBI<sub>1&#x02212;3</sub> did not show statistically significant correlation with each other, meaning that DBI<sub>1&#x02212;3</sub> did not provide redundant information to the classifiers.</p>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Novel vegetation indices (VIs) firstly described in this work.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>VIs name</bold></th>
<th valign="top" align="left"><bold>Related to</bold></th>
<th valign="top" align="left"><bold>Equation</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Diseased broccoli index 1</td>
<td valign="top" align="left">Xcc infection</td>
<td valign="top" align="left"><inline-formula><mml:math id="M5"><mml:msub><mml:mrow><mml:mtext>DBI</mml:mtext></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>400</mml:mn><mml:mtext>&#x000A0;</mml:mtext><mml:mo>-</mml:mo><mml:mtext>&#x000A0;R</mml:mtext><mml:mn>690</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>850</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">Diseased broccoli index 2</td>
<td valign="top" align="left">Xcc infection</td>
<td valign="top" align="left"><inline-formula><mml:math id="M6"><mml:msub><mml:mrow><mml:mtext>DBI</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>400</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>850</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
</tr>
<tr>
<td valign="top" align="left">Diseased broccoli index 3</td>
<td valign="top" align="left">Xcc infection</td>
<td valign="top" align="left"><inline-formula><mml:math id="M7"><mml:msub><mml:mrow><mml:mtext>DBI</mml:mtext></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>578</mml:mn></mml:mrow><mml:mrow><mml:mtext>R</mml:mtext><mml:mn>529</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Identification of Xcc-Infected Leaves by Classificatory Algorithms</title>
<p>For each experimental condition, an independent database was built containing the values of selected parameters (T<sub>C</sub>-T<sub>A</sub>, NDVI, PRI, ARI, CRI, WBI, DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub>) for every treatment and dpi assayed. The three databases were normalized and then randomly split in two datasets: training (70%) and testing (30%). Each of the three training dataset was used to feed supervised classifying algorithms (MLP, SVM, and kNN) to classify samples into the following categories: mock-control, Xcc race 1-, and Xcc race 4-infected leaves; each of the three testing dataset was used to calculate their performance of classification.</p>
<p>The MLPs provided the highest accuracy for every climate condition (<xref ref-type="fig" rid="F3">Figure 3</xref>). They also provided the highest <italic>F</italic>-measure under every condition and, in general terms, the highest sensitivity. In contrast, SVM and kNN showed similar accuracies for CCC; however, these two algorithms were not able to identify control and infected samples at RCP 4.5 or RCP 8.5, with accuracies of 45&#x02013;50% and rather low specificity. Moreover, any attempt of classification by MLP, SVM, or kNN into two categories (mock-control vs Xcc-infected) was inefficient. This was probably due to the underrepresentation of mock-control samples in the datasets (1/3 healthy vs. 2/3 of infected), whereas in three-category models, every group had the same size.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Performance of three algorithms for the classification of samples into the categories control, Xcc race 1-infected, and Xcc race 4-infected leaves in terms of overall accuracy <bold>(A)</bold>, <italic>F</italic>-measure <bold>(B)</bold>, sensitivity <bold>(C)</bold>, and specificity <bold>(D)</bold> for each climate scenario. SVM, support vector machine; MLP, multilayer perceptron-based artificial neural network; kNN, k-nearest neighbors (<italic>k</italic> = 5 neighbors). CCC, current climate conditions; RCP 4.5 and 8.5, representative concentration pathways 4.5 and 8.5.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpls-13-790268-g0003.tif"/>
</fig>
<p>The suitability of the designed VIs for the identification of Xcc-infected leaves was evaluated in terms of global variable importance in the classifiers, calculated by a surrogate RF algorithm (<xref ref-type="fig" rid="F4">Figure 4</xref>). The accuracies obtained for the fit of each RF were 85.7%, 87.2%, and 88.9% for CCC, RCP 4.5, and RCP 8.5, respectively. Under CCC, the most informative parameters were DBI<sub>1</sub>, DBI<sub>2</sub>, and WBI. In contrast, under RCP 4.5 conditions, T<sub>C</sub>-T<sub>A</sub>, DBI<sub>3</sub>, and PRI obtained the highest global variable importance. Finally, under RCP 8.5 conditions, DBI<sub>2</sub>, CRI, and NDVI were the most instructive parameters.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Global variable importance calculated using a global surrogate random forest (RF) model. CCC, current climate conditions; RCP 4.5 and 8.5, representative concentration pathways 4.5 and 8.5; ARI, anthocyanin reflectance index; CRI, carotenoid reflectance index; DBI<sub>1&#x02212;3</sub>, disease broccoli index 1&#x02013;3; NDVI, normalized difference vegetation index; PRI, photochemical reflectance index; T<sub>C</sub>-T<sub>A</sub>, normalized temperature; WBI, water balance index.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpls-13-790268-g0004.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>Imaging techniques appear to be essential for precision agriculture due to their fast time-spatial response to biotic and abiotic stress in a non-destructive manner (Bar&#x000F3;n et al., <xref ref-type="bibr" rid="B8">2016</xref>; Mahlein, <xref ref-type="bibr" rid="B37">2016</xref>). In the last years, thermal and (multi- or hyper-) reflectance imaging sensors have been broadly used for monitoring stress in crop fields. Furthermore, sustainable agriculture is increasingly relying on AI (such as classifying algorithms) coupled with computer vision, to solve farming issues and to promote the automation of decision-making process (Tian et al., <xref ref-type="bibr" rid="B57">2020</xref>; Nabwire et al., <xref ref-type="bibr" rid="B42">2021</xref>). However, these methods require basic research to define informative parameters that efficiently report the health state and fitness of a particular crop. This work aims to define optimal VIs and classifiers for the detection of Xcc-infected broccoli leaves. Furthermore, the robustness of those models was analyzed under climate conditions mimicking those expected for Region of Murcia in years 2081&#x02013;2100.</p>
<p>According to Fargier and Manceau (<xref ref-type="bibr" rid="B18">2007</xref>), when a cultivar of a brassica is infected by Xcc, a collection of polymorphisms is obtained depending on the race inoculated. In the case of broccoli plants used for this study (<italic>B. oleracea</italic> var. <italic>italic</italic> cv. <italic>calabrese natalino</italic>), the symptoms developed under CCC triggered by races 1 and 4 were similar. However, Xcc race 1 showed a slower timecourse than race 4 under the same ambient conditions. The process of undergoing climate change could affect considerably plant biochemistry and therefore plant defense responses. For this reason, it is relevant to include future climate conditions in disease detection studies. Indeed, each disease may respond differently to these variations, and thus, climate change would cause neutral, positive, or negative effects on plant responses to diseases (Trebicki et al., <xref ref-type="bibr" rid="B59">2017</xref>; Vel&#x000E1;squez et al., <xref ref-type="bibr" rid="B62">2018</xref>; Cheng et al., <xref ref-type="bibr" rid="B14">2019</xref>). According to the results reported here, symptoms caused by Xcc on susceptible broccoli plants would not be altered on an intermediate climate change scenario like RCP 4.5. These results are in accordance with previous works, as extensively reviewed by Gullino et al. (<xref ref-type="bibr" rid="B26">2018</xref>). However, the RCP 8.5 imposed a stress condition limiting or slowing down plant growth. It will be of particular interest to gain knowledge about the impact of combined high temperature and high CO<sub>2</sub> on photosynthetic processes of the broccoli plant which, as a C<sub>3</sub> species, is well adapted to mild temperatures. Nevertheless, further research would be needed to fully understand the impact of climate change on broccoli plant physiology (particularly on photosynthesis), as well as on the physiology of Xcc races, and/or their interaction with host plants.</p>
<p>In literature, a number of classic VIs derived from multispectral (and hyperspectral) imaging can be found. This VIs can be used to detect, classify, and quantify specific diseases with varying degrees of success (Lowe et al., <xref ref-type="bibr" rid="B35">2017</xref>). However, high-resolution spectra recorded with hyperspectral imaging sensors allow the selection of an optimized set of wavelengths to maximize differences between healthy and infected plants. Those wavelengths can be used to create novel parameters specific for a given host&#x02013;pathogen system or stress factor. This approach has already been demonstrated to be suitable to detect diseased plants when combined with AI algorithms. Thus, Mahlein et al. (<xref ref-type="bibr" rid="B38">2013</xref>) reported specific spectral disease indices for the detection of sugar beet plants infected with Cercospora leaf spot, sugar beet rust, or powdery mildew. Those indices improved disease detection and identification when implemented on classifiers. Similarly, Yuan et al. (<xref ref-type="bibr" rid="B63">2019</xref>) proposed a novel method for detecting anthracnose in tea plants based on hyperspectral imaging that included two new disease indices in the classificatory models. Moreover, the analysis of reflectance spectral data of healthy and diseased wheat ears allowed the creation of a novel index that demonstrated a stronger ability to determine the severity of the Fusarium head blight compared with other sixteen existing spectral indices (Zhang et al., <xref ref-type="bibr" rid="B67">2020</xref>).</p>
<p>In this work, three novel VIs have been developed to successfully distinguish between healthy and Xcc-infected broccoli plants (<xref ref-type="table" rid="T4">Table 4</xref>). Leaf reflectance is a complex phenomenon dependent on biochemical and biophysical properties of the canopy leaves, which in turn are affected by growth conditions and diseases. Thus, the visible reflectance range (400&#x02013;700 nm) is mostly influenced by the leaf pigment content; the reflectance in the near-infrared range (700&#x02013;1100 nm) depends on water content and leaf structure, or internal scattering processes; and the short-wave infrared (1,100&#x02013;2,500 nm) is influenced by the composition of leaf chemicals and water, as reviewed by Mahlein (<xref ref-type="bibr" rid="B37">2016</xref>). Since chlorophylls are the main pigments influencing reflectance spectrum at 400 and 690 nm, both DBI<sub>1</sub> and DBI<sub>2</sub> indices could be indicative of the severity of chlorosis. Moreover, DBI<sub>3</sub> could be also related to the contents on chlorophylls and carotenes (Carter and Knapp, <xref ref-type="bibr" rid="B13">2001</xref>).</p>
<p>DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub>, together with thermal (T<sub>C</sub>-T<sub>A</sub>) and other common hyperspectral reflectance parameters (NDVI, PRI, ARI, CRI, and WBI), were implemented in three different supervised classifiers (MLP, SVM, and kNN) for each experimental condition. Since the learning process of each algorithm differs from each other, so will the quality of its predictions on the new samples. In this sense, it is a common procedure to compare the performance of several algorithms when sorting new samples (the validation datasets) after training on the same dataset. Metrics such as specificity (true negative rate), sensitivity (true positive rate), accuracy (percentage of right guesses), or <italic>F</italic>-measure (harmonic mean of precision and sensitivity) evaluate the performance of classification, that is, the estimation of the true risk of error of the output prediction of a machine learning algorithm (Shalev-Shwartz and Ben-David, <xref ref-type="bibr" rid="B54">2014</xref>; Liakos et al., <xref ref-type="bibr" rid="B34">2018</xref>). The MLPs were the most effective classifier, with the highest overall accuracy and <italic>F</italic>-measure under the three growing conditions assayed. The performance of the MLP models was comparable to that reported by other authors for disease detection classifiers. Indeed, an increasing number of studies apply classifiers to spectral data (including or not thermal parameters) to identify infected plants at conditions resembling CCC. For example, Sankaran et al. (<xref ref-type="bibr" rid="B51">2013</xref>) reported an accuracy of 87% when classifying citrus trees infected by <italic>Candidatus Liberibacter</italic> spp, a bacteria causing Huanglongbing disease. Zarco-Tejada et al. (<xref ref-type="bibr" rid="B64">2018</xref>) obtained accuracies of disease detection exceeding 80% when classifying <italic>Xylella fastidiosa</italic>-infected olive trees. This pathogen, alike Xcc, is a xylem bacterium. Abdulridha et al. (<xref ref-type="bibr" rid="B2">2020a</xref>,<xref ref-type="bibr" rid="B3">b</xref>) identified tomato plants infected with tomato yellow leaf curl virus, <italic>Xanthomonas perforans</italic>, or <italic>Corynespora cassiicola</italic> (a fungus) with 94&#x02013;100% accuracy depending on the pathogen. P&#x000E9;rez-Bueno et al. (<xref ref-type="bibr" rid="B48">2019b</xref>) detected avocado trees suffering white root rot (caused by the fungus <italic>Rosellinia necatrix</italic>) with accuracies up to 82.5%. Nguyen et al. (<xref ref-type="bibr" rid="B43">2021</xref>) achieved accuracies ranging from 82 to 96.75% when identifying vines affected by the Grapevine vein-clearing virus. Similarly to the results here reported, Yuan et al. (<xref ref-type="bibr" rid="B63">2019</xref>) designed novel hyperspectral reflectance indices which help to identify <italic>Gloeosporium theae-sinesis</italic> Miyake-infected tea plants with 94 and 98% accuracies at pixel and leaf levels, respectively.</p>
<p>The performance of the models was affected differentially by growing conditions, depending on the classifier. In both RCPs, the accuracy of the classifiers decreased in all cases. However, the accuracy of models based on MLP only decreased from 88.1% at CCC to 76.9 and 83.3% for RCP 4.5 and RCP 8.5, respectively. This advantage of MLPs against SVM and kNN models could be related to the fact that MLPs are less affected by noise factors (compared to other algorithms), which in turn reduces significantly the influence of the unknown variability. Therefore, MLPs are usually more robust models that often outperform other classifying algorithms in solving a variety of classification problems (Basheer and Hajmeer, <xref ref-type="bibr" rid="B9">2000</xref>; Bala and Kumar, <xref ref-type="bibr" rid="B7">2017</xref>). To our best knowledge, this is the first time that machine learning classifiers have been applied to hyperspectral and thermal data taken under climate conditions mimicking those projected for the future in order to classify healthy and infected plants.</p>
<p>DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub> proved to be important features for plant classification according to a surrogate RF used for testing the global importance of variables. Overall, DBI<sub>1</sub> and DBI<sub>2</sub> were the most informative parameters of the set for CCC. However, the global variable importance varied for each parameter depending on the climate conditions. Under RCP 4.5 conditions, T<sub>C</sub>-T<sub>A</sub> and DBI<sub>3</sub> were the most informative parameters. In contrast, DBI<sub>2</sub> was the parameter with the highest global variable importance at RCP 8.5. This effect may be due to the impact of growing conditions on the symptomatology (degree of chlorosis and/or necrosis) of the infections, as discussed above.</p>
</sec>
<sec sec-type="conclusions" id="s5">
<title>Conclusion</title>
<p>The parameters DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub> here presented are good reporters for Xcc infection in broccoli leaves. Furthermore, the model based on MLP and the set of parameters DBI<sub>1</sub>, DBI<sub>2</sub>, and DBI<sub>3</sub> along with common VIs (ARI, CRI, NDVI, PRI, and WBI) and T<sub>C</sub>-T<sub>A</sub> would be an effective procedure for the identification of Xcc-broccoli infected plants. In addition, this model proved to be robust regardless of the climate conditions.</p>
</sec>
<sec sec-type="data-availability" id="s6">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/<xref ref-type="sec" rid="s10">Supplementary Material</xref>. Further inquiries can be directed to the corresponding authors.</p>
</sec>
<sec id="s7">
<title>Author Contributions</title>
<p>MP, MLP-B, and MB conceived and designed the experiments and wrote the manuscript. MP and MP-B conducted the experiments. MP analyzed the data, interpreted the results, and mounted images. MB contributed to the materials, equipment, and analysis tools. All the authors reviewed it and approved the final version.</p>
</sec>
<sec sec-type="funding-information" id="s8">
<title>Funding</title>
<p>This work was supported by grant RTI2018-094652-B-I00 funded by MCIN/AEI/10.13039/501100011033 and by &#x0201C;ERDF: A way of making Europe&#x0201D;. The free open access publication was partially funded by Consejo Superior de Investigaciones Cient&#x000ED;ficas (CSIC) through the Unidad de Recursos de Informaci&#x000F3;n Cient&#x000ED;fica para la Investigaci&#x000F3;n (URICI).</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec> 
</body>
<back>
<sec sec-type="supplementary-material" id="s10">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpls.2022.790268/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpls.2022.790268/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Image_1.TIF" id="SM1" mimetype="image/tif" xmlns:xlink="http://www.w3.org/1999/xlink">
<label>Supplementary Figure 1</label>
<caption><p>Spectral profiles of whole leaves of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at RCP 4.5 and at different days post-inoculation (dpi). Graphs represent mean values for every treatment. Sample size (<italic>n</italic>) is given for each timepoint and treatment: mock-control (green); Xcc race 1-infected (orange); and Xcc race 4-infected broccoli plants (purple).</p></caption></supplementary-material>
<supplementary-material xlink:href="Image_2.TIF" id="SM2" mimetype="image/tif" xmlns:xlink="http://www.w3.org/1999/xlink">
<label>Supplementary Figure 2</label>
<caption><p>Spectral profiles of whole leaves of mock-control, Xcc race 1-infected, and Xcc race 4-infected broccoli plants at RCP 8.5 and at different days post-inoculation (dpi). Graphs represent mean values (<italic>n</italic> = 4) for every treatment and timepoint.</p></caption></supplementary-material>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aasen</surname> <given-names>H.</given-names></name> <name><surname>Van Wittenberghe</surname> <given-names>S.</given-names></name> <name><surname>Medina</surname> <given-names>N. S.</given-names></name> <name><surname>Damm</surname> <given-names>A.</given-names></name> <name><surname>Goulas</surname> <given-names>Y.</given-names></name> <name><surname>Wieneke</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Sun-induced chlorophyll fluorescence II: review of passive measurement setups, protocols, and their application at the leaf to canopy level</article-title>. <source>Remote Sens.</source> <volume>11</volume>, <fpage>33</fpage>. <pub-id pub-id-type="doi">10.3390/rs11080927</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abdulridha</surname> <given-names>J.</given-names></name> <name><surname>Ampatzidis</surname> <given-names>Y.</given-names></name> <name><surname>Kakarla</surname> <given-names>S. C.</given-names></name> <name><surname>Roberts</surname> <given-names>P.</given-names></name></person-group> (<year>2020a</year>). <article-title>Detection of target spot and bacterial spot diseases in tomato using UAV-based and benchtop-based hyperspectral imaging techniques</article-title>. <source>Precis. Agric.</source> <volume>21</volume>, <fpage>955</fpage>&#x02013;<lpage>978</lpage>. <pub-id pub-id-type="doi">10.1007/s11119-019-09703-4</pub-id></citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abdulridha</surname> <given-names>J.</given-names></name> <name><surname>Ampatzidis</surname> <given-names>Y.</given-names></name> <name><surname>Qureshi</surname> <given-names>J.</given-names></name> <name><surname>Roberts</surname> <given-names>P.</given-names></name></person-group> (<year>2020b</year>). <article-title>Laboratory and UAV-based identification and classification of tomato yellow leaf curl, bacterial spot, and target spot diseases in tomato utilizing hyperspectral imaging and machine learning</article-title>. <source>Remote Sens.</source> <volume>12</volume>, <fpage>2732</fpage>. <pub-id pub-id-type="doi">10.3390/rs12172732</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abdulridha</surname> <given-names>J.</given-names></name> <name><surname>Batuman</surname> <given-names>O.</given-names></name> <name><surname>Ampatzidis</surname> <given-names>Y.</given-names></name></person-group> (<year>2019</year>). <article-title>UAV-based remote sensing technique to detect citrus canker disease utilizing hyperspectral imaging and machine learning</article-title>. <source>Remote Sens.</source> <volume>11</volume>, <fpage>1373</fpage>. <pub-id pub-id-type="doi">10.3390/rs11111373</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aidoo</surname> <given-names>O. F.</given-names></name> <name><surname>Cunze</surname> <given-names>S.</given-names></name> <name><surname>Guimapi</surname> <given-names>R. A.</given-names></name> <name><surname>Arhin</surname> <given-names>L.</given-names></name> <name><surname>Ablormeti</surname> <given-names>F. K.</given-names></name> <name><surname>Tettey</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Lethal yellowing disease: insights from predicting potential distribution under different climate change scenarios</article-title>. <source>J. Plant Dis. Prot.</source> <volume>128</volume>, <fpage>1313</fpage>&#x02013;<lpage>1325</lpage>. <pub-id pub-id-type="doi">10.1007/s41348-021-00488-1</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bagherzadeh</surname> <given-names>A.</given-names></name> <name><surname>Hoseini</surname> <given-names>A. V.</given-names></name> <name><surname>Totmaj</surname> <given-names>L. H.</given-names></name></person-group> (<year>2020</year>). <article-title>The effects of climate change on normalized difference vegetation index (NDVI) in the Northeast of Iran</article-title>. <source>Model. Earth Syst. Environ.</source> <volume>6</volume>, <fpage>671</fpage>&#x02013;<lpage>683</lpage>. <pub-id pub-id-type="doi">10.1007/s40808-020-00724-x</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bala</surname> <given-names>R.</given-names></name> <name><surname>Kumar</surname> <given-names>D.</given-names></name></person-group> (<year>2017</year>). <article-title>Classification using ANN: a review</article-title>. <source>Int. J. Comput. Intell. Res.</source> <volume>13</volume>, <fpage>1811</fpage>&#x02013;<lpage>1820</lpage>.</citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bar&#x000F3;n</surname> <given-names>M.</given-names></name> <name><surname>Pineda</surname> <given-names>M.</given-names></name> <name><surname>P&#x000E9;rez-Bueno</surname> <given-names>M. L.</given-names></name></person-group> (<year>2016</year>). <article-title>Picturing pathogen infection in plants</article-title>. <source>Z. Naturforsch. C</source> <volume>71</volume>, <fpage>355</fpage>&#x02013;<lpage>368</lpage>. <pub-id pub-id-type="doi">10.1515/znc-2016-0134</pub-id><pub-id pub-id-type="pmid">27626766</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Basheer</surname> <given-names>I. A.</given-names></name> <name><surname>Hajmeer</surname> <given-names>M.</given-names></name></person-group> (<year>2000</year>). <article-title>Artificial neural networks: fundamentals, computing, design, and application</article-title>. <source>J. Microbiol. Methods</source> <volume>43</volume>, <fpage>3</fpage>&#x02013;<lpage>31</lpage>. <pub-id pub-id-type="doi">10.1016/S0167-7012(00)00201-3</pub-id><pub-id pub-id-type="pmid">11084225</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Behmann</surname> <given-names>J.</given-names></name> <name><surname>Mahlein</surname> <given-names>A.-K.</given-names></name> <name><surname>Rumpf</surname> <given-names>T.</given-names></name> <name><surname>R&#x000F6;mer</surname> <given-names>C.</given-names></name> <name><surname>Pl&#x000FC;mer</surname> <given-names>L.</given-names></name></person-group> (<year>2015</year>). <article-title>A review of advanced machine learning methods for the detection of biotic stress in precision crop protection</article-title>. <source>Precis. Agric</source>. <volume>16</volume>, <fpage>239</fpage>&#x02013;<lpage>260</lpage>. <pub-id pub-id-type="doi">10.1007/s11119-014-9372-7</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Berthold</surname> <given-names>M. R.</given-names></name> <name><surname>Cebron</surname> <given-names>N.</given-names></name> <name><surname>Dill</surname> <given-names>F.</given-names></name> <name><surname>Gabriel</surname> <given-names>T. R.</given-names></name> <name><surname>K&#x000F6;tter</surname> <given-names>T.</given-names></name> <name><surname>Meinl</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2008</year>). <source>KNIME: The Konstanz Information Miner</source>. <publisher-loc>Freiburg</publisher-loc>: <publisher-name>Springer Berlin</publisher-name> <volume>Heidelberg</volume>, <fpage>319</fpage>&#x02013;<lpage>326</lpage>.</citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blanzieri</surname> <given-names>E.</given-names></name> <name><surname>Melgani</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <article-title>Nearest neighbor classification of remote sensing images with the maximal margin principle</article-title>. <source>IEEE Trans. Geosci. Remote</source> <volume>46</volume>, <fpage>1804</fpage>&#x02013;<lpage>1811</lpage>. <pub-id pub-id-type="doi">10.1109/TGRS.2008.916090</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carter</surname> <given-names>G. A.</given-names></name> <name><surname>Knapp</surname> <given-names>A. K.</given-names></name></person-group> (<year>2001</year>). <article-title>Leaf optical properties in higher plants: linking spectral characteristics to stress and chlorophyll concentration</article-title>. <source>Am. J. Bot.</source> <volume>88</volume>, <fpage>677</fpage>&#x02013;<lpage>684</lpage>.<pub-id pub-id-type="pmid">11302854</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname> <given-names>Y. T.</given-names></name> <name><surname>Zhang</surname> <given-names>L.</given-names></name> <name><surname>He</surname> <given-names>S. Y.</given-names></name></person-group> (<year>2019</year>). <article-title>Plant-microbe interactions facing environmental challenge</article-title>. <source>Cell Host Microbe</source> <volume>26</volume>, <fpage>183</fpage>&#x02013;<lpage>192</lpage>. <pub-id pub-id-type="doi">10.1016/j.chom.2019.07.009</pub-id><pub-id pub-id-type="pmid">31415751</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chlingaryan</surname> <given-names>A.</given-names></name> <name><surname>Sukkarieh</surname> <given-names>S.</given-names></name> <name><surname>Whelan</surname> <given-names>B.</given-names></name></person-group> (<year>2018</year>). <article-title>Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: a review</article-title>. <source>Comput. Electron. Agric.</source> <volume>151</volume>, <fpage>61</fpage>&#x02013;<lpage>69</lpage>. <pub-id pub-id-type="doi">10.1016/j.compag.2018.05.012</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ekman</surname> <given-names>J.</given-names></name> <name><surname>Tesoriero</surname> <given-names>L.</given-names></name> <name><surname>Grigg</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <source>Pests, Diseases and Disorders of Brassica Vegetables: A Field Identification Guide.</source> <publisher-loc>North Sydney, NSW</publisher-loc>: <publisher-name>Horticulture Australia</publisher-name>.</citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>El-Hendawy</surname> <given-names>S. E.</given-names></name> <name><surname>Al-Suhaibani</surname> <given-names>N. A.</given-names></name> <name><surname>Elsayed</surname> <given-names>S.</given-names></name> <name><surname>Hassan</surname> <given-names>W. M.</given-names></name> <name><surname>Dewir</surname> <given-names>Y. H.</given-names></name> <name><surname>Refay</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Potential of the existing and novel spectral reflectance indices for estimating the leaf water status and grain yield of spring wheat exposed to different irrigation rates</article-title>. <source>Agric. Water Manag.</source> <volume>217</volume>, <fpage>356</fpage>&#x02013;<lpage>373</lpage>. <pub-id pub-id-type="doi">10.1016/j.agwat.2019.03.006</pub-id></citation>
</ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fargier</surname> <given-names>E.</given-names></name> <name><surname>Manceau</surname> <given-names>C.</given-names></name></person-group> (<year>2007</year>). <article-title>Pathogenicity assays restrict the species <italic>Xanthomonas campestris</italic> into three pathovars and reveal nine races within <italic>X. campestris pv. campestris</italic></article-title>. <source>Plant Pathol</source>. <volume>56</volume>, <fpage>805</fpage>&#x02013;<lpage>818</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-3059.2007.01648.x</pub-id></citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fuchs</surname> <given-names>M.</given-names></name> <name><surname>Tanner</surname> <given-names>C. B.</given-names></name></person-group> (<year>1966</year>). <article-title>Infrared thermometry of vegetation</article-title>. <source>Agron. J.</source> <volume>58</volume>, <fpage>597</fpage>&#x02013;<lpage>601</lpage>. <pub-id pub-id-type="doi">10.2134/agronj1966.00021962005800060014x</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gamon</surname> <given-names>J. A.</given-names></name> <name><surname>Pe&#x000F1;uelas</surname> <given-names>J.</given-names></name> <name><surname>Field</surname> <given-names>C. B.</given-names></name></person-group> (<year>1992</year>). <article-title>A narrow-waveband spectral index that tracks diurnal changes in photosynthetic efficiency</article-title>. <source>Remote Sens. Environ.</source> <volume>41</volume>, <fpage>35</fpage>&#x02013;<lpage>44</lpage>. <pub-id pub-id-type="doi">10.1016/0034-4257(92)90059-S</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gao</surname> <given-names>Z.</given-names></name> <name><surname>Luo</surname> <given-names>Z.</given-names></name> <name><surname>Zhang</surname> <given-names>W.</given-names></name> <name><surname>Lv</surname> <given-names>Z.</given-names></name> <name><surname>Xu</surname> <given-names>Y.</given-names></name></person-group> (<year>2020</year>). <article-title>Deep learning application in plant stress imaging: a review</article-title>. <source>AgriEngineering</source> <volume>2</volume>, <fpage>430</fpage>&#x02013;<lpage>446</lpage>. <pub-id pub-id-type="doi">10.3390/agriengineering2030029</pub-id><pub-id pub-id-type="pmid">32830044</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gerhards</surname> <given-names>M.</given-names></name> <name><surname>Schlerf</surname> <given-names>M.</given-names></name> <name><surname>Mallick</surname> <given-names>K.</given-names></name> <name><surname>Udelhoven</surname> <given-names>T.</given-names></name></person-group> (<year>2019</year>). <article-title>Challenges and future perspectives of multi-/hyperspectral thermal infrared remote sensing for crop water-stress detection: a review</article-title>. <source>Remote Sens.</source> <volume>11</volume>, <fpage>1240</fpage>. <pub-id pub-id-type="doi">10.3390/rs11101240</pub-id></citation>
</ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gitelson</surname> <given-names>A. A.</given-names></name> <name><surname>Merzlyak</surname> <given-names>M. N.</given-names></name> <name><surname>Chivkunova</surname> <given-names>O. B.</given-names></name></person-group> (<year>2001</year>). <article-title>Optical properties and nondestructive estimation of anthocyanin content in plant leaves</article-title>. <source>Photochem. Photobiol.</source> <volume>74</volume>, <fpage>38</fpage>&#x02013;<lpage>45</lpage>. <pub-id pub-id-type="doi">10.1562/0031-8655(2001)074&#x0003C;0038:opaneo&#x0003E;2.0.co;2</pub-id><pub-id pub-id-type="pmid">11460535</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gitelson</surname> <given-names>A. A.</given-names></name> <name><surname>Zur</surname> <given-names>Y.</given-names></name> <name><surname>Chivkunova</surname> <given-names>O. B.</given-names></name> <name><surname>Merzlyak</surname> <given-names>M. N.</given-names></name></person-group> (<year>2002</year>). <article-title>Assessing carotenoid content in plant leaves with reflectance spectroscopy</article-title>. <source>Photochem. Photobiol.</source> <volume>75</volume>, <fpage>272</fpage>&#x02013;<lpage>281</lpage>. <pub-id pub-id-type="doi">10.1562/0031-8655(2002)0750272ACCIPL2.0.CO2</pub-id><pub-id pub-id-type="pmid">11950093</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Golhani</surname> <given-names>K.</given-names></name> <name><surname>Balasundram</surname> <given-names>S. K.</given-names></name> <name><surname>Vadamalai</surname> <given-names>G.</given-names></name> <name><surname>Pradhan</surname> <given-names>B.</given-names></name></person-group> (<year>2018</year>). <article-title>A review of neural networks in plant disease detection using hyperspectral data</article-title>. <source>Inf. Process. Agric.</source> <volume>5</volume>, <fpage>354</fpage>&#x02013;<lpage>371</lpage>. <pub-id pub-id-type="doi">10.1016/j.inpa.2018.05.002</pub-id></citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gullino</surname> <given-names>M. L.</given-names></name> <name><surname>Pugliese</surname> <given-names>M.</given-names></name> <name><surname>Gilardi</surname> <given-names>G.</given-names></name> <name><surname>Garibaldi</surname> <given-names>A.</given-names></name></person-group> (<year>2018</year>). <article-title>Effect of increased CO<sub>2</sub> and temperature on plant diseases: a critical appraisal of results obtained in studies carried out under controlled environment facilities</article-title>. <source>J. Plant Pathol.</source> <volume>100</volume>, <fpage>371</fpage>&#x02013;<lpage>389</lpage>. <pub-id pub-id-type="doi">10.1007/s42161-018-0125-8</pub-id></citation>
</ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hahn</surname> <given-names>F.</given-names></name></person-group> (<year>2009</year>). <article-title>Actual pathogen detection: sensors and algorithms &#x02013; a review</article-title>. <source>Algorithms</source> <volume>2</volume>, <fpage>301</fpage>&#x02013;<lpage>338</lpage>. <pub-id pub-id-type="doi">10.3390/a2010301</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huete</surname> <given-names>A.</given-names></name> <name><surname>Didan</surname> <given-names>K.</given-names></name> <name><surname>Miura</surname> <given-names>T.</given-names></name> <name><surname>Rodriguez</surname> <given-names>E. P.</given-names></name> <name><surname>Gao</surname> <given-names>X.</given-names></name> <name><surname>Ferreira</surname> <given-names>L. G.</given-names></name></person-group> (<year>2002</year>). <article-title>Overview of the radiometric and biophysical performance of the MODIS vegetation indices</article-title>. <source>Remote Sens. Environ.</source> <volume>83</volume>, <fpage>195</fpage>&#x02013;<lpage>213</lpage>. <pub-id pub-id-type="doi">10.1016/S0034-4257(02)00096-2</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="web"><person-group person-group-type="author"><collab>IPCC</collab></person-group> (<year>2014</year>). <source>AR5. Climate Change 2014: Synthesis Report. Contribution of Working Groups I, II and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change</source>. <publisher-loc>Geneva</publisher-loc>: <publisher-name>IPCC</publisher-name>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.ipcc.ch/report/ar5/syr/">https://www.ipcc.ch/report/ar5/syr/</ext-link></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jia</surname> <given-names>M.</given-names></name> <name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Mao</surname> <given-names>D.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name></person-group> (<year>2019</year>). <article-title>A new vegetation index to detect periodically submerged mangrove forest using single-tide Sentinel-2 imagery</article-title>. <source>Remote Sens.</source> <volume>11</volume>, <fpage>2043</fpage>. <pub-id pub-id-type="doi">10.3390/rs11172043</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jung</surname> <given-names>J.</given-names></name> <name><surname>Maeda</surname> <given-names>M.</given-names></name> <name><surname>Chang</surname> <given-names>A.</given-names></name> <name><surname>Bhandari</surname> <given-names>M.</given-names></name> <name><surname>Ashapure</surname> <given-names>A.</given-names></name> <name><surname>Landivar-Bowles</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>The potential of remote sensing and artificial intelligence as tools to improve the resilience of agriculture production systems</article-title>. <source>Curr. Opin. Biotechnol.</source> <volume>70</volume>, <fpage>15</fpage>&#x02013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.1016/j.copbio.2020.09.003</pub-id><pub-id pub-id-type="pmid">33038780</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kalisa</surname> <given-names>W.</given-names></name> <name><surname>Igbawua</surname> <given-names>T.</given-names></name> <name><surname>Henchiri</surname> <given-names>M.</given-names></name> <name><surname>Ali</surname> <given-names>S.</given-names></name> <name><surname>Zhang</surname> <given-names>S.</given-names></name> <name><surname>Bai</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Assessment of climate impact on vegetation dynamics over East Africa from 1982 to 2015</article-title>. <source>Sci. Rep.</source> <volume>9</volume>, <fpage>16865</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-019-53150-0</pub-id><pub-id pub-id-type="pmid">31727960</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kashyap</surname> <given-names>B.</given-names></name> <name><surname>Kumar</surname> <given-names>R.</given-names></name></person-group> (<year>2021</year>). <article-title>Sensing methodologies in agriculture for monitoring biotic stress in plants due to pathogens and pests</article-title>. <source>Inventions</source> <volume>6</volume>, <fpage>29</fpage>. <pub-id pub-id-type="doi">10.3390/inventions6020029</pub-id></citation>
</ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liakos</surname> <given-names>K. G.</given-names></name> <name><surname>Busato</surname> <given-names>P.</given-names></name> <name><surname>Moshou</surname> <given-names>D.</given-names></name> <name><surname>Pearson</surname> <given-names>S.</given-names></name> <name><surname>Bochtis</surname> <given-names>D.</given-names></name></person-group> (<year>2018</year>). <article-title>Machine learning in agriculture: a review</article-title>. <source>Sensors</source> <volume>18</volume>, <fpage>2674</fpage>. <pub-id pub-id-type="doi">10.3390/s18082674</pub-id><pub-id pub-id-type="pmid">30110960</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lowe</surname> <given-names>A.</given-names></name> <name><surname>Harrison</surname> <given-names>N.</given-names></name> <name><surname>French</surname> <given-names>A. P.</given-names></name></person-group> (<year>2017</year>). <article-title>Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress</article-title>. <source>Plant Methods</source> <volume>13</volume>, <fpage>80</fpage>. <pub-id pub-id-type="doi">10.1186/s13007-017-0233-z</pub-id><pub-id pub-id-type="pmid">29051772</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maes</surname> <given-names>W. H.</given-names></name> <name><surname>Steppe</surname> <given-names>K.</given-names></name></person-group> (<year>2019</year>). <article-title>Perspectives for remote sensing with unmanned aerial vehicles in precision agriculture</article-title>. <source>Trends Plant Sci.</source> <volume>24</volume>, <fpage>152</fpage>&#x02013;<lpage>164</lpage>. <pub-id pub-id-type="doi">10.1016/j.tplants.2018.11.007</pub-id><pub-id pub-id-type="pmid">30558964</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mahlein</surname> <given-names>A.-K.</given-names></name></person-group> (<year>2016</year>). <article-title>Plant disease detection by imaging sensors &#x02013; parallels and specific demands for precision agriculture and plant phenotyping</article-title>. <source>Plant Dis.</source> <volume>100</volume>, <fpage>241</fpage>&#x02013;<lpage>251</lpage>. <pub-id pub-id-type="doi">10.1094/pdis-03-15-0340-fe</pub-id><pub-id pub-id-type="pmid">30694129</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mahlein</surname> <given-names>A. K.</given-names></name> <name><surname>Rumpf</surname> <given-names>T.</given-names></name> <name><surname>Welke</surname> <given-names>P.</given-names></name> <name><surname>Dehne</surname> <given-names>H. W.</given-names></name> <name><surname>Pl&#x000FC;mer</surname> <given-names>L.</given-names></name> <name><surname>Steiner</surname> <given-names>U.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Development of spectral indices for detecting and identifying plant diseases</article-title>. <source>Remote Sens. Environ.</source> <volume>128</volume>, <fpage>21</fpage>&#x02013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.1016/j.rse.2012.09.019</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mansfield</surname> <given-names>J.</given-names></name> <name><surname>Genin</surname> <given-names>S.</given-names></name> <name><surname>Magori</surname> <given-names>S.</given-names></name> <name><surname>Citovsky</surname> <given-names>V.</given-names></name> <name><surname>Sriariyanum</surname> <given-names>M.</given-names></name> <name><surname>Ronald</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Top 10 plant pathogenic bacteria in molecular plant pathology</article-title>. <source>Mol. Plant Pathol.</source> <volume>13</volume>, <fpage>614</fpage>&#x02013;<lpage>629</lpage>. <pub-id pub-id-type="doi">10.1111/j.1364-3703.2012.00804.x</pub-id><pub-id pub-id-type="pmid">22672649</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miao</surname> <given-names>X.</given-names></name> <name><surname>Gong</surname> <given-names>P.</given-names></name> <name><surname>Swope</surname> <given-names>S.</given-names></name> <name><surname>Pu</surname> <given-names>R.</given-names></name> <name><surname>Carruthers</surname> <given-names>R.</given-names></name></person-group> (<year>2007</year>). <article-title>Detection of yellow starthistle through band selection and feature extraction from hyperspectral imagery</article-title>. <source>Photogramm. Eng. Remote Sensing</source> <volume>73</volume>, <fpage>1005</fpage>&#x02013;<lpage>1015</lpage>.</citation>
</ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Milthorpe</surname> <given-names>F. L.</given-names></name> <name><surname>Spencer</surname> <given-names>E. J.</given-names></name></person-group> (<year>1957</year>). <article-title>Experimental studies of the factors controlling transpiration</article-title>. <source>J. Exp. Bot.</source> <volume>8</volume>, <fpage>413</fpage>&#x02013;<lpage>437</lpage>. <pub-id pub-id-type="doi">10.1093/jxb/8.3.413</pub-id></citation>
</ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nabwire</surname> <given-names>S.</given-names></name> <name><surname>Suh</surname> <given-names>H.-K.</given-names></name> <name><surname>Kim</surname> <given-names>M. S.</given-names></name> <name><surname>Baek</surname> <given-names>I.</given-names></name> <name><surname>Cho</surname> <given-names>B.-K.</given-names></name></person-group> (<year>2021</year>). <article-title>Review: application of artificial intelligence in phenomics</article-title>. <source>Sensors</source> <volume>21</volume>, <fpage>4363</fpage>. <pub-id pub-id-type="doi">10.3390/s21134363</pub-id><pub-id pub-id-type="pmid">34202291</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nguyen</surname> <given-names>C.</given-names></name> <name><surname>Sagan</surname> <given-names>V.</given-names></name> <name><surname>Maimaitiyiming</surname> <given-names>M.</given-names></name> <name><surname>Maimaitijiang</surname> <given-names>M.</given-names></name> <name><surname>Bhadra</surname> <given-names>S.</given-names></name> <name><surname>Kwasniewski</surname> <given-names>M. T.</given-names></name></person-group> (<year>2021</year>). <article-title>Early detection of plant viral disease using hyperspectral imaging and deep learning</article-title>. <source>Sensors</source> <volume>21</volume>, <fpage>742</fpage>. <pub-id pub-id-type="doi">10.3390/s21030742</pub-id><pub-id pub-id-type="pmid">33499335</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Owis</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Broccoli; The green beauty: a review</article-title>. <source>J. Pharm. Sci. Res.</source> 7, 696.</citation>
</ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pe&#x000F1;uelas</surname> <given-names>J.</given-names></name> <name><surname>Filella</surname> <given-names>I.</given-names></name> <name><surname>Biel</surname> <given-names>C.</given-names></name> <name><surname>Serrano</surname> <given-names>L.</given-names></name> <name><surname>Sav&#x000E9;</surname> <given-names>R.</given-names></name></person-group> (<year>1993</year>). <article-title>The reflectance at the 950&#x02013;970 nm region as an indicator of plant water status</article-title>. <source>Int. J. Remote Sens.</source> <volume>14</volume>, <fpage>1887</fpage>&#x02013;<lpage>1905</lpage>. <pub-id pub-id-type="doi">10.1080/01431169308954010</pub-id><pub-id pub-id-type="pmid">29568306</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>P&#x000E9;rez-Bueno</surname> <given-names>M. L.</given-names></name> <name><surname>Pineda</surname> <given-names>M.</given-names></name> <name><surname>Bar&#x000F3;n</surname> <given-names>M.</given-names></name></person-group> (<year>2019a</year>). <article-title>Phenotyping plant responses to biotic stress by chlorophyll fluorescence imaging</article-title>. <source>Front. Plant Sci.</source> <volume>10</volume>:<fpage>1135</fpage>. <pub-id pub-id-type="doi">10.3389/fpls.2019.01135</pub-id><pub-id pub-id-type="pmid">31620158</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>P&#x000E9;rez-Bueno</surname> <given-names>M. L.</given-names></name> <name><surname>Pineda</surname> <given-names>M.</given-names></name> <name><surname>Cabeza</surname> <given-names>F.</given-names></name> <name><surname>Bar&#x000F3;n Ayala</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Multicolor fluorescence imaging as a candidate for disease detection in plant phenotyping</article-title>. <source>Front. Plant Sci.</source> <volume>7</volume>:<fpage>1790</fpage>. <pub-id pub-id-type="doi">10.3389/fpls.2016.01790</pub-id><pub-id pub-id-type="pmid">27994607</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>P&#x000E9;rez-Bueno</surname> <given-names>M. L.</given-names></name> <name><surname>Pineda</surname> <given-names>M.</given-names></name> <name><surname>Vida</surname> <given-names>C.</given-names></name> <name><surname>Fern&#x000E1;ndez-Ortu&#x000F1;o</surname> <given-names>D.</given-names></name> <name><surname>Tor&#x000E9;s</surname> <given-names>J. A.</given-names></name> <name><surname>De Vicente</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2019b</year>). <article-title>Detection of white root rot in avocado trees by remote sensing</article-title>. <source>Plant Dis.</source> <volume>103</volume>, <fpage>1119</fpage>&#x02013;<lpage>1125</lpage>. <pub-id pub-id-type="doi">10.1094/PDIS-10-18-1778-RE</pub-id><pub-id pub-id-type="pmid">30995422</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pettorelli</surname> <given-names>N.</given-names></name></person-group> (<year>2013</year>). <source>The Normalized Difference Vegetation Index.</source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation>
</ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pineda</surname> <given-names>M.</given-names></name> <name><surname>Bar&#x000F3;n</surname> <given-names>M.</given-names></name> <name><surname>P&#x000E9;rez-Bueno</surname> <given-names>M.-L.</given-names></name></person-group> (<year>2021</year>). <article-title>Thermal imaging for plant stress detection and phenotyping</article-title>. <source>Remote Sens.</source> <volume>13</volume>, <fpage>68</fpage>. <pub-id pub-id-type="doi">10.3390/rs13010068</pub-id></citation>
</ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sankaran</surname> <given-names>S.</given-names></name> <name><surname>Maja</surname> <given-names>J. M.</given-names></name> <name><surname>Buchanon</surname> <given-names>S.</given-names></name> <name><surname>Ehsani</surname> <given-names>R.</given-names></name></person-group> (<year>2013</year>). <article-title>Huanglongbing (citrus greening) detection using visible, near infrared and thermal imaging techniques</article-title>. <source>Sensors</source> <volume>13</volume>, <fpage>2117</fpage>&#x02013;<lpage>2130</lpage>. <pub-id pub-id-type="doi">10.3390/s130202117</pub-id><pub-id pub-id-type="pmid">23389343</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Savary</surname> <given-names>S.</given-names></name> <name><surname>Ficke</surname> <given-names>A.</given-names></name> <name><surname>Aubertot</surname> <given-names>J.-N.</given-names></name> <name><surname>Hollier</surname> <given-names>C.</given-names></name></person-group> (<year>2012</year>). <article-title>Crop losses due to diseases and their implications for global food production losses and food security</article-title>. <source>Food Secur.</source> <volume>4</volume>, <fpage>519</fpage>&#x02013;<lpage>537</lpage>. <pub-id pub-id-type="doi">10.1007/s12571-012-0200-5</pub-id></citation>
</ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scarth</surname> <given-names>G. W.</given-names></name> <name><surname>Loewy</surname> <given-names>A.</given-names></name> <name><surname>Shaw</surname> <given-names>M.</given-names></name></person-group> (<year>1948</year>). <article-title>Use of the infrared total absorption method for estimating the time course of photosynthesis and transpiration</article-title>. <source>Can. J. Res.</source> <volume>26c</volume>, <fpage>94</fpage>&#x02013;<lpage>107</lpage>. <pub-id pub-id-type="doi">10.1139/cjr48c-010</pub-id><pub-id pub-id-type="pmid">18909158</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Shalev-Shwartz</surname> <given-names>S.</given-names></name> <name><surname>Ben-David</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <source>Understanding Machine Learning: From Theory to Algorithms</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation>
</ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sperschneider</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>Machine learning in plant&#x02013;pathogen interactions: empowering biological predictions from field scale to genome scale</article-title>. <source>New Phytol</source>. <volume>228</volume>, <fpage>35</fpage>&#x02013;<lpage>41</lpage>. <pub-id pub-id-type="doi">10.1111/nph.15771</pub-id><pub-id pub-id-type="pmid">30834534</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Talaviya</surname> <given-names>T.</given-names></name> <name><surname>Shah</surname> <given-names>D.</given-names></name> <name><surname>Patel</surname> <given-names>N.</given-names></name> <name><surname>Yagnik</surname> <given-names>H.</given-names></name> <name><surname>Shah</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>Implementation of artificial intelligence in agriculture for optimisation of irrigation and application of pesticides and herbicides</article-title>. <source>Artif. Intell. Agric.</source> <volume>4</volume>, <fpage>58</fpage>&#x02013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1016/j.aiia.2020.04.002</pub-id></citation>
</ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tian</surname> <given-names>H.</given-names></name> <name><surname>Wang</surname> <given-names>T.</given-names></name> <name><surname>Liu</surname> <given-names>Y.</given-names></name> <name><surname>Qiao</surname> <given-names>X.</given-names></name> <name><surname>Li</surname> <given-names>Y.</given-names></name></person-group> (<year>2020</year>). <article-title>Computer vision technology in agricultural automation&#x02014;a review</article-title>. <source>Inf. Process. Agric.</source> <volume>7</volume>, <fpage>1</fpage>&#x02013;<lpage>19</lpage>. <pub-id pub-id-type="doi">10.1016/j.inpa.2019.09.006</pub-id></citation>
</ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tortosa</surname> <given-names>M.</given-names></name> <name><surname>Cartea</surname> <given-names>M. E.</given-names></name> <name><surname>Rodr&#x000ED;guez</surname> <given-names>V. M.</given-names></name> <name><surname>Velasco</surname> <given-names>P.</given-names></name></person-group> (<year>2018</year>). <article-title>Unraveling the metabolic response of <italic>Brassica oleracea</italic> exposed to <italic>Xanthomonas campestris</italic> pv</article-title>. <source>campestris. J. Sci. Food Agric.</source> <volume>98</volume>, <fpage>3675</fpage>&#x02013;<lpage>3683</lpage>. <pub-id pub-id-type="doi">10.1002/jsfa.8876</pub-id><pub-id pub-id-type="pmid">29315593</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Trebicki</surname> <given-names>P.</given-names></name> <name><surname>D&#x000E1;der</surname> <given-names>B.</given-names></name> <name><surname>Vassiliadis</surname> <given-names>S.</given-names></name> <name><surname>Fereres</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <article-title>Insect&#x02013;plant&#x02013;pathogen interactions as shaped by future climate: effects on biology, distribution, and implications for agriculture</article-title>. <source>Insect Sci.</source> <volume>24</volume>, <fpage>975</fpage>&#x02013;<lpage>989</lpage>. <pub-id pub-id-type="doi">10.1111/1744-7917.12531</pub-id><pub-id pub-id-type="pmid">28843026</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Trivedi</surname> <given-names>P.</given-names></name> <name><surname>Batista</surname> <given-names>B. D.</given-names></name> <name><surname>Bazany</surname> <given-names>K. E.</given-names></name> <name><surname>Singh</surname> <given-names>B. K.</given-names></name></person-group> (<year>2022</year>). <article-title>Plant&#x02013;microbiome interactions under a changing world: responses, consequences and perspectives</article-title>. <source>New Phytol.</source> <volume>234</volume>, <fpage>1951</fpage>&#x02013;<lpage>1959</lpage>. <pub-id pub-id-type="doi">10.1111/nph.18016</pub-id><pub-id pub-id-type="pmid">35118660</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tucker</surname> <given-names>C. J.</given-names></name></person-group> (<year>1979</year>). <article-title>Red and photographic infrared linear combinations for monitoring vegetation</article-title>. <source>Remote Sens. Environ.</source> <volume>8</volume>, <fpage>127</fpage>&#x02013;<lpage>150</lpage>. <pub-id pub-id-type="doi">10.1016/0034-4257(79)90013-0</pub-id></citation>
</ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vel&#x000E1;squez</surname> <given-names>A. C.</given-names></name> <name><surname>Castroverde</surname> <given-names>C. D. M.</given-names></name> <name><surname>He</surname> <given-names>S. Y.</given-names></name></person-group> (<year>2018</year>). <article-title>Plant&#x02013;pathogen warfare under changing climate conditions</article-title>. <source>Curr. Biol.</source> <volume>28</volume>, <fpage>R619</fpage>&#x02013;<lpage>R634</lpage>. <pub-id pub-id-type="doi">10.1016/j.cub.2018.03.054</pub-id><pub-id pub-id-type="pmid">29787730</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yuan</surname> <given-names>L.</given-names></name> <name><surname>Yan</surname> <given-names>P.</given-names></name> <name><surname>Han</surname> <given-names>W.</given-names></name> <name><surname>Huang</surname> <given-names>Y.</given-names></name> <name><surname>Wang</surname> <given-names>B.</given-names></name> <name><surname>Zhang</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Detection of anthracnose in tea plants based on hyperspectral imaging</article-title>. <source>Comput. Electron. Agric.</source> <volume>167</volume>, <fpage>105039</fpage>. <pub-id pub-id-type="doi">10.1016/j.compag.2019.105039</pub-id></citation>
</ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zarco-Tejada</surname> <given-names>P. J.</given-names></name> <name><surname>Camino</surname> <given-names>C.</given-names></name> <name><surname>Beck</surname> <given-names>P. S. A.</given-names></name> <name><surname>Calderon</surname> <given-names>R.</given-names></name> <name><surname>Hornero</surname> <given-names>A.</given-names></name> <name><surname>Hern&#x000E1;ndez-Clemente</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Previsual symptoms of <italic>Xylella fastidiosa</italic> infection revealed in spectral plant-trait alterations</article-title>. <source>Nat. Plants</source> <volume>4</volume>, <fpage>432</fpage>&#x02013;<lpage>439</lpage>. <pub-id pub-id-type="doi">10.1038/s41477-018-0189-7</pub-id><pub-id pub-id-type="pmid">29942047</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhan</surname> <given-names>J.</given-names></name> <name><surname>Thrall</surname> <given-names>P. H.</given-names></name> <name><surname>Papa&#x000EF;x</surname> <given-names>J.</given-names></name> <name><surname>Xie</surname> <given-names>L.</given-names></name> <name><surname>Burdon</surname> <given-names>J. J.</given-names></name></person-group> (<year>2015</year>). <article-title>Playing on a pathogen&#x00027;s weakness: using evolution to guide sustainable plant disease control strategies</article-title>. <source>Annu. Rev. Phytopathol.</source> <volume>53</volume>, <fpage>19</fpage>&#x02013;<lpage>43</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-phyto-080614-120040</pub-id><pub-id pub-id-type="pmid">25938275</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>C.</given-names></name> <name><surname>Ren</surname> <given-names>H.</given-names></name> <name><surname>Qin</surname> <given-names>Q.</given-names></name> <name><surname>Ersoy</surname> <given-names>O. K.</given-names></name></person-group> (<year>2017</year>). <article-title>A new narrow band vegetation index for characterizing the degree of vegetation stress due to copper: the copper stress vegetation index (CSVI)</article-title>. <source>Remote Sens. Lett.</source> <volume>8</volume>, <fpage>576</fpage>&#x02013;<lpage>585</lpage>. <pub-id pub-id-type="doi">10.1080/2150704X.2017.1306135</pub-id></citation>
</ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>D.</given-names></name> <name><surname>Wang</surname> <given-names>Q.</given-names></name> <name><surname>Lin</surname> <given-names>F.</given-names></name> <name><surname>Yin</surname> <given-names>X.</given-names></name> <name><surname>Gu</surname> <given-names>C.</given-names></name> <name><surname>Qiao</surname> <given-names>H.</given-names></name></person-group> (<year>2020</year>). <article-title>Development and evaluation of a new spectral disease index to detect wheat fusarium head blight using hyperspectral imaging</article-title>. <source>Sensors</source> <volume>20</volume>, <fpage>2260</fpage>. <pub-id pub-id-type="doi">10.3390/s20082260</pub-id><pub-id pub-id-type="pmid">32316216</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>J.</given-names></name> <name><surname>Feng</surname> <given-names>X.</given-names></name> <name><surname>Wu</surname> <given-names>Q.</given-names></name> <name><surname>Yang</surname> <given-names>G.</given-names></name> <name><surname>Tao</surname> <given-names>M.</given-names></name> <name><surname>Yang</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Rice bacterial blight resistant cultivar selection based on visible/near-infrared spectrum and deep learning</article-title>. <source>Plant Methods</source> <volume>18</volume>, <fpage>49</fpage>. <pub-id pub-id-type="doi">10.1186/s13007-022-00882-2</pub-id><pub-id pub-id-type="pmid">35428329</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>W.</given-names></name> <name><surname>Yu</surname> <given-names>X.</given-names></name> <name><surname>Jiao</surname> <given-names>C.</given-names></name> <name><surname>Xu</surname> <given-names>C.</given-names></name> <name><surname>Liu</surname> <given-names>Y.</given-names></name> <name><surname>Wu</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). <article-title>Increased association between climate change and vegetation index variation promotes the coupling of dominant factors and vegetation growth</article-title>. <source>Sci. Total Environ.</source> <volume>767</volume>, <fpage>144669</fpage>. <pub-id pub-id-type="doi">10.1016/j.scitotenv.2020.144669</pub-id><pub-id pub-id-type="pmid">33429281</pub-id></citation></ref>
</ref-list> 
</back>
</article> 