<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Remote Sens.</journal-id>
<journal-title>Frontiers in Remote Sensing</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Remote Sens.</abbrev-journal-title>
<issn pub-type="epub">2673-6187</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">1086085</article-id>
<article-id pub-id-type="doi">10.3389/frsen.2023.1086085</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Remote Sensing</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Remote mapping of leafy spurge (<italic>Euphorbia esula,</italic> L.) in Northwestern Colorado</article-title>
<alt-title alt-title-type="left-running-head">Mattilio et al.</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/frsen.2023.1086085">10.3389/frsen.2023.1086085</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Mattilio</surname>
<given-names>Chloe M.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1210723/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Tekiela</surname>
<given-names>Daniel R.</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Norton</surname>
<given-names>Urszula</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1326201/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>Department of Plant Sciences</institution>, <institution>University of Wyoming</institution>, <addr-line>Laramie</addr-line>, <addr-line>WY</addr-line>, <country>United States</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>United States Department of Agriculture</institution>, <institution>Invasive Plant and Pesticide Use Program</institution>, <institution>United States Forest Service</institution>, <addr-line>Lakewood</addr-line>, <addr-line>CO</addr-line>, <country>United States</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1372443/overview">Jane Southworth</ext-link>, University of Florida, United States</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1025909/overview">Yu-Hsuan Tu</ext-link>, King Abdullah University of Science and Technology, Saudi Arabia</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1128436/overview">Alireza Sharifi</ext-link>, Shahid Rajaee Teacher Training University, Iran</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Chloe M. Mattilio, <email>cmattili@uwyo.edu</email>
<email>chloe.mattilio@gmail.com</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Satellite Missions, a section of the journal Frontiers in Remote Sensing</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>18</day>
<month>01</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>4</volume>
<elocation-id>1086085</elocation-id>
<history>
<date date-type="received">
<day>01</day>
<month>11</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>04</day>
<month>01</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2023 Mattilio, Tekiela and Norton.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Mattilio, Tekiela and Norton</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Leafy spurge (<italic>Euphorbia esula L.</italic>) has been introduced to the Yampa River in Northwestern Colorado for over 40&#xa0;years and flood and runoff events transport leafy spurge propagules onto adjacent landscapes. The spread of leafy spurge beyond the river channels has yet to be mapped and recorded, and this research was conducted to map leafy spurge occurrence in the Yampa River Valley. Significant stakeholder mapping efforts took place in the summer of 2019&#x2013;2021, leading to excellent spatial data on leafy spurge presence and absence along the main channel. In summer 2019, multispectral SPOT seven satellite imagery, stakeholder ground mapping efforts, and bright yellow-green leafy spurge bracts were used to interpret imagery, identify dense, unobscured patches of leafy spurge, and digitize them. Spectral signatures from training samples for leafy spurge and other land cover classes (generalized as &#x201c;not leafy spurge&#x201d;) were then used to train a Random Forest machine learning classification. In the summer of 2021, generated classification maps were compared to multispectral satellite imagery and stakeholder ground mapped leafy spurge presence. Mismatches were identified, and 271 validation locations were identified, navigated to, and evaluated for leafy spurge presence. Leafy spurge training samples were classified with 96% accuracy. Correctly classified leafy spurge locations had higher leafy spurge coverage and lower overstory canopy than missed leafy spurge locations. Leafy spurge growing beneath shrub canopy or growing as individual plants along the riverbanks were more likely to be missed. A frequency analysis for other plant species found at validation locations determined that smooth brome (<italic>Bromus inermis</italic> Leyss.), dandelion (<italic>Taraxacum officinale</italic> L.), and willow (<italic>Salix</italic> sp.) were most frequently misclassified as leafy spurge. In conclusion, multispectral satellite imagery was useful at remote detection of leafy spurge in open areas with dense leafy spurge coverage, but more work must be done for identification of sparse and diffuse leafy spurge infestations.</p>
</abstract>
<kwd-group>
<kwd>invasive plant mapping</kwd>
<kwd>leafy spurge (<italic>Euphorbia</italic> esula L.)</kwd>
<kwd>satellite remote sensing</kwd>
<kwd>validation mapping</kwd>
<kwd>rangeland management</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>Leafy spurge (<italic>Euphorbia esula</italic> L<italic>.</italic>) is a perennial invasive weedy species that has successfully established across a wide range of ecosystems and has a noxious weed designation in 22 US states (<xref ref-type="bibr" rid="B5">Goodwin et al., 2001</xref>). Leafy spurge is difficult to eradicate, despite heavy use of herbicides, targeted grazing, and various biocontrol agents (<xref ref-type="bibr" rid="B5">Goodwin et al., 2001</xref>). Leafy spurge is adapted to a wide range of growing conditions, including disturbed areas, rangelands, pastures, and river bottoms (<xref ref-type="bibr" rid="B8">Hyder et al., 2008</xref>).</p>
<p>With blue-green stems, linear leaves, small green flowers, and bright yellow bracts, mature leafy spurge is easily identifiable. Individual stems can produce over 200 seeds annually, which when mature, can be expelled up to 15 feet from the plant (<xref ref-type="bibr" rid="B9">St. John and Tilley, 2014</xref>). Seeds are small and buoyant, easily transported by water to areas downstream. Tissues contain a milky white sap that contains ingenol, which is released when plants are injured (<xref ref-type="bibr" rid="B11">Larry Leistritz, 2004</xref>). Once ingested, leafy spurge can be toxic to livestock, horses and wildlife, and result in significant economic losses to producers and other land users (<xref ref-type="bibr" rid="B5">Goodwin et al., 2001</xref>).</p>
<p>Remote sensing for leafy spurge mapping has been conducted since 1995, when leafy spurge was mapped with real color aerial imagery at Theodore Roosevelt National Park and found to be associated with high proximity to waterways (<italic>r</italic>
<sup>
<italic>2</italic>
</sup> &#x3d; .98) (<xref ref-type="bibr" rid="B1">Anderson et al., 1996</xref>). Multispectral sensors, which record reflectance beyond the visible spectrum in 3&#x2013;10 spectral bands, have been used in a mixed-grass prairie in North Dakota (<xref ref-type="bibr" rid="B2">Casady et al., 2006</xref>) Leafy spurge was mapped with 67% accuracy, with decreasing classification accuracy when grown with herbaceous vegetation (<xref ref-type="bibr" rid="B2">Casady et al., 2006</xref>).</p>
<p>Successful remote detection of leafy spurge depends on capturing spectral differences between leafy spurge and other land cover, and imagery with limited spectral bands can make identifying leafy spurge challenging (<xref ref-type="bibr" rid="B7">Hunt andParker Williams, 2006</xref>). In a heterogeneous landscape near Devil&#x2019;s Tower National Monument Crook County, Wyoming, hyperspectral (remote sensing imagery consisting of hundreds to thousands of spectral wavelengths) classifications performed best in prairie vegetation, and better in bottomlands than uplands, which was caused by dense leafy spurge cover in riparian areas and longer periods of blooming in moist habitats (<xref ref-type="bibr" rid="B18">Williams and Raymond, 2002</xref>). In a study by <xref ref-type="bibr" rid="B15">Parker and Hunt. (2004)</xref>, leafy spurge was well correlated with higher near infrared (NIR) reflectance, which is also known to be well correlated with dense vegetation cover. Leafy spurge was detected with 95% accuracy, and classification performed well in mixed-prairie and riparian vegetation than in forested areas (<xref ref-type="bibr" rid="B18">Williams and Raymond, 2002</xref>). In the sagebrush (<italic>Artemisia tridentata subsp. tridentata</italic>) steppe of Swan Valley, Idaho with 84%&#x2013;94% accuracy (<xref ref-type="bibr" rid="B4">Glenn et al., 2005</xref>) and with 96%&#x2013;99.5% accuracy at the mixed-grass prairie at Theodore Roosevelt National Park (<xref ref-type="bibr" rid="B14">O&#x2019;Neill et al., 2000</xref>).</p>
<p>Leafy spurge has been spreading along the Yampa River main channel and constructed irrigation ditches for over 40&#xa0;years (Yampa River Leafy Spurge Association, 2018; <xref ref-type="bibr" rid="B20">Turnage, 2021</xref>). The Yampa River flows for 250 river miles in Moffat and Routt Counties, Colorado, United States. Increased presence of leafy spurge in this area can be indicative of disturbance and large flooding events (<xref ref-type="bibr" rid="B18">Yampa River Leafy Spurge Project, 2018</xref>; <xref ref-type="bibr" rid="B5">Goodwin et al., 2001</xref>). The Yampa is one of the last free-flowing rivers in the Western United States, with seasonal flooding temporarily inundating sandbars and terraces away from the active river channel (<xref ref-type="bibr" rid="B12">Merritt and Cooper, 2000</xref>). Understanding the current extent of leafy spurge invasion with high spatial resolution is critical as its presence has already been observed beyond the riverbanks and floodplains, such as upland meadows, hillslopes and mountain ridges. High spatial resolution is a priority, as small satellite clusters of leafy spurge away from the main invasion are more likely to be effectively managed and to spread to new areas (<xref ref-type="bibr" rid="B17">Westbrooks, 2004</xref>). This project aimed to: 1) produce detailed maps of the current leafy spurge infestation along the Yampa River corridor with SPOT seven satellite remote sensing and 2), visit locations and validate leafy spurge presence or absence to describe classification performance.</p>
</sec>
<sec sec-type="materials|methods" id="s2">
<title>2 Materials and methods</title>
<sec id="s2-1">
<title>2.1 Study area</title>
<p>The Yampa River flows from the Flattops Wilderness to a confluence with the Green River deep inside of Dinosaur National Monument. The stretch of the Yampa River under investigation flows through the Moffat and the Routt Counties, between Hayden, Colorado, and Dinosaur National Monument (<xref ref-type="fig" rid="F1">Figure 1</xref>). There, leafy spurge has already invaded riparian areas such as riverbanks and islands and is now advancing to uplands covered by juniper forests, sagebrush shrublands, grasslands, and agricultural fields. <xref ref-type="fig" rid="F2">Figure 2</xref>.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Map of the Yampa River study area, with location in Colorado (upper panel) and closer view of study area (lower panel) with satellite imagery extent buffered to 1.5 miles from river&#x2019;s edge (pink).</p>
</caption>
<graphic xlink:href="frsen-04-1086085-g001.tif"/>
</fig>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>a and b. Random Forest classification predictions for imagery study area (magenta outline) for a binary classifier <bold>(A)</bold> and a probabilistic classifier <bold>(B)</bold>. The binary map shows pixels not classified as leafy spurge as colorless (negatives) and pixels classified as leafy spurge in yellow (positives). The probabilistic model represents values from 0 to 1, for least likely to be leafy spurge in dark green and most likely to be leafy spurge in red.</p>
</caption>
<graphic xlink:href="frsen-04-1086085-g002.tif"/>
</fig>
</sec>
<sec id="s2-2">
<title>2.2 Data collection</title>
<sec id="s2-2-1">
<title>2.2.1 Ground mapping of leafy spurge</title>
<p>Ground mapping of leafy spurge took place during over three summers between 2019 and 2021, as water levels allowed each year. Mapping was conducted by stakeholder volunteers from the Yampa River Leafy Spurge Project (YRLSP) <italic>via</italic> water to map the extent of infestation along the Yampa&#x2019;s main channel and beyond riverbanks. Coverage was extensive, with one or more observers scanning the riverbanks of the main channel for leafy spurge rafts to map the perimeter of the invasion to full extent or property lines where owners rejected mapping requests. During each stop, the location and presence of leafy spurge (density, abundance, and patch size), land characteristics, vegetation type and overstory canopy cover were recorded on location service enabled tablets equipped with Map It Fast (Agterra, 2017) (<xref ref-type="table" rid="T1">Table 1</xref>.a). All information was imported into a Geographic Information System (GIS) (ArcMap 10.5 (<xref ref-type="bibr" rid="B21">ESRI, 2018</xref>) and used for identification of leafy spurge presence visible in the imagery. These mapped polygons were not used directly as classification training samples, as the imagery represented one sample in time, leafy spurge growing beneath shrubs and trees, and leafy spurge infestations that were too small to be represented by tablet spatial accuracy and imagery spatial resolution.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>a and b (top to bottom). Categorical infestation characteristics recorded and levels of each infestation characteristic from a. Ground mapped leafy spurge polygons and b. Validation leafy spurge locations.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center">Infestation Characteristic</th>
<th align="center">Level 1</th>
<th align="center">Level 2</th>
<th align="center">Level 3</th>
<th align="center">Level 4</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">Leafy Spurge Abundance</td>
<td align="center">Single</td>
<td align="center">Scattered</td>
<td align="center">Scattered Dense</td>
<td align="center">Dense Monoculture</td>
</tr>
<tr>
<td align="center">Bare Ground Coverage</td>
<td align="center">Trace</td>
<td align="center">Low</td>
<td align="center">Moderate</td>
<td align="center">High</td>
</tr>
<tr>
<td align="center">Overstory Canopy Coverage</td>
<td align="center">Trace</td>
<td align="center">Low</td>
<td align="center">Moderate</td>
<td align="center">High</td>
</tr>
<tr>
<td align="center">Geomorphologic Type</td>
<td align="center">Active Channel</td>
<td align="center">Bank</td>
<td align="center">Seasonally Inundated</td>
<td align="center">Upland</td>
</tr>
<tr>
<td align="center">Vegetation Type</td>
<td align="center">Riparian Herbaceous</td>
<td align="center">Riparian Shrub</td>
<td align="center">Riparian Forest</td>
<td align="center">Sparsely Vegetated</td>
</tr>
</tbody>
</table>
<table>
<thead valign="top">
<tr>
<th align="center">Infestation Characteristic</th>
<th align="center">Level 1</th>
<th align="center">Level 2</th>
<th align="center">Level 3</th>
<th align="center">Level 4</th>
<th align="center">Level 5</th>
<th align="center">Level 6</th>
<th align="center">Level 7</th>
<th align="center">Level 8</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">Discrete Patch</td>
<td align="center">No</td>
<td align="center">Yes</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="center">Inundation Type</td>
<td align="center">Never</td>
<td align="center">100&#xa0;years</td>
<td align="center">20&#xa0;years</td>
<td align="center">Annual</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="center">Geomorphologic Type</td>
<td align="center">Active Channel</td>
<td align="center">Bank</td>
<td align="center">Seasonal Creek</td>
<td align="center">Seasonal Floodplain</td>
<td align="center">Agricultural</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="center">Vegetation Type</td>
<td align="center">Riparian Herbaceous</td>
<td align="center">Riparian Shrub</td>
<td align="center">Riparian Forest</td>
<td align="center">Herbaceous</td>
<td align="center">Irrigated Pasture</td>
<td align="center">Upland</td>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="center">Count of Other Plant Species</td>
<td align="center">0</td>
<td align="center">1</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">4</td>
<td align="center">5</td>
<td align="center">6</td>
<td align="center">7</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2-2-2">
<title>2.2.2 Satellite imagery acquisition</title>
<p>YRLSP funds were acquired and budgeted to purchase one set of SPOT seven satellite imagery from early July of 2019 from L3Harris Geospatial (L3Harris Geospatial, 2019). The beginning of summer in 2019 was cool and wet, so this sampling represents the late peak bloom of 2019. The spatial extent of this satellite imagery and resulting classification covers the area from Hayden, Colorado to Cross Mountain within 1.5 miles of the Yampa River channel (<xref ref-type="fig" rid="F1">Figure 1</xref>). The imagery consists of five spectral bands, one panchromatic (1.5&#xa0;m &#xd7; 1.5&#xa0;m pixels, 450&#x2013;745&#xa0;nm) and four multispectral: red (625&#x2013;695&#xa0;nm), green (530&#x2013;590&#xa0;nm), blue (450&#x2013;520&#xa0;nm), and near infrared (NIR, 760&#x2013;890&#xa0;nm) (6&#xa0;m &#xd7; 6&#xa0;m pixels). Multispectral imagery was resampled to approximately 4&#xa0;m &#xd7; 4&#xa0;m pixels using the finer resolution panchromatic band in ArcMap to increase the spatial resolution and identify the smallest clusters of leafy spurge plants possible with this imagery set. Despite this resampling of pixels of the spectral imagery, pan-sharpened imagery showed spectral patterns that delineated land cover classes that were difficult to distinguish, like riparian hay meadows, sparse rangeland vegetation, and wetlands. Once pan-sharpened, band combinations and representation were experimented with to highlight contrasts between ground mapped leafy spurge polygons and other recognizable land cover classes.</p>
</sec>
</sec>
<sec id="s2-3">
<title>2.3 Data analysis</title>
<sec id="s2-3-1">
<title>2.3.1 Training and classification</title>
<p>One hundred and eight training polygons of unobscured leafy spurge were digitized based on interpretation of the YRLSP ground mapped leafy spurge presence in the imagery in ArcMap. Volunteer ground mapping work was essential for development of these training samples, as they covered the main channel comprehensively with locations and detailed descriptions of leafy spurge presence. In addition, 96 polygons were developed for other land cover classes within the study area (water, forage fields, other vegetation, roads, structures, bare ground, etc.) and combined to create a &#x201c;not leafy spurge&#x201d; dataset. These training polygons represent the leafy spurge invasion as of imagery collection in July of 2019, and were imported into Program R, where SPOT seven imagery spectral reflectance values (red, green, blue, and NIR) were extracted to train the classification algorithm for leafy spurge and not leafy spurge. The method used a machine learning technique known as Random Forest (Breiman and Cutler, 2001), from the random Forest package in Program R (<xref ref-type="bibr" rid="B22">Liaw and Wiener, 2002</xref>). For this classification, 101 trees were grown, and 20% of the training samples were reserved for an internal validation. Two classification maps were developed with both, binary classification of &#x201c;leafy spurge&#x201d; and &#x201c;not leafy spurge&#x201d; classes using a probabilistic scale from 0 (most likely to be not leafy spurge) to 1 (most likely to be leafy spurge).</p>
<p>An accuracy assessment of the binary leafy spurge classification was conducted using a confusion matrix of classified and digitized training data, and users&#x2019; accuracy, producer&#x2019;s accuracy, and overall accuracy. The kappa coefficient for the classification accuracy was calculated. To investigate differences in reflectance for red, green, blue, and NIR bands, correctly and incorrectly classified ground mapped leafy spurge presence polygons were selected from the classification map, and reflectance values were extracted for all four spectral bands for each class. To test differences in reflectance for detected and missed leafy spurge polygons for each spectral band, a two-way analysis of variance (ANOVA) was conducted in Program R.</p>
</sec>
<sec id="s2-3-2">
<title>2.3.2 Validation</title>
<p>To better understand classification performance, ground validation was conducted by identifying 271 points of interest, especially suspected classification mismatches within the study area. These areas were identified and discussed in 2020 during multiple remote open table discussions with Yampa River stakeholders in who know the area well and conducted ground mapping efforts for the YRLSP. These locations were selected to cover a broad range of habitat types and areas with known leafy spurge infestations. Within these locations, four or more pixels of the same class were generalized to make polygons of the same class. To avoid GPS inaccuracies, validation points were placed within these polygon centroids. In June of 2021, these validation points were visited by floating the river and on foot with a handheld preprogrammed GPS unit. Selected locations were scattered at the Yampa River State Wildlife Area, through Craig, Colorado, in the Little Yampa Canyon, and through Axial Basin. In addition to confirming leafy spurge presence and absence, binary classification performance (correct or incorrect), geomorphologic type, vegetation type, count and identification of other species present, inundation frequency, leafy spurge cover, canopy cover, and bare ground were recorded (<xref ref-type="table" rid="T1">Table 1</xref> b).</p>
<p>Binary and continuous classification maps were exported back to ArcMap where classification values were extracted from both, classification methods for leafy spurge presence polygons from Yampa River Leafy Spurge Project ground mapping and from 2021 validation points. Proportion of correctly identified leafy spurge polygons from the binary classification were calculated for each level of infestation characteristic (i.e. trace, low, moderate, and high for the overstory canopy cover infestation characteristic). Characteristics recorded were geomorphological features, vegetation type, leafy spurge cover and density; overstory canopy cover and the presence of bare ground (<xref ref-type="table" rid="T1">Table 1</xref>.a). Binary classification (leafy spurge vs. not leafy spurge) was fit to a logistic regression to determine the effect of infestation on classification accuracy from ground mapped data. The same approach was applied to the 2021 validation points, with proportional correct classification recorded for each level of infestation characteristic and binary classification. Results were fitted to a logistic regression model to determine which infestation characteristics (geomorphologic type, vegetation type, count of other species present, inundation frequency, proportional leafy spurge cover, proportional canopy cover, and proportional bare ground) affect classification accuracy within the validation dataset (<xref ref-type="table" rid="T1">Table 1</xref> b).</p>
</sec>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3 Results</title>
<sec id="s3-1">
<title>3.1 Imagery classification</title>
<p>Leafy spurge training samples were identified in the Random Forest classification of multispectral satellite imagery with an overall accuracy rate of 90.7%. The same classification resulted in a 95.4% class producer&#x2019;s accuracy and 88% class user&#x2019;s accuracy for leafy spurge (positive) (<xref ref-type="table" rid="T2">Table 2</xref>). The final accuracy metric calculated for the remote sensing classification was a coefficient of agreement, kappa (ranges from &#x2212;1&#x2013;1, with values close to 0 showing that the classification performed no better than random and one describing the data perfectly). Kappa was equal to 0.902, indicating that our remote sensing classification described our leafy spurge population samples well. Correctly classified leafy spurge spectral reflectance was not significantly different from missed leafy spurge reflectance for the red, green, and blue spectral bands, but was significantly higher for the NIR spectral band (<italic>p</italic>-value &#x3d; 0.031) (<xref ref-type="table" rid="T3">Table 3</xref>).</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Confusion matrix for Random Forest classification of imagery pixels as leafy spurge (positive) and not leafy spurge (negative) with training and validation samples correctly classified contributing to class and overall classification accuracy and misclassified other ground cover (false positives) and missed leafy spurge training samples (false negatives) and reducing class and overall classification accuracy.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center"/>
<th align="left"/>
<th colspan="2" align="center">Training class</th>
</tr>
<tr>
<th align="left"/>
<th align="left"/>
<th align="center">Positive</th>
<th align="center">Negative</th>
<th align="center">Producer&#x2019;s accuracy (%)</th>
<th align="center">Kappa</th>
<th align="center">Overall accuracy (%)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="2" align="center">
<bold>Classification Class</bold>
</td>
<td align="center">
<bold>Positive</bold>
</td>
<td align="center">103<break/>True positive</td>
<td align="center">5<break/>False positive</td>
<td align="center">95.4</td>
<td rowspan="2" align="center">.902</td>
<td rowspan="2" align="center">90.7</td>
</tr>
<tr>
<td align="center">
<bold>Negative</bold>
</td>
<td align="center">14<break/>False negative</td>
<td align="center">83<break/>True negative</td>
<td align="center">86.5</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="center">88.0%</td>
<td align="center">94.3%</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td colspan="2" align="center">
<bold>User&#x2019;s Accuracy</bold>
</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>Results table from t-test for differences between reflectance in each spectral band (red, green, blue, and NIR) for true positives (Leafy Spurge) and false negative (Missed Leafy Spurge) leafy spurge polygons. Values shown are mean reflectance (Mean) and <italic>p</italic>-values (<italic>p</italic>-value) testing the differences between the class means for each spectral band. <italic>p</italic>-values marked with &#x2a; are significantly different.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center"/>
<th colspan="8" align="center">Spectral band of multispectral imagery</th>
</tr>
<tr>
<th align="left"/>
<th colspan="2" align="center">Red</th>
<th colspan="2" align="center">Green</th>
<th colspan="2" align="center">Blue</th>
<th colspan="2" align="center">Near infrared</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">
<bold>Assigned Class</bold>
</td>
<td align="center">Mean</td>
<td align="center">
<italic>p</italic>-value</td>
<td align="center">Mean</td>
<td align="center">
<italic>p</italic>-value</td>
<td align="center">Mean</td>
<td align="center">
<italic>p</italic>-value</td>
<td align="center">Mean</td>
<td align="center">
<italic>p</italic>-value</td>
</tr>
<tr>
<td align="center">
<bold>Leafy Spurge</bold>
</td>
<td align="center">308</td>
<td rowspan="2" align="center">0.8</td>
<td align="center">434</td>
<td rowspan="2" align="center">0.1</td>
<td align="center">368</td>
<td rowspan="2" align="center">0.6</td>
<td align="center">1359</td>
<td rowspan="2" align="center">.03&#x2a;</td>
</tr>
<tr>
<td align="center">
<bold>Missed Leafy Spurge</bold>
</td>
<td align="center">309</td>
<td align="center">433</td>
<td align="center">367</td>
<td align="center">1323</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Across a range of environmental and infestation conditions, the number of correctly mapped presence locations varied in the ground mapped dataset. Predictors that decreased correct classification likelihood of ground mapped leafy spurge polygons were single leafy spurge plant infestations (<italic>p</italic>-value &#x3d; 0.011), leafy spurge located on riverbanks (<italic>p</italic>-value &#x3d; 0.036), leafy spurge growing with shrubs (<italic>p</italic>-value &#x3d; 0.021) and leafy spurge growing with trace amounts of bare ground (<xref ref-type="table" rid="T4">Table 4</xref>).</p>
<table-wrap id="T4" position="float">
<label>TABLE 4</label>
<caption>
<p>Logistic regression output for statistically significant predictors of leafy spurge classification of ground mapped leafy spurge polygons with odds ratio (values &#x3c; 1, decrease odds of correctly classifying leafy spurge, values &#x3e; 1, increase odds of correctly classifying leafy spurge), impact on leafy spurge prediction rates, and <italic>p</italic>-values of logistic regression.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center"/>
<th align="center">Odds ratio</th>
<th align="center">Leafy spurge classification likelihood</th>
<th align="center">
<italic>p</italic>-value</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">
<bold>Geomorphology - Bank</bold>
</td>
<td align="center">.180</td>
<td align="center">&#x2212;</td>
<td align="center">.036</td>
</tr>
<tr>
<td align="center">
<bold>Bare Ground - Low</bold>
</td>
<td align="center">23.515</td>
<td align="center">&#x2b;</td>
<td align="center">.010</td>
</tr>
<tr>
<td align="center">
<bold>Bare Ground -Moderate</bold>
</td>
<td align="center">38.318</td>
<td align="center">&#x2b;</td>
<td align="center">.003</td>
</tr>
<tr>
<td align="center">
<bold>Bare Ground - High</bold>
</td>
<td align="center">89.334</td>
<td align="center">&#x2b;</td>
<td align="center">.000</td>
</tr>
<tr>
<td align="center">
<bold>Vegetation &#x2013; Shrub</bold>
</td>
<td align="center">.106</td>
<td align="center">&#x2212;</td>
<td align="center">.021</td>
</tr>
<tr>
<td align="center">
<bold>Leafy Spurge &#x2013; Single Plant</bold>
</td>
<td align="center">.136</td>
<td align="center">&#x2212;</td>
<td align="center">.011</td>
</tr>
<tr>
<td align="center">
<bold>Polygon Area</bold>
</td>
<td align="center">1.000</td>
<td align="center">&#x2b;</td>
<td align="center">.018</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s3-2">
<title>3.2 Classification validation</title>
<p>Much like the ground mapped leafy spurge dataset, the 271 ground validation points selected and visited represented a wide range of environmental and infestation conditions. Of these validation points that were classified as leafy spurge, 102 out of 190 were correctly classified (54% classification accuracy for leafy spurge). 190 out of 271 points were classified as leafy spurge (70%), 81 were classified as not leafy spurge (30%), and 159 out of the 271 total validation points were correctly classified (59% overall classification accuracy rate in the field). Successful classification of validation locations varied and predictors that increased likelihood of validation areas being correctly classified as leafy spurge are infestations that have higher leafy spurge percent cover (<italic>p</italic>-value &#x3d; 5.8e-08) and infestations that have distinct boundaries, or discrete patches (<italic>p</italic>-value &#x3d; 0.0480) (<xref ref-type="table" rid="T5">Table 5</xref>). Plant species that were misclassified as leafy spurge and growing alongside missed leafy spurge were smooth brome (<italic>Bromus inermis</italic> Leyss.), willows (<italic>Salix sp.</italic>), and dandelions (<italic>Taraxacum officinale</italic> L.) (<xref ref-type="fig" rid="F3">Figure 3</xref>), while Sandberg bluegrass (<italic>Poa secunda</italic> J. Presl), western wheatgrass (<italic>Pascopyrum smithii</italic> Rydb.), poverty weed (<italic>Iva axillaris</italic> Pursh), dandelions, curlycup gumweed (<italic>Grindelia squarrosa</italic> Pursh.), tamarisk (<italic>Tamarix ramosissima</italic> L.), and whitetop (<italic>Lepidium draba</italic> L.) were misclassified as leafy spurge (<xref ref-type="fig" rid="F4">Figure 4</xref>).</p>
<table-wrap id="T5" position="float">
<label>TABLE 5</label>
<caption>
<p>Logistic regression output for statistically significant predictors of leafy spurge classification of validation locations of leafy spurge with odds ratio (values &#x3c; 1, decrease odds of correctly classifying leafy spurge, values &#x3e; 1, increase odds of correctly classifying leafy spurge), impact on leafy spurge prediction rates, and <italic>p</italic>-values of logistic regression.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center"/>
<th align="center">Odds ratio</th>
<th align="center">Odds of spurge</th>
<th align="center">
<italic>p</italic>-value</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">
<bold>Discrete Patch</bold>
</td>
<td align="center">8.129</td>
<td align="center">&#x2b;</td>
<td align="center">.0480</td>
</tr>
<tr>
<td align="center">
<bold>Leafy Spurge Percent Cover</bold>
</td>
<td align="center">1.556</td>
<td align="center">&#x2b;</td>
<td align="center">5.8e-08</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Results of frequency analysis of the three most mistaken species, smooth brome, willow, and dandelions, with their proportional presence in the full validation dataset (white), false positives (black, mistakenly classified as leafy spurge), and false negatives (grey, present with missed leafy spurge infestations).</p>
</caption>
<graphic xlink:href="frsen-04-1086085-g003.tif"/>
</fig>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Results of frequency analysis of false positive plant species with their proportional presence in the full validation dataset (white) and false positives (black, mistakenly classified as leafy spurge).</p>
</caption>
<graphic xlink:href="frsen-04-1086085-g004.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4 Discussion</title>
<p>The classification method identified mapped leafy spurge training samples with 95.4% accuracy training and an overall classification accuracy of 90.7%. If mapping was to take place again however, satellite imagery with additional wavelengths of near infrared spectra may be useful, as SPOT seven imagery NIR only covers the 760&#x2013;890&#xa0;nm of the spectrum. Near infrared reflectance was the only spectral band that was significantly different between correctly identified and missed leafy spurge polygons, so more bands of varying wavelengths of near infrared may be useful in distinguishing leafy spurge&#x2019;s unique spectral signature. Leafy spurge does seem to be spectrally identifiable within the narrow portion of the electromagnetic spectrum captured by multispectral satellite imagery products (<xref ref-type="bibr" rid="B13">Mitchell and Glenn, 2009</xref>). Our detection rates of leafy spurge varied, as infestations that consist of a single leafy spurge plant, leafy spurge growing with trace amounts of bare ground, leafy spurge growing on banks, and leafy spurge growing with riparian shrub vegetation cover types were more likely to be missed by our Random Forest imagery classification. This may be because the presence of a single leafy spurge population is much harder to detect with 1) somewhat limited spatial resolution (4&#xa0;m &#xd7; 4&#xa0;m pixels), 2) changes to bank geomorphology caused by seasonal flooding during the period between satellite imagery collection and validation mapping, and 3), dense shrub cover obscuring leafy spurge invasions beneath their canopy. Overstory canopy coverage alone, however, was not a significant predictor of leafy spurge classification accuracy.</p>
<p>In other research projects where remote sensing was used to map leafy spurge, leafy spurge growing below overstory canopy coverage, leafy spurge on steep slopes, sparse leafy spurge populations, and small infestations of leafy spurge were missed (<xref ref-type="bibr" rid="B1">Anderson et al., 1996</xref>; <xref ref-type="bibr" rid="B15">Parker and Hunt, 2004</xref>; <xref ref-type="bibr" rid="B4">Glenn et al., 2005</xref>), aligning with our decreased detection accuracy of singly leafy spurge plants and leafy spurge growing below shrub and tree canopy. In contrast to our challenges of mapping leafy spurge in riparian areas of the Yampa River, detection accuracy of leafy spurge mapping in Crook County, Wyoming was improved when growing in riparian areas (<xref ref-type="bibr" rid="B18">Williams and Raymond, 2002</xref>; <xref ref-type="bibr" rid="B15">Parker and Hunt, 2004</xref>). Adding ancillary spatial data, like vegetation cover maps and distance to waterways may improve remote sensing classification results (<xref ref-type="bibr" rid="B6">Hunt et al., 2010</xref>; <xref ref-type="bibr" rid="B3">Dubovik et al., 2021</xref>). Additionally, the incorporation of citizen science data of dense, unobscured leafy spurge presence collected and submitted from within the study area could be incorporated, to increase training samples and obtain samples away from the Yampa River riparian zone (<xref ref-type="bibr" rid="B16">Vaz et al., 2019</xref>) but increasing the temporal resolution of the imagery with a times series of multiple imagery scenes through the leafy spurge bloom could.</p>
<p>One major limitation of this project is the difference between June 2021 validation mapping and satellite imagery data collection in July of 2019. Imagery procurement was limited by YRLSP budget, and 2021 SPOT seven satellite imagery purchase and classification would have been beneficial, as leafy spurge invasions may have advanced. If further remote sensing was to be conducted for mapping general leafy spurge invasion in the area, free coarser resolution multispectral imagery like Sentinel-2 (10&#xa0;m &#xd7; 10&#xa0;m pixels) could be used. As leafy spurge is a deep-rooted perennial and a prolific seed producer (<xref ref-type="bibr" rid="B9">St. John and Tilley, 2014</xref>) and largely uncontrolled in the Yampa River Valley, leafy spurge populations away from the dynamic riverbanks are unlikely to decrease, excepting extreme environmental conditions, like drought. In experimental plots where herbicide was applied in the fall of 2019, treatments that controlled leafy spurge reproduction left woody stems which were recognizable during validation mapping in the summer of 2021, so some signs of past leafy spurge may be recognizable even if plants do not regrow from established roots. Additionally, our training samples were biased toward dense, large, and unobscured leafy spurge recognizable in multispectral imagery sets and may not represent the full range of leafy spurge infestation abundance, size, and habitat type.</p>
<p>Though the success rates of the validation mapping efforts were generally low (59% of validation locations were correctly classified), the validation locations were chosen based on anomalies in YRLSP members expert knowledge of the area or features and areas of interest from the classification prediction. For example, a series of validation points were set in a seasonal Yampa River tributary, to see if positively classified pixels as leafy spurge were true leafy spurge locations. Leafy spurge detection accuracy varies within the 190 leafy spurge positive presence locations within the dataset, as the Random Forest classification was more accurate at identifying leafy spurge populations growing as discrete patches rather than scattered populations. Discrete patches of leafy spurge and infestations with higher leafy spurge percent cover were more likely to be correctly classified by the Random Forest imagery classification. <xref ref-type="bibr" rid="B2">Casady et al. (2006)</xref> found that detected leafy spurge patches had higher average leafy spurge percent cover and higher average patch size, with infestations smaller than 200&#xa0;m<sup>2</sup> and 30% leafy spurge cover less likely to be identified (<xref ref-type="bibr" rid="B2">Casady et al., 2006</xref>). Dense populations with high leafy spurge cover may have more recognizable spectral signatures than sparse populations. Discrete boundaries of leafy spurge patches may be more identifiable, as scattered populations might share pixel space with other land cover types, though the number of additional species present at validation locations did not significantly influence classification accuracy of leafy spurge.</p>
</sec>
<sec sec-type="conclusion" id="s5">
<title>5 Conclusion</title>
<p>Satellite remote sensing appears to be a viable option for leafy spurge mapping on the Yampa River, but classification accuracy varies with leafy spurge infestation characteristics and environment. Small and/or sparse infestations of leafy spurge may go undetected, and detection rates decreased in areas with shrubs and overstory canopy coverage. Identification was most accurate when leafy spurge coverage was dense. Validation mapping suggests that leafy spurge is best identified when growing in discrete patches and when leafy spurge densities are higher.</p>
<p>If leafy spurge mapping was to be conducted again in the Yampa, a time series of imagery that represents early season and mid-season would be employed to try to differentiate leafy spurge from other vegetation, as suggested by Lake et al. in a heterogeneous Minnesota landscape (<xref ref-type="bibr" rid="B10">Lake et al., 2022</xref>). If left unmanaged, leafy spurge may become a much more prevalent invader in Moffat and Routt Counties, producing more propagules to spread through the Yampa, Green, and Colorado Rivers.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s6">
<title>Data availability statement</title>
<p>The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s7">
<title>Author contributions</title>
<p>All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.</p>
</sec>
<sec id="s8">
<title>Funding</title>
<p>Funding for this work came from the Colorado Water Conservation Board Water Supply Reserve Fund through the Friends of the Yampa and the Y Cross Ranch Endowment. Publication costs were covered by the University of Wyoming Agricultural Experiment Station Hatch Fund.</p>
</sec>
<sec sec-type="COI-statement" id="s9">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Anderson</surname>
<given-names>G. L.</given-names>
</name>
<name>
<surname>Everitt</surname>
<given-names>J. H.</given-names>
</name>
<name>
<surname>Escobar</surname>
<given-names>D. E.</given-names>
</name>
<name>
<surname>Spencer</surname>
<given-names>N. R.</given-names>
</name>
<name>
<surname>Andrascik</surname>
<given-names>R. J.</given-names>
</name>
</person-group> (<year>1996</year>). <article-title>Mapping leafy spurge (euphorbia esula) infestations using aerial photography and geographic information systems</article-title>. <source>Geocarto Int.</source> <volume>11</volume> (<issue>1</issue>), <fpage>81</fpage>&#x2013;<lpage>89</lpage>. <pub-id pub-id-type="doi">10.1080/10106049609354526</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Breiman</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Random Forests</article-title>. <source>Machine Learning</source> <volume>45</volume>, <fpage>5</fpage>&#x2013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1023/A:1010933404324</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Casady</surname>
<given-names>G. M.</given-names>
</name>
<name>
<surname>Hanley</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Seelan</surname>
<given-names>S. K.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Detection of leafy spurge (Euphorbia esula) using multidate high-resolution satellite imagery</article-title>. <source>Weed Technol.</source> <volume>19</volume> (<issue>02</issue>), <fpage>462</fpage>&#x2013;<lpage>467</lpage>. <pub-id pub-id-type="doi">10.1614/wt-03-182r1</pub-id>
</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dubovik</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Schuster</surname>
<given-names>G. L.</given-names>
</name>
<name>
<surname>Xu</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Hu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>B&#xf6;sch</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Landgraf</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Grand challenges in satellite remote sensing</article-title>. <source>Front. Remote Sens.</source> <volume>2</volume>, <fpage>1</fpage>&#x2013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.3389/frsen.2021.619818</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="web">
<collab>ESRI</collab> (<year>2018</year>). <article-title>ArcGIS Desktop: Release 10.6</article-title>. <publisher-loc>Redlands, CA</publisher-loc>: <publisher-name>Environmental Systems Research Institute</publisher-name>.</citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Glenn</surname>
<given-names>N. F.</given-names>
</name>
<name>
<surname>Mundt</surname>
<given-names>J. T.</given-names>
</name>
<name>
<surname>Weber</surname>
<given-names>K. T.</given-names>
</name>
<name>
<surname>Prather</surname>
<given-names>T. S.</given-names>
</name>
<name>
<surname>Lass</surname>
<given-names>L. W.</given-names>
</name>
<name>
<surname>Pettingill</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Hyperspectral data processing for repeat detection of small infestations of leafy spurge</article-title>. <source>Remote Sens. Environ.</source> <volume>95</volume> (<issue>3</issue>), <fpage>399</fpage>&#x2013;<lpage>412</lpage>. <pub-id pub-id-type="doi">10.1016/j.rse.2005.01.003</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Goodwin</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Sheley</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Nowierski</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Lym</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Leafy spurge: Biology, ecology and management</article-title>. <comment>AvaliableAt: <ext-link ext-link-type="uri" xlink:href="http://store.msuextension.org/publications/AgandNaturalResources/EB0134.pdf">http://store.msuextension.org/publications/AgandNaturalResources/EB0134.pdf</ext-link>
</comment>.</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hunt</surname>
<given-names>E. R.</given-names>
</name>
<name>
<surname>Gillham</surname>
<given-names>J. H.</given-names>
</name>
<name>
<surname>Daughtry</surname>
<given-names>C. S. T.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Improving potential geographic distribution models for invasive plants by remote sensing</article-title>. <source>Rangel. Ecol. Manag.</source> <volume>63</volume> (<issue>5</issue>), <fpage>505</fpage>&#x2013;<lpage>513</lpage>. <pub-id pub-id-type="doi">10.2111/REM-D-09-00137.1</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hunt</surname>
<given-names>E. R.</given-names>
</name>
<name>
<surname>Parker Williams</surname>
<given-names>A. E.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Detection of flowering leafy spurge with satellite multispectral imagery published by: Society for range management detection of flowering leafy spurge with satellite multispectral imagery</article-title>. <source>Rangel. Ecol. Manag.</source> <volume>59</volume> (<issue>5</issue>), <fpage>494</fpage>&#x2013;<lpage>499</lpage>. <pub-id pub-id-type="doi">10.2111/05-216R.1</pub-id>
</citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hyder</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Leung</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Miao</surname>
<given-names>Z.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Integrating data, biology, and decision models for invasive species management: Application to leafy spurge (Euphorbia esula)</article-title>. <source>Ecol. Soc.</source> <volume>13</volume> (<issue>2</issue>), <fpage>art12</fpage>. <pub-id pub-id-type="doi">10.5751/ES-02485-130212</pub-id>
</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lake</surname>
<given-names>T. A.</given-names>
</name>
<name>
<surname>Runquist</surname>
<given-names>R. D. B.</given-names>
</name>
<name>
<surname>Moeller</surname>
<given-names>D. A.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Deep learning detects invasive plant species across complex landscapes using Worldview-2 and Planetscope satellite imagery</article-title>. <source>Remote Sens. Ecol. Conservation</source> <volume>8</volume>, <fpage>875</fpage>&#x2013;<lpage>889</lpage>. <pub-id pub-id-type="doi">10.1002/rse2.288</pub-id>
</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Larry Leistritz</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Dean</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Hodur</surname>
<given-names>N. M.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Assessing the economic impact of invasive weeds: The case of leafy spurge (Euphorbia esula)</article-title>. <source>Weed Technol.</source> <volume>18</volume>, <fpage>1392</fpage>&#x2013;<lpage>1395</lpage>. <pub-id pub-id-type="doi">10.1614/0890-037x(2004)018[1392:ateioi]2.0.co;2</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liaw</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Wiener</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Classification and Regression by randomForest</article-title>. <source>R News</source> <volume>2</volume> (<issue>3</issue>), <fpage>18</fpage>&#x2013;<lpage>22</lpage>. <comment>
<ext-link ext-link-type="uri" xlink:href="https://CRAN.R-project.org/doc/Rnews/">https://CRAN.R-project.org/doc/Rnews/</ext-link>
</comment>.</citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Merritt</surname>
<given-names>D. M.</given-names>
</name>
<name>
<surname>Cooper</surname>
<given-names>D. J.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>Riparian vegetation and channel change in response to river regulation: A comparative study of regulated and unregulated streams in the Green River basin, USA</article-title>. <source>River Res. Appl.</source>, <volume>16</volume>, <fpage>543</fpage>&#x2013;<lpage>564</lpage>. <pub-id pub-id-type="doi">10.1002/1099-1646(200011/12)16:6&#x3c;543::aid-rrr590&#x3e;3.0.co;2-n</pub-id>
</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mitchell</surname>
<given-names>J. J.</given-names>
</name>
<name>
<surname>Glenn</surname>
<given-names>N. F.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Leafy spurge (Euphorbia esula) classification performance using hyperspectral and multispectral sensors</article-title>. <source>Rangel. Ecol. Manag.</source> <volume>62</volume> (<issue>1</issue>), <fpage>16</fpage>&#x2013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.2111/08-100</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>O&#x2019;Neill</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Ustin</surname>
<given-names>S. L.</given-names>
</name>
<name>
<surname>Hager</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Root</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2000</year>). &#x201c;<article-title>Mapping the distribution of leafy spurge at Theodore Roosevelt national Park using AVIRIS</article-title>,&#x201d; in <source>Proceedings of the 9th JPL airborne earth sciences workshop</source> <comment>(pp. 00-18)</comment> (<publisher-loc>Pasadena, California</publisher-loc>: <publisher-name>NASA Jet Propulsion Laboratory</publisher-name>).</citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Parker</surname>
<given-names>A. E.</given-names>
</name>
<name>
<surname>Hunt</surname>
<given-names>E. R.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Accuracy assessment for detection of leafy spurge with hyperspectral imagery</article-title>. <source>J. Range Manag.</source> <volume>57</volume> (<issue>1</issue>), <fpage>106</fpage>&#x2013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.2111/1551-5028(2004)057[0106:aafdol]2.0.co;2</pub-id>
</citation>
</ref>
<ref id="B9">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>St. John</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Tilley</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2014</year>). <source>Plant Guide for Leafy spurge (Euphorbia esula)</source>. <publisher-loc>Aberdeen, Idaho</publisher-loc>: <publisher-name>Natural Resources Conservation Service, Plant Materials Center</publisher-name> <fpage>83210</fpage>.</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Turnage</surname>
<given-names>M. B.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>An invasion problem: Leafy spurge and its management efforts in Dinosaur National Monument and the Greater Yampa River Area</article-title>. <comment>Avaliable At: <ext-link ext-link-type="uri" xlink:href="https://storymaps.arcgis.com/stories/998e931b97024734bf988db86e1fde61">https://storymaps.arcgis.com/stories/998e931b97024734bf988db86e1fde61</ext-link>
</comment>. <comment>Google Play <ext-link ext-link-type="uri" xlink:href="https://play.google.com/store/apps/details?id=com.agterra.MapItFastandhl=en_USandgl=US">https://play.google.com/store/apps/details?id&#x003D;com.agterra.MapItFastandhl&#x003D;en_USandgl&#x003D;US</ext-link>
</comment>.</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vaz</surname>
<given-names>A. S.</given-names>
</name>
<name>
<surname>Alcaraz-Segura</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Vicente</surname>
<given-names>J. R.</given-names>
</name>
<name>
<surname>Honrado</surname>
<given-names>J. P.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>The many roles of remote sensing in invasion science</article-title>. <source>Front. Ecol. Evol.</source> <volume>7</volume>, <fpage>1</fpage>&#x2013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.3389/fevo.2019.00370</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Westbrooks</surname>
<given-names>R. G.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>New approaches for early detection and rapid response to invasive plants in the United States<sup>1</sup>
</article-title>. <source>Weed Technol. Invasive Weed Symp. Weed Technol.</source> <volume>18</volume>, <fpage>1468</fpage>&#x2013;<lpage>1471</lpage>. <pub-id pub-id-type="doi">10.1614/0890-037x(2004)018[1468:nafeda]2.0.co;2</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Williams</surname>
<given-names>A. P.</given-names>
</name>
<name>
<surname>Raymond</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>Estimation of leafy spurge cover from hyperspectral imagery using mixture tuned matched filtering</article-title>. <comment>Avaliable At: <ext-link ext-link-type="uri" xlink:href="http://www.elsevier.com/locate/rse">www.elsevier.com/locate/rse</ext-link>
</comment>.</citation>
</ref>
<ref id="B19">
<citation citation-type="web">
<collab>Yampa River Leafy Spurge Project</collab> (<year>2018</year>). <article-title>Who we are. Yampa River Leafy Spurge Project</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.yampariverleafyspurgeproject.com/who-we-are">https://www.yampariverleafyspurgeproject.com/who-we-are</ext-link>
</comment>.</citation>
</ref>
</ref-list>
</back>
</article>