<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="article-commentary">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Environ. Sci.</journal-id>
<journal-title>Frontiers in Environmental Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Environ. Sci.</abbrev-journal-title>
<issn pub-type="epub">2296-665X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fenvs.2017.00085</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Environmental Science</subject>
<subj-group>
<subject>General Commentary</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Commentary: <italic>Aedes albopictus</italic> and <italic>Aedes japonicus</italic>&#x02014;two invasive mosquito species with different temperature niches in Europe</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Demertzis</surname> <given-names>Konstantinos</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/480644/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Iliadis</surname> <given-names>Lazaros</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/503870/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Anezakis</surname> <given-names>Vardis-Dimitrios</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/482080/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Civil Engineering, Faculty of Mathematics Programming and General Courses, School of Engineering, Democritus University of Thrace</institution>, <addr-line>Xanthi</addr-line>, <country>Greece</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Forestry and Management of the Environment and Natural Resources, Democritus University of Thrace</institution>, <addr-line>Orestiada</addr-line>, <country>Greece</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Aristides (Aris) Moustakas, Universiti Brunei Darussalam, Brunei</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Dimitris Poursanidis, Foundation for Research and Technology Hellas, Greece; Stelios Katsanevakis, University of the Aegean, Greece</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Konstantinos Demertzis <email>kdemertz&#x00040;fmenr.duth.gr</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Environmental Informatics, a section of the journal Frontiers in Environmental Science</p></fn></author-notes>
<pub-date pub-type="epub">
<day>11</day>
<month>12</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>5</volume>
<elocation-id>85</elocation-id>
<history>
<date date-type="received">
<day>27</day>
<month>09</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>11</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 Demertzis, Iliadis and Anezakis.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Demertzis, Iliadis and Anezakis</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<related-article id="RA1" related-article-type="commentary-article" journal-id="Parasit Vectors" journal-id-type="nlm-ta" vol="9" page="573" xlink:href="27814747" ext-link-type="pubmed">A commentary on <article-title><italic>Aedes albopictus</italic> and <italic>Aedes japonicus</italic>&#x02014;two invasive mosquito species with different temperature niches in Europe</article-title> by Cunze, S., Koch, L. K., Kochmann, J., and Klimpel, S. Parasit. Vectors (2016). 9:573. doi: <object-id>10.1186/s13071-016-1853-2</object-id></related-article>
<kwd-group>
<kwd>Asian bush mosquito</kwd>
<kwd>Asian tiger mosquito</kwd>
<kwd>climate change</kwd>
<kwd>invasive species</kwd>
<kwd>species distribution modeling</kwd>
<kwd>ensemble learning</kwd>
<kwd>machine learning</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="21"/>
<page-count count="3"/>
<word-count count="2293"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>In this interesting and original study, the authors present an ensemble Machine Learning (ML) model for the prediction of the habitats&#x00027; suitability, which is affected by the complex interactions between living conditions and survival-spreading climate factors. The research focuses in two of the most dangerous invasive mosquito species in Europe with the requirements&#x00027; identification in temperature and rainfall conditions. Though it is an interesting approach, the ensemble ML model is not presented and discussed in sufficient detail and thus its performance and value as a tool for modeling the distribution of invasive species cannot be adequately evaluated.</p>
</sec>
<sec id="s2">
<title>Methodology used</title>
<p>The authors use an Ensemble Approach (ENAP) based on 10 timely ML algorithms, aiming to draw up the habitats&#x00027; maps for both species of mosquitoes. Ensemble methods are meta-algorithms that combine several techniques into a unique predictive model to decrease variance. For example, in Bagging different training data subsets are randomly drawn&#x02014;with replacement&#x02014;from the entire training dataset, to train a different classifier. In Boosting, resampling is strategically geared to provide the most informative training data for each consecutive classifier, or to improve predictions. Stacking, involves training to combine the predictions of several other learning algorithms (Zhou, <xref ref-type="bibr" rid="B21">2012</xref>).</p>
<p>Unlike a statistical ensemble in statistical mechanics which is usually infinite, a ML ensemble consists of only a concrete finite set of alternative models, but typically allows for much more flexible structures to exist among those alternatives. Perhaps one of the earliest works on ensemble systems is the paper by Dasarathy and Sheela (<xref ref-type="bibr" rid="B4">1979</xref>). They first introduced an ENAP for partitioning the feature space, using two or more classifiers, in a divide-and-conquer fashion. Over a decade later, Hansen and Salamon (<xref ref-type="bibr" rid="B9">1990</xref>) showed the variance reduction property of an ENAP. They managed to improve the generalization performance of an ANN by using an ensemble of similarly configured ANN. But it was Schapire&#x00027;s work that has put the ENAP at the center of ML research, as he has proven that a strong classifier can be generated by combining weak classifiers (Schapire, <xref ref-type="bibr" rid="B17">1990</xref>). Finally, Buisson et al. suggested that attention should be paid to the use of predictions ensembles resulting from the application of several statistical methods. Forecasted impacts should always be provided with an assessment of their uncertainty (Buisson et al., <xref ref-type="bibr" rid="B2">2010</xref>).</p>
<p>Unfortunately, the authors of this interesting paper, do not offer a deep description of the proposed ENAP and it is not clear if their approach can cover the main points of the ensemble techniques. For example, the proposed ENAP convert species&#x00027; probability of occurrence into binary presence-absence data using a predefined threshold. Assessing models based on presence only data, it is difficult to learn the overall species occurrence probability, based on false or misleading information or unjustified simplifying assumptions, because there is typically no validation data with true presences and absences (Hastie and Fithian, <xref ref-type="bibr" rid="B10">2013</xref>). The ENAP that was proposed cannot surmount this problem, it only makes it more hidden.</p>
</sec>
<sec id="s3">
<title>Alien species distribution modeling and machine learning ensembles models</title>
<p>Current practices in Alien Species Distribution Modeling (ASDM) algorithms (Lorena et al., <xref ref-type="bibr" rid="B14">2011</xref>; Duan et al., <xref ref-type="bibr" rid="B7">2014</xref>; Shabani et al., <xref ref-type="bibr" rid="B18">2016</xref>), include Profile Methods (BIOCLIM, ENFA) (Lorena et al., <xref ref-type="bibr" rid="B14">2011</xref>; Duan et al., <xref ref-type="bibr" rid="B7">2014</xref>; Shabani et al., <xref ref-type="bibr" rid="B18">2016</xref>), Regression-based techniques (GLM, MARS) (Lorena et al., <xref ref-type="bibr" rid="B14">2011</xref>; Duan et al., <xref ref-type="bibr" rid="B7">2014</xref>; Shabani et al., <xref ref-type="bibr" rid="B18">2016</xref>), ML techniques (MAXENT, ANN, SVM) (Lorena et al., <xref ref-type="bibr" rid="B14">2011</xref>; Duan et al., <xref ref-type="bibr" rid="B7">2014</xref>; Shabani et al., <xref ref-type="bibr" rid="B18">2016</xref>).</p>
<p>A widely used and effective method in ASDM involves creating ML ensembles&#x00027; models (Duan et al., <xref ref-type="bibr" rid="B7">2014</xref>). The two most important advantages of ENAP focus on the fact that they offer better prediction and more stable and robust models, as the overall behavior of a multiple model is less noisy than a corresponding single one (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). For example, in Zhang and Zhang (<xref ref-type="bibr" rid="B20">2012</xref>) the authors propose an effective ENAP to assess the impacts of predictor variables and ASDM. In Daliakopoulos et al. (<xref ref-type="bibr" rid="B3">2017</xref>) the Random Forest EANP has proven that it can provide a better understanding of facilitating and limiting factors of alien species presence, both for research and management purposes. Finally, Lauzeral et al. (<xref ref-type="bibr" rid="B12">2012</xref>) proposes an iterative ENAP to ensure noise absence and hence to improve the predictive reliability of ensemble modeling of species distributions.</p>
<p>Some of the most important points related to the operation and use of the ENAP that should be included and discussed thoroughly by the authors are presented below:</p>
<list list-type="order">
<list-item><p>The ensemble size of the proposed model. The number of classifiers included in the creation of an ensemble model has a large impact on the accuracy of the prediction (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). Regarding the proposed ENAP, a 10 state-of-the-art algorithms used, nevertheless without thorough analysis and explanation. On the other hand, their theoretical framework of Ensemble Learning shows that using the same number of independent component classifiers as class labels gives the highest accuracy (Hamed and Can, <xref ref-type="bibr" rid="B8">2016</xref>).</p></list-item>
<list-item><p>A detailed and complete description and justification of the classifiers selection. The choice of the proper classifiers (e.g., ANN) to be included in an ENAP (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>) should be based on the selection of the implementation mode and on the parameters&#x00027; settings which can lead to different decision boundaries, even if all other parameters remain constant (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). It is a fact that there is no point or advantage to combining a group of models that are identical and generalize in the same way (L&#x000F3;pez et al., <xref ref-type="bibr" rid="B13">2007</xref>; Bougoudis et al., <xref ref-type="bibr" rid="B1">2014</xref>). In the proposed ENAP, both GLM and MAXENT were used, and there is no clear explanation on how the authors have chosen this specific architecture. As shown by Renner and Warton (<xref ref-type="bibr" rid="B16">2013</xref>) MAXENT is equivalent to a GLM with a Poisson error structure and differing only in the intercept term, which is scale-dependent in MAXENT. One cannot argue that MAXENT has different predictive performance than a GLM when they are equivalent.</p></list-item>
<list-item><p>A clear and sufficiently detailed discussion-explanation on the determination and handling of the weights employed by the distinct ensemble models (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). The weight vector is a very important parameter in the process of training an ENAP, as it is used in the determination of the classifiers&#x00027; performance and of the classification confidence level (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). The authors do not include a detailed description of the weights employed by the distinct ensemble models, with no attempt to tie them to the problem at hand.</p></list-item>
<list-item><p>Clear description of the process that has determined the optimal model, its potential hybrid nature and justification of the proposed ensemble&#x00027;s architecture reliability. This can be done using inclusion of diagrams or algorithms. The variance of prediction results in a ML model is one of the most important measures for assessing the credibility of the method (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). The work by Yackulic et al. (<xref ref-type="bibr" rid="B19">2013</xref>) shows that MAXENT model outputs (i.e., maps) are presented completely casually and without providing readers with any means to critically examine modeled relationships. This fact may be hidden or masked within proposed ENAP, but the problem remains.</p></list-item>
</list>
</sec>
<sec id="s4">
<title>Discussion and conclusions</title>
<p>It is worth noting that in general an ENAP can lead to much better prediction results, while offering generalization. This is one of the key issues in the field of ML, as it can reduce bias and variance and it has the potential to eliminate overfitting (Kuncheva, <xref ref-type="bibr" rid="B11">2004</xref>; Zhou, <xref ref-type="bibr" rid="B21">2012</xref>). Moreover, it implements robust predictive models capable of responding to high complexity problems such as those of spreading invasive species (Demertzis and Iliadis, <xref ref-type="bibr" rid="B5">2015</xref>, <xref ref-type="bibr" rid="B6">2017</xref>). However, the development of these models should not be done in a black box mode research and it should be accompanied by a set of in-depth analysis regarding key training and operation decision points, thus allowing critical readers to fully and thoroughly evaluate the proposed methodology and to promote research in the broader scope. Finally, there are cases where wide variety of comparatively model-free forecasting methods outperforms the correct mechanistic data-driven model. However, according to Moustakas (<xref ref-type="bibr" rid="B15">2017</xref>) &#x0201C;<italic>if one simply relies on data-driven science, several components of scientific methods will be made poorer</italic>.&#x0201D;</p>
</sec>
<sec id="s5">
<title>Author contributions</title>
<p>KD and LI conceived of the presented idea. KD and LI developed the theoretical formalism, performed the analytic calculations and performed the numerical simulations. KD, LI, and V-DA verified the analytical methods. All the authors contributed to the final version of the manuscript. LI supervised the project.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Bougoudis</surname> <given-names>I.</given-names></name> <name><surname>Iliadis</surname> <given-names>L.</given-names></name> <name><surname>Papaleonidas</surname> <given-names>A.</given-names></name></person-group> (<year>2014</year>). <article-title>Fuzzy inference ANN ensembles for air pollutants modeling in a major urban area: the case of athens</article-title>, in <source>Proceedings of the 15th Engineering Applications of Neural Networks</source>, <volume>Vol. 459</volume> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer; Communications in Computer and Information Science</publisher-name>), <fpage>1</fpage>&#x02013;<lpage>14</lpage>.</citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buisson</surname> <given-names>L.</given-names></name> <name><surname>Thuiller</surname> <given-names>W.</given-names></name> <name><surname>Casajus</surname> <given-names>N.</given-names></name> <name><surname>Lek</surname> <given-names>S.</given-names></name> <name><surname>Grenouillet</surname> <given-names>G.</given-names></name></person-group> (<year>2010</year>). <article-title>Uncertainty in ensemble forecasting of species distribution</article-title>. <source>Global Change Biol.</source> <volume>16</volume>, <fpage>1145</fpage>&#x02013;<lpage>1157</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-2486.2009.02000.x</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Daliakopoulos</surname> <given-names>I. N.</given-names></name> <name><surname>Katsanevakis</surname> <given-names>S.</given-names></name> <name><surname>Moustakas</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <article-title>Spatial downscaling of alien species presences using machine learning</article-title>. <source>Front. Earth Sci.</source> <volume>5</volume>:<fpage>60</fpage>. <pub-id pub-id-type="doi">10.3389/feart.2017.00060</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dasarathy</surname> <given-names>B. V.</given-names></name> <name><surname>Sheela</surname> <given-names>B. V.</given-names></name></person-group> (<year>1979</year>). <article-title>Composite classifier system design: concepts and me-thodology</article-title>. <source>Proc. IEEE</source> <volume>67</volume>, <fpage>708</fpage>&#x02013;<lpage>713</lpage>. <pub-id pub-id-type="doi">10.1109/PROC.1979.11321</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Demertzis</surname> <given-names>K.</given-names></name> <name><surname>Iliadis</surname> <given-names>L.</given-names></name></person-group> (<year>2015</year>). <article-title>Intelligent bio-inspired detection of food borne pathogen by DNA barcodes: the case of invasive fish species lagocephalus sceleratus</article-title>, in <source>Engineering Applications of Neural Networks. Communications in Computer and Information Science</source>, <volume>Vol. 517</volume>, eds <person-group person-group-type="editor"><name><surname>Iliadis</surname> <given-names>L.</given-names></name> <name><surname>Jayne</surname> <given-names>C.</given-names></name></person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>89</fpage>&#x02013;<lpage>99</lpage>.</citation></ref>
<ref id="B6">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Demertzis</surname> <given-names>K.</given-names></name> <name><surname>Iliadis</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>Adaptive elitist differential evolution extreme learning machines on big data: intelligent recognition of invasive species</article-title>, in <source>Advances in Big Data; Advances in Intelligent Systems and Computing</source>, <volume>Vol. 529</volume>, eds <person-group person-group-type="editor"><name><surname>Angelov</surname> <given-names>P.</given-names></name> <name><surname>Manolopoulos</surname> <given-names>Y.</given-names></name> <name><surname>Iliadis</surname> <given-names>L.</given-names></name> <name><surname>Roy</surname> <given-names>A.</given-names></name> <name><surname>Vellasco</surname> <given-names>M.</given-names></name></person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>333</fpage>&#x02013;<lpage>345</lpage>.</citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duan</surname> <given-names>R.-Y.</given-names></name> <name><surname>Kong</surname> <given-names>X.-Q.</given-names></name> <name><surname>Huang</surname> <given-names>M.-Y.</given-names></name> <name><surname>Fan</surname> <given-names>W.-Y.</given-names></name> <name><surname>Wang</surname> <given-names>Z.-G.</given-names></name></person-group> (<year>2014</year>). <article-title>The predictive performance and stability of six species distribution models</article-title>. <source>PLoS ONE</source> <volume>9</volume>:<fpage>e112764</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0112764</pub-id><pub-id pub-id-type="pmid">25383906</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hamed</surname> <given-names>R. B.</given-names></name> <name><surname>Can</surname> <given-names>F.</given-names></name></person-group> (<year>2016</year>). <article-title>A theoretical framework on the ideal number of classifiers for online ensembles in data streams</article-title>, in <source>CIKM</source> (<publisher-loc>Indianapolis, IN</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>2053</fpage>.</citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hansen</surname> <given-names>L. K.</given-names></name> <name><surname>Salamon</surname> <given-names>P.</given-names></name></person-group> (<year>1990</year>). <article-title>Neural network ensembles</article-title>. <source>IEEE Trans. Pattern Anal. Mach. Intellig.</source> <volume>12</volume>, <fpage>993</fpage>&#x02013;<lpage>1001</lpage>. <pub-id pub-id-type="doi">10.1109/34.58871</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hastie</surname> <given-names>T.</given-names></name> <name><surname>Fithian</surname> <given-names>W.</given-names></name></person-group> (<year>2013</year>). <article-title>Inference from presence-only data; the ongoing controversy</article-title>. <source>Ecography</source> <volume>36</volume>, <fpage>864</fpage>&#x02013;<lpage>867</lpage>. <pub-id pub-id-type="doi">10.1111/j.1600-0587.2013.00321.x</pub-id><pub-id pub-id-type="pmid">25492992</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kuncheva</surname> <given-names>L.</given-names></name></person-group> (<year>2004</year>). <source>Combining Pattern Classifiers: Methods and Algorithms.</source> <publisher-loc>Hoboken, NJ</publisher-loc>: <publisher-name>Wiley</publisher-name>.</citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lauzeral</surname> <given-names>C.</given-names></name> <name><surname>Grenouillet</surname> <given-names>G.</given-names></name> <name><surname>Brosse</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>Dealing with noisy absences to optimize species distribution models: an iterative ensemble modelling approach</article-title>. <source>PLoS ONE</source> <volume>7</volume>:<fpage>e49508</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0049508</pub-id><pub-id pub-id-type="pmid">23166691</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>L&#x000F3;pez</surname> <given-names>M.</given-names></name> <name><surname>Melin</surname> <given-names>P.</given-names></name> <name><surname>Castillo</surname> <given-names>O.</given-names></name></person-group> (<year>2007</year>). <article-title>A method for creating ensemble neural networks using a sampling data approach</article-title>. <source>Ther. Adv. Appl. Fuzzy Logic</source> <volume>42</volume>, <fpage>772</fpage>&#x02013;<lpage>780</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-540-72434-6</pub-id>_78</citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lorena</surname> <given-names>A. C.</given-names></name> <name><surname>Jacintho</surname> <given-names>L. F. O.</given-names></name> <name><surname>Siqueira</surname> <given-names>M. F.</given-names></name> <name><surname>De Giovanni</surname> <given-names>R.</given-names></name> <name><surname>Lohmann</surname> <given-names>L. G.</given-names></name> <name><surname>de Carvalho</surname> <given-names>A. C. P. L. F.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Comparing machine learning classifiers in potential distribution modelling</article-title>. <source>Expert Syst. Appl.</source> <volume>38</volume>, <fpage>5268</fpage>&#x02013;<lpage>5275</lpage>. <pub-id pub-id-type="doi">10.1016/j.eswa.2010.10.031</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moustakas</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <article-title>Spatio-temporal data mining in ecological and veterinary epidemiology</article-title>. <source>Stochast. Environ. Res. Risk Assess.</source> <volume>31</volume>, <fpage>829</fpage>&#x02013;<lpage>834</lpage>. <pub-id pub-id-type="doi">10.1007/s00477-016-1374-8</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Renner</surname> <given-names>I. W.</given-names></name> <name><surname>Warton</surname> <given-names>D. I.</given-names></name></person-group> (<year>2013</year>). <article-title>Equivalence of MAXENT and poisson point process models for species distribution modeling in ecology</article-title>. <source>Biometrics</source> <volume>69</volume>, <fpage>274</fpage>&#x02013;<lpage>281</lpage>. <pub-id pub-id-type="doi">10.1111/j.1541-0420.2012.01824.x</pub-id><pub-id pub-id-type="pmid">23379623</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schapire</surname> <given-names>R. E.</given-names></name></person-group> (<year>1990</year>). <article-title>The strength of weak learnability</article-title>. <source>Mach. Learn.</source> <volume>5</volume>, <fpage>197</fpage>&#x02013;<lpage>227</lpage>.</citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shabani</surname> <given-names>F.</given-names></name> <name><surname>Kumar</surname> <given-names>L.</given-names></name> <name><surname>Ahmadi</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>A comparison of absolute performance of different correlative and mechanistic species distribution models in an independent area</article-title>. <source>Ecol. Evol</source>. <volume>6</volume>, <fpage>5973</fpage>&#x02013;<lpage>5986</lpage>. <pub-id pub-id-type="doi">10.1002/ece3.2332</pub-id><pub-id pub-id-type="pmid">27547370</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yackulic</surname> <given-names>C. B.</given-names></name> <name><surname>Chandler</surname> <given-names>R.</given-names></name> <name><surname>Zipkin</surname> <given-names>E. F.</given-names></name> <name><surname>Royle</surname> <given-names>J. A.</given-names></name> <name><surname>Nichols</surname> <given-names>J. D.</given-names></name> <name><surname>Grant</surname> <given-names>E. H. C.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Presence-only modelling using MAXENT: when can we trust the inferences?</article-title> <source>Methods Ecol. Evol.</source> <volume>4</volume>, <fpage>236</fpage>&#x02013;<lpage>243</lpage>. <pub-id pub-id-type="doi">10.1111/2041-210x.12004</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Q.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name></person-group> (<year>2012</year>). <article-title>Impacts of predictor variables and species models on simulating <italic>Tamarix ramosissima</italic> distribution in Tarim Basin, northwestern China</article-title>. <source>J. Plant Ecol.</source> <volume>5</volume>, <fpage>337</fpage>&#x02013;<lpage>345</lpage>. <pub-id pub-id-type="doi">10.1093/jpe/rtr049</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>Z.-H.</given-names></name></person-group> (<year>2012</year>). <source>Ensemble Methods: Foundations and Algorithms.</source> <publisher-loc>London</publisher-loc>: <publisher-name>CRC Press</publisher-name>.</citation></ref>
</ref-list>
</back>
</article>