<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Mar. Sci.</journal-id>
<journal-title>Frontiers in Marine Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Mar. Sci.</abbrev-journal-title>
<issn pub-type="epub">2296-7745</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fmars.2019.00659</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Marine Science</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Comparison of Rapid Biodiversity Assessment of Meiobenthos Using MALDI-TOF MS and Metabarcoding</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Rossel</surname> <given-names>Sven</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/517880/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Khodami</surname> <given-names>Sahar</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/817371/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Mart&#x00ED;nez Arbizu</surname> <given-names>Pedro</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>German Centre for Marine Biodiversity Research, Senckenberg am Meer, Senckenberg Gesellschaft f&#x00FC;r Naturforschung</institution>, <addr-line>Wilhelmshaven</addr-line>, <country>Germany</country></aff>
<aff id="aff2"><sup>2</sup><institution>Marine Biodiversity Research, Institute for Biology and Environmental Sciences, Carl von Ossietzky University Oldenburg</institution>, <addr-line>Oldenburg</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Andrew Stanley Mount, Clemson University, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Erik Michael Pilgrim, United States Environmental Protection Agency, United States; Ciro Rico, The University of the South Pacific, Fiji</p></fn>
<corresp id="c001">&#x002A;Correspondence: Sven Rossel, <email>sven.rossel@senckenberg.de</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Marine Molecular Biology and Ecology, a section of the journal Frontiers in Marine Science</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>11</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2019</year>
</pub-date>
<volume>6</volume>
<elocation-id>659</elocation-id>
<history>
<date date-type="received">
<day>06</day>
<month>05</month>
<year>2019</year>
</date>
<date date-type="accepted">
<day>09</day>
<month>10</month>
<year>2019</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2019 Rossel, Khodami and Mart&#x00ED;nez Arbizu.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Rossel, Khodami and Mart&#x00ED;nez Arbizu</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Nowadays, most biodiversity assessments involving meiofauna are mainly carried out using very time-consuming, specimen-wise morphological identifications, which demands comprehensive taxonomic knowledge. Animals have to be examined for minor differences of setae compositions, mouthpart morphology or number of segments for various extremities. DNA-based methods such as metabarcoding as well as recently emerged rapid analyses using MALDI-TOF mass spectrometry to identify specimens based on a proteome fingerprint could vastly accelerate the process of specimen identification in biodiversity assessments. However, these techniques depend on reference libraries to connect collected data to morphologically described species. In this study the success rate of both approaches have been tested based on reference libraries constructed using part of the samples from a new study area to identify unknown samples. Using MALDI-TOF MS we found, that species which do not exist in an incomplete mass spectra reference library only have minor impact on the results, when employing a <italic>post hoc</italic> test for Random Forest classifications. This test reveals specimens that demand morphological re-examination for the final species assignment. Metabarcoding however strongly demands a rich reference library to provide correct MOTU assessments in congruence with morphological determination. Nevertheless, with a complete library and a suitable data transformation [herein log(x + 1)], the number of reads per MOTU reflects relative species abundances in metabarcoding inference. The results of this study facilitate specimen identification by using MALDI-TOF MS, which is incomparably cheap for specimen-by-specimen identification, but when it comes to sample-wise analyses, metabarcoding outperforms other techniques by far.</p>
</abstract>
<kwd-group>
<kwd>meiofauna</kwd>
<kwd>proteomic fingerprint</kwd>
<kwd>species identification</kwd>
<kwd>COI</kwd>
<kwd>barcoding</kwd>
<kwd>specimen identification</kwd>
<kwd>harpacticoida</kwd>
<kwd>copepoda</kwd>
</kwd-group>
<contract-sponsor id="cn001">Nieders&#x00E4;chsische Ministerium f&#x00FC;r Wissenschaft und Kultur<named-content content-type="fundref-id">10.13039/100011937</named-content></contract-sponsor>
<counts>
<fig-count count="4"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="70"/>
<page-count count="13"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1">
<title>Introduction</title>
<p>Assessing species&#x2019; diversity, distribution, and community structure is crucial to understand the relationship of species to the surrounding environment. Moreover, monitoring of communities is necessary to detect the influence of environmental changes on species compositions. Therefore, accurate species identification is necessary for biodiversity research.</p>
<p>Morphological identification in particular for the tiny meiofauna organisms is very challenging and time-consuming (e.g., <xref ref-type="bibr" rid="B6">Brannock et al., 2014</xref>; <xref ref-type="bibr" rid="B45">Morad et al., 2017</xref>; <xref ref-type="bibr" rid="B56">Rzeznik-Orignac et al., 2017</xref>). An exact determination often demands dissection of the smallest appendages (<xref ref-type="bibr" rid="B28">Huys et al., 1996</xref>) and a comprehensive taxonomic knowledge. Unfortunately, taxonomic identification using morphology only has shown to underestimate the true diversity compared to DNA-based methods (<xref ref-type="bibr" rid="B63">Tang et al., 2012</xref>), mainly because of cryptic diversity for many species (<xref ref-type="bibr" rid="B34">Knowlton, 1993</xref>).</p>
<p>Over the last years, several methods have been introduced to improve and accelerate species identification. The most commonly applied method is COI mtDNA barcoding, based on amplification of the mitochondrial cytochrome oxidase <italic>c</italic> subunit I fragment (<xref ref-type="bibr" rid="B26">Hebert et al., 2003a</xref>, <xref ref-type="bibr" rid="B27">b</xref>). Large data sets for many groups of animals have been published (e.g., <xref ref-type="bibr" rid="B33">Knebelsberger et al., 2014</xref>; <xref ref-type="bibr" rid="B2">Barco et al., 2016</xref>) and have been applied for rapid and reliable species identifications. However, this technique often demands taxa-specific optimization and several processing steps. Therefore, meiofauna barcoding surveys which often focus on identification of voucher specimens only (<xref ref-type="bibr" rid="B64">Vogt et al., 2014</xref>; <xref ref-type="bibr" rid="B1">Av&#x00F3; et al., 2017</xref>) may underestimate the true diversity (<xref ref-type="bibr" rid="B63">Tang et al., 2012</xref>) and consequently the importance of meiofauna.</p>
<p>Next generation sequencing approaches such as metabarcoding allow community analysis using batch samples (e.g., <xref ref-type="bibr" rid="B62">Taberlet et al., 2012</xref>; <xref ref-type="bibr" rid="B39">Leray and Knowlton, 2015</xref>; <xref ref-type="bibr" rid="B17">Fonseca V. et al., 2017</xref>) which not only reduces the expenses, but also decreases the effort of extraction, fragment amplification, purification, and sequencing from several 100 specimens to just processing whole samples in DNA-based biodiversity assessments. However, to reliably identify species from bulk samples, well-curated reference libraries are essential (e.g., <xref ref-type="bibr" rid="B16">Fonseca G et al., 2017</xref>) to provide connection between obtained OTUs to morphospecies.</p>
<p>Another promising method for species identification in biodiversity assessments originates from the field of microbiology. Matrix-Assisted Laser Desorption/Ionization Time-of-Flight mass spectrometry (MALDI-TOF MS) is commonly used to identify bacteria, viruses or fungi (<xref ref-type="bibr" rid="B47">Moura et al., 2008</xref>; <xref ref-type="bibr" rid="B35">La Scola et al., 2010</xref>; <xref ref-type="bibr" rid="B11">De Bruyne et al., 2011</xref>) based on a proteomic fingerprint. Also, pilot studies were carried out for several animal groups like fish (<xref ref-type="bibr" rid="B43">Mazzeo et al., 2008</xref>), dipterans (<xref ref-type="bibr" rid="B15">Feltens et al., 2010</xref>; <xref ref-type="bibr" rid="B31">Kaufmann et al., 2012</xref>) or copepods (<xref ref-type="bibr" rid="B36">Laakmann et al., 2013</xref>; <xref ref-type="bibr" rid="B52">Rossel and Mart&#x00ED;nez Arbizu, 2018a</xref>, <xref ref-type="bibr" rid="B54">2019</xref>).</p>
<p>The method provides a fast and reliable workflow for specimen-by-specimen identification at low expenses. Studies on copepods and dipterans showed the ability to differentiate between cryptic species and the congruence of COI barcode and MALDI-TOF MS-based species delimitation (<xref ref-type="bibr" rid="B48">M&#x00FC;ller et al., 2013</xref>; <xref ref-type="bibr" rid="B5">Bode et al., 2017</xref>). In case of whole specimen extraction from copepods, exuviae were retained and could be examined afterward for morphological identifications (<xref ref-type="bibr" rid="B36">Laakmann et al., 2013</xref>; <xref ref-type="bibr" rid="B52">Rossel and Mart&#x00ED;nez Arbizu, 2018a</xref>, <xref ref-type="bibr" rid="B53">b</xref>). In contrast to morphospecies assignments that were often used in ecological studies MALDI-TOF MS provides mass spectra that are comparable between studies.</p>
<p>Faunistic assessments are very important for understanding species relationships to the environment and DNA-based delimitation methods are widely used. Despite the fact that the accuracy of metabarcoding and MALDI-TOF MS strongly depend on reference libraries, DNA databases are remarkably poor in case of meiofauna organisms, even from well-studied areas like the North Sea (e.g., <xref ref-type="bibr" rid="B64">Vogt et al., 2014</xref>). Therefore, in this study, we aim at comparing the efficiency of metabarcoding and MALDI-TOF MS for community studies of previously un-sampled study sites by sampling a tidal flat and using some samples for building up DNA and mass spectra libraries and others for assessing biodiversity and community structures. Techniques will be analyzed in terms of identification success compared to morphological examination and expenses.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="S2.SS1">
<title>Sampling and Storage</title>
<p>Samples were taken by hand with a syringe (&#x00D8; 3.1 cm, 5 cm depth) during low tide at a tidal flat (53&#x00B0;38&#x2032;40.2&#x2032;&#x2032; N 8&#x00B0;04&#x2032;57.6&#x2032;&#x2032; E) in front of the village Hooksiel in the littoral zone of the German North Sea coast on 19<sup><italic>th</italic></sup> April 2017. Twelve sandy sediment samples were fixed in absolute ethanol and stored overnight at &#x2212;25&#x00B0;C.</p>
<p>Samples were sieved through a 40 &#x03BC;m sieve and density-gravity centrifuged according to <xref ref-type="bibr" rid="B44">McIntyre and Warwick (1984)</xref> employing Kaolin and Levasil<sup>&#x00AE;</sup> (Kurt Obermeier GmbH &#x0026; Co. KG, Bad Berleburg, Germany). Until further processing, samples were stored at &#x2212;25&#x00B0;C in absolute ethanol.</p>
<p>Adult specimens were sorted on ice from centrifuged samples and morphologically identified using different identification keys (<xref ref-type="bibr" rid="B37">Lang, 1948</xref>; <xref ref-type="bibr" rid="B28">Huys et al., 1996</xref>; <xref ref-type="bibr" rid="B66">Wells, 2007</xref>).</p>
<p>Five samples were used for Metabarcoding, five for MALDI-TOF MS measurements and two for the construction of 18S rRNA and mass spectra libraries (<xref ref-type="fig" rid="F1">Figure 1</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Workflow of community identifications using metabarcoding and MALDI-TOF MS. DNA and MS reference libraries were constructed from specimens of two samples. The DNA library was used to assign species to Illumina MiSeq sequence reads from pooled samples. With incomplete library, this will however result in an unresolved community containing unidentified MOTUs. Based on the MS reference library a Random Forest model is constructed to classify all specimens from samples. The <italic>post hoc</italic> test is then used to validate or reject classifications. Rejected classifications are re-examined morphologically and subsequently assigned to the correct species. The resulting community consists of species based on MS and specimens identified morphologically.</p></caption>
<graphic xlink:href="fmars-06-00659-g001.tif"/>
</fig>
</sec>
<sec id="S2.SS2">
<title>Specimen Processing and Measurements for MALDI-TOF MS</title>
<p>Individual specimens were separated into 1.5 ml microcentrifuge tubes with 0.5 &#x03BC;l absolute ethanol. After complete evaporation of ethanol, 2 &#x03BC;l of a matrix solution containing &#x03B1;-Cyano-4-hydroxycinnamic acid (HCCA) as a saturated solution in 50% acetonitrile, 47.5% molecular grade water and 2.5% trifluoroacetic acid were added. After 5 min of incubation, the solution was applied to one spot for crystallization on a target plate.</p>
<p>Samples were measured using a Microflex LT/SH System (Bruker Daltonics), employing the flexControl 3.4 (Bruker Daltonics) software. Masses were measured from 2 to 20k Dalton. For peak evaluation, mass peak range from 2 to 10k Dalton was analyzed using a centroid peak detection algorithm, a signal to noise threshold of 2 and a minimum intensity threshold of 600, with a peak resolution higher than 400. Proteins/Oligonucleotide method was employed for fuzzy control with a maximal resolution 10 times above the threshold. For a sum spectrum, 240 satisfactory shots were summed up. One mass spectrum was measured for each specimen.</p>
<p>If retained after extraction of proteomic data, exuviae were stored in 70% ethanol at Senckenberg German Centre for Marine Biodiversity Research (DZMB, Wilhelmshaven, Germany).</p>
</sec>
<sec id="S2.SS3">
<title>DNA Isolation, PCR Amplification, and Sequencing for Reference DNA Libraries</title>
<p>18S rRNA (V1 and V2 hypervariable regions, &#x223C;380 bp) was amplified using SSU-F04 forward primer (5&#x2032;-GCTTGTCTCAAAGATTAAGCC-3&#x2032;) and SSU-R22 reverse primer (5&#x2032;-GCCTGCTGCCTTCCTTGGA-3&#x2032;) (<xref ref-type="bibr" rid="B4">Blaxter et al., 1998</xref>) and were used as reference library for metabarcoding.</p>
<p>DNA was extracted from individual specimens using 20 &#x03BC;l InstaGene matrix (Bio-Rad Laboratories, Munich, Germany) in a vapo.protect Mastercycler pro S Cycler (Eppendorf, Hamburg, Germany) for 50 min at 56&#x00B0;C and 10 min at 96&#x00B0;C. The prosome body part was used for MALDI-TOF MS and urosome body part for extraction of DNA for simultaneous use of one specimen for proteomics and DNA sequencing. If retained after DNA extraction, exuviae were stored in 70% ethanol at Senckenberg German Centre for Marine Biodiversity Research.</p>
<p>Amplification of DNA fragments was done in a total reaction volume of 20 &#x03BC;l, containing 10 &#x03BC;l AccuStart II PCR ToughMix (QuantaBio, Beverly, MA, United States), 0.2 &#x03BC;l primers (20 pmol/&#x03BC;l), 2 to 5 &#x03BC;l DNA extract and the respective amount of molecular grade water. Amplifications were carried out in a vapo.protect Mastercycler pro S (Eppendorf, Hamburg, Germany) for both gene fragments.</p>
<p>Cycler settings for amplification of 18S fragment were: an initial denaturation step at 94&#x00B0;C for 3 minutes (min), denaturation at 94&#x00B0;C for 30 seconds (s), annealing at 57&#x00B0;C for 50 s and elongation at 72&#x00B0;C for 60 s. In total, 35 amplification cycles were carried out ending in a final elongation step for 2 min at 72&#x00B0;C.</p>
<p>Negative control samples were included in all amplification runs. From each PCR product, 2 &#x03BC;l were verified for size conformity by electrophoresis in a 1% agarose gel stained with GelRED<sup>TM</sup> using commercial DNA size standards.</p>
<p>PCR products were purified and sequenced at a contract sequencing facility (Macrogen Europe, Amsterdam, Netherlands). Trace files were assembled with SeqTrace (<xref ref-type="bibr" rid="B61">Stucky, 2012</xref>) and aligned in SeaView (<xref ref-type="bibr" rid="B21">Gouy et al., 2010</xref>). Sequences were checked for the amplification of the correct gene fragment by Blast search (<xref ref-type="bibr" rid="B70">Zhang et al., 2000</xref>; <xref ref-type="bibr" rid="B46">Morgulis et al., 2008</xref>).</p>
<p>18S rRNA gene fragments were amplified from seven harpacticoid species presented in the NGS library comprising <italic>Tachidius discipes</italic> Giesbrecht, 1881; <italic>Harpacticus flexus</italic> Brady &#x0026; Robertson, 1873<italic>; Asellopsis intermedia</italic> (Scott, 1895)<italic>; Laophonte</italic> sp.; <italic>Platychelipus littoralis</italic> Brady, 1880; <italic>Delavalia palustris</italic> Brady, 1868 and Ectinosomatidae sp. DNA amplification failed for the single specimen of <italic>D. palustris</italic>; hence, the 18S fragment was amplified using specimens of a former project (<xref ref-type="table" rid="T1">Table 1</xref>). Two of the 18S sequences from the selected specimens have shown the Q30 lower than optimal at both 5&#x2032; and 3&#x2032; end of the sequence immediately after and before the primer binding regions. To produce a reference library covering the full fragment size according to NGS libraries, the representative sequence of each species (with 100% similarity match) was retrieved from the Illumina reads.</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Specimens for which an 18S gene fragment was amplified with the according GenBank accession numbers.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="justify"><bold>Specimen</bold></td>
<td valign="top" align="justify"><bold>Species</bold></td>
<td valign="top" align="justify"><bold>Accession number</bold></td>
<td valign="top" align="justify"><bold>Specimen retrieved from</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="justify">DP_332</td>
<td valign="top" align="justify"><italic>Asellopsis intermedia</italic></td>
<td valign="top" align="justify">MK972336</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_333</td>
<td valign="top" align="justify"><italic>Asellopsis intermedia</italic></td>
<td valign="top" align="justify">MK972335</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_334</td>
<td valign="top" align="justify"><italic>Harpacticus flexus</italic></td>
<td valign="top" align="justify">MK972342</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_335</td>
<td valign="top" align="justify"><italic>Harpacticus flexus</italic></td>
<td valign="top" align="justify">MK972341</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_336</td>
<td valign="top" align="justify"><italic>Tachidius discipes</italic></td>
<td valign="top" align="justify">MK972346</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_337</td>
<td valign="top" align="justify"><italic>Tachidius discipes</italic></td>
<td valign="top" align="justify">MK972345</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_338</td>
<td valign="top" align="justify"><italic>Tachidius discipes</italic></td>
<td valign="top" align="justify">MK972344</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_339</td>
<td valign="top" align="justify"><italic>Laophonte</italic> sp.</td>
<td valign="top" align="justify">MK972343</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_340</td>
<td valign="top" align="justify"><italic>Ectinosomatidae</italic> sp. <italic>38</italic></td>
<td valign="top" align="justify">MK972340</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_341</td>
<td valign="top" align="justify"><italic>Ectinosomatidae</italic> sp. <italic>2</italic></td>
<td valign="top" align="justify">MK972339</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_342</td>
<td valign="top" align="justify"><italic>Ectinosomatidae</italic> sp. <italic>2</italic></td>
<td valign="top" align="justify">MK972337</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_343</td>
<td valign="top" align="justify"><italic>Ectinosomatidae</italic> sp. <italic>2</italic></td>
<td valign="top" align="justify">MK972338</td>
<td valign="top" align="justify">This study</td>
</tr>
<tr>
<td valign="top" align="justify">DP_015</td>
<td valign="top" align="justify"><italic>Delavalia palustris</italic></td>
<td valign="top" align="justify">MK919202</td>
<td valign="top" align="justify"><xref ref-type="bibr" rid="B54">Rossel and Mart&#x00ED;nez Arbizu (2019)</xref></td>
</tr>
<tr>
<td valign="top" align="justify">DP_016</td>
<td valign="top" align="justify"><italic>Delavalia palustris</italic></td>
<td valign="top" align="justify">MK919204</td>
<td valign="top" align="justify"><xref ref-type="bibr" rid="B54">Rossel and Mart&#x00ED;nez Arbizu (2019)</xref></td>
</tr>
<tr>
<td valign="top" align="justify">SR_470</td>
<td valign="top" align="justify"><italic>Delavalia palustris</italic></td>
<td valign="top" align="justify">MK919203</td>
<td valign="top" align="justify"><xref ref-type="bibr" rid="B54">Rossel and Mart&#x00ED;nez Arbizu (2019)</xref></td>
</tr>
</tbody>
</table></table-wrap>
</sec>
<sec id="S2.SS4">
<title>Processing of MALDI-TOF Mass Spectra</title>
<p>Mass spectrometry data from all samples were processed together in R (version 3.2.3, <xref ref-type="bibr" rid="B50">R Core Team. (2018)</xref> using packages &#x2018;MALDIquant&#x2019; (<xref ref-type="bibr" rid="B20">Gibb and Strimmer, 2012</xref>) and &#x2018;MALDIquantForeign&#x2019; (<xref ref-type="bibr" rid="B19">Gibb, 2015</xref>). Protein mass spectra were trimmed to an identical range from 2,000 to 20,000 m/z and smoothed with the Savitzky-Golay method (<xref ref-type="bibr" rid="B57">Savitzky and Golay, 1964</xref>). The baseline was removed based on SNIP baseline estimation method (<xref ref-type="bibr" rid="B55">Ryan et al., 1988</xref>) and spectra were normalized using the TIC method implemented in MALDIquant. Noise estimation was carried out with a signal to noise ratio (SNR) of 7. Peaks were repeatedly binned using command &#x2018;binpeaks&#x2019; with a tolerance of 0.002 in a strict approach to the number of peaks for the whole data set was reduced from 9344 to 652 peaks. The resulting intensity matrix was Hellinger transformed (<xref ref-type="bibr" rid="B38">Legendre and Gallagher, 2001</xref>) for further use in Random Forest (RF) (<xref ref-type="bibr" rid="B7">Breimann, 2001</xref>) analysis.</p>
</sec>
<sec id="S2.SS5">
<title>Random Forest Analysis</title>
<p>Based on the library (<italic>n</italic> = 115) an RF model was calculated using &#x2018;randomForest&#x2019; R package (<xref ref-type="bibr" rid="B40">Liaw and Wiener, 2002</xref>) to classify specimens from the test samples (<xref ref-type="fig" rid="F1">Figure 1</xref>). The model was generated using 2,000 trees with 35 analyzed characters at each tree split. To prevent overestimation of frequent species, &#x2018;sampsize&#x2019; was set to 1.</p>
<p>RF classifications were tested using the <italic>post hoc</italic> test sensu <xref ref-type="bibr" rid="B52">Rossel and Mart&#x00ED;nez Arbizu (2018a)</xref> with a 1% quantile as the threshold for false positive classification. The function rf.post.hoc is available from the R package Rftools (<xref ref-type="bibr" rid="B41">Mart&#x00ED;nez Arbizu and Rossel, 2018</xref>). RF classifications rejected by the <italic>post hoc</italic> test were morphologically re-examined (<xref ref-type="fig" rid="F1">Figure 1</xref>). For species with only one specimen in the reference library, a <italic>post hoc</italic> test could not be carried out. Hence, all specimens classified as this species were automatically regarded as false positive classifications and subsequently re-examined morphologically (<xref ref-type="fig" rid="F1">Figure 1</xref>).</p>
</sec>
<sec id="S2.SS6">
<title>NGS, Library Preparation</title>
<p>Five samples were prepared for metabarcoding containing selected specimens which were identified to the species level using a dissecting microscope. Specimens from one sample were pooled together and DNA was extracted from the pooled sample (<xref ref-type="bibr" rid="B18">Fontaneto et al., 2015</xref>) using E.Z.N.A. Mollusc DNA Kit (Omega Bio-tek).</p>
<p>A short fragment (&#x223C;380 bp) including the hypervariable regions V1 and V2 of the 18S gene (see <xref ref-type="bibr" rid="B24">Hadziavdic et al., 2014</xref>) was amplified using the primers SSUF04 and SSUR22 (<xref ref-type="bibr" rid="B4">Blaxter et al., 1998</xref>) in which the Nextera compatible Illumina adapter overhang sequences were added to the 5&#x2032; end of the locus-specific primers following the Illumina 16S Metagenomic Sequencing Library Preparation guide (15044223Rev.B), resulting in following composite primers:</p>
<list list-type="simple">
<list-item><p>5&#x2032;-TCGTCGGCAGCGTCAGATGTGTATAAGAGACAG-<bold>SSUF04</bold>,</p>
</list-item>
<list-item><p>5&#x2032;-GTCTCGTGGGCTCGGAGATGTGTATAAGAGACAG-<bold>SSUR22</bold>.</p>
</list-item>
</list>
<p>The first PCR was performed using the composite primers and Phusion High-Fidelity PCR Master Mix (Thermo Fisher) using 2 &#x03BC;l of template DNA and 0.5 &#x03BC;l of each primer (10 pmol) in a final 20 &#x03BC;l reaction volume with following protocol: initial denaturation for 2 min and 10 cycles of denaturation at 98&#x00B0;C for 15 s, annealing at 62&#x00B0;C for 30 s, extension at 72&#x00B0;C for 30 s followed by a final extension of 4 min.</p>
<p>Five &#x03BC;l of the first PCR products were purified using 2 &#x03BC;l of ExoSAP-IT PCR Product Cleanup Reagent (Thermo Fisher) following incubation of 5 min at 37&#x00B0;C and 1 min at 80&#x00B0;C.</p>
<p>A second PCR using Nextera XT V2 Indexed primers (dual indexing approach) was performed using 7 &#x03BC;l of the purified first PCR amplicons, 0.5 &#x03BC;l of each primer (10 pmol) in a final volume of 20 &#x03BC;l, and 10 amplification cycles of using the PCR protocol above. Incorporation of the full Illumina adapter to the amplicon was checked by comparing the length of the fragments of the 1<sup><italic>st</italic></sup> and 2<sup><italic>nd</italic></sup> PCR in a 1% Agarose Gel stained with 1% Gel Red. The amplicons from second PCR were purified from 1% agarose gel using Monarch DNA Gel Extraction Kit (NEB).</p>
</sec>
<sec id="S2.SS7">
<title>NGS, Sequencing, and Bioinformatics</title>
<p>DNA concentration of each amplicon from second PCR was measured after extracting from agarose gel with Qubit Fluorometer using Qubit dsDNA High Sensitivity (HS) Assay (Thermo Fisher). For normalization, libraries were diluted to a concentration of 4 nM/&#x03BC;l and pooled together with libraries from another project at equal molarity. Five &#x03BC;l of the 4 nM pooled library was denatured into single stranded DNA using 5 &#x03BC;l of NaOH 0.2M and diluted to 20 pmol concentration using 990 &#x03BC;l of Hyb1 buffer (Illumina). To increase the diversity in the first sequencing runs, 10% volume of 20 pmol PhiX control was spiked into the library. The spiked Library was further diluted to 17 pmol prior sequencing on a MiSeq using V3 chemistry and 301 paired-end read frame.</p>
<p>The Illumina reads were processed using VSEARCH (<xref ref-type="bibr" rid="B51">Rognes et al., 2016</xref>) following the pipeline found at <ext-link ext-link-type="uri" xlink:href="https://github.com/torognes/vsearch/wiki/VSEARCH-pipeline">https://github.com/torognes/vsearch/wiki/VSEARCH-pipeline</ext-link>. Initially paired-end reads were used to create contigs for each sample with following settings: expected mean size 400 bp, allowed variation: &#x00B1; 50 bp, minimum contig overlap: 50 bp, maximum allowed differences in the contig: 15 bp. Contigs were quality filtered with: maximum expected errors after contig creation: 0.5, maximum ambiguities in the contig: 0. Contigs were then de-replicated using two minimum counts to create a unique sequence. The initial OTU library was created by pooling all de-noised and de-replicated reads from all samples together and performing an initial clustering at 98% similarity. Then chimeras were detected and excluded. This final OTU library was used to create an OTU table by assigning the reads of the individual samples to OTUs at 97% similarity threshold. The generated OTUs have been clustered according to the reference library at the minimum identity of 97 and 100% length coverage.</p>
<p>The OTU table was analyzed with R package vegan (<xref ref-type="bibr" rid="B49">Oksanen et al., 2013</xref>). We tested four different transformations of the data in order to check which of them produces a higher similarity between community structure present in the sample (number of counts per specimen) and results of metabarcoding. The transformations applied were Chord (divide by total <italic>n</italic> per sample), Hellinger (square root of Chord), log(x + 1) and presence/absence. For each transformation, Spearman rank correlation between the similarity of samples based morphological identification and similarity based on metabarcoding results was tested with the Mantel test (function mantel in vegan). Community similarity was depicted using bar plots and non-metric multidimensional scaling (nMDS) (function metaMDS in vegan).</p>
</sec>
<sec id="S2.SS8">
<title>Comparison of Expenses</title>
<p>Expenses of different methods were calculated including kits, chemicals and prices for sequencing, excluding costs for pipette tips, microcentrifuge tubes, or instruments. For DNA barcoding, cost-effective chelex DNA extraction, plate purification and sequencing services were considered for calculations. Expenses of approaches using different volumes of matrix to adjust for specimen size and also matrix prices from different providers were analyzed for MALDI-TOF MS. Different indices kits for analysis of 24 or 96 samples simultaneously were compared for metabarcoding. Detailed information on the calculation of prices can be found in the supplementary (<xref ref-type="supplementary-material" rid="TS1">Supplementary Tables S1</xref>&#x2013;<xref ref-type="supplementary-material" rid="TS3">S3</xref>).</p>
</sec>
</sec>
<sec id="S3">
<title>Results</title>
<sec id="S3.SS1">
<title>MALDI-TOF MS</title>
<p>The RF analysis was carried out based on a library containing 115 specimens of eight species (<xref ref-type="table" rid="T2">Table 2</xref>), including specimens for which DNA was extracted and a mass spectrum was measured simultaneously. However, test samples contained two further species, which were not part of the library (<italic>Enhydrosoma gariene</italic> Gurney, 1930, <italic>P. littoralis</italic>). Hence, the library was considered incomplete. Abundances in the test samples analyzed ranged from one specimen for <italic>Laophonte</italic> sp. and Ectinosomatidae sp. 38 to 19 for <italic>H. flexus</italic> (<xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Number of specimens identified for all samples morphologically (M) and classified by Random Forest (RF).</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left"><graphic xlink:href="fmars-06-00659-t001.jpg"/></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>The number of classifications rejected by the <italic>post hoc</italic> test (FP) and the number of specimens per species after re-examination (FP &#x2013; reviewed) are summarized. Specimens rejected by the post-test are combined in the column unknown (U). Specimen numbers marked with red are misclassifications by Random Forest. Specimen numbers marked with gray are specimens recognized as false positive classifications.</italic></attrib>
</table-wrap-foot>
</table-wrap>
<p>The incomplete library was used to calculate an RF model (<italic>n</italic> = 115, training error: 0.87%). This model was employed to classify specimens from the test samples (<xref ref-type="table" rid="T2">Table 2</xref>: RF). In total, of 133 specimens, five (3.76%) were misclassified by the RF model because the correct species was not part of the initial model. In the classification approach, one <italic>E. gariene</italic> and three <italic>P. littoralis</italic> specimens were misclassified as <italic>Laophonte</italic> spec., and a fourth <italic>P. littoralis</italic> specimen was classified as <italic>Microarthridion fallax</italic> Perkins, 1956. However, all of these classifications were rejected by the <italic>post hoc</italic> test (<xref ref-type="table" rid="T2">Tables 2</xref>, <xref ref-type="table" rid="T3">3</xref>: FP) and could be morphologically re-examined to verify they belonged to species absent from the reference library (<xref ref-type="table" rid="T2">Table 2</xref>: FP &#x2013; reviewed). Besides these, all specimens were classified correctly by Random Forest, including those species for which only one specimen was contained in the reference library (<italic>Laophonte</italic> sp., Ectinosomatidae sp. 38, and <italic>D. palustris</italic>). As described above, these were automatically recognized as false positives by the <italic>post hoc</italic> test and hence had to be re-examined mor.phologically. This confirmed the initial RF classification.</p>
<table-wrap position="float" id="T3">
<label>TABLE 3</label>
<caption><p>Number of specimens present in the samples refers to metabarcoding and the resulting number of reads per sample.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="justify"><bold>Species</bold></td>
<td valign="top" align="center"><bold>AS_r</bold></td>
<td valign="top" align="center"><bold>AS_s</bold></td>
<td valign="top" align="center"><bold>AT_r</bold></td>
<td valign="top" align="center"><bold>AT_s</bold></td>
<td valign="top" align="center"><bold>AU_r</bold></td>
<td valign="top" align="center"><bold>AU_s</bold></td>
<td valign="top" align="center"><bold>AV_r</bold></td>
<td valign="top" align="center"><bold>AV_s</bold></td>
<td valign="top" align="center"><bold>AW_r</bold></td>
<td valign="top" align="center"><bold>AW_s</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><italic>Asellopsis intermedia</italic></td>
<td valign="top" align="center">13522</td>
<td valign="top" align="center">10</td>
<td valign="top" align="center">46955</td>
<td valign="top" align="center">24</td>
<td valign="top" align="center">3566</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">4663</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center">1308</td>
<td valign="top" align="center">4</td>
</tr>
<tr>
<td valign="top" align="left">Ectinosomatidae sp. 2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">14177</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><italic>Harpacticus flexus</italic></td>
<td valign="top" align="center">171904</td>
<td valign="top" align="center">32</td>
<td valign="top" align="center">8104</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">71551</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center">181858</td>
<td valign="top" align="center">12</td>
</tr>
<tr>
<td valign="top" align="left"><italic>Laophonte</italic> sp.</td>
<td valign="top" align="center">1986</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">34</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">886</td>
<td valign="top" align="center">1</td>
</tr>
<tr>
<td valign="top" align="left"><italic>Platychelipus littoralis</italic></td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">28926</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
</tr>
<tr>
<td valign="top" align="left"><italic>Delavalia palustris</italic></td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">1092</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">0</td>
<td valign="top" align="center">123</td>
<td valign="top" align="center">1</td>
</tr>
<tr>
<td valign="top" align="left"><italic>Tachidius discipes</italic></td>
<td valign="top" align="center">472171</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">523901</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">507547</td>
<td valign="top" align="center">20</td>
<td valign="top" align="center">292783</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">454082</td>
<td valign="top" align="center">20</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>AS-AW = sample name. Suffix &#x2018;_r&#x2019; means number of reads, &#x2018;_s&#x2019; means number of specimens.</italic></attrib>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS2">
<title>Metabarcoding</title>
<p>The final reference library generated by sanger sequencing produced reference sequences ranging from 344 bp in <italic>Laophonte</italic> sp. and 369 bp in <italic>D. palustris</italic>. The pure pairwise genetic distances between the seven species of the library range between a minimum of 5% and a maximum of 14.1%. This validated our OTU clustering threshold of 97% similarity.</p>
<p>The MiSeq run had a cluster density of 1,024 K/mm<sup>2</sup> generating 25.8 Million paired-end reads (92% cluster passing filter). From those, 69% (23.8 Million) passed the read filter and were de-multiplexed. The Hooksiel samples were multiplexed with a plankton metabarcoding project in the same run. A total of 5.6 million reads (23%) (between 3 and 5% or 1.2&#x2013;0.71 million reads per sample) were assigned to this study. Samples used for metabarcoding are called AS, AT, AU, AV, and AW. <xref ref-type="table" rid="T3">Table 3</xref> shows these samples as columns with the suffix &#x2018;_r&#x2019; for reads from metabarcoding or &#x2018;_s&#x2019; for specimens present in the sample. As DNA amplification from the only specimen of <italic>D. palustris</italic> failed, no reference for this species was available. Hence, metabarcoding failed to identify all species from the samples based on the incomplete reference library. However, the sequences of this species were assigned to a discrete MOTU, which could be further used for database searches or in general biodiversity assessments and comparisons. Adding genetic information for <italic>D. palustris</italic> from a previous project allowed further analyses of the data. With this, all seven species presented in the samples were detected by metabarcoding. However, <italic>H. flexus</italic> and <italic>Laophonte</italic> sp. Which were not included in the sample AU were recovered in the metabarcoding library by 14 reads each. Also <italic>P. littoralis</italic> has committed 3 and 1 reads from samples AT and AW, did not have any representative in the following reference libraries. <xref ref-type="fig" rid="F2">Figure 2</xref> shows the proportion of every species in the samples displaying the results of morphological identification (&#x2018;_s&#x2019;) and metabarcoding number of reads (&#x2018;_r&#x2019;) side by side to facilitate comparison. While Chord and Hellinger transformations show a certain similarity between the relative abundances of reads and specimens, the absolute values of relative abundances in a species by species comparison are still highly divergent. Remarkably, the relative abundance of <italic>A. intermedia</italic> (blue color in <xref ref-type="fig" rid="F2">Figure 2</xref>) is constantly underestimated by the number of metabarcoding reads, while <italic>T. discipes</italic> (yellow) is overrepresented by the number of reads. The best agreement between morphological community structures and metabarcoding results derived from a log(x + 1) transformation of the data. The agreement in the relative proportions of number of specimens and number of reads is high across samples and species. The presence/absence transformation shows exact agreement of the samples AT and AW, and slight disagreement in samples AT, AU, and AW as explained above.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Comparison of the number of reads (&#x2018;_r&#x2019;) to the number of morphologically identified specimens/species (&#x2018;_s&#x2019;) for all samples with four different data transformations. Of the four transformations, log(x + 1) transformation and working with presence/absence data reflect the relative abundance and the presence of species best.</p></caption>
<graphic xlink:href="fmars-06-00659-g002.tif"/>
</fig>
<p>The Mantel test evidences significant spearman correlation among the similarity between samples of morphology assignment and metabarcoding (values shown in <xref ref-type="fig" rid="F3">Figure 3</xref>) for Hellinger (<italic>r</italic> = 0.85, <italic>p</italic> = 0.042) and log(x + 1) (<italic>r</italic> = 0.9, <italic>p</italic> = 0.008) transformations, log(x + 1) over competing Hellinger transformation. However, Chord and presence/absence show no significant correlation in the Mantel test.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>nMDS plots depicting reads per sample (&#x2018;_r&#x2019;) and morphological species (&#x2018;_s&#x2019;) for the four different data transformation. Again, presences/absence and log(x + 1) transformed data are most congruent comparing specimen and species abundances/presence.</p></caption>
<graphic xlink:href="fmars-06-00659-g003.tif"/>
</fig>
<p>The nMDS plots (<xref ref-type="fig" rid="F3">Figure 3</xref>) show similarities of the samples based on community composition comparing morphological assessment and metabarcoding on the same ordination. The nMDS of the Chord transformed data appears visually as the worst of the three quantitative transformations (evidenced also by the non-significant mantel test). There is a raw agreement in the relative position of AU (green), AV (purple) and AS (blue), but AW (orange) and AT (red) show disagreement in the relative position between treatments. Interestingly, Hellinger transformation separates the treatments in ordination space, the samples from the metabarcoding (circles) showing less multivariate dispersal and located at the top-right quarter of the plot. The relative position of the samples to each other greatly agrees between treatments. The log(x + 1) nMDS plots shows the best agreement in the position of the samples in ordination space between the treatments. The couples of samples AV, AU appear close to each other and AT and AS show similar pattern. The nMDS with presence/absence data show complete agreement in samples AV and AS and lacks agreement in all others.</p>
</sec>
</sec>
<sec id="S4">
<title>Discussion</title>
<sec id="S4.SS1">
<title>MALDI-TOF MS</title>
<p>Based on MALDI-TOF mass spectra using RF and the <italic>post hoc</italic> test, all specimens were correctly identified. In contrast to the time demanding morphological identification, the <italic>post hoc</italic> test false positive assignment of the RF classification has greatly simplified and enhanced detection of the community composition and diversity assessments of the samples. Retaining the exuviae during the procession of specimens for MALDI-TOF MS has ensured the correct taxonomic assignment. Indeed an incomplete reference library, would lead to the misclassification of the specimens from the test samples according to the species available in the model. However, all of these classifications were recognized by the post-test and a subsequent morphological re-examination was carried out, identifying these specimens as new species. Therefore, it was shown that classification by RF using a post-test is also able to reveal species, which are new to the dataset. The results demonstrate the power of MALDI-TOF MS in combination with RF and the <italic>post hoc</italic> test for species identification based on an incomplete library as may be encountered when a new research area is accessed. According to the results, an incomplete library does not necessarily lead to misclassification of new species, which likely happens in unsupervised approaches like clustering algorithms (<xref ref-type="bibr" rid="B10">Collins and Cruickshank, 2013</xref>).</p>
<p>Therefore, even in new study areas, MALDI-TOF MS was found to be applicable by setting up a library from parts of the samples, accelerating biodiversity assessments by fast and reliable species identification compared to morphological assessments. Although one specimen per species was sufficient to create an RF model, which successfully classified all specimens of that species, using more specimens will certify the created RF model and implement a robust <italic>post hoc</italic> test to variability of the measured data.</p>
<p>Our results further align with low identification errors from other field studies of <xref ref-type="bibr" rid="B5">Bode et al. (2017)</xref> and <xref ref-type="bibr" rid="B30">Kaiser et al. (2018)</xref> on calanoid copepods or by <xref ref-type="bibr" rid="B31">Kaufmann et al. (2012)</xref> on biting midges (Diptera). However, most studies about metazoans using MALDI-TOF MS for species identification were pilot studies which did not provide biodiversity assessments (<xref ref-type="bibr" rid="B31">Kaufmann et al., 2012</xref>; <xref ref-type="bibr" rid="B65">Volta et al., 2012</xref>; <xref ref-type="bibr" rid="B36">Laakmann et al., 2013</xref>; <xref ref-type="bibr" rid="B48">M&#x00FC;ller et al., 2013</xref>; <xref ref-type="bibr" rid="B60">Steinmann et al., 2013</xref>; <xref ref-type="bibr" rid="B67">Yssouf et al., 2013</xref>, <xref ref-type="bibr" rid="B68">2014a</xref>,<xref ref-type="bibr" rid="B69">b</xref>; <xref ref-type="bibr" rid="B13">Dieme et al., 2014</xref>; <xref ref-type="bibr" rid="B42">Mathis et al., 2015</xref>; <xref ref-type="bibr" rid="B29">Hynek et al., 2018</xref>), making it difficult to compare results to existing literature. Nevertheless, all studies carried out so far provide high identification success making MALDI-TOF MS a promising tool for biodiversity assessments.</p>
</sec>
<sec id="S4.SS2">
<title>Metabarcoding</title>
<p>Our study showed the ability of metabarcoding to detect all species present in the samples including low abundant species as can be seen in <xref ref-type="table" rid="T3">Table 3</xref>. However, only a complete reference library can assure correct taxonomic assignment of the detected MOTUs to species. Because the public DNA depositories contain only partial records especially in case of meiofauna communities, enriching the reference libraries is crucial to assure factual diversity obtained by metabarcoding approach. Concerning the result of this study, the reads of <italic>D. palustris</italic>, the species missing from the reference library during the initial analyses, were clustered into a discrete MOTU, which further confirms the ability of metabarcoding using V1 and V2 hypervariable region of 18S in 97% pairwise similarity to discriminate the sequences into species. In congruence with previous metabarcoding studies (<xref ref-type="bibr" rid="B22">Guardiola et al., 2015</xref>; <xref ref-type="bibr" rid="B12">De Faria et al., 2018</xref>; <xref ref-type="bibr" rid="B23">G&#x00FC;nther et al., 2018</xref>), we further suggest the successful use of 18S gene especially in case of metabarcoding of meiofauna communities in which amplification of COI barcode region has shown to be less successful for some organisms such as nematodes (<xref ref-type="bibr" rid="B25">Haenel et al., 2017</xref>). <italic>Laophonte</italic> sp. and <italic>D. palustris</italic> were presented with a single specimen in the libraries AS, AT, AW and AT, AW respectively and were recovered with the number of reads ranging from 34 to 1986, suggesting that, apart from the biomass which can effectively alter the number of reads (objective from <italic>A. intermedia</italic>, <italic>H. flexus</italic>, and <italic>T. discipes</italic>), other factors can also have influence on the absolute number of reads per MOTU.</p>
<p>As can be seen from <xref ref-type="table" rid="T3">Table 3</xref> three species that were not present in the respective samples were recovered by metabarcoding with low number of reads. Sample AU had no <italic>H. flexus</italic> and <italic>Laophonte</italic> sp., however the species were recorded with 14 reads each. <italic>P. littoralis</italic>, which had no specimen in samples AT and AW, was recorded with 3 and 1 reads respectively. There are variety of reasons to explain the presence of these reads in the samples, the most probable explanations in our view being misassignment during de-multiplexing due to sequencing error in the index regions (<xref ref-type="bibr" rid="B32">Kircher et al., 2011</xref>) or tag jumping (<xref ref-type="bibr" rid="B58">Schnell et al., 2015</xref>). The wrong assignment of species to samples could be overcome by establishing a minimum number of reads to be achieved for a positive species assignment. The numbers of reads of wrong assignments are the lowest in the dataset (<xref ref-type="table" rid="T3">Table 3</xref>) ranging from 1 to 14 reads, which is less than the 34&#x2013;1986 reads achieved when a single specimen was present (see above). However, we do not have an objective method for establishing a fixed threshold value for eliminating these reads. The threshold may change from study to study and even between sequencing runs of the same library. The wrong assignment of these species is the reason for the low performance of the presence/absence transformation, which otherwise would be very promising.</p>
<p>From the three quantitative transformations tested here, the log(x + 1) shows the best correlation between the similarity of samples based on morphological assignment and metabarcoding. Both the bar plot (<xref ref-type="fig" rid="F2">Figure 2</xref>) and the multivariate nMDS plot (<xref ref-type="fig" rid="F3">Figure 3</xref>) evidence greatest agreement with this transformation. Remarkably, the comparison of community structure between samples suggests the same ecological conclusion with both treatments. The samples AS and AW are converged while samples AU and AV are more divergent. Although there seems to be agreement that metabarcoding cannot estimate the absolute abundance of species in the samples (<xref ref-type="bibr" rid="B14">Elbrecht and Leese, 2015</xref>), our results show that the log(x + 1) transformation is accurate in estimating at least the relative abundance of the species within samples. The number of reads is most probably correlated to biomass, rather than abundance. The relatively low difference in biomass between the harpacticoid species analyzed here could be the reason for high quantitative agreements between abundances and number of reads after log(x + 1) transformation.</p>
</sec>
<sec id="S4.SS3">
<title>MALDI-TOF MS vs. Barcoding vs. Metabarcoding</title>
<p>In this study, reliable results have been obtained from MALDI-TOF MS and metabarcoding for species identification in biodiversity assessments in an unexplored study area. Our results show that metabarcoding finds all of the species recorded morphologically if contained in a previously generated reference library. However, in studies lacking a rich reference library, metabarcoding can fail to connect the obtained sequences to morphospecies. Nevertheless, metabarcoding of bulk samples was found to reveal overseen diversity (<xref ref-type="bibr" rid="B39">Leray and Knowlton, 2015</xref>; <xref ref-type="bibr" rid="B17">Fonseca V. et al., 2017</xref>); for example, Platyhelminthes were excessively found by metabarcoding studies but less frequently by morphological analyses (<xref ref-type="bibr" rid="B3">Blaxter, 2016</xref>).</p>
<p>Regarding to the DNA barcoding, the delimitation thresholds defined by the user may under- or over-estimate the diversity (<xref ref-type="bibr" rid="B9">Carugati et al., 2015</xref>) because of varying inter- and intra-specific genetic distances (<xref ref-type="bibr" rid="B8">Bucklin et al., 2010</xref>). In addition, the effort, which has to be considered in case of DNA barcoding to sort out every individual, DNA extraction and PCRs, is considerably higher than both metabarcoding and MALDI-TOF.</p>
<p>MALDI-TOF MS and COI barcoding, however, can only analyze the submitted specimens; any diversity beyond this is disregarded. An overseen assignment due to uncovered very similar morphospecies can be re-checked for detection of minor morphological differences afterward. Therefore, assessed data is always related to an actual specimen and not only to a substitutional DNA sequence, fostering a better understanding.</p>
<p>Connectivity, population structures or phylogenetic relationships can only be analyzed employing DNA-based methods and more genetic markers amplified from available DNA extracts (<xref ref-type="bibr" rid="B59">Selkoe et al., 2016</xref>). Therefore, at the beginning of a study, it should be secured that the chosen method for species identification is the suitable one because MALDI-TOF MS can only be used to recognize species and different developmental stages (<xref ref-type="bibr" rid="B36">Laakmann et al., 2013</xref>; <xref ref-type="bibr" rid="B5">Bode et al., 2017</xref>) while metabarcoding assesses general biodiversity only.</p>
<p>Simultaneous use of individuals for barcoding and analysis in MALDI-TOF MS was shown several times (e.g., <xref ref-type="bibr" rid="B36">Laakmann et al., 2013</xref>; <xref ref-type="bibr" rid="B5">Bode et al., 2017</xref>; <xref ref-type="bibr" rid="B53">Rossel and Mart&#x00ED;nez Arbizu, 2018b</xref>; <xref ref-type="bibr" rid="B54">Rossel and Mart&#x00ED;nez Arbizu, 2019</xref>) even for small animals such as copepods, implying a possible combination of MALDI-TOF MS and DNA barcoding for biodiversity assessments and monitoring. Voucher specimens can be analyzed by MALDI-TOF MS and sequenced simultaneously to support identifications based on mass spectra by DNA without causing high costs by barcoding of all assessed specimens. Because MALDI-TOF MS provides a discrete species-specific signal, pitfalls for underestimating species diversity are avoided.</p>
<p>Unfortunately, obtaining DNA and mass spectra data from a single microscopic animal while retaining an intact voucher specimen for microscopic examination, has not been developed yet. Therefore, a subsequent comparison between morphological, DNA-based and MS-based methods is, yet, not possible for single specimens after measurements were carried out.</p>
</sec>
<sec id="S4.SS4">
<title>Expenses</title>
<p>Based on our workflow and expenses, here we calculated the costs of single gene barcoding (e.g., COI barcoding), metabarcoding and MALDI-TOF MS (<xref ref-type="fig" rid="F4">Figure 4</xref>) with hypothetical samples containing 96 specimens each. Although cost comparison strongly depends on the country where the study and analyses were carried out, the comparison can give a good impression of the difference in costs raised for the different applied methods. However, one has to be aware, that displayed costs will probably not reflect the actual costs in every country.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Comparison of expenses of the different species identification methods for hypothetical samples containing 96 specimens each. Set-ups for 24 and 96 samples were compared for metabarcoding. Besides the factory-delivered matrix for MALDI-TOF MS, cheaper competitive products are available, allowing identification of 9,216 specimens for less than 250&#x20AC;. In actual studies, metabarcoding would analyze 100s and 1000s of specimens within a single sample and would outperform the other techniques in terms of costs. Here, hypothetical samples were used to allow comparisons.</p></caption>
<graphic xlink:href="fmars-06-00659-g004.tif"/>
</fig>
<p>Metabarcoding is barely comparable to the other techniques considering the batch sample workflow. Using unsorted bulk samples, metabarcoding will outperform the other techniques in terms of costs and effort because especially in meiofauna biodiversity assessments, single samples can contain 1000s of specimens of different major taxa and species. However, the research questions and the desired output have to be considered, to justify possible high costs and effort caused by the method applied.</p>
<p>When comparing the two specimen-by-specimen methods, it is obvious that even the most expensive MALDI-TOF approach is still much cheaper than COI barcoding (<xref ref-type="fig" rid="F4">Figure 4</xref>). Working plate-wise using 4 &#x03BC;l factory delivered matrix solution per specimen, one complete plate containing 95 specimens and one spot with bacterial standard (used for calibration) sums to only 40.15&#x20AC; (0.42&#x20AC; per specimen). In comparison to this, processing 96 specimens plate wise for COI barcoding including two directional sequencing costs 5.65&#x20AC; per specimen. This adds up to more than 10-fold the price for MALDI-TOF MS. However, cheaper alternatives for MALDI-TOF MS are available. Competitive matrix can be purchased, reducing the costs per plate to 12.18&#x20AC; while retaining the same purity of the solution. Less pure matrix can reduce the costs even more, to only 2.53&#x20AC; per plate (0.03&#x20AC; per specimen) and first tests showed no loss of signal quality, compared to the factory delivered matrix. This allows the identification of more than 9,000 specimens for only around 250&#x20AC;. Moreover, the volume of matrix should be adjusted to specimen size, thus it often has to be reduced to 3 or 2 &#x03BC;l, cutting the costs to around 187&#x20AC; or 125&#x20AC; respectively. Considering that barcoding of voucher specimens only was shown to underestimate true species diversity, MALDI-TOF MS provides a valuable alternative when assessing species diversities specimen-by-specimen because all specimens can be measured without causing high costs.</p>
</sec>
</sec>
<sec id="S5">
<title>Conclusion</title>
<p>Metabarcoding is a promising tool to assess general diversity without emphasizing a certain animal group. Here we demonstrated that metabarcoding can detect species occurring in low biomass and abundances. However, providing several replicates from a sampling site is strongly recommended to produce a rich and complete reference library simultaneously, to be used for MOTU assignment for metabarcoding.</p>
<p>Our study shows that log(x + 1) transformation of the data produces multivariate community similarities that highly correlate with the morphological assignment. However, if a precise quantitative analysis of species and specimens is desired, MALDI-TOF MS is superior to metabarcoding as it results in more discrete quantitative results. Also, MALDI-TOF MS can overcome the COI barcoding as it is significantly cheaper and provides, with a good quality library, equally reliable species identifications within a considerably shorter time.</p>
</sec>
<sec id="S6">
<title>Data Availability Statement</title>
<p>18S sequences are accessible via GenBank. Hellinger transformed data matrix containing all submitted MALDI-TOF MS spectra and respective metadata are available as a data set on dryad (<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5061/dryad.rxwdbrv46">doi: 10.5061/dryad.rxwdbrv46</ext-link>). Raw data can also be accessed via dryad (<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5061/dryad.rxwdbrv46">doi: 10.5061/dryad.rxwdbrv46</ext-link>).</p>
</sec>
<sec id="S7">
<title>Author Contributions</title>
<p>SR, PM, and SK designed the study. SR and PM carried out the sampling. SR did the morphological identifications and setup of the reference libraries, and measured and analyzed the MALDI-TOF MS data. PM and SK carried out the metabarcoding analyses. SK and PM analyzed the metabarcoding data. All authors contributed to the writing of the manuscript.</p>
</sec>
<sec id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> SR was supported by a grant of Graduate School IBR from the Ministry for Science and Culture of Lower Saxony (IBR B7).</p>
</fn>
</fn-group>
<ack>
<p>This is publication no. 8 of Senckenberg am Meer Proteome Laboratory and publication no. 65 of Senckenberg am Meer Metabarcoding and Molecular Laboratory.</p>
</ack>
<sec id="S10" sec-type="supplementary material"><title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fmars.2019.00659/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fmars.2019.00659/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.XLSX" id="TS1" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_2.XLSX" id="TS2" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_3.XLSX" id="TS3" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Av&#x00F3;</surname> <given-names>A. P.</given-names></name> <name><surname>Daniell</surname> <given-names>T. J.</given-names></name> <name><surname>Neilson</surname> <given-names>R.</given-names></name> <name><surname>Oliveira</surname> <given-names>S.</given-names></name> <name><surname>Branco</surname> <given-names>J.</given-names></name> <name><surname>Ad&#x00E3;o</surname> <given-names>H.</given-names></name></person-group> (<year>2017</year>). <article-title>DNA barcoding and morphological identification of benthic nematodes assemblages of estuarine intertidal sediments: advances in molecular tools for biodiversity assessment.</article-title> <source><italic>Front. Mar. Sci.</italic></source> <volume>4</volume>:<issue>66</issue>.</citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barco</surname> <given-names>A.</given-names></name> <name><surname>Raupach</surname> <given-names>M. J.</given-names></name> <name><surname>Laakmann</surname> <given-names>S.</given-names></name> <name><surname>Neumann</surname> <given-names>H.</given-names></name> <name><surname>Knebelsberger</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). <article-title>Identification of North Sea molluscs with DNA barcoding.</article-title> <source><italic>Mol. Ecol. Resour.</italic></source> <volume>16</volume> <fpage>288</fpage>&#x2013;<lpage>297</lpage>. <pub-id pub-id-type="doi">10.1111/1755-0998.12440</pub-id> <pub-id pub-id-type="pmid">26095230</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blaxter</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Imagining sisyphus happy: DNA barcoding and the unnamed majority.</article-title> <source><italic>Phil. Trans. R. Soc. B</italic></source> <volume>371</volume>:<issue>20150329</issue>. <pub-id pub-id-type="doi">10.1098/rstb.2015.0329</pub-id> <pub-id pub-id-type="pmid">27481781</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blaxter</surname> <given-names>M. L.</given-names></name> <name><surname>De Ley</surname> <given-names>P.</given-names></name> <name><surname>Garey</surname> <given-names>J. R.</given-names></name> <name><surname>Liu</surname> <given-names>L. X.</given-names></name> <name><surname>Scheldeman</surname> <given-names>P.</given-names></name> <name><surname>Vierstraete</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>1998</year>). <article-title>A molecular evolutionary framework for the phylum Nematoda.</article-title> <source><italic>Nature</italic></source> <volume>392</volume> <fpage>71</fpage>&#x2013;<lpage>75</lpage>. <pub-id pub-id-type="doi">10.1038/32160</pub-id> <pub-id pub-id-type="pmid">9510248</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bode</surname> <given-names>M.</given-names></name> <name><surname>Laakmann</surname> <given-names>S.</given-names></name> <name><surname>Kaiser</surname> <given-names>P.</given-names></name> <name><surname>Hagen</surname> <given-names>W.</given-names></name> <name><surname>Auel</surname> <given-names>H.</given-names></name> <name><surname>Cornils</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <article-title>Unravelling diversity of deep-sea copepods using integrated morphological and molecular techniques.</article-title> <source><italic>J. Plankton Res.</italic></source> <volume>39</volume> <fpage>600</fpage>&#x2013;<lpage>617</lpage>. <pub-id pub-id-type="doi">10.1093/plankt/fbx031</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brannock</surname> <given-names>P. M.</given-names></name> <name><surname>Waits</surname> <given-names>D. S.</given-names></name> <name><surname>Sharma</surname> <given-names>J.</given-names></name> <name><surname>Halanych</surname> <given-names>K. M.</given-names></name></person-group> (<year>2014</year>). <article-title>High-throughput sequencing characterizes intertidal meiofaunal communities in northern Gulf of Mexico (Dauphin Island and Mobile Bay, Alabama).</article-title> <source><italic>Biol. Bull.</italic></source> <volume>227</volume> <fpage>161</fpage>&#x2013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.1086/bblv227n2p161</pub-id> <pub-id pub-id-type="pmid">25411374</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Breimann</surname> <given-names>L.</given-names></name></person-group> (<year>2001</year>). <article-title>Random Forests.</article-title> <source><italic>Mach. Learn.</italic></source> <volume>45</volume> <fpage>5</fpage>&#x2013;<lpage>32</lpage>.</citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bucklin</surname> <given-names>A.</given-names></name> <name><surname>Ortman</surname> <given-names>B. D.</given-names></name> <name><surname>Jennings</surname> <given-names>R. M.</given-names></name> <name><surname>Nigro</surname> <given-names>L. M.</given-names></name> <name><surname>Sweetman</surname> <given-names>C. J.</given-names></name> <name><surname>Copley</surname> <given-names>N. J.</given-names></name><etal/></person-group> (<year>2010</year>). <article-title>A &#x201C;Rosetta Stone&#x201D; for metazoan zooplankton: DNA barcode analysis of species diversity of the Sargasso Sea (Northwest Atlantic Ocean).</article-title> <source><italic>Deep Sea Res. Part II Top. Stud. Oceanogr.</italic></source> <volume>57</volume> <fpage>2234</fpage>&#x2013;<lpage>2247</lpage>. <pub-id pub-id-type="doi">10.1016/j.dsr2.2010.09.025</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carugati</surname> <given-names>L.</given-names></name> <name><surname>Corinaldesi</surname> <given-names>C.</given-names></name> <name><surname>Dell&#x2019;Anno</surname> <given-names>A.</given-names></name> <name><surname>Danovaro</surname> <given-names>R.</given-names></name></person-group> (<year>2015</year>). <article-title>Metagenetic tools for the census of marine meiofaunal biodiversity: an overview.</article-title> <source><italic>Mar. Genom.</italic></source> <volume>24</volume> <fpage>11</fpage>&#x2013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1016/j.margen.2015.04.010</pub-id> <pub-id pub-id-type="pmid">25957694</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Collins</surname> <given-names>R. A.</given-names></name> <name><surname>Cruickshank</surname> <given-names>R. H.</given-names></name></person-group> (<year>2013</year>). <article-title>The seven deadly sins of DNA barcoding.</article-title> <source><italic>Mol. Ecol. Resour.</italic></source> <volume>13</volume> <fpage>969</fpage>&#x2013;<lpage>975</lpage>. <pub-id pub-id-type="doi">10.1111/1755-0998.12046</pub-id> <pub-id pub-id-type="pmid">23280099</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Bruyne</surname> <given-names>K.</given-names></name> <name><surname>Slabbinck</surname> <given-names>B.</given-names></name> <name><surname>Waegeman</surname> <given-names>W.</given-names></name> <name><surname>Vauterin</surname> <given-names>P.</given-names></name> <name><surname>De Baets</surname> <given-names>B.</given-names></name> <name><surname>Vandamme</surname> <given-names>P.</given-names></name></person-group> (<year>2011</year>). <article-title>Bacterial species identification from MALDI-TOF mass spectra through data analysis and machine learning.</article-title> <source><italic>Syst. Appl. Microbiol.</italic></source> <volume>34</volume> <fpage>20</fpage>&#x2013;<lpage>29</lpage>. <pub-id pub-id-type="doi">10.1016/j.syapm.2010.11.003</pub-id> <pub-id pub-id-type="pmid">21295428</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Faria</surname> <given-names>L. C.</given-names></name> <name><surname>Di Domenico</surname> <given-names>M.</given-names></name> <name><surname>Andrade</surname> <given-names>S. C.</given-names></name> <name><surname>dos Santos</surname> <given-names>M. C.</given-names></name> <name><surname>Fonseca</surname> <given-names>G.</given-names></name> <name><surname>Zanol</surname> <given-names>J.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>The use of metabarcoding for meiofauna ecological patterns assessment.</article-title> <source><italic>Mar. Environ. Res.</italic></source> <volume>140</volume> <fpage>160</fpage>&#x2013;<lpage>168</lpage>. <pub-id pub-id-type="doi">10.1016/j.marenvres.2018.06.013</pub-id> <pub-id pub-id-type="pmid">29933903</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dieme</surname> <given-names>C.</given-names></name> <name><surname>Yssouf</surname> <given-names>A.</given-names></name> <name><surname>Vega-R&#x00FA;a</surname> <given-names>A.</given-names></name> <name><surname>Berenger</surname> <given-names>J.-M.</given-names></name> <name><surname>Failloux</surname> <given-names>A.-B.</given-names></name> <name><surname>Raoult</surname> <given-names>D.</given-names></name><etal/></person-group> (<year>2014</year>). <article-title>Accurate identification of Culicidae at aquatic developmental stages by MALDI-TOF MS profiling.</article-title> <source><italic>Parasit. Vectors</italic></source> <volume>7</volume>:<issue>544</issue>. <pub-id pub-id-type="doi">10.1186/s13071-014-0544-0</pub-id> <pub-id pub-id-type="pmid">25442218</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Elbrecht</surname> <given-names>V.</given-names></name> <name><surname>Leese</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>Can DNA-based ecosystem assessments quantify species abundance? Testing primer bias and biomass&#x2014;sequence relationships with an innovative metabarcoding protocol.</article-title> <source><italic>PLoS One</italic></source> <volume>10</volume>:<issue>e0130324</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0130324</pub-id> <pub-id pub-id-type="pmid">26154168</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Feltens</surname> <given-names>R.</given-names></name> <name><surname>G&#x00F6;rner</surname> <given-names>R.</given-names></name> <name><surname>Kalkhof</surname> <given-names>S.</given-names></name> <name><surname>Gr&#x00F6;ger-Arndt</surname> <given-names>H.</given-names></name> <name><surname>von Bergen</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Discrimination of different species from the genus <italic>Drosophila</italic> by intact protein profiling using matrix-assisted laser desorption ionization mass spectrometry.</article-title> <source><italic>BMC Evol. Biol.</italic></source> <volume>10</volume>:<issue>1</issue>. <pub-id pub-id-type="doi">10.1186/1471-2148-10-95</pub-id> <pub-id pub-id-type="pmid">20374617</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fonseca</surname> <given-names>G.</given-names></name> <name><surname>Fontaneto</surname> <given-names>D.</given-names></name> <name><surname>Di Domenico</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>Addressing biodiversity shortfalls in meiofauna.</article-title> <source><italic>J. Exp. Mar. Biol. Ecol.</italic></source> <volume>502</volume> <fpage>26</fpage>&#x2013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1016/j.jembe.2017.05.007</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fonseca</surname> <given-names>V.</given-names></name> <name><surname>Sinniger</surname> <given-names>F.</given-names></name> <name><surname>Gaspar</surname> <given-names>J.</given-names></name> <name><surname>Quince</surname> <given-names>C.</given-names></name> <name><surname>Creer</surname> <given-names>S.</given-names></name> <name><surname>Power</surname> <given-names>D. M.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Revealing higher than expected meiofaunal diversity in Antarctic sediments: a metabarcoding approach.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>7</volume>:<issue>6094</issue>. <pub-id pub-id-type="doi">10.1038/s41598-017-06687-x</pub-id> <pub-id pub-id-type="pmid">28733608</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fontaneto</surname> <given-names>D.</given-names></name> <name><surname>Flot</surname> <given-names>J.-F.</given-names></name> <name><surname>Tang</surname> <given-names>C. Q.</given-names></name></person-group> (<year>2015</year>). <article-title>Guidelines for DNA taxonomy, with a focus on the meiofauna.</article-title> <source><italic>Mar. Biodivers.</italic></source> <volume>45</volume> <fpage>433</fpage>&#x2013;<lpage>451</lpage>. <pub-id pub-id-type="doi">10.1007/s12526-015-0319-7</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gibb</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <source><italic>MALDIquantForeign</italic><italic>: Import/Export routines for MALDIquant. A package for R.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="https://CRAN.R-project.org/package=MALDIquantForeign">https://CRAN.R-project.org/package=MALDIquantForeign</ext-link> <comment>(accessed August 14, 2018)</comment>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gibb</surname> <given-names>S.</given-names></name> <name><surname>Strimmer</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>MALDIquant: a versatile R package for the analysis of mass spectrometry data.</article-title> <source><italic>Bioinformatics</italic></source> <volume>28</volume> <fpage>2270</fpage>&#x2013;<lpage>2271</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/bts447</pub-id> <pub-id pub-id-type="pmid">22796955</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gouy</surname> <given-names>M.</given-names></name> <name><surname>Guindon</surname> <given-names>S.</given-names></name> <name><surname>Gascuel</surname> <given-names>O.</given-names></name></person-group> (<year>2010</year>). <article-title>SeaView version 4: a multiplatform graphical user interface for sequence alignment and phylogenetic tree building.</article-title> <source><italic>Mol. Biol. Evol.</italic></source> <volume>27</volume> <fpage>221</fpage>&#x2013;<lpage>224</lpage>. <pub-id pub-id-type="doi">10.1093/molbev/msp259</pub-id> <pub-id pub-id-type="pmid">19854763</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guardiola</surname> <given-names>M.</given-names></name> <name><surname>Uriz</surname> <given-names>M. J.</given-names></name> <name><surname>Taberlet</surname> <given-names>P.</given-names></name> <name><surname>Coissac</surname> <given-names>E.</given-names></name> <name><surname>Wangensteen</surname> <given-names>O. S.</given-names></name> <name><surname>Turon</surname> <given-names>X.</given-names></name></person-group> (<year>2015</year>). <article-title>Deep-sea, deep-sequencing: metabarcoding extracellular DNA from sediments of marine canyons.</article-title> <source><italic>PLoS One</italic></source> <volume>10</volume>:<issue>e0139633</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0139633</pub-id> <pub-id pub-id-type="pmid">26436773</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>G&#x00FC;nther</surname> <given-names>B.</given-names></name> <name><surname>Knebelsberger</surname> <given-names>T.</given-names></name> <name><surname>Neumann</surname> <given-names>H.</given-names></name> <name><surname>Laakmann</surname> <given-names>S.</given-names></name> <name><surname>Arbizu</surname> <given-names>P. M.</given-names></name></person-group> (<year>2018</year>). <article-title>Metabarcoding of marine environmental DNA based on mitochondrial and nuclear genes.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>8</volume>:<issue>14822</issue>.</citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hadziavdic</surname> <given-names>K.</given-names></name> <name><surname>Lekang</surname> <given-names>K.</given-names></name> <name><surname>Lanzen</surname> <given-names>A.</given-names></name> <name><surname>Jonassen</surname> <given-names>I.</given-names></name> <name><surname>Thompson</surname> <given-names>E. M.</given-names></name> <name><surname>Troedsson</surname> <given-names>C.</given-names></name></person-group> (<year>2014</year>). <article-title>Characterization of the 18S rRNA gene for designing universal eukaryote specific primers.</article-title> <source><italic>PLoS One</italic></source> <volume>9</volume>:<issue>e87624</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0087624</pub-id> <pub-id pub-id-type="pmid">24516555</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haenel</surname> <given-names>Q.</given-names></name> <name><surname>Holovachov</surname> <given-names>O.</given-names></name> <name><surname>Jondelius</surname> <given-names>U.</given-names></name> <name><surname>Sundberg</surname> <given-names>P.</given-names></name> <name><surname>Bourlat</surname> <given-names>S. J.</given-names></name></person-group> (<year>2017</year>). <article-title>NGS-based biodiversity and community structure analysis of meiofaunal eukaryotes in shell sand from H&#x00E5;ll&#x00F6; island, Sm&#x00F6;gen, and soft mud from Gullmarn Fjord, Sweden.</article-title> <source><italic>Biodivers. Data J.</italic></source> <volume>2017</volume>:<issue>e12731</issue>. <pub-id pub-id-type="doi">10.3897/bdj.5.e12731</pub-id> <pub-id pub-id-type="pmid">28781565</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hebert</surname> <given-names>P. D. N.</given-names></name> <name><surname>Cywinska</surname> <given-names>A.</given-names></name> <name><surname>Ball</surname> <given-names>S. L.</given-names></name> <name><surname>deWaard</surname> <given-names>J. R.</given-names></name></person-group> (<year>2003a</year>). <article-title>Biological identifications through DNA barcodes.</article-title> <source><italic>Proc. Biol. Sci.</italic></source> <volume>270</volume> <fpage>313</fpage>&#x2013;<lpage>321</lpage>. <pub-id pub-id-type="doi">10.1098/rspb.2002.2218</pub-id> <pub-id pub-id-type="pmid">12614582</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hebert</surname> <given-names>P. D. N.</given-names></name> <name><surname>Ratnasingham</surname> <given-names>S.</given-names></name> <name><surname>deWaard</surname> <given-names>J. R.</given-names></name></person-group> (<year>2003b</year>). <article-title>Barcoding animal life: cytochrome c oxidase subunit 1 divergences among closely related species.</article-title> <source><italic>Proc. Biol. Sci.</italic></source> <volume>270</volume>(<issue>Suppl. 1</issue>), <fpage>S96</fpage>&#x2013;<lpage>S99</lpage>.</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huys</surname> <given-names>R.</given-names></name> <name><surname>Gee</surname> <given-names>J.</given-names></name> <name><surname>Moore</surname> <given-names>C.</given-names></name> <name><surname>Hammond</surname> <given-names>R.</given-names></name></person-group> (<year>1996</year>). <source><italic>Marine and Brackish Water Harpacticoid Copepods Part 1.</italic></source> <publisher-loc>Shrewsbury</publisher-loc>: <publisher-name>Field Studies Council</publisher-name>.</citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hynek</surname> <given-names>R.</given-names></name> <name><surname>Kuckova</surname> <given-names>S.</given-names></name> <name><surname>Cejnar</surname> <given-names>P.</given-names></name> <name><surname>Junkov&#x00E1;</surname> <given-names>P.</given-names></name> <name><surname>Pvrikryl</surname> <given-names>I.</given-names></name> <name><surname>Rihov&#x00E1; Ambrovzov&#x00E1;</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>Identification of freshwater zooplankton species using protein profiling and principal component analysis.</article-title> <source><italic>Limnol. Oceanogr.</italic></source> <volume>16</volume> <fpage>199</fpage>&#x2013;<lpage>204</lpage>. <pub-id pub-id-type="doi">10.1002/lom3.10238</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaiser</surname> <given-names>P.</given-names></name> <name><surname>Bode</surname> <given-names>M.</given-names></name> <name><surname>Cornils</surname> <given-names>A.</given-names></name> <name><surname>Hagen</surname> <given-names>W.</given-names></name> <name><surname>Arbizu</surname> <given-names>P. M.</given-names></name> <name><surname>Auel</surname> <given-names>H.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>High-resolution community analysis of deep-sea copepods using MALDI-TOF protein fingerprinting.</article-title> <source><italic>Deep Sea Res. Part I Oceanogr. Res. Pap.</italic></source> <volume>138</volume> <fpage>122</fpage>&#x2013;<lpage>130</lpage>. <pub-id pub-id-type="doi">10.1016/j.dsr.2018.06.005</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaufmann</surname> <given-names>C.</given-names></name> <name><surname>Steinmann</surname> <given-names>I. C.</given-names></name> <name><surname>Hegglin</surname> <given-names>D.</given-names></name> <name><surname>Schaffner</surname> <given-names>F.</given-names></name> <name><surname>Mathis</surname> <given-names>A.</given-names></name></person-group> (<year>2012</year>). <article-title>Spatio-temporal occurrence of <italic>Culicoides</italic> biting midges in the climatic regions of Switzerland, along with large scale species identification by MALDI-TOF mass spectrometry.</article-title> <source><italic>Paras. Vectors</italic></source> <volume>5</volume>:<issue>246</issue>. <pub-id pub-id-type="doi">10.1186/1756-3305-5-246</pub-id> <pub-id pub-id-type="pmid">23111100</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kircher</surname> <given-names>M.</given-names></name> <name><surname>Sawyer</surname> <given-names>S.</given-names></name> <name><surname>Meyer</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Double indexing overcomes inaccuracies in multiplex sequencing on the Illumina platform.</article-title> <source><italic>Nucleic Acids Res.</italic></source> <volume>40</volume> <issue>e3</issue>. <pub-id pub-id-type="doi">10.1093/nar/gkr771</pub-id> <pub-id pub-id-type="pmid">22021376</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Knebelsberger</surname> <given-names>T.</given-names></name> <name><surname>Landi</surname> <given-names>M.</given-names></name> <name><surname>Neumann</surname> <given-names>H.</given-names></name> <name><surname>Kloppmann</surname> <given-names>M.</given-names></name> <name><surname>Sell</surname> <given-names>A. F.</given-names></name> <name><surname>Campbell</surname> <given-names>P. D.</given-names></name><etal/></person-group> (<year>2014</year>). <article-title>A reliable DNA barcode reference library for the identification of the North European shelf fish fauna.</article-title> <source><italic>Mol. Ecol. Resour.</italic></source> <volume>14</volume> <fpage>1060</fpage>&#x2013;<lpage>1071</lpage>. <pub-id pub-id-type="doi">10.1111/1755-0998.12238</pub-id> <pub-id pub-id-type="pmid">24618145</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Knowlton</surname> <given-names>N.</given-names></name></person-group> (<year>1993</year>). <article-title>Sibling species in the sea.</article-title> <source><italic>Ann. Rev. Ecol. Syst.</italic></source> <volume>24</volume> <fpage>189</fpage>&#x2013;<lpage>216</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.es.24.110193.001201</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>La Scola</surname> <given-names>B.</given-names></name> <name><surname>Campocasso</surname> <given-names>A.</given-names></name> <name><surname>N&#x2019;Dong</surname> <given-names>R.</given-names></name> <name><surname>Fournous</surname> <given-names>G.</given-names></name> <name><surname>Barrassi</surname> <given-names>L.</given-names></name> <name><surname>Flaudrops</surname> <given-names>C.</given-names></name><etal/></person-group> (<year>2010</year>). <article-title>Tentative characterization of new environmental giant viruses by MALDI-TOF mass spectrometry.</article-title> <source><italic>Intervirology</italic></source> <volume>53</volume> <fpage>344</fpage>&#x2013;<lpage>353</lpage>. <pub-id pub-id-type="doi">10.1159/000312919</pub-id> <pub-id pub-id-type="pmid">20551686</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Laakmann</surname> <given-names>S.</given-names></name> <name><surname>Gerdts</surname> <given-names>G.</given-names></name> <name><surname>Erler</surname> <given-names>R.</given-names></name> <name><surname>Knebelsberger</surname> <given-names>T.</given-names></name> <name><surname>Mart&#x00ED;nez Arbizu</surname> <given-names>P.</given-names></name> <name><surname>Raupach</surname> <given-names>M. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Comparison of molecular species identification for North Sea calanoid copepods (<italic>Crustacea</italic>) using proteome fingerprints and DNA sequences.</article-title> <source><italic>Mol. Ecol. Resour.</italic></source> <volume>13</volume> <fpage>862</fpage>&#x2013;<lpage>876</lpage>. <pub-id pub-id-type="doi">10.1111/1755-0998.12139</pub-id> <pub-id pub-id-type="pmid">23848968</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lang</surname> <given-names>K.</given-names></name></person-group> (<year>1948</year>). <source><italic>Monographie der Harpacticiden.</italic></source> <publisher-loc>K&#x00F6;nigstein</publisher-loc>: <publisher-name>Otto Koeltz Science Publishers</publisher-name>.</citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Legendre</surname> <given-names>P.</given-names></name> <name><surname>Gallagher</surname> <given-names>E. D.</given-names></name></person-group> (<year>2001</year>). <article-title>Ecologically meaningful transformations for ordination of species data.</article-title> <source><italic>Oecologia</italic></source> <volume>129</volume> <fpage>271</fpage>&#x2013;<lpage>280</lpage>. <pub-id pub-id-type="doi">10.1007/s004420100716</pub-id> <pub-id pub-id-type="pmid">28547606</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leray</surname> <given-names>M.</given-names></name> <name><surname>Knowlton</surname> <given-names>N.</given-names></name></person-group> (<year>2015</year>). <article-title>DNA barcoding and metabarcoding of standardized samples reveal patterns of marine benthic diversity.</article-title> <source><italic>Proc. Natl. Acad. Sci. U.S.A.</italic></source> <volume>112</volume> <fpage>2076</fpage>&#x2013;<lpage>2081</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1424997112</pub-id> <pub-id pub-id-type="pmid">25646458</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liaw</surname> <given-names>A.</given-names></name> <name><surname>Wiener</surname> <given-names>M.</given-names></name></person-group> (<year>2002</year>). <article-title>Classification and regression by randomForest.</article-title> <source><italic>R News</italic></source> <volume>2</volume> <fpage>18</fpage>&#x2013;<lpage>22</lpage>.</citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mart&#x00ED;nez Arbizu</surname> <given-names>P.</given-names></name> <name><surname>Rossel</surname> <given-names>S.</given-names></name></person-group> (<year>2018</year>). <source><italic>RFtools: Miscellaneous Tools For Random Forest Models.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="https://github.com/pmartinezarbizu/RFtools">https://github.com/pmartinezarbizu/RFtools</ext-link> <comment>(accessed October 1, 2017)</comment>.</citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mathis</surname> <given-names>A.</given-names></name> <name><surname>Depaquit</surname> <given-names>J.</given-names></name> <name><surname>Dvovr&#x00E1;k</surname> <given-names>V.</given-names></name> <name><surname>Tuten</surname> <given-names>H.</given-names></name> <name><surname>Ba&#x00F1;uls</surname> <given-names>A.-L.</given-names></name> <name><surname>Halada</surname> <given-names>P.</given-names></name><etal/></person-group> (<year>2015</year>). <article-title>Identification of phlebotomine sand flies using one MALDI-TOF MS reference database and two mass spectrometer systems.</article-title> <source><italic>Paras. Vectors</italic></source> <volume>8</volume>:<issue>266</issue>. <pub-id pub-id-type="doi">10.1186/s13071-015-0878-2</pub-id> <pub-id pub-id-type="pmid">25957576</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mazzeo</surname> <given-names>M. F.</given-names></name> <name><surname>Giulio</surname> <given-names>B. D.</given-names></name> <name><surname>Guerriero</surname> <given-names>G.</given-names></name> <name><surname>Ciarcia</surname> <given-names>G.</given-names></name> <name><surname>Malorni</surname> <given-names>A.</given-names></name> <name><surname>Russo</surname> <given-names>G. L.</given-names></name><etal/></person-group> (<year>2008</year>). <article-title>Fish authentication by MALDI-TOF mass spectrometry.</article-title> <source><italic>J. Agric. Food Chem.</italic></source> <volume>56</volume> <fpage>11071</fpage>&#x2013;<lpage>11076</lpage>. <pub-id pub-id-type="doi">10.1021/jf8021783</pub-id> <pub-id pub-id-type="pmid">19007297</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McIntyre</surname> <given-names>A.</given-names></name> <name><surname>Warwick</surname> <given-names>R.</given-names></name></person-group> (<year>1984</year>). <source><italic>Meiofauna Techniques. Methods for the Study of Marine Benthos.</italic></source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Blackwell</publisher-name>, <fpage>217</fpage>&#x2013;<lpage>244</lpage>.</citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morad</surname> <given-names>T. Y.</given-names></name> <name><surname>Dubinsky</surname> <given-names>Z.</given-names></name> <name><surname>Iluz</surname> <given-names>D.</given-names></name></person-group> (<year>2017</year>). <article-title>Meiobenthos assemblages as bioindicators for coastal pollution assessment.</article-title> <source><italic>Science</italic></source> <volume>7</volume> <fpage>409</fpage>&#x2013;<lpage>423</lpage>. <pub-id pub-id-type="doi">10.4236/ojms.2017.73028</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morgulis</surname> <given-names>A.</given-names></name> <name><surname>Coulouris</surname> <given-names>G.</given-names></name> <name><surname>Raytselis</surname> <given-names>Y.</given-names></name> <name><surname>Madden</surname> <given-names>T. L.</given-names></name> <name><surname>Agarwala</surname> <given-names>R.</given-names></name> <name><surname>Sch&#x00E4;ffer</surname> <given-names>A. A.</given-names></name></person-group> (<year>2008</year>). <article-title>Database indexing for production MegaBLAST searches.</article-title> <source><italic>Bioinformatics</italic></source> <volume>24</volume> <fpage>1757</fpage>&#x2013;<lpage>1764</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btn322</pub-id> <pub-id pub-id-type="pmid">18567917</pub-id></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moura</surname> <given-names>H.</given-names></name> <name><surname>Woolfitt</surname> <given-names>A. R.</given-names></name> <name><surname>Carvalho</surname> <given-names>M. G.</given-names></name> <name><surname>Pavlopoulos</surname> <given-names>A.</given-names></name> <name><surname>Teixeira</surname> <given-names>L. M.</given-names></name> <name><surname>Satten</surname> <given-names>G. A.</given-names></name><etal/></person-group> (<year>2008</year>). <article-title>MALDI-TOF mass spectrometry as a tool for differentiation of invasive and noninvasive Streptococcus pyogenes isolates.</article-title> <source><italic>FEMS Immunol. Med. Microbiol.</italic></source> <volume>53</volume> <fpage>333</fpage>&#x2013;<lpage>342</lpage>. <pub-id pub-id-type="doi">10.1111/j.1574-695X.2008.00428.x</pub-id> <pub-id pub-id-type="pmid">18537829</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x00FC;ller</surname> <given-names>P.</given-names></name> <name><surname>Pfl&#x00FC;ger</surname> <given-names>V.</given-names></name> <name><surname>Wittwer</surname> <given-names>M.</given-names></name> <name><surname>Ziegler</surname> <given-names>D.</given-names></name> <name><surname>Chandre</surname> <given-names>F.</given-names></name> <name><surname>Simard</surname> <given-names>F.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Identification of cryptic <italic>Anopheles</italic> mosquito species by molecular protein profiling.</article-title> <source><italic>PLoS One</italic></source> <volume>8</volume>:<issue>e57486</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0057486</pub-id> <pub-id pub-id-type="pmid">23469000</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oksanen</surname> <given-names>J.</given-names></name> <name><surname>Blanchet</surname> <given-names>F. G.</given-names></name> <name><surname>Kindt</surname> <given-names>R.</given-names></name> <name><surname>Legendre</surname> <given-names>P.</given-names></name> <name><surname>Minchin</surname> <given-names>P. R.</given-names></name> <name><surname>O&#x2019;hara</surname> <given-names>R.</given-names></name><etal/></person-group> (<year>2013</year>). <source><italic>Package &#x201C;Vegan.&#x201D; Community Ecology Package, Version 2.</italic></source></citation></ref>
<ref id="B50"><citation citation-type="journal"><collab>R Core Team.</collab> (<year>2018</year>). <source><italic>R: A language and environment for statistical computing.</italic></source> <publisher-loc>Vienna</publisher-loc>: <publisher-name>R Core Team</publisher-name>.</citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rognes</surname> <given-names>T.</given-names></name> <name><surname>Flouri</surname> <given-names>T.</given-names></name> <name><surname>Nichols</surname> <given-names>B.</given-names></name> <name><surname>Quince</surname> <given-names>C.</given-names></name> <name><surname>Mah&#x00E9;</surname> <given-names>F.</given-names></name></person-group> (<year>2016</year>). <article-title>VSEARCH: a versatile open source tool for metagenomics.</article-title> <source><italic>PeerJ</italic></source> <volume>4</volume> <issue>e2584</issue>. <pub-id pub-id-type="doi">10.7717/peerj.2584</pub-id> <pub-id pub-id-type="pmid">27781170</pub-id></citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rossel</surname> <given-names>S.</given-names></name> <name><surname>Mart&#x00ED;nez Arbizu</surname> <given-names>P.</given-names></name></person-group> (<year>2018a</year>). <article-title>Automatic specimen identification of <italic>Harpacticoids</italic> (<italic>Crustacea</italic>: <italic>Copepoda</italic>) using random forest and MALDI-TOF mass spectra, including a post hoc test for false positive discovery.</article-title> <source><italic>Methods Ecol. Evol.</italic></source> <volume>9</volume> <fpage>1421</fpage>&#x2013;<lpage>1434</lpage>. <pub-id pub-id-type="doi">10.1111/2041-210x.13000</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rossel</surname> <given-names>S.</given-names></name> <name><surname>Mart&#x00ED;nez Arbizu</surname> <given-names>P.</given-names></name></person-group> (<year>2018b</year>). <article-title>Effects of sample fixation on specimen identification in biodiversity assemblies based on proteomic data (MALDI-TOF).</article-title> <source><italic>Front. Mar. Sci.</italic></source> <volume>5</volume>:<issue>149</issue>.</citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rossel</surname> <given-names>S.</given-names></name> <name><surname>Mart&#x00ED;nez Arbizu</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). <article-title>Revealing higher than expected diversity of <italic>Harpacticoida</italic> (<italic>Crustacea</italic>: <italic>Copepoda</italic>) in the North Sea using MALDI-TOF MS and molecular barcoding.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>9</volume>:<issue>9182</issue>. <pub-id pub-id-type="doi">10.1038/s41598-019-45718-7</pub-id> <pub-id pub-id-type="pmid">31235850</pub-id></citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ryan</surname> <given-names>C.</given-names></name> <name><surname>Clayton</surname> <given-names>E.</given-names></name> <name><surname>Griffin</surname> <given-names>W.</given-names></name> <name><surname>Sie</surname> <given-names>S.</given-names></name> <name><surname>Cousens</surname> <given-names>D.</given-names></name></person-group> (<year>1988</year>). <article-title>SNIP, a statistics-sensitive background treatment for the quantitative analysis of PIXE spectra in geoscience applications.</article-title> <source><italic>Nucl. Instrum. Methods Phys. Res. Section B</italic></source> <volume>34</volume> <fpage>396</fpage>&#x2013;<lpage>402</lpage>. <pub-id pub-id-type="doi">10.1016/0168-583x(88)90063-8</pub-id></citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rzeznik-Orignac</surname> <given-names>J.</given-names></name> <name><surname>Kalenitchenko</surname> <given-names>D.</given-names></name> <name><surname>Mariette</surname> <given-names>J.</given-names></name> <name><surname>Bodiou</surname> <given-names>J.-Y.</given-names></name> <name><surname>Le Bris</surname> <given-names>N.</given-names></name> <name><surname>Derelle</surname> <given-names>E.</given-names></name></person-group> (<year>2017</year>). <article-title>Comparison of meiofaunal diversity by combined morphological and molecular approaches in a shallow Mediterranean sediment.</article-title> <source><italic>Mar. Biol.</italic></source> <volume>164</volume> <issue>40</issue>.</citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Savitzky</surname> <given-names>A.</given-names></name> <name><surname>Golay</surname> <given-names>M. J.</given-names></name></person-group> (<year>1964</year>). <article-title>Smoothing and differentiation of data by simplified least squares procedures.</article-title> <source><italic>Anal. Chem.</italic></source> <volume>36</volume> <fpage>1627</fpage>&#x2013;<lpage>1639</lpage>. <pub-id pub-id-type="doi">10.1021/ac60214a047</pub-id> <pub-id pub-id-type="pmid">21322220</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schnell</surname> <given-names>I. B.</given-names></name> <name><surname>Bohmann</surname> <given-names>K.</given-names></name> <name><surname>Gilbert</surname> <given-names>M. T. P.</given-names></name></person-group> (<year>2015</year>). <article-title>Tag jumps illuminated-reducing sequence-to-sample misidentifications in metabarcoding studies.</article-title> <source><italic>Mol. Ecol. Resour.</italic></source> <volume>15</volume> <fpage>1289</fpage>&#x2013;<lpage>1303</lpage>. <pub-id pub-id-type="doi">10.1111/1755-0998.12402</pub-id> <pub-id pub-id-type="pmid">25740652</pub-id></citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selkoe</surname> <given-names>K. A.</given-names></name> <name><surname>Aloia</surname> <given-names>C. C.</given-names></name> <name><surname>Crandall</surname> <given-names>E. D.</given-names></name> <name><surname>Iacchei</surname> <given-names>M.</given-names></name> <name><surname>Liggins</surname> <given-names>L.</given-names></name> <name><surname>Puritz</surname> <given-names>J. B.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>A decade of seascape genetics: contributions to basic and applied marine connectivity.</article-title> <source><italic>Mar. Ecol. Prog. Ser.</italic></source> <volume>554</volume> <fpage>1</fpage>&#x2013;<lpage>19</lpage>. <pub-id pub-id-type="doi">10.3354/meps11792</pub-id></citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Steinmann</surname> <given-names>I. C.</given-names></name> <name><surname>Pfl&#x00FC;ger</surname> <given-names>V.</given-names></name> <name><surname>Schaffner</surname> <given-names>F.</given-names></name> <name><surname>Mathis</surname> <given-names>A.</given-names></name> <name><surname>Kaufmann</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <article-title>Evaluation of matrix-assisted laser desorption/ionization time of flight mass spectrometry for the identification of ceratopogonid and culicid larvae.</article-title> <source><italic>Parasitology</italic></source> <volume>140</volume> <fpage>318</fpage>&#x2013;<lpage>327</lpage>. <pub-id pub-id-type="doi">10.1017/S0031182012001618</pub-id> <pub-id pub-id-type="pmid">23171762</pub-id></citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stucky</surname> <given-names>B. J.</given-names></name></person-group> (<year>2012</year>). <article-title>SeqTrace: a graphical tool for rapidly processing DNA sequencing chromatograms.</article-title> <source><italic>J. Biomol. Tech.</italic></source> <volume>23</volume>:<fpage>90</fpage>&#x2013;<lpage>93</lpage>. <pub-id pub-id-type="doi">10.7171/jbt.12-2303-004</pub-id> <pub-id pub-id-type="pmid">22942788</pub-id></citation></ref>
<ref id="B62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taberlet</surname> <given-names>P.</given-names></name> <name><surname>Coissac</surname> <given-names>E.</given-names></name> <name><surname>Pompanon</surname> <given-names>F.</given-names></name> <name><surname>Brochmann</surname> <given-names>C.</given-names></name> <name><surname>Willerslev</surname> <given-names>E.</given-names></name></person-group> (<year>2012</year>). <article-title>Towards next-generation biodiversity assessment using DNA metabarcoding.</article-title> <source><italic>Mol. Ecol.</italic></source> <volume>21</volume> <fpage>2045</fpage>&#x2013;<lpage>2050</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-294X.2012.05470.x</pub-id> <pub-id pub-id-type="pmid">22486824</pub-id></citation></ref>
<ref id="B63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>C. Q.</given-names></name> <name><surname>Leasi</surname> <given-names>F.</given-names></name> <name><surname>Obertegger</surname> <given-names>U.</given-names></name> <name><surname>Kieneke</surname> <given-names>A.</given-names></name> <name><surname>Barraclough</surname> <given-names>T. G.</given-names></name> <name><surname>Fontaneto</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). <article-title>The widely used small subunit 18S rDNA molecule greatly underestimates true diversity in biodiversity surveys of the meiofauna.</article-title> <source><italic>Proc. Natl. Acad. Sci. U.S.A.</italic></source> <volume>109</volume> <fpage>16208</fpage>&#x2013;<lpage>16212</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1209160109</pub-id> <pub-id pub-id-type="pmid">22988084</pub-id></citation></ref>
<ref id="B64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vogt</surname> <given-names>P.</given-names></name> <name><surname>Miljutina</surname> <given-names>M.</given-names></name> <name><surname>Raupach</surname> <given-names>M. J.</given-names></name></person-group> (<year>2014</year>). <article-title>The application of DNA sequence data for the identification of benthic nematodes from the North Sea.</article-title> <source><italic>Helgol. Mar. Res.</italic></source> <volume>68</volume> <fpage>549</fpage>&#x2013;<lpage>558</lpage>. <pub-id pub-id-type="doi">10.1007/s10152-014-0411-6</pub-id></citation></ref>
<ref id="B65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Volta</surname> <given-names>P.</given-names></name> <name><surname>Riccardi</surname> <given-names>N.</given-names></name> <name><surname>Lauceri</surname> <given-names>R.</given-names></name> <name><surname>Tonolla</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>Discrimination of freshwater fish species by matrix-assisted laser desorption/ionization-time of flight mass spectrometry (MALDI-TOF MS): a pilot study.</article-title> <source><italic>J. Limnol.</italic></source> <volume>71</volume>:<issue>e17</issue>.</citation></ref>
<ref id="B66"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wells</surname> <given-names>J. B. J.</given-names></name></person-group> (<year>2007</year>). <source><italic>An Annotated Checklist and Keys to the Species of Copepoda Harpacticoida (Crustacea).</italic></source> <publisher-loc>Auckland</publisher-loc>: <publisher-name>Magnolia Press</publisher-name>.</citation></ref>
<ref id="B67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yssouf</surname> <given-names>A.</given-names></name> <name><surname>Flaudrops</surname> <given-names>C.</given-names></name> <name><surname>Drali</surname> <given-names>R.</given-names></name> <name><surname>Kernif</surname> <given-names>T.</given-names></name> <name><surname>Socolovschi</surname> <given-names>C.</given-names></name> <name><surname>Berenger</surname> <given-names>J.-M.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Matrix-assisted laser desorption ionization-time of flight mass spectrometry for rapid identification of tick vectors.</article-title> <source><italic>J. Clin. Microbiol.</italic></source> <volume>51</volume> <fpage>522</fpage>&#x2013;<lpage>528</lpage>. <pub-id pub-id-type="doi">10.1128/JCM.02665-12</pub-id> <pub-id pub-id-type="pmid">23224087</pub-id></citation></ref>
<ref id="B68"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yssouf</surname> <given-names>A.</given-names></name> <name><surname>Parola</surname> <given-names>P.</given-names></name> <name><surname>Lindstr&#x00F6;m</surname> <given-names>A.</given-names></name> <name><surname>Lilja</surname> <given-names>T.</given-names></name> <name><surname>L&#x2019;Ambert</surname> <given-names>G.</given-names></name> <name><surname>Bondesson</surname> <given-names>U.</given-names></name><etal/></person-group> (<year>2014a</year>). <article-title>Identification of European mosquito species by MALDI-TOF MS.</article-title> <source><italic>Parasitol. Res.</italic></source> <volume>113</volume> <fpage>2375</fpage>&#x2013;<lpage>2378</lpage>. <pub-id pub-id-type="doi">10.1007/s00436-014-3876-y</pub-id> <pub-id pub-id-type="pmid">24737398</pub-id></citation></ref>
<ref id="B69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yssouf</surname> <given-names>A.</given-names></name> <name><surname>Socolovschi</surname> <given-names>C.</given-names></name> <name><surname>Leulmi</surname> <given-names>H.</given-names></name> <name><surname>Kernif</surname> <given-names>T.</given-names></name> <name><surname>Bitam</surname> <given-names>I.</given-names></name> <name><surname>Audoly</surname> <given-names>G.</given-names></name><etal/></person-group> (<year>2014b</year>). <article-title>Identification of flea species using MALDI-TOF/MS.</article-title> <source><italic>Comp. Immunol. Microbiol. Infect. Dis.</italic></source> <volume>37</volume> <fpage>153</fpage>&#x2013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1016/j.cimid.2014.05.002</pub-id> <pub-id pub-id-type="pmid">24878069</pub-id></citation></ref>
<ref id="B70"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Z.</given-names></name> <name><surname>Schwartz</surname> <given-names>S.</given-names></name> <name><surname>Wagner</surname> <given-names>L.</given-names></name> <name><surname>Miller</surname> <given-names>W.</given-names></name></person-group> (<year>2000</year>). <article-title>A greedy algorithm for aligning DNA sequences.</article-title> <source><italic>J. Comput. Biol.</italic></source> <volume>7</volume> <fpage>203</fpage>&#x2013;<lpage>214</lpage>. <pub-id pub-id-type="doi">10.1089/10665270050081478</pub-id> <pub-id pub-id-type="pmid">10890397</pub-id></citation></ref>
</ref-list>
</back>
</article>