<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="discussion">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Vet. Sci.</journal-id>
<journal-title>Frontiers in Veterinary Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Vet. Sci.</abbrev-journal-title>
<issn pub-type="epub">2297-1769</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fvets.2023.1235837</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Veterinary Science</subject>
<subj-group>
<subject>Opinion</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title><italic>In silico</italic> analysis to develop PCR assays for identification of bacterial pathogens in animals: what can we improve?</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Bogomazova</surname> <given-names>Alexandra</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1198193/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Krylova</surname> <given-names>Ekaterina</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2023962/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Soltynskaya</surname> <given-names>Irina</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2311217/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Prasolova</surname> <given-names>Olga</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2139708/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ivanova</surname> <given-names>Olga</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Molecular Biology, Russian State Center for Quality and Standardization of Veterinary Drugs and Feed (VGNKI)</institution>, <addr-line>Moscow</addr-line>, <country>Russia</country></aff>
<aff id="aff2"><sup>2</sup><institution>Laboratory of Cell Biology, Lopukhin Federal Research and Clinical Center of Physical-Chemical Medicine of FMBA of Russia (Lopukhin FRCC PCM)</institution>, <addr-line>Moscow</addr-line>, <country>Russia</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Yasser Mahmmod, Higher Colleges of Technology, United Arab Emirates</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Deepanker Tewari, Pennsylvania Veterinary Laboratory, United States; Amro Hashish, Iowa State University, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Ekaterina Krylova <email>e.krylova&#x00040;vgnki.ru</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>14</day>
<month>08</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>10</volume>
<elocation-id>1235837</elocation-id>
<history>
<date date-type="received">
<day>06</day>
<month>06</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>31</day>
<month>07</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Bogomazova, Krylova, Soltynskaya, Prasolova and Ivanova.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Bogomazova, Krylova, Soltynskaya, Prasolova and Ivanova</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions> 
<kwd-group>
<kwd>PCR assay</kwd>
<kwd>bacterial pathogens</kwd>
<kwd>nucleotide collection database</kwd>
<kwd><italic>in silico</italic> analysis</kwd>
<kwd>assay development</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="23"/>
<page-count count="4"/>
<word-count count="3045"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Veterinary Infectious Diseases</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>Polymerase chain reaction (PCR) as a diagnostic method has gained enormous notability during the coronavirus pandemic (<xref ref-type="bibr" rid="B1">1</xref>). Indeed, PCR is an indispensable tool for rapidly assessing the spread of a disease spreading during viral infection outbreaks in the human population, animal herds and poultry. More generally, PCR is one of the primary methods for diagnostics of viral infections in clinical and veterinary medicine.</p>
<p>Regarding bacterial pathogens, PCR-based diagnostics play a more modest role since laboratories rely mostly on culture-based methods (<xref ref-type="bibr" rid="B2">2</xref>). Nevertheless, the World Organization for Animal Health (WOAH, founded as OIE) recommends the use of PCR assay as a supplement to traditional diagnostic methods for <italic>Mycoplasma spp</italic>., <italic>Mycobacterium tuberculosis, Pasteurella multocida</italic> and <italic>Chlamydia spp</italic>. For example, recommendations to employ genetic tests are present in the WOAH guidelines for the diagnostics of mycoplasmosis (<xref ref-type="bibr" rid="B3">3</xref>), tuberculosis (<xref ref-type="bibr" rid="B4">4</xref>), fowl cholera (<xref ref-type="bibr" rid="B5">5</xref>), and chlamydiosis (<xref ref-type="bibr" rid="B6">6</xref>). However, no WOAH diagnostics guidelines have yet been developed for contagious diseases, such as infectious coryza, bordetellosis, ornitobacteriosis, serositis, etc.</p>
<p>Some bacterial pathogens that cause the above diseases are difficult to culture <italic>in vitro</italic>. For instance, <italic>Ornithobacterium rhinotracheale</italic>, which causes bird ornitobacteriosis, and <italic>Avibacterium paragallinarum</italic>, which causes infectious coryza are very demanding to culture conditions (<xref ref-type="bibr" rid="B7">7</xref>, <xref ref-type="bibr" rid="B8">8</xref>). In addition, frequent mixed infections can seriously hamper the identification of pathogens (<xref ref-type="bibr" rid="B9">9</xref>). For such diseases, the PCR assay can become a primary diagnostic method. Furthermore, the PCR-based identification of pathogens circulating in an animal population can also be helpful in the choosing a vaccination strategy (<xref ref-type="bibr" rid="B10">10</xref>). Indeed, papers on the development and validation of novel PCR-based diagnostic assays for bacterial pathogens are regularly published in veterinary journals.</p>
<p>When designing PCR assays, developers follow a standard workflow consisting of three main stages: <italic>in silico</italic> stage, the evaluation of analytical performance of PCR, and evaluation of its diagnostic performance (<xref ref-type="bibr" rid="B11">11</xref>, <xref ref-type="bibr" rid="B12">12</xref>). An <italic>in silico</italic> bioinformatics analysis involves the use of computational tools and databases to check the quality of designed PCR primers. By performing the <italic>in silico</italic> bioinformatics analysis, potential problems such as primer-dimer formation, hairpin formation, primer mispriming, and false negative or false positive results can be avoided. Here, we briefly review the <italic>in silico</italic> stage of the recently published PCR assays, focusing on how the authors account for genetic polymorphism that can cause false negative results in a PCR assay. For this mini-review, we compared nearly three dozen real-time PCR diagnostic assays developed in the last 5 years to identify bacteria causing upper respiratory tract diseases in animals (<xref ref-type="table" rid="T1">Table 1</xref>). We considered only those PCR assays that assessed the diagnostic performance of PCR tests. In the end, we formulate some suggestions for improving the presentation of <italic>in silico</italic> analysis in publications.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>List of PCR assays reviewed in this article.</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th valign="top" align="left"><bold>Reference</bold></th>
<th valign="top" align="left"><bold>Pathogen</bold></th>
<th valign="top" align="left"><bold>Gene</bold></th>
<th valign="top" align="left"><bold>Sequence collections used in polymorphism analysis</bold></th>
<th valign="top" align="left"><bold>Polymorphic primer sites<sup>&#x0002A;&#x0002A;</sup></bold></th>
<th valign="top" align="left" colspan="3"><bold>Number of sequences in NCBI collections (as of May, 2023)</bold></th>
</tr>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th/>
<th/>
<th/>
<th/>
<th/>
<th valign="top" align="left"><bold>nt/nr</bold></th>
<th valign="top" align="left"><bold>Refseq genomes</bold></th>
<th valign="top" align="left"><bold>wgs</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Arai et al. (<xref ref-type="bibr" rid="B13">13</xref>)</td>
<td valign="top" align="left"><italic>Streptococcus parasuis</italic></td>
<td valign="top" align="left"><italic>recN</italic></td>
<td valign="top" align="left">nt/nr</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left"><bold>26</bold><sup><bold>&#x0002A;</bold></sup></td>
<td valign="top" align="left">10</td>
<td valign="top" align="left">10</td>
</tr> <tr>
<td valign="top" align="left">Hashish et al. (<xref ref-type="bibr" rid="B7">7</xref>)</td>
<td valign="top" align="left"><italic>Ornithobacterium rhinotracheale</italic></td>
<td valign="top" align="left"><italic>16S rRNA</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left"><bold>284</bold></td>
<td valign="top" align="left">20</td>
<td valign="top" align="left">9</td>
</tr> <tr>
<td valign="top" align="left">Hashish et al. (<xref ref-type="bibr" rid="B14">14</xref>)</td>
<td valign="top" align="left"><italic>Bordetella avium</italic></td>
<td valign="top" align="left"><italic>BAV1945</italic></td>
<td valign="top" align="left">nt/nr</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">6</td>
<td valign="top" align="left"><bold>26</bold></td>
<td valign="top" align="left">20</td>
</tr> <tr>
<td valign="top" align="left">Hashish et a. (<xref ref-type="bibr" rid="B14">14</xref>)</td>
<td valign="top" align="left"><italic>Bordetella avium</italic></td>
<td valign="top" align="left"><italic>fhaC</italic></td>
<td valign="top" align="left">nt/nr</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">7</td>
<td valign="top" align="left"><bold>26</bold></td>
<td valign="top" align="left">20</td>
</tr> <tr>
<td valign="top" align="left">Goecke et al. (<xref ref-type="bibr" rid="B15">15</xref>)</td>
<td valign="top" align="left"><italic>Trueperella pyogenes</italic></td>
<td valign="top" align="left"><italic>plo</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left"><bold>51</bold></td>
<td valign="top" align="left"><bold>27</bold></td>
<td valign="top" align="left">10</td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Mesomycoplasma hyopneumoniae</italic></td>
<td valign="top" align="left"><italic>p102</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">13</td>
<td valign="top" align="left"><bold>28</bold></td>
<td valign="top" align="left">14</td>
</tr> <tr>
<td valign="top" align="left">Kuchipudi et al. (<xref ref-type="bibr" rid="B8">8</xref>)</td>
<td valign="top" align="left"><italic>Avibacterium paragallinarum</italic></td>
<td valign="top" align="left"><italic>recN</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">17</td>
<td valign="top" align="left"><bold>50</bold></td>
<td valign="top" align="left">34</td>
</tr> <tr>
<td valign="top" align="left">Loy et al. (<xref ref-type="bibr" rid="B17">17</xref>)</td>
<td valign="top" align="left"><italic>Histophilus somni</italic></td>
<td valign="top" align="left"><italic>ompA</italic></td>
<td valign="top" align="left">refseq genomes</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">31</td>
<td valign="top" align="left"><bold>59</bold></td>
<td valign="top" align="left">35</td>
</tr> <tr>
<td valign="top" align="left">Goecke et al. (<xref ref-type="bibr" rid="B15">15</xref>)</td>
<td valign="top" align="left"><italic>Histophilus somni</italic></td>
<td valign="top" align="left"><italic>16S rRNA</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left"><bold>105</bold></td>
<td valign="top" align="left">60</td>
<td valign="top" align="left">35</td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Mycoplasma hyosynoviae</italic></td>
<td valign="top" align="left"><italic>rpoB</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">7</td>
<td valign="top" align="left"><bold>73</bold></td>
<td valign="top" align="left">69</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>omlA (apxIVA)</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">57</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>eamA</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>nusG</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>sppA</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>xerD</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>ybbN</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>ycfL</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Srijuntongsir et al. (<xref ref-type="bibr" rid="B18">18</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>ychJ</italic></td>
<td valign="top" align="left">nt/nr, wgs</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">36</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Actinobacillus pleuropneumoniae</italic></td>
<td valign="top" align="left"><italic>omlA (apxIVA)</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">57</td>
<td valign="top" align="left"><bold>78</bold></td>
<td valign="top" align="left">49</td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Mycoplasma hyorhinis</italic></td>
<td valign="top" align="left"><italic>p37</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">31</td>
<td valign="top" align="left"><bold>85</bold></td>
<td valign="top" align="left">85</td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Bordetella bronchiseptica</italic></td>
<td valign="top" align="left"><italic>flaA</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">39</td>
<td valign="top" align="left"><bold>96</bold></td>
<td valign="top" align="left">79</td>
</tr> <tr>
<td valign="top" align="left">Goecke et al. (<xref ref-type="bibr" rid="B15">15</xref>)</td>
<td valign="top" align="left"><italic>Mycoplasma bovis</italic></td>
<td valign="top" align="left"><italic>oppD</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">196</td>
<td valign="top" align="left">168</td>
<td valign="top" align="left"><bold>428</bold></td>
</tr> <tr>
<td valign="top" align="left">Goecke et al. (<xref ref-type="bibr" rid="B15">15</xref>)</td>
<td valign="top" align="left"><italic>Mannheimia haemolytica</italic></td>
<td valign="top" align="left"><italic>sodA</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">108</td>
<td valign="top" align="left">212</td>
<td valign="top" align="left"><bold>1,613</bold></td>
</tr> <tr>
<td valign="top" align="left">Loy et al. (<xref ref-type="bibr" rid="B17">17</xref>)</td>
<td valign="top" align="left"><italic>Mannheimia haemolytica</italic></td>
<td valign="top" align="left"><italic>lktD</italic></td>
<td valign="top" align="left">refseq genomes, (<xref ref-type="bibr" rid="B19">19</xref>)</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">121</td>
<td valign="top" align="left">212</td>
<td valign="top" align="left"><bold>1,613</bold></td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Haemophilus parasuis</italic></td>
<td valign="top" align="left"><italic>inf B</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">77</td>
<td valign="top" align="left">219</td>
<td valign="top" align="left"><bold>431</bold></td>
</tr> <tr>
<td valign="top" align="left">Goecke et al. (<xref ref-type="bibr" rid="B15">15</xref>)</td>
<td valign="top" align="left"><italic>Pasteurella multocida</italic></td>
<td valign="top" align="left"><italic>kmt1</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">152</td>
<td valign="top" align="left">407</td>
<td valign="top" align="left"><bold>882</bold></td>
</tr> <tr>
<td valign="top" align="left">Loy et al. (<xref ref-type="bibr" rid="B17">17</xref>)</td>
<td valign="top" align="left"><italic>Pasteurella multocida</italic></td>
<td valign="top" align="left"><italic>Pm1231</italic></td>
<td valign="top" align="left">refseq genomes</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">152</td>
<td valign="top" align="left">407</td>
<td valign="top" align="left"><bold>882</bold></td>
</tr> <tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Pasteurella multocida</italic></td>
<td valign="top" align="left"><italic>kmt1</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">215</td>
<td valign="top" align="left">407</td>
<td valign="top" align="left"><bold>882</bold></td>
</tr> <tr>
<td valign="top" align="left">Arai et al. (<xref ref-type="bibr" rid="B13">13</xref>)</td>
<td valign="top" align="left"><italic>Streptococcus suis</italic></td>
<td valign="top" align="left"><italic>recN</italic></td>
<td valign="top" align="left">nt/nr</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">172</td>
<td valign="top" align="left">1,989</td>
<td valign="top" align="left"><bold>2,966</bold></td>
</tr>
<tr>
<td valign="top" align="left">Sunaga et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="left"><italic>Streptococcus suis</italic></td>
<td valign="top" align="left"><italic>16S RNA</italic></td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">&#x0002B;</td>
<td valign="top" align="left">413</td>
<td valign="top" align="left">1,989</td>
<td valign="top" align="left"><bold>2,966</bold></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><sup>&#x0002A;</sup>A priority database for consideration of polymorphism in the bacterial gene is indicated in bold.</p>
<p><sup>&#x0002A;&#x0002A;</sup>The analysis for polymorphic primer sites was conducted with the NCBI collections accessed in May, 2023.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s2">
<title>Common practice for <italic>in silico</italic> analysis of genetic polymorphism to develop PCR assays</title>
<p>Intra-species genetic variation can compromise the diagnostic sensitivity of PCR, increasing the likelihood of false negative results. For instance, genetic polymorphism can seriously impair primer annealing, especially if a variable nucleotide is at the 3&#x02032; end of the primer. Moreover, the impact of genetic polymorphism on PCR efficiency can be even more significant if the polymorphic position is at the annealing site of the PCR probe. Guidelines for creating diagnostic PCR tests recommend taking genetic polymorphism into account during the assay development (<xref ref-type="bibr" rid="B20">20</xref>), but this recommendation is not specific enough. For example, there are no quantitative endpoints for considering genetic polymorphisms. There are also no guidelines for presenting the results of the <italic>in silico</italic> analysis of genetic polymorphisms.</p>
<p>Not surprisingly, the authors describe the <italic>in silico</italic> analysis with varying levels of detail and depth (<xref ref-type="table" rid="T1">Table 1</xref>). For example, all authors used the BLAST tool (<xref ref-type="bibr" rid="B21">21</xref>) to check how the sequence variation within a bacterial species could affect the PCR sensitivity. However, in many cases they did not specify which NCBI database was searched: the nucleotide collection (nt/nr), the RefSeq genome database (refseq genomes), or whole-genome shotgun database (wgs) (<xref ref-type="bibr" rid="B22">22</xref>, <xref ref-type="bibr" rid="B23">23</xref>). Thus, the BLAST search coverage was not clear in many cases.</p>
<p>Moreover, the authors were choosing different NCBI collections for analysis of genetic polymorphisms (<xref ref-type="table" rid="T1">Table 1</xref>). Most likely, the choice depended on personal preferences. However, the choice of the database may have depended on the target gene and the number of genomes for a bacterial species in the NCBI collections. In our sample, nearly 40 percent of the PCR target gene sequences were submitted to the NCBI sequence collections as a result of whole genome sequencing. However, other target genes, including phylogenetic genetic markers (<italic>16S rRNA, recN</italic>), virulence genes (<italic>kmt1, oppD, omlA</italic>), and multilocus sequence typing gene (<italic>infA</italic>) were submitted to the nt/nr database as result of Sanger sequencing. Therefore, for these genes, intra-species polymorphism may be more widely represented in the nt/nr database compared to the wgs database. For instance, the <italic>Streptococcus parasuis recN</italic> gene used as a target gene by Arai et al. (<xref ref-type="bibr" rid="B13">13</xref>) is a phylogenetic marker with 26 sequences in the nt/nr database and only 10 sequences in the wgs database. On the other hand, the wgs database is the most representative for bacterial species, the whole genome of which has been sequenced more than 150 times. The refseq genomes database is optimal for bacterial species with intermediate number of genomes sequenced (<xref ref-type="table" rid="T1">Table 1</xref>). It should be emphasized that NCBI Genbank collections may not accurately reflect true genetic polymorphism due to uneven representation of different regions, annotation inaccuracies, or technical sequencing errors. So, <italic>in silico</italic> analysis should always be accompanied by verification of PCR sensitivity and specificity on real samples.</p>
<p>Loy et al. (<xref ref-type="bibr" rid="B17">17</xref>) provided an excellent example of how to take genetic polymorphism into account. In their study, degenerate nucleotides were placed at polymorphic positions in the primer and multiple alignments were used to illustrate variable positions. However, most authors did not explicitly state whether polymorphic nucleotides were present at the primer annealing sites. As a result, we examined the primer annealing sites for polymorphism in all PCR tests listed in <xref ref-type="table" rid="T1">Table 1</xref>. In May 2023, we accessed the NCBI sequence collections, the number of sequences of which has increased significantly since the publication of the analyzed primers. We found polymorphic positions in 50% of the cases, which was common among bacterial species with the highest numbers of genomes in wgs database. However, <italic>the sodA</italic> (<xref ref-type="bibr" rid="B15">15</xref>) and <italic>lktD</italic> (<xref ref-type="bibr" rid="B17">17</xref>) genes were found to be very conservative with single-variant sequences among 1,613 <italic>Mannheimia haemolytica</italic> genomes in the wgs database. The frequency of <italic>sodA</italic> and <italic>lktD</italic> sequences with a polymorphic nucleotide in the primer was only 0.06%. In other words, the primers and probes perfectly matched the target sequence in 99.94% of the <italic>Mannheimia haemolytica</italic> genomes. It should also be noted that a BLAST search in the wgs database allows detection if a target PCR sequence is not ubiquitous for the genome sequenced of a given bacterial species. For instance, the wgs database comprises 1,613 genomes of <italic>Mannheimia haemolytica</italic> and the target sequence for PCR in the <italic>sodA</italic> gene (<xref ref-type="bibr" rid="B15">15</xref>) is present in 1,611 cases.</p>
</sec>
<sec sec-type="conclusions" id="s3">
<title>Conclusion</title>
<p>The NCBI sequence collections now contain thousands of genomes for a variety of pathogenic bacteria, as shown in <xref ref-type="table" rid="T1">Table 1</xref>. The abundance of data allows for comprehensive testing of primers for many sequences. On the other hand, the growth of the NCBI sequence collections will inevitably make it increasingly difficult for researchers to find perfectly conservative sites for primer design. This highlights the need for establishing pipelines that take into account genetic polymorphism when developing PCR assays for diagnostics of bacterial pathogens.</p>
<p>We believe that developers should clearly state the sequence database used with the BLAST tool and provide the number of bacterial gene sequences available for analysis. The presence or absence of polymorphism at the annealing sites of primers and samples should be clearly indicated. If polymorphic sites are present, it is appropriate to demonstrate the polymorphism using a multiple sequence alignment, as shown by Loy et al. (<xref ref-type="bibr" rid="B17">17</xref>) in the supplemental material to their publication. Moreover, a quantitative assessment may be included, such as &#x0201C;&#x02026;the primers and probe perfectly match 99% of the genomic sequences of the target species deposited in the NCBI reference genome database&#x02026;&#x0201D; When using previously published primers, it is important to recheck them for the presence of polymorphic sites at the annealing sites of primers and probe in current sequence databases. In addition, the authors should disclose if the PCR target sequence is absent in some bacterial genomic sequences deposited to the NCBI collections.</p>
</sec>
<sec sec-type="author-contributions" id="s4">
<title>Author contributions</title>
<p>AB conceptualized the study and wrote the manuscript. EK and IS conducted literature analysis and searched the NCBI database. OP analyzed the manuals of diagnostic tests for terrestrial animals. OI secured funding for the work. All authors contributed to the article and approved the final version for submission.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="s5">
<title>Funding</title>
<p>This work was supported by the grant &#x00023; 075-15-2021-1054 from the Ministry of Science and Higher Education of the Russian Federation.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s6">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jarrom</surname> <given-names>D</given-names></name> <name><surname>Elston</surname> <given-names>L</given-names></name> <name><surname>Washington</surname> <given-names>J</given-names></name> <name><surname>Prettyjohns</surname> <given-names>M</given-names></name> <name><surname>Cann</surname> <given-names>K</given-names></name> <name><surname>Myles</surname> <given-names>S</given-names></name> <etal/></person-group>. <article-title>Effectiveness of tests to detect the presence of SARS-CoV-2 virus, and antibodies to SARS-CoV-2, to inform COVID-19 diagnosis: a rapid systematic review</article-title>. <source>BMJ Evidence-Based Med.</source> (<year>2022</year>) <volume>27</volume>:<fpage>33</fpage>&#x02013;<lpage>45</lpage>. <pub-id pub-id-type="doi">10.1136/bmjebm-2020-111511</pub-id><pub-id pub-id-type="pmid">33004426</pub-id></citation></ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>V&#x000E1;radi</surname> <given-names>L</given-names></name> <name><surname>Luo</surname> <given-names>JL</given-names></name> <name><surname>Hibbs</surname> <given-names>DE</given-names></name> <name><surname>Perry</surname> <given-names>JD</given-names></name> <name><surname>Anderson</surname> <given-names>RJ</given-names></name> <name><surname>Orenga</surname> <given-names>S</given-names></name> <etal/></person-group>. <article-title>Methods for the detection and identification of pathogenic bacteria: past, present, and future</article-title>. <source>Chem Soc Rev.</source> (<year>2017</year>) <volume>46</volume>:<fpage>4818</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1039/C6CS00693K</pub-id><pub-id pub-id-type="pmid">28644499</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>The World Organisation for Animal Health</collab></person-group>. <article-title>Avian mycoplasmosis</article-title>. In: <source>Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, 12<sup>th</sup> Edn</source>. <publisher-name>The World Organisation for Animal Health</publisher-name> (<year>2023</year>).</citation>
</ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>The World Organisation for Animal Health</collab></person-group>. <article-title>Avian tuberculosis</article-title>. In: <source>Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, 12</source><sup><italic>th</italic></sup> <italic>Edn</italic>.<publisher-name> The World Organisation for Animal Health</publisher-name> (<year>2023</year>).</citation>
</ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>The World Organisation for Animal Health</collab></person-group>. <article-title>Fowl Cholera</article-title>. In: <source>Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, 12</source><sup><italic>th</italic></sup> <italic>Edn</italic>. <publisher-name>The World Organisation for Animal Health</publisher-name> (<year>2023</year>).</citation>
</ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>The World Organisation for Animal Health</collab></person-group>. <article-title>Avian chlamydiosis</article-title>. In: <source>Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, 12</source><sup><italic>th</italic></sup> <italic>Edn</italic>. <publisher-name>The World Organisation for Animal Health</publisher-name> (<year>2023</year>).</citation>
</ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hashish</surname> <given-names>A</given-names></name> <name><surname>Sinha</surname> <given-names>A</given-names></name> <name><surname>Sato</surname> <given-names>Y</given-names></name> <name><surname>Macedo</surname> <given-names>NR</given-names></name> <name><surname>El-Gazzar</surname> <given-names>M</given-names></name></person-group>. <article-title>Development and validation of a new TaqMan real-time PCR for the detection of <italic>Ornithobacterium rhinotracheale</italic></article-title>. <source>Microorganisms</source>. (<year>2022</year>) <volume>10</volume>:<fpage>341</fpage>. <pub-id pub-id-type="doi">10.3390/microorganisms10020341</pub-id><pub-id pub-id-type="pmid">35630519</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kuchipudi</surname> <given-names>SV</given-names></name> <name><surname>Yon</surname> <given-names>M</given-names></name> <name><surname>Surendran Nair</surname> <given-names>M</given-names></name> <name><surname>Byukusenge</surname> <given-names>M</given-names></name> <name><surname>Barry</surname> <given-names>RM</given-names></name> <name><surname>Nissly</surname> <given-names>RH</given-names></name> <etal/></person-group>. <article-title>A highly sensitive and specific probe-based real-time PCR for the detection of <italic>Avibacterium paragallinarum</italic> in clinical samples from poultry</article-title>. <source>Front Vet Sci.</source> (<year>2021</year>) <volume>8</volume>:<fpage>609126</fpage>. <pub-id pub-id-type="doi">10.3389/fvets.2021.609126</pub-id><pub-id pub-id-type="pmid">33912603</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Astrup</surname> <given-names>LB</given-names></name> <name><surname>Pedersen</surname> <given-names>K</given-names></name> <name><surname>Farre</surname> <given-names>M</given-names></name></person-group>. <article-title>Microbiological diagnoses on clinical mastitis&#x02014;Comparison between diagnoses made in veterinary clinics vs. in laboratory applying MALDI-TOF MS</article-title>. <source>Antibiotics.</source> (<year>2022</year>) <volume>11</volume>:<fpage>271</fpage>. <pub-id pub-id-type="doi">10.3390/antibiotics11020271</pub-id><pub-id pub-id-type="pmid">35203873</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kurmanov</surname> <given-names>B</given-names></name> <name><surname>Zincke</surname> <given-names>D</given-names></name> <name><surname>Su</surname> <given-names>W</given-names></name> <name><surname>Hadfield</surname> <given-names>TL</given-names></name> <name><surname>Aikimbayev</surname> <given-names>A</given-names></name> <name><surname>Karibayev</surname> <given-names>T</given-names></name> <etal/></person-group>. <article-title>Assays for identification and differentiation of Brucella species: a review</article-title>. <source>Microorganisms.</source> (<year>2022</year>) <volume>10</volume>:<fpage>1584</fpage>. <pub-id pub-id-type="doi">10.3390/microorganisms10081584</pub-id><pub-id pub-id-type="pmid">36014002</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>The World Organisation for Animal Health</collab></person-group>. <article-title>Principles and methods of validation of diagnostic assays for infectious disease</article-title>. In: <source>Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, 12</source><sup>th</sup> <italic>Edn</italic>. <publisher-name>The World Organisation for Animal Health</publisher-name> (<year>2023</year>).</citation>
</ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>The World Organisation for Animal Health</collab></person-group>. <article-title>Development and optimisation of nucleic acid detection assays</article-title>. In: <source>Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, 12</source><sup>th</sup> <italic>Edn</italic>. <publisher-name>The World Organisation for Animal Health</publisher-name> (<year>2023</year>).</citation>
</ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arai</surname> <given-names>S</given-names></name> <name><surname>Kim</surname> <given-names>H</given-names></name> <name><surname>Watanabe</surname> <given-names>T</given-names></name> <name><surname>Tohya</surname> <given-names>M</given-names></name> <name><surname>Suzuki</surname> <given-names>E</given-names></name> <name><surname>Ishida-Kuroki</surname> <given-names>K</given-names></name> <etal/></person-group>. <article-title>Assessment of pig saliva as a <italic>Streptococcus suis</italic> reservoir and potential source of infection on farms by use of a novel quantitative polymerase chain reaction assay</article-title>. <source>Am J Vet Res.</source> (<year>2018</year>) <volume>79</volume>:<fpage>941</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.2460/ajvr.79.9.941</pub-id><pub-id pub-id-type="pmid">30153059</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hashish</surname> <given-names>A</given-names></name> <name><surname>Sinha</surname> <given-names>A</given-names></name> <name><surname>Mekky</surname> <given-names>A</given-names></name> <name><surname>Sato</surname> <given-names>Y</given-names></name> <name><surname>Macedo</surname> <given-names>NR</given-names></name> <etal/></person-group>. <article-title>Development and validation of two diagnostic real-time PCR (TaqMan) assays for the detection of <italic>Bordetella avium</italic> from clinical samples and comparison to the currently available real-time TaqMan PCR assay</article-title>. <source>Microorganisms.</source> (<year>2021</year>) <volume>9</volume>:<fpage>2232</fpage>. <pub-id pub-id-type="doi">10.3390/microorganisms9112232</pub-id><pub-id pub-id-type="pmid">34835358</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goecke</surname> <given-names>NB</given-names></name> <name><surname>Nielsen</surname> <given-names>BH</given-names></name> <name><surname>Petersen</surname> <given-names>MB</given-names></name> <name><surname>Larsen</surname> <given-names>LE</given-names></name></person-group>. <article-title>Design of a high-throughput real-time PCR system for detection of bovine respiratory and enteric pathogens</article-title>. <source>Frontiers in veterinary science.</source> (<year>2021</year>) <fpage>8</fpage>. <pub-id pub-id-type="doi">10.3389/fvets.2021.677993</pub-id><pub-id pub-id-type="pmid">34250065</pub-id></citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sunaga</surname> <given-names>F</given-names></name> <name><surname>Tsuchiaka</surname> <given-names>S</given-names></name> <name><surname>Kishimoto</surname> <given-names>M</given-names></name> <name><surname>Aoki</surname> <given-names>H</given-names></name> <name><surname>Kakinoki</surname> <given-names>M</given-names></name> <name><surname>Kure</surname> <given-names>K</given-names></name> <etal/></person-group>. <article-title>Development of a one-run real-time PCR detection system for pathogens associated with porcine respiratory diseases</article-title>. <source>J Vet Med Sci.</source> (<year>2020</year>) <volume>82</volume>:<fpage>217</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1292/jvms.19-0063</pub-id><pub-id pub-id-type="pmid">31866601</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loy</surname> <given-names>JD</given-names></name> <name><surname>Leger</surname> <given-names>L</given-names></name> <name><surname>Workman</surname> <given-names>AM</given-names></name> <name><surname>Clawson</surname> <given-names>ML</given-names></name> <name><surname>Bulut</surname> <given-names>E</given-names></name> <etal/></person-group>. <article-title>Development of a multiplex real-time PCR assay using two thermocycling platforms for detection of major bacterial pathogens associated with bovine respiratory disease complex from clinical samples</article-title>. <source>J Vet Diagn Investigat.</source> (<year>2018</year>) <volume>30</volume>:<fpage>837</fpage>&#x02013;<lpage>47</lpage>. <pub-id pub-id-type="doi">10.1177/1040638718800170</pub-id><pub-id pub-id-type="pmid">30239324</pub-id></citation></ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Srijuntongsiri</surname> <given-names>G</given-names></name> <name><surname>Mhoowai</surname> <given-names>A</given-names></name> <name><surname>Samngamnim</surname> <given-names>S</given-names></name> <name><surname>Assavacheep</surname> <given-names>P</given-names></name> <name><surname>Boss&#x000E9;</surname> <given-names>JT</given-names></name> <name><surname>Langford</surname> <given-names>PR</given-names></name> <etal/></person-group>. <article-title>Novel DNA markers for identification of <italic>Actinobacillus pleuropneumoniae</italic></article-title>. <source>Microbiology spectrum</source>. (<year>2022</year>) <volume>10</volume>:<fpage>e01311</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1128/spectrum.01311-21</pub-id><pub-id pub-id-type="pmid">34985298</pub-id></citation></ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Clawson</surname> <given-names>ML</given-names></name> <name><surname>Murray</surname> <given-names>RW</given-names></name> <name><surname>Sweeney</surname> <given-names>MT</given-names></name> <name><surname>Apley</surname> <given-names>MD</given-names></name> <name><surname>DeDonder</surname> <given-names>KD</given-names></name> <name><surname>Capik</surname> <given-names>SF</given-names></name> <etal/></person-group>. <article-title>Genomic signatures of Mannheimia haemolytica that associate with the lungs of cattle with respiratory disease, an integrative conjugative element, and antibiotic resistance genes</article-title>. <source>BMC Genomics.</source> (<year>2016</year>) <volume>17</volume>:<fpage>1</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1186/s12864-016-3316-8</pub-id><pub-id pub-id-type="pmid">27894259</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Toohey-Kurth</surname> <given-names>K</given-names></name> <name><surname>Reising</surname> <given-names>MM</given-names></name> <name><surname>Tallmadge</surname> <given-names>RL</given-names></name> <name><surname>Goodman</surname> <given-names>LB</given-names></name> <name><surname>Bai</surname> <given-names>J</given-names></name> <name><surname>Bolin</surname> <given-names>SR</given-names></name> <etal/></person-group>. <article-title>Suggested guidelines for validation of real-time PCR assays in veterinary diagnostic laboratories</article-title>. <source>J Vet Diagn Investigat.</source> (<year>2020</year>) <volume>32</volume>:<fpage>802</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1177/1040638720960829</pub-id><pub-id pub-id-type="pmid">32988335</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Madden</surname> <given-names>T</given-names></name></person-group>. <article-title>The BLAST sequence analysis tool</article-title>. In: <source>The NCBI Handbook, 2</source><sup><italic>nd</italic></sup> <italic>Edn</italic>. <publisher-loc>Bethesda, MD</publisher-loc>: <publisher-name>National Center for Biotechnology Information</publisher-name> (<year>2013</year>).</citation>
</ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x00027;Leary</surname> <given-names>NA</given-names></name> <name><surname>Wright</surname> <given-names>MW</given-names></name> <name><surname>Brister</surname> <given-names>JR</given-names></name> <name><surname>Ciufo</surname> <given-names>S</given-names></name> <name><surname>Haddad</surname> <given-names>D</given-names></name> <name><surname>McVeigh</surname> <given-names>R</given-names></name> <etal/></person-group>. <article-title>Reference sequence (RefSeq) database at NCBI: current status, taxonomic expansion, and functional annotation</article-title>. <source>Nucleic Acids Res.</source> (<year>2016</year>) <volume>44</volume>:<fpage>D733</fpage>&#x02013;<lpage>45</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkv1189</pub-id><pub-id pub-id-type="pmid">26553804</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mart&#x000ED;</surname> <given-names>JM</given-names></name> <name><surname>Garay</surname> <given-names>CP</given-names></name></person-group>. <article-title>Not just BLAST nt: WGS database joins the party</article-title>. <source>BioRxiv.</source> (<year>2019</year>) <volume>2019</volume>:<fpage>653592</fpage>. <pub-id pub-id-type="doi">10.1101/653592</pub-id></citation>
</ref>
</ref-list> 
</back>
</article> 