<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Cell. Infect. Microbiol.</journal-id>
<journal-title>Frontiers in Cellular and Infection Microbiology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Cell. Infect. Microbiol.</abbrev-journal-title>
<issn pub-type="epub">2235-2988</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fcimb.2021.632647</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Cellular and Infection Microbiology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>MALDI-TOF MS Biomarker Detection Models to Distinguish RTX Toxin Phenotypes of <italic>Moraxella bovoculi</italic> Strains Are Enhanced Using Calcium Chloride Supplemented Agar</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Hille</surname><given-names>Matthew M.</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1110622"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Clawson</surname><given-names>Michael L.</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/216936"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Dickey</surname><given-names>Aaron M.</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Lowery</surname><given-names>Justin H.</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1150811"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Loy</surname><given-names>John Dustin</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>*</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/84479"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Veterinary Medicine and Biomedical Sciences, Institute for Agriculture and Natural Resources, University of Nebraska-Lincoln</institution>, <addr-line>Lincoln, NE</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>U.S. Meat Animal Research Center, United States Department of Agriculture, Agricultural Research Service</institution>, <addr-line>Clay Center, NE</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by">
<p>Edited by: Di Xiao, National Institute for Communicable Disease Control and Prevention (China CDC), China</p>
</fn>
<fn fn-type="edited-by">
<p>Reviewed by: Grazieli Maboni, University of Georgia, United States; Michael John Calcutt, University of Missouri, United States</p>
</fn>
<fn fn-type="corresp" id="fn001">
<p>*Correspondence: John Dustin Loy, <email xlink:href="mailto:jdloy@unl.edu">jdloy@unl.edu</email></p>
</fn>
<fn fn-type="other" id="fn002">
<p>This article was submitted to Clinical Microbiology, a section of the journal Frontiers in Cellular and Infection Microbiology</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>16</day>
<month>03</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>11</volume>
<elocation-id>632647</elocation-id>
<history>
<date date-type="received">
<day>23</day>
<month>11</month>
<year>2020</year>
</date>
<date date-type="accepted">
<day>01</day>
<month>03</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Hille, Clawson, Dickey, Lowery and Loy</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Hille, Clawson, Dickey, Lowery and Loy</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p><italic>Moraxella bovoculi</italic> is the bacterium most often cultured from ocular lesions of cattle with infectious bovine keratoconjunctivitis, also known as bovine pinkeye. Some strains of <italic>M. bovoculi</italic> contain operons encoding for a repeats-in-toxin (RTX) toxin, which is a known virulence factor of multiple veterinary pathogens. We explored the utility of MALDI-TOF MS and biomarker detection models to classify the presence or absence of an RTX phenotype in <italic>M. bovoculi</italic>. Ninety strains that had undergone whole genome sequencing were classified by the presence or absence of complete RTX operons and confirmed with a visual assessment of hemolysis on blood agar. Strains were grown on Tryptic Soy Agar (TSA) with 5% sheep blood, TSA with 5% bovine blood that was supplemented with 10% fetal bovine serum, 10 mmol/LCaCl<sub>2</sub>, or both. The formulations were designed to determine the influence of growth media on toxin production or activity, as calcium ions are required for toxin secretion and activity. Mass spectra were obtained for strains grown on each agar formulation and biomarker models were developed using ClinProTools 3.0 software. The most accurate model was developed using spectra from strains grown on TSA with 5% bovine blood and supplemented with CaCl<sub>2</sub>, which had a sensitivity and specificity of 93.3% and 73.3%, respectively, regarding RTX phenotype classification. The same biomarker model algorithm developed from strains grown on TSA with 5% sheep blood had a substantially lower sensitivity and specificity of 68.0% and 52.0%, respectively. Our results indicate that MALDI-TOF MS biomarker models can accurately classify strains of <italic>M. bovoculi</italic> regarding the presence or absence of RTX toxin operons and that agar media modifications improve the accuracy of these models.</p>
</abstract>
<kwd-group>
<kwd>MALDI-TOF MS</kwd>
<kwd><italic>Moraxella bovoculi</italic></kwd>
<kwd>infectious bovine keratoconjunctivitis</kwd>
<kwd>biomarker model</kwd>
<kwd>RTX toxin</kwd>
<kwd>Moraxella bovis</kwd>
</kwd-group>
<counts>
<fig-count count="3"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="32"/>
<page-count count="8"/>
<word-count count="3724"/>
</counts>
</article-meta>
</front>
<body>
<sec id="s1" sec-type="intro">
<title>Introduction</title>
<p>Infectious bovine keratoconjunctivitis (IBK) is the most common ocular disease in cattle (<xref ref-type="bibr" rid="B9">Brown et al., 1998</xref>). IBK has a substantial economic impact including costs associated with treatment as well as decreased weight gain in affected animals and impacts animal welfare by causing pain and blindness (<xref ref-type="bibr" rid="B24">Killinger et al., 1977</xref>; <xref ref-type="bibr" rid="B15">Dewell et al., 2014</xref>). <italic>Moraxella bovis</italic> (<italic>M. bovis</italic>) is the only bacterium that has reproduced IBK-like lesions in a variety of experimental models (<xref ref-type="bibr" rid="B19">Henson and Grumbles, 1960</xref>; <xref ref-type="bibr" rid="B1">Aikman et al., 1985</xref>). Other bacteria are often associated with IBK, but so far none have produced disease experimentally. The most notable and frequently isolated of these associated bacteria is <italic>Moraxella bovoculi</italic> (<xref ref-type="bibr" rid="B5">Angelos et al., 2007b</xref>). While <italic>M. bovoculi</italic> has been unsuccessful at inducing IBK experimentally (<xref ref-type="bibr" rid="B18">Gould et al., 2013</xref>), it is more frequently isolated from IBK lesions when compared to <italic>M. bovis</italic>, using both aerobic culture and molecular detection techniques (<xref ref-type="bibr" rid="B26">Loy and Brodersen, 2014</xref>; <xref ref-type="bibr" rid="B32">Zheng et al., 2019</xref>). Despite the lack of proven causation for <italic>M</italic>. bovoculi in IBK to date, in 2017 the USDA approved the first conditionally licensed <italic>M. bovoculi</italic> based vaccine product to be marketed for the prevention of IBK (USDA CVM code: 2A77.00, Addison Biological Laboratory). Recently, whole genome sequencing of <italic>M. bovoculi</italic> has revealed a large degree of diversity within the species that led to the characterization of two distinct genotypes (genotype 1 and genotype 2) separated by over 23,000 single nucleotide polymorphisms (<xref ref-type="bibr" rid="B16">Dickey et al., 2018</xref>). To date, only genotype 1 <italic>M. bovoculi</italic> have been isolated from IBK lesions while both genotypes have been recovered from animals without clinical signs.</p>
<p>Strains of <italic>M. bovis</italic> have been shown to produce an exotoxin belonging to the repeats-in-toxin (RTX) class of exotoxins that is cytopathic to bovine erythrocytes and neutrophils (<xref ref-type="bibr" rid="B13">Clinkenbeard and Thiessen, 1991</xref>; <xref ref-type="bibr" rid="B2">Angelos et al., 2001</xref>). In <italic>M. bovis</italic>, this RTX toxin, encoded by <italic>mbxA</italic> within an operon, is often referred to by several names including cytolysin, hemolysin, or cytotoxin. RTX toxins are known virulence factors in a variety of veterinary pathogens, including species within the family <italic>Pasteurellacea</italic> (<xref ref-type="bibr" rid="B25">Linhartova et al., 2018</xref>). A well-studied example of this is the leukotoxin produced by <italic>Mannheimia haemolytica</italic> (<xref ref-type="bibr" rid="B17">Frey, 2019</xref>). These RTX toxins are secreted in a calcium-dependent manner <italic>via</italic> a type I secretion system (T1SS) responsible for translocating the toxin from the cytosol to the exterior (<xref ref-type="bibr" rid="B25">Linhartova et al., 2018</xref>) Like <italic>M. bovis</italic>, some <italic>M. bovoculi</italic> strains also contain a complete RTX operon that produces an RTX toxin, cytotoxin A encoded by <italic>mbvA</italic> (<xref ref-type="bibr" rid="B4">Angelos et al., 2007a</xref>). Like <italic>mbxA</italic> produced by <italic>M. bovis, mbvA</italic> of <italic>M. bovoculi</italic> is responsible for hemolytic and lytic activity on bovine cells (<xref ref-type="bibr" rid="B11">Cerny et al., 2006</xref>; <xref ref-type="bibr" rid="B5">Angelos et al., 2007b</xref>). Within <italic>M. bovoculi</italic>, only the disease associated genotype 1 strains have been shown to possess the RTX operon, although not all do (<xref ref-type="bibr" rid="B16">Dickey et al., 2018</xref>). Besides RTX toxins, both <italic>M. bovis</italic> and <italic>M. bovoculi</italic> express a type IV pilus, a known virulence factor in other bacterial pathogens (<xref ref-type="bibr" rid="B6">Angelos et al., 2021</xref>). These similar potential virulence factors between the two <italic>Moraxella</italic> species highlight the relevance of continued investigation into the diversity within <italic>M. bovoculi</italic> and how this diversity may impact IBK pathogenesis.</p>
<p>Matrix-assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF MS) is an approach that is increasingly being applied to the identification of prokaryotes and eukaryotes. (<xref ref-type="bibr" rid="B31">Seng et al., 2009</xref>; <xref ref-type="bibr" rid="B12">Clark et al., 2013</xref>; <xref ref-type="bibr" rid="B22">Khot and Fisher, 2013</xref>; <xref ref-type="bibr" rid="B21">Karger et al., 2019</xref>). MALDI-TOF MS has replaced or supplemented more traditional biochemical identification methods as it is faster and increasingly more accurate as databases become mature. Using spectrum profiles generated from MALDI-TOF MS, biomarker models have been developed that are capable of differentiating subspecies and genotypes within a given bacterial species (<xref ref-type="bibr" rid="B27">Loy and Clawson, 2017</xref>; <xref ref-type="bibr" rid="B28">Mani et al., 2017</xref>; <xref ref-type="bibr" rid="B29">Perez-Sancho et al., 2018</xref>). Recently, a MALDI-TOF biomarker model was developed that accurately distinguishes <italic>M. bovoculi</italic> genotypes 1 and 2 (<xref ref-type="bibr" rid="B20">Hille et al., 2020</xref>). This model allows for the screening of strains for potential disease associated genotypes without the need for genome sequencing.</p>
<p>Genotype 1 <italic>M. bovoculi</italic> strains isolated from IBK associated eyes have been found with a higher frequency of the RTX operon than those isolated from unaffected eyes (<xref ref-type="bibr" rid="B16">Dickey et al., 2018</xref>). While it can be suspected based on a hemolytic phenotype, confirming the presence or absence of an RTX operon requires PCR or genomic sequencing (<xref ref-type="bibr" rid="B3">Angelos et al., 2003</xref>). In this study we evaluated the utility of MALDI-TOF MS biomarker models to accurately classify <italic>M. bovoculi</italic> strains regarding the presence or absence of an RTX operon among strains that had previously undergone whole genome sequencing and thus whose RTX operon status was known. Such a model would allow for an additional screening tool to characterize strains more likely to represent disease associated strains.</p>
<p>In addition to traditional tryptic soy agar (TSA) with 5% sheep blood agar culture conditions, we also compared biomarker model accuracies using three additional growth agar formulations to determine if agar formulation could improve model accuracy. The hemolytic activity of hemolysin produced by <italic>M. bovis</italic> has been shown to decrease when extracellular calcium is rendered unavailable (<xref ref-type="bibr" rid="B13">Clinkenbeard and Thiessen, 1991</xref>; <xref ref-type="bibr" rid="B8">Billson et al., 2000</xref>). Calcium has also been shown to promote efficient post translational modification and excretion of RTX toxins from the cell <italic>via</italic> the T1SS in <italic>Bordetella pertussis</italic> (<xref ref-type="bibr" rid="B10">Bumba et al., 2016</xref>). We hypothesized calcium may be a limiting factor in the production of RTX for <italic>M. bovoculi</italic> using the traditional culture conditions. Additionally, in the authors&#x2019; experience, <italic>Moraxella</italic> sp. isolated from cattle grow subjectively better on agar that utilizes bovine red blood cells vs traditional sheep&#x2019;s blood agar.</p>
</sec>
<sec id="s2">
<title>Methods</title>
<sec id="s2_1">
<title>Bacterial Strains</title>
<p>The 90 <italic>M. bovoculi</italic> strains used in this study had previously been identified to the species level using both PCR and MALDI-TOF MS techniques as previously described (<xref ref-type="bibr" rid="B26">Loy and Brodersen, 2014</xref>; <xref ref-type="bibr" rid="B30">Robbins et al., 2018</xref>). The strains also underwent whole genome sequencing which enabled characterization to the genotype level as well as the presence or absence of an RTX operon element (<xref ref-type="bibr" rid="B16">Dickey et al., 2018</xref>). Included were 45 genotype 1, RTX negative and 45 genotype 1, RTX positive strains obtained from a total of 18 different states within the US (<xref ref-type="table" rid="T1"><bold>Table 1</bold></xref>). Hemolytic activity on blood agar containing 5% sheep blood was confirmed for all RTX positive strains and was absent in all RTX negative strains. All 90 strains were used in the models developed from TSA with 5% sheep erythrocytes and a subset of 70 strains were used in the models developed from TSA with 5% bovine erythrocytes.</p>
<table-wrap id="T1" position="float">
<label>Table 1</label>
<caption>
<p>The biomarker model group, RTX status, and state of origin for the 90 <italic>M. bovoculi</italic> strains used in this study.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" align="left">Group</th>
<th valign="top" align="center">Strain Number</th>
<th valign="top" align="center">RTX +/-</th>
<th valign="top" align="center">State</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Model Generation</td>
<td valign="top" align="center">57909</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58026</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Oklahoma</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58036</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Iowa</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58058</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58065</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Indiana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58079</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58094</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58122</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">60479</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68507</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57851</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Montana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57855</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Ohio</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57904</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">California</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57917</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57922</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Indiana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58001</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Montana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58015</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Illinois</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58027</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Virginia</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58080</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Minnesota</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58119</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left">Model Validation</td>
<td valign="top" align="center">57861</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">South Dakota</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57876</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57923</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Minnesota</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58034</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58054</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58075</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58090</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Illinois</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">60476</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68485</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68511</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57860</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Iowa</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57870</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57884</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Indiana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57891</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Wisconsin</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57993</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58030</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58035</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Illinois</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58053</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Montana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58063</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Minnesota</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58088</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Minnesota</td>
</tr>
<tr>
<td valign="top" align="left">Model Classify</td>
<td valign="top" align="center">57881</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57883</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58028</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">South Dakota</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58047</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Virginia</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58067</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58086</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Virginia</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58123</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Iowa</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">60481</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68486</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68512</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68513</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68542</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68552</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68554</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68555</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58029*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Wisconsin</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58037*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58044*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Oklahoma</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58055*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58091*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58108*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">60478*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68528*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68529*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">68541*</td>
<td valign="top" align="center">&#x2013;</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57854</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57863</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Indiana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57865</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57879</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Oklahoma</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57894</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57903</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">California</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57905</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Iowa</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57906</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Montana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57918</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">North Dakota</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57919</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Washington</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58009</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Montana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58016</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Illinois</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58039</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58097</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">South Carolina</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58101</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Ohio</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57857*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Texas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57871*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57873*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57878*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57887*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Wisconsin</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57892*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Indiana</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">57894*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Kansas</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58010*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Tennessee</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58011*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Illinois</td>
</tr>
<tr>
<td valign="top" align="left"/>
<td valign="top" align="center">58069*</td>
<td valign="top" align="center">+</td>
<td valign="top" align="left">Nebraska</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>All strains were used in the development of models using TSA + 5% sheep erythrocytes. Strain numbers with an asterisk signify strains omitted from the TSA + 5% bovine erythrocyte model development portion of this study.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s2_2">
<title>Culture Conditions</title>
<p>From a library of frozen stocks, <italic>M. bovoculi</italic> strains were plated on either TSA(Becton, Dickinson &amp; Company, Sparks, MD) with 5% sheep blood (Remel, Lenexa, KS) or TSA with 5% defibrinated bovine blood (Colorado Serum Company, Denver, CO). Additionally, the agars using bovine blood were supplemented with either 10% fetal bovine serum (Colorado Serum Company), 10 mmol/L CaCl<sub>2</sub> (Fisher Scientific, Waltham, MA), or both. After the strains were plated they were incubated in 5% CO<sub>2</sub> at 37&#xb0; C for 24 hours prior to being passed once on the same agar formulation for an additional 24 hours prior to MALDI-TOF MS analysis.</p>
</sec>
<sec id="s2_3">
<title>MALDI-TOF MS</title>
<p>MALDI-TOF MS spectra were obtained for each of the strains listed in <xref ref-type="table" rid="T1"><bold>Table 1</bold></xref> according to the manufacturer&#x2019;s recommendation using the formic acid-ethanol extraction method that has previously been described (<xref ref-type="bibr" rid="B23">Khot et al., 2012</xref>; <xref ref-type="bibr" rid="B20">Hille et al., 2020</xref>). Spectra were collected on a linear MALDI-TOF MS (Bruker microflex, Bruker Daltonik, Billerica, MA) using settings and calibrations as described previously (<xref ref-type="bibr" rid="B20">Hille et al., 2020</xref>). For the sheep&#x2019;s blood media models, strains were spotted three times on the target plate and analyzed once for each spot well resulting in three spectra per strain. For the bovine blood models, the strains were spotted five times each and analyzed twice per well resulting in 10 spectra per strain. This yielded a total of 970 unique spectra being analyzed for this study.</p>
</sec>
<sec id="s2_4">
<title>Biomarker Models</title>
<p>ClinProTools 3.0 software (Bruker Daltonik) was used to analyze the spectra for the presence of RTX phenotype specific, discriminatory peaks. To develop biomarker models, three spectra classification algorithms were used that included support vector machine (SVM), genetic algorithm (GA), and quick classifier (QC) methods. <italic>M. bovoculi</italic> strains were randomly assigned to separate groups according to RTX status to develop the biomarker models which included model generation, model validation, and model classify groups (<xref ref-type="table" rid="T1"><bold>Table 1</bold></xref>). Spectra from the model generation groups were input into ClinProTools 3.0 software (Bruker Daltonik) according to their known RTX status to develop the models. The model validation step used spectra that were input with the RTX status known to the software as a test of accuracy of the developed models. Finally, the classification step involved inputting spectra with RTX status unknown to the software and allowing the models to classify them. The accuracy of the models to classify spectra was then calculated manually based on individual spectra as well as using the majority classification from a strain&#x2019;s spectra profile. When the study was expanded to assess different agar formulations, the number of isolates used in the model classification groups was reduced by 10 for each genotype to minimize the extra culture time and computational power required to do the study yet still allow for accuracy comparisons across all models. The isolates removed were chosen at random and resulted in a total of 70 isolates being used for the bovine blood agar portion of the study as opposed to the 90 isolates used in the sheep blood agar portion. When a model classified half of the spectra from a given strain as RTX &#x2013; and half of the spectra as RTX +, this was counted as an incorrect classification by the model. Sensitivity, specificity, negative predictive value, and positive predictive value were also calculated manually using the genomic sequencing RTX classification as the gold standard.</p>
</sec>
</sec>
<sec id="s3" sec-type="results">
<title>Results</title>
<sec id="s3_1">
<title>TSA + 5% Sheep Blood SVM Model</title>
<p>The SVM method proved the most accurate for this study overall and is the focus of the remainder of the paper. The parameters and accuracy of all models developed in this study across all culture conditions and biomarker model development methods are included as <xref ref-type="supplementary-material" rid="SM1"><bold>supplementary material</bold></xref> (<xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Table 1</bold></xref>). The SVM model developed using TSA + 5% sheep blood yielded individual spectra classification accuracies of 50.7% for RTX &#x2013; strains and 66.6% for RTX + strains (<xref ref-type="table" rid="T2"><bold>Table 2</bold></xref>). In terms of the presence or absence of RTX, these statistics would correlate to specificity and sensitivity, respectively, when interpreting the model result as a diagnostic assay. When all spectra for an individual strain were classified, and the majority model classification was used for the final strain phenotype interpretation, these accuracy values increased slightly to 52% for RTX -, and 68% for RTX + strains. This equates to a negative predictive value of 61.9% and a positive predictive value of 58.6% when using the majority classification.</p>
<table-wrap id="T2" position="float">
<label>Table 2</label>
<caption>
<p>Accuracy of SVM models developed in this study using TSA + 5% sheep blood and TSA + 5% bovine blood supplemented with CaCl<sub>2</sub>.</p>
</caption>
<table frame="hsides">
<thead>
<tr>
<th valign="top" align="left">Culture Conditions</th>
<th valign="top" align="center">TSA + 5% sheep rbc</th>
<th valign="top" align="center">TSA + 5% bovine rbc + 10 mmol/L CaCl<sub>2</sub></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Recognition</td>
<td valign="top" align="center">100%</td>
<td valign="top" align="center">100%</td>
</tr>
<tr>
<td valign="top" align="left">Cross Validation</td>
<td valign="top" align="center">91.69%</td>
<td valign="top" align="center">99.23%</td>
</tr>
<tr>
<td valign="top" align="left">RTX &#x2013; External Validation</td>
<td valign="top" align="center">23.3%</td>
<td valign="top" align="center">67%</td>
</tr>
<tr>
<td valign="top" align="left">RTX + External Validation</td>
<td valign="top" align="center">83.3%</td>
<td valign="top" align="center">83%</td>
</tr>
<tr>
<td valign="top" align="left">RTX &#x2013; Classify per spectra</td>
<td valign="top" align="center">50.7%</td>
<td valign="top" align="center">67.3%</td>
</tr>
<tr>
<td valign="top" align="left">RTX + Classify per spectra</td>
<td valign="top" align="center">66.6%</td>
<td valign="top" align="center">90%</td>
</tr>
<tr>
<td valign="top" align="left">RTX - Classify majority spectra</td>
<td valign="top" align="center">52%</td>
<td valign="top" align="center">73.3%</td>
</tr>
<tr>
<td valign="top" align="left">RTX + Classify majority spectra</td>
<td valign="top" align="center">68%</td>
<td valign="top" align="center">93.3%</td>
</tr>
<tr>
<td valign="top" align="left">NPV: Classify majority spectra</td>
<td valign="top" align="center">61.9%</td>
<td valign="top" align="center">91.7%</td>
</tr>
<tr>
<td valign="top" align="left">PPV: Classify majority spectra</td>
<td valign="top" align="center">58.6%</td>
<td valign="top" align="center">77.8%</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>NPV, negative predictive value; PPV, positive predictive value.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s3_2">
<title>TSA + 5% Bovine Blood + 10 mmol CaCl<sub>2</sub> SVM Model</title>
<p>We tested the same MALDI-TOF MS biomarker model development methods using strains grown on TSA + 5% bovine blood supplemented with either 10% fetal bovine serum (FBS), 10 mmol/L CaCl<sub>2</sub>, or both. The addition of CaCl<sub>2</sub> alone to the bovine blood agar resulted in the most accurate model (<xref ref-type="table" rid="T2"><bold>Table 2</bold></xref>). The two most common peaks incorporated into the models in this study had m/z values of at or very near 3971 and 7530 (<xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Table 1</bold></xref>). Using these peaks, when we examine 2-dimensional plots within ClinProTools 3.0, the different culture conditions show more defined clustering and less overlap in the spectra of strains grown on bovine blood plates with CaCl<sub>2</sub> when compared to those grown on the sheep blood plates (<xref ref-type="fig" rid="f2"><bold>Figure 2</bold></xref>). The models developed incorporating FBS are summarized in the <xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Material</bold></xref> (<xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Table 1</bold></xref>). Using the bovine blood agar and 10 mmol/L CaCl<sub>2</sub>, the specificity and sensitivity increased to 73.3% and 93.3% respectively (<xref ref-type="table" rid="T2"><bold>Table 2</bold></xref>). Additionally, the negative predictive value and positive predictive value increased to 91.7% and 77.8% respectively. All the CaCl<sub>2</sub> supplemented bovine blood plates displayed subjectively larger colonies with a more visually prominent zone of hemolysis suggesting either an overall increase in RTX production per bacterial cell, an increase in RTX hemolytic activity, an increase in cellular division, or a combination of the three (<xref ref-type="fig" rid="f1"><bold>Figure 1</bold></xref>). The most discriminatory peaks incorporated into the models in this study often had subtle differences between RTX groups that were not always easily discernible by visually examining the spectra alone, regardless of the agar formulation used (<xref ref-type="fig" rid="f3"><bold>Figure 3</bold></xref>).</p>
<fig id="f1" position="float">
<label>Figure 1</label>
<caption>
<p>Representative backlit blood agar plates streaked with strain #57905 after 48 hours incubation in 5% CO<sub>2</sub> at 37&#xb0;C on TSA with 5% sheep blood <bold>(A)</bold> and TSA with 5% bovine blood and 10 mmol/L CaCl<sub>2</sub> <bold>(B)</bold>. Care was taken to ensure the thickness of the bovine blood agar within the petri dish was like that of the commercial sheep blood agar.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcimb-11-632647-g001.tif"/>
</fig>
<fig id="f2" position="float">
<label>Figure 2</label>
<caption>
<p>ClinProTools 3.0 2-D plots incorporating the two most common and highest weighted peaks in the study. <bold>(A)</bold> <italic>M. bovoculi</italic> strains grown on TSA + 5% sheep blood. <bold>(B)</bold> <italic>M. bovoculi</italic> strains grown on TSA + 5% bovine blood with 10 mmol/L CaCl<sub>2</sub>. Red X: RTX &#x2013; strains. Green circle: RTX + strains.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcimb-11-632647-g002.tif"/>
</fig>
<fig id="f3" position="float">
<label>Figure 3</label>
<caption>
<p>Spectra of the two most discriminatory peaks 3971 m/z and 7530 m/z, compared between the sheep blood agar and bovine blood agar plus CaCl<sub>2</sub> formulations. Red line: average RTX &#x2013; spectra for the group of model classify strains. Green line: average RTX + spectra for the group of model classify strains.</p>
</caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcimb-11-632647-g003.tif"/>
</fig>
</sec>
</sec>
<sec id="s4" sec-type="discussion">
<title>Discussion</title>
<p>Here we have described a group of biomarker models developed using ClinProTools 3.0 software that are capable of correctly phenotyping most <italic>M. bovoculi</italic> genotype 1 strains for RTX. Across all models, the RTX phenotype specificity ranged from 26.7% - 86.7% while the sensitivity ranged from 46.7% - 93.3%. The most accurate model overall was the SVM model developed using strains grown on TSA + 5% bovine blood supplemented with 10 mmol/L CaCl<sub>2</sub>, which had a specificity and sensitivity of 73.3% and 93.3% respectively. Regardless of the biomarker model algorithm used, the usage of agar incorporating bovine blood and CaCl<sub>2</sub> substantially outperformed sheep blood agar. Since secretion of RTX toxins utilizes a calcium-dependent T1SS, the extra calcium may result in an overall increase in RTX production, although confirming this would require more investigation and was outside the scope of this study. Additionally, mammalian erythrocytes vary in the composition of their membranes (<xref ref-type="bibr" rid="B14">de and Van Deenen, 1961</xref>), and the species of erythrocyte has shown to affect activity of other toxins (<xref ref-type="bibr" rid="B7">Bhakdi et al., 1984</xref>). This increase in hemolysis may increase nutrient or other factor availability that enhances model performance.</p>
<p>MALDI-TOF MS biomarker models often highlight discriminatory peaks between groups of spectra that are different enough in their m/z value that they can be discerned even without the use of computer models. For instance, within <italic>M. bovoculi</italic> a strong peak at 9057 m/z is specific for genotype 1 whereas a peak at 6550 m/z is specific for genotype 2 (<xref ref-type="bibr" rid="B20">Hille et al., 2020</xref>). Having strong discriminatory peaks such as these allows those without ClinProTools 3.0 software to differentiate groups by manually examining spectra. This was not the case for the current study and highlights the need for biomarker models and their algorithmic approach to analysis when spectra peak differences may be subtle between groups.</p>
<p>The SVM model developed in this study using bovine blood agar and CaCl<sub>2</sub> provides an efficient method of RTX phenotyping for <italic>M. bovoculi</italic> without the need for PCR or genomic sequencing. A negative predictive value of 91.7% means that RTX &#x2013; strains can be classified accordingly with acceptable accuracy. While the importance of RTX toxins in the pathogenesis of IBK is not fully known, they are regarded as likely important virulence factors and RTX + strains are overrepresented in cases of IBK (<xref ref-type="bibr" rid="B4">Angelos et al., 2007a</xref>; <xref ref-type="bibr" rid="B16">Dickey et al., 2018</xref>). The ability to classify RTX &#x2013; strains in this manner may prove beneficial in the formulation of autogenous vaccines for IBK as this will allow vaccine manufacturers to eliminate any RTX &#x2013; strains from consideration and include only strains that are more likely to represent disease associated, RTX + strains within the vaccine formulation. With hemolysis shown to be RTX mediated in <italic>M. bovis</italic>, an RTX phenotyping MALDI-TOF MS biomarker model for <italic>M. bovis</italic> analogous to the one described here for <italic>M. bovoculi</italic>, would provide the same utility for vaccine formulations that choose to include <italic>M. bovis</italic>. Developing an <italic>M. bovis</italic> model would benefit from a library of sequenced <italic>M. bovis</italic> isolates whose RTX status is defined, unless hemolytic activity alone was used to assume RTX status. Here, we focused solely on <italic>M. bovoculi</italic> given our in-house library of previously sequenced isolates in order to examine the biomarker phenotyping proof-of-concept since the known presence of RTX components allowed us to avoid using hemolysis alone to classify RTX presence. In addition to its relevance to IBK, this study also serves as a blueprint of methods and proof-of-concept for utilizing MALDI-TOF MS spectra and biomarker models to distinguish strains of bacteria based on their ability to produce secreted exotoxins. Such methods could prove beneficial in differentiating other bacterial pathogens of both humans and animals that possess secreted exotoxins as virulence factors. Beyond being a proof-of-concept, the methods described here also reduce the time required to classify a <italic>M. bovoculi</italic> isolate by RTX status based solely on hemolysis. The gross appearance of hemolysis is often not readily apparent until 48 hours of growth while the MALDI-TOF MS biomarkers models we developed here use colonies that were grown for only 24 hours.</p>
<p>A major limitation for this study is the inability to assure only a single variable, in this case RTX presence or absence, differentiates the groups of isolates. It is possible that some of the peaks incorporated into the models developed here represent isolate components unrelated to RTX itself. We have mitigated the likelihood of this limitation affecting the overall study interpretation by: 1) utilizing only genotype 1 strains for the entire study, and 2) incorporating a large number of isolates and spectra within each group, and 3) utilizing geographically diverse populations of isolates for both RTX status groups.</p>
</sec>
<sec id="s5">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/<xref ref-type="supplementary-material" rid="SM1"><bold>Supplementary Material</bold></xref>. Further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>MH performed MALDI-TOF analysis, developed the biomarker models, wrote the original manuscript draft and edited the manuscript. MC and AD performed genomic sequencing analysis on the bacterial strains and edited the manuscript. JHL performed MALDI-TOF analysis. JDL conceptualized the study, supervised the project, and edited the manuscript. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="s7" sec-type="funding-information">
<title>Funding</title>
<p>This project was funded by the Nebraska Experiment Station with funds from the Animal Health and Disease Research (section 1433) capacity funding program (accession 1017646) through the USDA National Institute of Food and Agriculture. The use of product and company names is necessary to accurately report the methods and results; however, the United States Department of Agriculture (USDA) neither guarantees nor warrants the standard of the products, and the use of names by the USDA implies no approval of the product to the exclusion of others that may also be suitable. The USDA is an equal opportunity provider and employer.</p>
</sec>
<sec id="s8" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgments</title>
<p>The authors would like to thank the faculty and staff of the Nebraska Veterinary Diagnostic Center.</p>
</ack>
<sec sec-type="supplementary-material" id="s9">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fcimb.2021.632647/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fcimb.2021.632647/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.docx" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Aikman</surname> <given-names>J. G.</given-names>
</name>
<name>
<surname>Allan</surname> <given-names>E. M.</given-names>
</name>
<name>
<surname>Selman</surname> <given-names>I. E.</given-names>
</name>
</person-group> (<year>1985</year>). <article-title>Experimental production of infectious bovine keratoconjunctivitis</article-title>. <source>Vet. Rec.</source> <volume>117</volume>, <fpage>234</fpage>&#x2013;<lpage>239</lpage>. doi: <pub-id pub-id-type="doi">10.1136/vr.117.10.234</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Angelos</surname> <given-names>J. A.</given-names>
</name>
<name>
<surname>Hess</surname> <given-names>J. F.</given-names>
</name>
<name>
<surname>George</surname> <given-names>L. W.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Cloning and characterization of a Moraxella bovis cytotoxin gene</article-title>. <source>Am. J. Vet. Res.</source> <volume>62</volume>, <fpage>1222</fpage>&#x2013;<lpage>1228</lpage>. doi: <pub-id pub-id-type="doi">10.2460/ajvr.2001.62.1222</pub-id>
</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Angelos</surname> <given-names>J. A.</given-names>
</name>
<name>
<surname>Hess</surname> <given-names>J. F.</given-names>
</name>
<name>
<surname>George</surname> <given-names>L. W.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>An RTX operon in hemolytic Moraxella bovis is absent from nonhemolytic strains</article-title>. <source>Vet. Microbiol.</source> <volume>92</volume>, <fpage>363</fpage>&#x2013;<lpage>377</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0378-1135(02)00410-8</pub-id>
</citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Angelos</surname> <given-names>J. A.</given-names>
</name>
<name>
<surname>Ball</surname> <given-names>L. M.</given-names>
</name>
<name>
<surname>Hess</surname> <given-names>J. F.</given-names>
</name>
</person-group> (<year>2007</year>a). <article-title>Identification and characterization of complete RTX operons in Moraxella bovoculi and Moraxella ovis</article-title>. <source>Vet. Microbiol.</source> <volume>125</volume>, <fpage>73</fpage>&#x2013;<lpage>79</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.vetmic.2007.05.009</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Angelos</surname> <given-names>J. A.</given-names>
</name>
<name>
<surname>Spinks</surname> <given-names>P. Q.</given-names>
</name>
<name>
<surname>Ball</surname> <given-names>L. M.</given-names>
</name>
<name>
<surname>George</surname> <given-names>L. W.</given-names>
</name>
</person-group> (<year>2007</year>b). <article-title>Moraxella bovoculi sp. nov., isolated from calves with infectious bovine keratoconjunctivitis</article-title>. <source>Int. J. Syst. Evol. Microbiol.</source> <volume>57</volume>, <fpage>789</fpage>&#x2013;<lpage>795</lpage>. doi: <pub-id pub-id-type="doi">10.1099/ijs.0.64333-0</pub-id>
</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Angelos</surname> <given-names>J. A.</given-names>
</name>
<name>
<surname>Clothier</surname> <given-names>K. A.</given-names>
</name>
<name>
<surname>Agulto</surname> <given-names>R. L.</given-names>
</name>
<name>
<surname>Mandzyuk</surname> <given-names>B.</given-names>
</name>
<name>
<surname>Tryland</surname> <given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Relatedness of type IV pilin PilA amongst geographically diverse Moraxella bovoculi isolated from cattle with infectious bovine keratoconjunctivitis</article-title>. <source>JMed Microbiol.</source> <volume>70</volume>. doi: <pub-id pub-id-type="doi">10.1099/jmm.0.001293</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bhakdi</surname> <given-names>S.</given-names>
</name>
<name>
<surname>Muhly</surname> <given-names>M.</given-names>
</name>
<name>
<surname>F&#xfc;ssle</surname> <given-names>R.</given-names>
</name>
</person-group> (<year>1984</year>). <article-title>Correlation between toxin binding and hemolytic activity in membrane damage by staphylococcal alpha-toxin</article-title>. <source>Infect. Immun.</source> <volume>46</volume>, <fpage>318</fpage>&#x2013;<lpage>323</lpage>. doi: <pub-id pub-id-type="doi">10.1128/IAI.46.2.318-323.1984</pub-id>
</citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Billson</surname> <given-names>F. M.</given-names>
</name>
<name>
<surname>Harbour</surname> <given-names>C.</given-names>
</name>
<name>
<surname>Michalski</surname> <given-names>W. P.</given-names>
</name>
<name>
<surname>Tennent</surname> <given-names>J. M.</given-names>
</name>
<name>
<surname>Egerton</surname> <given-names>J. R.</given-names>
</name>
<name>
<surname>Hodgson</surname> <given-names>J. L.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>Characterization of hemolysin of Moraxella bovis using a hemolysis-neutralizing monoclonal antibody</article-title>. <source>Infect. Immun.</source> <volume>68</volume>, <fpage>3469</fpage>&#x2013;<lpage>3474</lpage>. doi: <pub-id pub-id-type="doi">10.1128/IAI.68.6.3469-3474.2000</pub-id>
</citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Brown</surname> <given-names>M. H.</given-names>
</name>
<name>
<surname>Brightman</surname> <given-names>A. H.</given-names>
</name>
<name>
<surname>Fenwick</surname> <given-names>B. W.</given-names>
</name>
<name>
<surname>Rider</surname> <given-names>M. A.</given-names>
</name>
</person-group> (<year>1998</year>). <article-title>Infectious bovine keratoconjunctivitis: a review</article-title>. <source>J. Vet. Intern. Med.</source> <volume>12</volume>, <fpage>259</fpage>&#x2013;<lpage>266</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1939-1676.1998.tb02120.x</pub-id>
</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bumba</surname> <given-names>L.</given-names>
</name>
<name>
<surname>Masin</surname> <given-names>J.</given-names>
</name>
<name>
<surname>Macek</surname> <given-names>P.</given-names>
</name>
<name>
<surname>Wald</surname> <given-names>T.</given-names>
</name>
<name>
<surname>Motlova</surname> <given-names>L.</given-names>
</name>
<name>
<surname>Bibova</surname> <given-names>I.</given-names>
</name>
<etal/>
</person-group>. (<year>2016</year>). <article-title>Calcium-Driven Folding of RTX Domain &#x3b2;-Rolls Ratchets Translocation of RTX Proteins through Type I Secretion Ducts</article-title>. <source>Mol. Cell.</source> <volume>62</volume>, <fpage>47</fpage>&#x2013;<lpage>62</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.molcel.2016.03.018</pub-id>
</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cerny</surname> <given-names>H. E.</given-names>
</name>
<name>
<surname>Rogers</surname> <given-names>D. G.</given-names>
</name>
<name>
<surname>Gray</surname> <given-names>J. T.</given-names>
</name>
<name>
<surname>Smith</surname> <given-names>D. R.</given-names>
</name>
<name>
<surname>Hinkley</surname> <given-names>S.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Effects of Moraxella (Branhamella) ovis culture filtrates on bovine erythrocytes, peripheral mononuclear cells, and corneal epithelial cells</article-title>. <source>J. Clin. Microbiol.</source> <volume>44</volume>, <fpage>772</fpage>&#x2013;<lpage>776</lpage>. doi: <pub-id pub-id-type="doi">10.1128/JCM.44.3.772-776.2006</pub-id>
</citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Clark</surname> <given-names>A. E.</given-names>
</name>
<name>
<surname>Kaleta</surname> <given-names>E. J.</given-names>
</name>
<name>
<surname>Arora</surname> <given-names>A.</given-names>
</name>
<name>
<surname>Wolk</surname> <given-names>D. M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Matrix-assisted laser desorption ionization-time of flight mass spectrometry: a fundamental shift in the routine practice of clinical microbiology</article-title>. <source>Clin. Microbiol. Rev.</source> <volume>26</volume>, <fpage>547</fpage>&#x2013;<lpage>603</lpage>. doi: <pub-id pub-id-type="doi">10.1128/CMR.00072-12</pub-id>
</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Clinkenbeard</surname> <given-names>K. D.</given-names>
</name>
<name>
<surname>Thiessen</surname> <given-names>A. E.</given-names>
</name>
</person-group> (<year>1991</year>). <article-title>Mechanism of action of Moraxella bovis hemolysin</article-title>. <source>Infect. Immun.</source> <volume>59</volume>, <fpage>1148</fpage>&#x2013;<lpage>1152</lpage>. doi: <pub-id pub-id-type="doi">10.1128/IAI.59.3.1148-1152.1991</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>De Gier</surname> <given-names>J.</given-names>
</name>
<name>
<surname>Van Deenen</surname> <given-names>L.</given-names>
</name>
</person-group> (<year>1961</year>). <article-title>Some lipid characteristics of red cell membranes of various animal species</article-title>. <source>Biochim. Biophys. Acta</source> <volume>49</volume>, <fpage>286</fpage>&#x2013;<lpage>296</lpage>. doi: <pub-id pub-id-type="doi">10.1016/0006-3002(61)90128-7</pub-id>
</citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dewell</surname> <given-names>R. D.</given-names>
</name>
<name>
<surname>Millman</surname> <given-names>S. T.</given-names>
</name>
<name>
<surname>Gould</surname> <given-names>S. A.</given-names>
</name>
<name>
<surname>Tofflemire</surname> <given-names>K. L.</given-names>
</name>
<name>
<surname>Whitley</surname> <given-names>R. D.</given-names>
</name>
<name>
<surname>Parsons</surname> <given-names>R. L.</given-names>
</name>
<etal/>
</person-group>. (<year>2014</year>). <article-title>Evaluating approaches to measuring ocular pain in bovine calves with corneal scarification and infectious bovine keratoconjunctivitis&#x2013;associated corneal ulcerations</article-title>. <source>J. Anim. Sci.</source> <volume>92</volume>, <fpage>1161</fpage>&#x2013;<lpage>1172</lpage>. doi: <pub-id pub-id-type="doi">10.2527/jas.2013-7264</pub-id>
</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dickey</surname> <given-names>A. M.</given-names>
</name>
<name>
<surname>Schuller</surname> <given-names>G.</given-names>
</name>
<name>
<surname>Loy</surname> <given-names>J. D.</given-names>
</name>
<name>
<surname>Clawson</surname> <given-names>M. L.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Whole genome sequencing of Moraxella bovoculi reveals high genetic diversity and evidence for interspecies recombination at multiple loci</article-title>. <source>PloS One</source> <volume>13</volume>, <elocation-id>e0209113</elocation-id>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0209113</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Frey</surname> <given-names>J.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>RTX Toxins of Animal Pathogens and Their Role as Antigens in Vaccines and Diagnostics</article-title>. <source>Toxins (Basel)</source> <volume>10</volume>, <fpage>11</fpage>. doi: <pub-id pub-id-type="doi">10.3390/toxins11120719</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gould</surname> <given-names>S.</given-names>
</name>
<name>
<surname>Dewell</surname> <given-names>R.</given-names>
</name>
<name>
<surname>Tofflemire</surname> <given-names>K.</given-names>
</name>
<name>
<surname>Whitley</surname> <given-names>R. D.</given-names>
</name>
<name>
<surname>Millman</surname> <given-names>S. T.</given-names>
</name>
<name>
<surname>Opriessnig</surname> <given-names>T.</given-names>
</name>
<etal/>
</person-group>. (<year>2013</year>). <article-title>Randomized blinded challenge study to assess association between Moraxella bovoculi and Infectious Bovine Keratoconjunctivitis in dairy calves</article-title>. <source>Vet. Microbiol.</source> <volume>164</volume>, <fpage>108</fpage>&#x2013;<lpage>115</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.vetmic.2013.01.038</pub-id>
</citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Henson</surname> <given-names>J. B.</given-names>
</name>
<name>
<surname>Grumbles</surname> <given-names>L. C.</given-names>
</name>
</person-group> (<year>1960</year>). <article-title>Infectious bovine keratoconjunctivitis. I. Etiology</article-title>. <source>Am. J. Vet. Res.</source> <volume>21</volume>, <fpage>761</fpage>&#x2013;<lpage>766</lpage>.
</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hille</surname> <given-names>M.</given-names>
</name>
<name>
<surname>Dickey</surname> <given-names>A.</given-names>
</name>
<name>
<surname>Robbins</surname> <given-names>K.</given-names>
</name>
<name>
<surname>Clawson</surname> <given-names>M. L.</given-names>
</name>
<name>
<surname>Loy</surname> <given-names>J. D.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Rapid differentiation of Moraxella bovoculi genotypes 1 and 2 using MALDI-TOF mass spectrometry profiles</article-title>. <source>J. Microbiol. Methods</source> <volume>173</volume>, <elocation-id>105942</elocation-id>. doi: <pub-id pub-id-type="doi">10.1016/j.mimet.2020.105942</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Karger</surname> <given-names>A.</given-names>
</name>
<name>
<surname>Bettin</surname> <given-names>B.</given-names>
</name>
<name>
<surname>Gethmann</surname> <given-names>J. M.</given-names>
</name>
<name>
<surname>Klaus</surname> <given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Whole animal matrix-assisted laser desorption/ionization time-of-flight (MALDI-TOF) mass spectrometry of ticks - Are spectra of Ixodes ricinus nymphs influenced by environmental, spatial, and temporal factors</article-title>? <source>PloS One</source> <volume>14</volume>, <elocation-id>e0210590</elocation-id>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0210590</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Khot</surname> <given-names>P. D.</given-names>
</name>
<name>
<surname>Fisher</surname> <given-names>M. A.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Novel approach for differentiating Shigella species and Escherichia coli by matrix-assisted laser desorption ionization-time of flight mass spectrometry</article-title>. <source>J. Clin. Microbiol.</source> <volume>51</volume>, <fpage>3711</fpage>&#x2013;<lpage>3716</lpage>. doi: <pub-id pub-id-type="doi">10.1128/JCM.01526-13</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Khot</surname> <given-names>P. D.</given-names>
</name>
<name>
<surname>Couturier</surname> <given-names>M. R.</given-names>
</name>
<name>
<surname>Wilson</surname> <given-names>A.</given-names>
</name>
<name>
<surname>Croft</surname> <given-names>A.</given-names>
</name>
<name>
<surname>Fisher</surname> <given-names>M. A.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Optimization of matrix-assisted laser desorption ionization-time of flight mass spectrometry analysis for bacterial identification</article-title>. <source>J. Clin. Microbiol.</source> <volume>50</volume>, <fpage>3845</fpage>&#x2013;<lpage>3852</lpage>. doi: <pub-id pub-id-type="doi">10.1128/JCM.00626-12</pub-id>
</citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Killinger</surname> <given-names>A. H.</given-names>
</name>
<name>
<surname>Valentine</surname> <given-names>D.</given-names>
</name>
<name>
<surname>Mansfield</surname> <given-names>M. E.</given-names>
</name>
<name>
<surname>Ricketts</surname> <given-names>G. E.</given-names>
</name>
<name>
<surname>Cmarik</surname> <given-names>G. F.</given-names>
</name>
<name>
<surname>Neumann</surname> <given-names>A. H.</given-names>
</name>
<etal/>
</person-group>. (<year>1977</year>). <article-title>Economic impact of infectious bovine keratoconjunctivitis in beef calves</article-title>. <source>Vet. Med. Small Anim. Clin.</source> <volume>72</volume>, <fpage>618</fpage>&#x2013;<lpage>620</lpage>.
</citation>
</ref>
<ref id="B25">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Linhartova</surname> <given-names>I.</given-names>
</name>
<name>
<surname>Osicka</surname> <given-names>R.</given-names>
</name>
<name>
<surname>Bumba</surname> <given-names>L.</given-names>
</name>
<name>
<surname>Masin</surname> <given-names>J.</given-names>
</name>
<name>
<surname>Sebo</surname> <given-names>P.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>Repeats-in-Toxin (RTX) Toxins: A Review</article-title>,&#x201d; in <source>Microbial Toxins</source> (<publisher-loc>Dordrecht</publisher-loc>: <publisher-name>Springer Netherlands</publisher-name>), <fpage>353</fpage>&#x2013;<lpage>381</lpage>.
</citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Loy</surname> <given-names>J. D.</given-names>
</name>
<name>
<surname>Brodersen</surname> <given-names>B. W.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Moraxella spp. isolated from field outbreaks of infectious bovine keratoconjunctivitis: a retrospective study of case submissions from 2010 to 2013</article-title>. <source>J. Vet. Diagn. Invest.</source> <volume>26</volume>, <fpage>761</fpage>&#x2013;<lpage>768</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1040638714551403</pub-id>
</citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Loy</surname> <given-names>J. D.</given-names>
</name>
<name>
<surname>Clawson</surname> <given-names>M. L.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Rapid typing of Mannheimia haemolytica major genotypes 1 and 2 using MALDI-TOF mass spectrometry</article-title>. <source>J. Microbiol. Methods</source> <volume>136</volume>, <fpage>30</fpage>&#x2013;<lpage>33</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.mimet.2017.03.002</pub-id>
</citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mani</surname> <given-names>R. J.</given-names>
</name>
<name>
<surname>Thachil</surname> <given-names>A. J.</given-names>
</name>
<name>
<surname>Ramachandran</surname> <given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Discrimination of Streptococcus equi subsp. equi and Streptococcus equi subsp. zooepidemicus using matrix-assisted laser desorption/ionization time-of-flight mass spectrometry</article-title>. <source>J. Vet. Diagn. Invest.</source> <volume>29</volume>, <fpage>622</fpage>&#x2013;<lpage>627</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1040638717702687</pub-id>
</citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Perez-Sancho</surname> <given-names>M.</given-names>
</name>
<name>
<surname>Vela</surname> <given-names>A. I.</given-names>
</name>
<name>
<surname>Horcajo</surname> <given-names>P.</given-names>
</name>
<name>
<surname>Ugarte-Ruiz</surname> <given-names>M.</given-names>
</name>
<name>
<surname>Dominguez</surname> <given-names>L.</given-names>
</name>
<name>
<surname>Fernandez-Garayzabal</surname> <given-names>J. F.</given-names>
</name>
<etal/>
</person-group>. (<year>2018</year>). <article-title>Rapid differentiation of Staphylococcus aureus subspecies based on MALDI-TOF MS profiles</article-title>. <source>J. Vet. Diagn. Invest.</source> <volume>30</volume>, <fpage>813</fpage>&#x2013;<lpage>820</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1040638718805537</pub-id>
</citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Robbins</surname> <given-names>K.</given-names>
</name>
<name>
<surname>Dickey</surname> <given-names>A. M.</given-names>
</name>
<name>
<surname>Clawson</surname> <given-names>M. L.</given-names>
</name>
<name>
<surname>Loy</surname> <given-names>J. D.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Matrix-assisted laser desorption/ionization time-of-flight mass spectrometry identification of Moraxella bovoculi and Moraxella bovis isolates from cattle</article-title>. <source>J. Vet. Diagn. Invest.</source> <volume>30</volume>, <fpage>739</fpage>&#x2013;<lpage>742</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1040638718789725</pub-id>
</citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Seng</surname> <given-names>P.</given-names>
</name>
<name>
<surname>Drancourt</surname> <given-names>M.</given-names>
</name>
<name>
<surname>Gouriet</surname> <given-names>F.</given-names>
</name>
<name>
<surname>La Scola</surname> <given-names>B.</given-names>
</name>
<name>
<surname>Fournier</surname> <given-names>P. E.</given-names>
</name>
<name>
<surname>Rolain</surname> <given-names>J. M.</given-names>
</name>
<etal/>
</person-group>. (<year>2009</year>). <article-title>Ongoing revolution in bacteriology: routine identification of bacteria by matrix-assisted laser desorption ionization time-of-flight mass spectrometry</article-title>. <source>Clin. Infect. Dis.</source> <volume>49</volume>, <fpage>543</fpage>&#x2013;<lpage>551</lpage>. doi: <pub-id pub-id-type="doi">10.1086/600885</pub-id>
</citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zheng</surname> <given-names>W.</given-names>
</name>
<name>
<surname>Porter</surname> <given-names>E.</given-names>
</name>
<name>
<surname>Noll</surname> <given-names>L.</given-names>
</name>
<name>
<surname>Stoy</surname> <given-names>C.</given-names>
</name>
<name>
<surname>Lu</surname> <given-names>N.</given-names>
</name>
<name>
<surname>Wang</surname> <given-names>Y.</given-names>
</name>
<etal/>
</person-group>. (<year>2019</year>). <article-title>A multiplex real-time PCR assay for the detection and differentiation of five bovine pinkeye pathogens</article-title>. <source>J. Microbiol. Methods</source> <volume>160</volume>, <fpage>87</fpage>&#x2013;<lpage>92</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.mimet.2019.03.024</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>