<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="methods-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Behav. Neurosci.</journal-id>
<journal-title>Frontiers in Behavioral Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Behav. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5153</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnbeh.2022.892010</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Methods</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Foot Fault Scoring System to Assess Skilled Walking in Rodents: A Reliability Study</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Martins</surname> <given-names>Lucas Athaydes</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x2020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Schiavo</surname> <given-names>Aniuska</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x2020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Xavier</surname> <given-names>L&#x00E9;der Leal</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1018207/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Mestriner</surname> <given-names>R&#x00E9;gis Gemerasca</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/461448/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Graduate Program in Biomedical Gerontology, School of Medicine, Pontifical Catholic University of Rio Grande do Sul (PUCRS)</institution>, <addr-line>Porto Alegre</addr-line>, <country>Brazil</country></aff>
<aff id="aff2"><sup>2</sup><institution>Neurorehabilitation and Neural Repair Research Group (NEUROPLAR), Pontifical Catholic University of Rio Grande do Sul</institution>, <addr-line>Porto Alegre</addr-line>, <country>Brazil</country></aff>
<aff id="aff3"><sup>3</sup><institution>School of Health and Life Sciences, Pontifical Catholic University of Rio Grande do Sul</institution>, <addr-line>Porto Alegre</addr-line>, <country>Brazil</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Simona Cabib, Sapienza University of Rome, Italy</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Angel Zeininger, Duke University, United States; Daniel Schmitt, Duke University, United States</p></fn>
<corresp id="c001">&#x002A;Correspondence: R&#x00E9;gis Gemerasca Mestriner, <email>regis.mestriner@pucrs.br</email>, <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0001-9837-1691">orcid.org/0000-0001-9837-1691</ext-link></corresp>
<fn fn-type="equal" id="fn002"><p><sup>&#x2020;</sup>These authors have contributed equally to this work</p></fn>
<fn fn-type="other" id="fn004"><p>This article was submitted to Learning and Memory, a section of the journal Frontiers in Behavioral Neuroscience</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>29</day>
<month>04</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>16</volume>
<elocation-id>892010</elocation-id>
<history>
<date date-type="received">
<day>08</day>
<month>03</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>28</day>
<month>03</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Martins, Schiavo, Xavier and Mestriner.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Martins, Schiavo, Xavier and Mestriner</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>The foot fault scoring system of the ladder rung walking test (LRWT) is used to assess skilled walking in rodents. However, the reliability of the LRWT foot fault score has not been properly addressed. This study was designed to address this issue. Two independent and blinded raters analyzed 20 rats and 20 mice videos. Each video was analyzed twice by the same rater (80 analyses per rater). The intraclass correlation coefficient (ICC) and the Kappa coefficient were employed to check the accuracy of agreement and reliability in the intra- and inter-rater analyses of the LRWT outcomes. Excellent intra- and inter-rater agreements were found for the forelimb, hindlimb, and both limbs combined in rats and mice. The agreement level was also excellent for total crossing time, total time stopped, and the number of stops during the walking path. Rating individual scores in the foot fault score system (0&#x2013;6) ranged from satisfactory to excellent, in terms of the intraclass correlation indexes. Moreover, we showed that experienced and inexperienced raters can obtain reliable results if supervised training is provided. We concluded that the LRWT is a reliable and useful tool to study skilled walking in rodents and can help researchers address walking-related neurobiological questions.</p>
</abstract>
<kwd-group>
<kwd>locomotion</kwd>
<kwd>rodentia</kwd>
<kwd>reliability</kwd>
<kwd>rat</kwd>
<kwd>mice</kwd>
<kwd>walking</kwd>
</kwd-group>
<contract-sponsor id="cn001">Coordena&#x00E7;&#x00E3;o de Aperfei&#x00E7;oamento de Pessoal de N&#x00ED;vel Superior<named-content content-type="fundref-id">10.13039/501100002322</named-content></contract-sponsor><contract-sponsor id="cn002">Conselho Nacional de Desenvolvimento Cient&#x00ED;fico e Tecnol&#x00F3;gico<named-content content-type="fundref-id">10.13039/501100003593</named-content></contract-sponsor>
<counts>
<fig-count count="5"/>
<table-count count="5"/>
<equation-count count="1"/>
<ref-count count="38"/>
<page-count count="11"/>
<word-count count="6818"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="intro">
<title>Introduction</title>
<p>Skilled walking is crucial for walking adaptability, i.e., a complex sensory-motor function, qualified or required to control and coordinate various degrees of freedom in joints, in a variety of environmental contexts, or that interfere with locomotion (<xref ref-type="bibr" rid="B17">Houdijk et al., 2012</xref>; <xref ref-type="bibr" rid="B3">Balasubramanian et al., 2014</xref>; <xref ref-type="bibr" rid="B10">Ducharme et al., 2018</xref>). Gait is influenced by the temporal and spatial integration of the cognitive and neuromusculoskeletal neural systems (<xref ref-type="bibr" rid="B30">Shimada et al., 2013</xref>). Moreover, the ability to adapt gait according to environmental context is a crucial aspect in maintaining body stability and preventing falls (<xref ref-type="bibr" rid="B36">Van Ooijen et al., 2015</xref>; <xref ref-type="bibr" rid="B11">Esteves et al., 2016</xref>; <xref ref-type="bibr" rid="B8">Caetano et al., 2018</xref>; <xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>). The ability to adapt walking demands skilled movements during locomotion, which is frequently impaired in the injured nervous system. While automatic walking is mainly brain stem and spinal cord-dependent, the skilled movements needed to adapt walking in challenging pathways require higher cerebral cortex processing (<xref ref-type="bibr" rid="B13">Farr et al., 2006</xref>; <xref ref-type="bibr" rid="B35">Ueda et al., 2018</xref>). Thus, central nervous system diseases or injuries can limit the ability to adapt walking (<xref ref-type="bibr" rid="B23">Mestriner et al., 2013</xref>).</p>
<p>Although several studies into skilled walking have focused on human biomechanics (<xref ref-type="bibr" rid="B16">Hawkins et al., 2017</xref>; <xref ref-type="bibr" rid="B20">Lanini et al., 2017</xref>; <xref ref-type="bibr" rid="B10">Ducharme et al., 2018</xref>), animal models can usefully provide neurobiological insights at the cellular and molecular levels (<xref ref-type="bibr" rid="B32">Soleman et al., 2010</xref>; <xref ref-type="bibr" rid="B23">Mestriner et al., 2013</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>). For instance, the ladder rung walking test (LRWT) has been used to assess skilled walking (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>, <xref ref-type="bibr" rid="B27">2009</xref>) in unilateral ischemic injury in the motor cortex (<xref ref-type="bibr" rid="B32">Soleman et al., 2010</xref>; <xref ref-type="bibr" rid="B2">Antonow-Schlorke et al., 2013</xref>); spinal cord injury (<xref ref-type="bibr" rid="B29">Sandner et al., 2018</xref>; <xref ref-type="bibr" rid="B15">Guo et al., 2019</xref>); dopaminergic depletion induced by 6-hydroxydopamine (a model of Parkinson&#x2019;s disease) (<xref ref-type="bibr" rid="B12">Faraji and Metz, 2007</xref>); neonatal white matter injury (<xref ref-type="bibr" rid="B35">Ueda et al., 2018</xref>); and stress-related conditions (<xref ref-type="bibr" rid="B24">Metz et al., 2015</xref>; <xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>).</p>
<p>In the LRWT, walking adaptability is assessed using a foot fault score that reflects rodent walking pattern, inter-foot coordination, foot support, forelimb and hindlimb kinematics, step and gait cycles, and gait speed (<xref ref-type="bibr" rid="B2">Antonow-Schlorke et al., 2013</xref>; <xref ref-type="bibr" rid="B15">Guo et al., 2019</xref>). The test apparatus consists of plexiglass walls and metal rungs that are inserted to create a floor, thus forming a horizontal ladder. Rodents are expected to cross the ladder using the available rungs to support paw placement. The better the ability to adapt walking, the lower the number of faults (slips and falls) while crossing the apparatus (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>, <xref ref-type="bibr" rid="B27">2009</xref>). The foot fault score system is a 7-point category scale in which the quality and appropriateness of foot placement are judged by analyzing a video recording, frame by frame, of rodents walking along a 1-m-long horizontal ladder. The rungs are arranged in a pattern that requires murine ability to adapt walking (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>, <xref ref-type="bibr" rid="B27">2009</xref>). This scoring system requires only a hand camera and a minimally trained researcher to analyze the video and apply the foot fault score (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>). This method may avoid common pitfalls that occur when using reflective markers on the flexible skin of rodents (<xref ref-type="bibr" rid="B14">Filipe et al., 2006</xref>; <xref ref-type="bibr" rid="B5">Bauman and Chang, 2010</xref>) and gives a measure of the success in adapting walking (<xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>).</p>
<p>However, to the best of our knowledge, the foot fault score has not been properly assessed regarding its intra- and inter-rater reliability and reproducibility, which is a source of uncertainty. Current studies usually elect a single rater to analyze all videos in an attempt to minimize bias, which is scientifically insufficient. We hypothesized that it is sufficient for raters to read and understand the instructions provided by the foot fault score creators to ensure reliable measures (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>, <xref ref-type="bibr" rid="B27">2009</xref>). Thus, this study sought to compare the scores obtained by two raters, one experienced and another without previous experience in applying the foot fault score. This article provides scientific information regarding the external validity of the LRWT findings in rodents, thus contributing to advance the field of skilled walking neurobiology.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<p>We randomly selected 40 video recordings of rodents from our laboratory database (20 recordings of Wistar CrlCembe: WI rats and 20 recordings of C57BL/6JUnib mice), which performed the horizontal LRWT. At the time of the original experiments, the animals were provided by the Center for Experimental Biological Models (CeMBE) of the Pontifical Catholic University of Rio Grande do Sul. The animals were housed in cages, each containing three to four rodents on a 12-h dark&#x2013;light cycle with food and water available <italic>ad libitum</italic>, at a temperature of 22&#x2013;24&#x00B0;C. The experiments were carried out in accordance with the National Council for Animal Control and Experimentation (Concea), and all the procedures were approved by the University Animal Ethics Commission (CEUA) under protocol numbers 15/00442 and 15/00475.</p>
<sec id="S2.SS1">
<title>Ladder Rung Walking Test</title>
<p>We used two LRWT apparatuses, one for rats and another one adapted for mice. Both consisted of clear plexiglass side walls (100 cm long and 20 cm high). The diameter of the metal rungs varied, being 3 mm for rats and 2 mm for mice. The minimum and maximum gaps between the rungs also varied, being from 1 to 5 cm for rats and from 0.5 to 2.5 cm for mice. In both cases, the ladders were elevated horizontally 30 cm above the ground, with a neutral cage placed in the starting position and the animal&#x2019;s home cage placed at the opposite end of the ladder (<xref ref-type="fig" rid="F1">Figure 1</xref>). The between-wall distance was adjusted leaving 1 cm wider than the size of the rodent to prevent the animal from turning around during the crossing (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>; <xref ref-type="bibr" rid="B13">Farr et al., 2006</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Schematic illustration of the ladder rung walking test apparatus. Note that the rungs could be inserted in symmetrical or asymmetrical patterns. The between-rung space could be varied from 1 to 5 cm for rats and from 0.5 to 2.5 cm for mice. The animal starts the trial from the empty box and is expected to walk to achieve the home cage.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnbeh-16-892010-g001.tif"/>
</fig>
<p>The pattern of the metal rungs demands different degrees of skilled walking and can be used to vary the complexity of the test. A regular arrangement allows animals to learn the position of the rungs over training sessions and to anticipate limb placement (<xref ref-type="fig" rid="F1">Figure 1</xref>, symmetrical pattern). In irregular patterns, rungs are randomly repositioned in each trial to prevent the rodents from learning the rung sequence. Thus, irregular patterns are more useful when studying skilled walking (<xref ref-type="fig" rid="F1">Figure 1</xref>, asymmetrical pattern) (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>; <xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>). In this study, only irregular rung patterns were analyzed.</p>
<p>In the test, the animals were placed at the beginning of the ladder, and walked along with it, adapting their foot placement on the rungs until reaching the home cage (<xref ref-type="fig" rid="F1">Figure 1</xref>). While performing the test, we filmed the rodents using a camera (GoPro Hero 4, 12 megapixels). An acquisition rate of 240 frames per second (FPS) in a lateral view was adopted, allowing a <italic>post hoc</italic> frame-by-frame video analysis.</p>
</sec>
<sec id="S2.SS2">
<title>Foot Fault Scoring System Ladder Rung Walking Test</title>
<p>To assess the forelimb and hindlimb placement on the rungs, which requires precise and coordinated foot positioning as well as stride and inter-limbic coordination, a quantitative foot fault scoring system (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>) derived from a categorical analysis was used. In the system, a frame-by-frame video recording analysis is performed to identify the steps in each limb and qualify foot placement using a 7-point category scale (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>, <xref ref-type="bibr" rid="B27">2009</xref>; <xref ref-type="table" rid="T1">Table 1</xref>). The score 0 is given when the limb did not touch the rung (missed a rung) and resulted in a fall (total miss). A fall is considered when the limbs fell between rungs and the animal&#x2019;s posture and balance are disturbed. Score 1 is given when the limb slipped off a rung and a fall occurred (deep slip). Score 2 is given when the limb slipped off a rung during weight bearing, but a fall did not occur and the rodent interrupts walking (slight slip). Score 3 is given when, before weight bearing the limb on a rung, the rodent quickly lifted and placed the foot on another rung (replacement). Score 4 occurs when the limb is clearly about to be placed on a rung, but the rodent quickly changes the feet placement to another rung without touching the first rung (correction). Score 4 is also given when the limb is placed on a rung, but the animal removes the foot and repositions it on the same rung. Score 5 is given when the limb is placed on the rung either using the wrist or digits for the forelimb or heel or toes for the hindlimb (partial placement). Finally, score 6 is given when the full body weight bearing is applied on a rung with the midportion of the foot (correct placement) (<xref ref-type="table" rid="T1">Table 1</xref>).</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Rating scale for foot placement in the LRWT.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Category</td>
<td valign="top" align="center">Type of foot misplacement</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">0</td>
<td valign="top" align="center">Total miss</td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">Deep slip</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">Slight slip</td>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="center">Replacement</td>
</tr>
<tr>
<td valign="top" align="left">4</td>
<td valign="top" align="center">Correction</td>
</tr>
<tr>
<td valign="top" align="left">5</td>
<td valign="top" align="center">Partial placement</td>
</tr>
<tr>
<td valign="top" align="left">6</td>
<td valign="top" align="center">Correct placement</td>
</tr>
</tbody>
</table></table-wrap>
<p>The score given in each category is then multiplied by the frequency of foot placements in the same category. Later, the sum of all the categories provides the total combined score (sum of the forelimb plus the hindlimb scores). The fully explained video protocol and all technical details to apply the foot fault score were previously published by <xref ref-type="bibr" rid="B27">Metz and Whishaw (2009)</xref>.</p>
<p>In this study, the following outcomes in the LRWT were assessed for inter- and intra-rater agreements: total crossing time, number of stops, total time stopped, scores 0&#x2013;6 for forelimb, total score for forelimb, scores 0&#x2013;6 for hindlimb, total score of the hindlimb, and the combined total score of limbs.</p>
<p>The skilled walking performance score (SWPS) was represented as a percentage of the maximum possible performance (100%) (<xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B1">Altamentova et al., 2020</xref>). The number of cycles (NC) each rodent took to cross the ladder was multiplied by 6 (the maximum score for each cycle in the foot fault score system) and the resulting number was considered the maximum possible performance of each animal in a trial (100%). Then, during a trial, each cycle was rated according to the foot fault score system and the sum of the obtained scores provided the total score in the trial (TS). Finally, the SWPS was represented as a percentage of the maximum possible performance (100%) (<xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B1">Altamentova et al., 2020</xref>), as follows:</p>
<disp-formula id="S2.Ex1">
<mml:math id="M1">
<mml:mrow>
<mml:mrow>
<mml:mi>S</mml:mi>
<mml:mo>&#x2062;</mml:mo>
<mml:mi>W</mml:mi>
<mml:mo>&#x2062;</mml:mo>
<mml:mi>P</mml:mi>
<mml:mo>&#x2062;</mml:mo>
<mml:mi>S</mml:mi>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mrow>
<mml:mi>T</mml:mi>
<mml:mo>&#x2062;</mml:mo>
<mml:mi>S</mml:mi>
</mml:mrow>
<mml:mo>&#x00D7;</mml:mo>
<mml:mn>100</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2062;</mml:mo>
<mml:mi>C</mml:mi>
</mml:mrow>
<mml:mo>&#x00D7;</mml:mo>
<mml:mn>6</mml:mn>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
<p>where <italic>SWPS</italic> is skilled walking performance score, <italic>TS</italic> is total score in the trial, <italic>NC</italic> is the number of cycles, and 6 is the maximum score for each cycle in the foot fault score system.</p>
</sec>
<sec id="S2.SS3">
<title>Foot Placement Reliability Between Inter- and Intra-Rater</title>
<p>To assess inter- and intra-rater reliability, two independent and blinded raters (called I and II) analyzed 20 rats and 20 mice videos. Each video was analyzed twice by the same rater (80 analyses per rater). The videos were named randomly by another independent researcher (not involved in the analyses) to prevent raters I and II from perceiving half of the videos that were similar. Thus, each video had a different number to ensure a blinded reproducibility Analysis. Rater I (A. Schiavo) was inexperienced in the foot fault score and received supervised training before starting data collection. Rater II (L. A. Martins) had previous experience and publications using the LRWT (<xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>).</p>
</sec>
<sec id="S2.SS4">
<title>Statistical Analysis</title>
<p>Descriptive statistics were used to characterize the sample profile in the SWPS. The intraclass correlation coefficient (ICC) and the Kappa coefficient were employed to verify the accuracy of agreement and reliability in the inter- and intra-rater analyses of the foot fault scores. Agreement values in ICC greater than 0.75 were considered &#x201C;excellent,&#x201D; those between 0.4 and 0.75 were considered &#x201C;satisfactory,&#x201D; and those &#x003C;0.4 were considered &#x201C;poor.&#x201D; When negative ICC values (difference between values greater than sample variance) occurred, the data were replaced by zero, as recommended by <xref ref-type="bibr" rid="B4">Bartko (1976)</xref> and <xref ref-type="bibr" rid="B31">Shrout and Fleiss (1979)</xref>. The statistical analysis was performed using the software Statistical Package for the Social Sciences (SPSS) version 20.0.</p>
</sec>
</sec>
<sec id="S3" sec-type="results">
<title>Results</title>
<sec id="S3.SS1">
<title>Inter-Rater Reliability for Rat</title>
<p>The LRWT analyses in rats demonstrated that raters I and II achieved an excellent agreement in the combined total score of limbs (ICC = 0.938/<italic>p</italic> = 0.0001). Regarding all the timed outcomes, the total crossing time (ICC = 0.994/<italic>p</italic> = 0.0001) and the total time stopped (ICC = 0.992/<italic>p</italic> = 0.0001) agreement levels were considered excellent, as were the variable number of stops (ICC = 0.957/<italic>p</italic> = 0.0001). Thus, the reliability between the total score for forelimb and hindlimb placement was shown to be excellent.</p>
<p>Furthermore, we analyzed the reliability among all scores described in the test, specifically, in the categories of 0&#x2013;6 for each of the limbs evaluated. For the forelimb, the data showed an excellent reliability for scores 0, 1, and 2, with ICC varying from 0.839 to 1 (<italic>p</italic> = 0.0001) as well as for scores 5 and 6, with ICC varying from 0.813 and 0.854, respectively (<italic>p</italic> = 0.0001). However, for the forelimb scores 3 and 4, the raters obtained a satisfactory agreement (ICC 0.721 and 0.551, respectively/<italic>p</italic> &#x2264; 0.045). Similarly, for the hindlimb, excellent reliability was obtained for scores 0, 1, 3, and 4, with ICC ranging from 0.889 to 0.931 (<italic>p</italic> = 0.0001). The reliability for scores 2, 5, and 6 was also considered satisfactory (<xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Agreement between raters I and II regarding the outcomes obtained in the LRWT in rats.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Outcome</td>
<td valign="top" align="center">ICC (IC 95%)</td>
<td valign="top" align="center">Cronbach&#x2019;s alpha</td>
<td valign="top" align="center"><italic>p</italic>-Value</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" colspan="4"><bold>Foot fault scoring in rat</bold></td>
</tr>
<tr>
<td valign="top" align="left">Combined total score</td>
<td valign="top" align="center">0.938 (0.844&#x2013;0.976)</td>
<td valign="top" align="center">0.938</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total crossing time</td>
<td valign="top" align="center">0.994 (0.985&#x2013;0.998)</td>
<td valign="top" align="center">0.994</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Number of stops</td>
<td valign="top" align="center">0.957 (0.892&#x2013;0.983)</td>
<td valign="top" align="center">0.957</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total time stopped</td>
<td valign="top" align="center">0.992 (0.980&#x2013;0.997)</td>
<td valign="top" align="center">0.992</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>Forelimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">0.839 (0.594&#x2013;0.936)</td>
<td valign="top" align="center">0.839</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.903 (0.754&#x2013;0.961)</td>
<td valign="top" align="center">0.903</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.721 (0.295&#x2013;0.889)</td>
<td valign="top" align="center">0.721</td>
<td valign="top" align="center">0.004<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">0.551 (0.000&#x2013;0.822)</td>
<td valign="top" align="center">0.551</td>
<td valign="top" align="center">0.045<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.854 (0.631&#x2013;0.942)</td>
<td valign="top" align="center">0.854</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.813 (0.528&#x2013;0.926)</td>
<td valign="top" align="center">0.813</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.879 (0.695&#x2013;0.952)</td>
<td valign="top" align="center">0.879</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>Hindlimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">0.931 (0.826&#x2013;0.973)</td>
<td valign="top" align="center">0.931</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.593 (0.000&#x2013;0.839)</td>
<td valign="top" align="center">0.593</td>
<td valign="top" align="center">0.028<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.41 (0.000&#x2013;0.620)</td>
<td valign="top" align="center">0.41</td>
<td valign="top" align="center">0.456</td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.592 (0.000&#x2013;0.839)</td>
<td valign="top" align="center">0.592</td>
<td valign="top" align="center">0.029<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.931 (0.826&#x2013;0.973)</td>
<td valign="top" align="center">0.931</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t2fns1">&#x002A;</xref></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t2fns1"><p><italic>&#x002A;Statistically significant difference.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
<p>The individual results for each animal in relation to SWPS are shown in <xref ref-type="fig" rid="F2">Figures 2</xref>, <xref ref-type="fig" rid="F3">3</xref>. In addition, the frequency of each score (1&#x2013;6) for the hindlimb and forelimb of each rodent is shown in <xref ref-type="fig" rid="F4">Figures 4</xref>, <xref ref-type="fig" rid="F5">5</xref>.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Skilled walking performance score (SWPS)&#x002A; obtained by raters I and II. The SWPS is represented as a percentage of the maximum possible performance. The number of cycles (NC) each rodent took to cross the ladder is multiplied by 6 (the maximum score for each cycle in the foot fault score system) and the resulting number is considered the maximum possible animal performance (100%). In a trial, each cycle is rated according to the foot fault score system and the sum of the obtained scores provided the total score in the trial (TS). &#x002A;SWPS = [(TS &#x00D7; 100)/(NC &#x00D7; 6)].</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnbeh-16-892010-g002.tif"/>
</fig>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>Skilled walking performance score (SWPS) obtained at first (a) and second (b) assessment by raters I and II. Note that both assessments present the same data distribution pattern.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnbeh-16-892010-g003.tif"/>
</fig>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Frequency (%) of each foot placement rate (from 0 to 6), as judged by raters I and II in the study rodents. Note that all possible foot placement rates were observed in the study sample, while score 6 (correct placement) was the most frequent for both forelimb and hindlimb, and the lower scores (&#x2264;3) were also present. <bold>(A&#x2013;D)</bold>: mice hindlimb and forelimb rates; <bold>(E&#x2013;H)</bold>: rat hindlimb and forelimb rates.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnbeh-16-892010-g004.tif"/>
</fig>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption><p>Frequency (%) of each foot placement rate (from 0 to 6) in the first (a) and second (b) assessment by raters I and II. Note that the overall rate distribution pattern was similar between raters and trials. <bold>(A&#x2013;D)</bold>: scores attributed by rater I; <bold>(E&#x2013;H)</bold>: scores attributed by rater II.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnbeh-16-892010-g005.tif"/>
</fig>
</sec>
<sec id="S3.SS2">
<title>Inter-Rater Reliability for Mice</title>
<p>The inter-rater reliability score system for mice is shown in <xref ref-type="table" rid="T3">Table 3</xref>. We observed a strong agreement between the raters in the combined total score (ICC = 0.954/<italic>p</italic> = 0.0001), total crossing time (ICC = 1/<italic>p</italic> = 0.0001), the number of steps (ICC = 0.922/<italic>p</italic> = 0.0001), and total time stopped (ICC = 0.998/<italic>p</italic> = 0.0001). In addition, the forelimb and hindlimb placement scores showed excellent agreement in the LRWT, with less consistency for forelimb placement (score 3) (ICC = 0.466/<italic>p</italic> = 0.090) and hindlimb correction (score 4) (ICC = 0.484/<italic>p</italic> = 0.079). Overall, the total scores for the forelimb (ICC = 0.925/<italic>p</italic> = 0.0001) and hindlimb (ICC = 0.919/<italic>p</italic> = 0.0001) placement between raters I and II showed strong agreement.</p>
<table-wrap position="float" id="T3">
<label>TABLE 3</label>
<caption><p>Agreement between raters I and II regarding the outcomes (scores) recorded in the LRWT in mice.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Outcome</td>
<td valign="top" align="center">ICC (IC 95%)</td>
<td valign="top" align="center">Cronbach&#x2019;s alpha</td>
<td valign="top" align="center"><italic>p</italic>-Value</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" colspan="4"><bold>Foot fault scoring in mice</bold></td>
</tr>
<tr>
<td valign="top" align="left">Combined total score</td>
<td valign="top" align="center">0.954 (0.883&#x2013;0.982)</td>
<td valign="top" align="center">0.954</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total crossing time</td>
<td valign="top" align="center">1 (0.999&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Number of stops</td>
<td valign="top" align="center">0.922 (0.802&#x2013;0.969)</td>
<td valign="top" align="center">0.922</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total time stopped</td>
<td valign="top" align="center">0.998 (0.995&#x2013;0.999)</td>
<td valign="top" align="center">0.998</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>Forelimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">0.755 (0.381&#x2013;0.903)</td>
<td valign="top" align="center">0.755</td>
<td valign="top" align="center">0.002<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.699 (0.239&#x2013;0.881)</td>
<td valign="top" align="center">0.699</td>
<td valign="top" align="center">0.006<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.466 (0.000&#x2013;0.789)</td>
<td valign="top" align="center">0.466</td>
<td valign="top" align="center">0.090</td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">0.904 (0.757&#x2013;0.962)</td>
<td valign="top" align="center">0.904</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.830 (0.571&#x2013;0.933)</td>
<td valign="top" align="center">0.830</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.712 (0.271&#x2013;0.886)</td>
<td valign="top" align="center">0.721</td>
<td valign="top" align="center">0.005<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.925 (0.812&#x2013;0.970)</td>
<td valign="top" align="center">0.925</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>Hindlimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">0.822 (0.550&#x2013;0.929)</td>
<td valign="top" align="center">0.822</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.938 (0.844&#x2013;0.976)</td>
<td valign="top" align="center">0.938</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.751 (0.371&#x2013;0.901)</td>
<td valign="top" align="center">0.751</td>
<td valign="top" align="center">0.002<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">0.484 (0.000&#x2013;0.796)</td>
<td valign="top" align="center">0.484</td>
<td valign="top" align="center">0.079</td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.622 (0.046&#x2013;0.850)</td>
<td valign="top" align="center">0.622</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.764 (0.405&#x2013;0.907)</td>
<td valign="top" align="center">0.764</td>
<td valign="top" align="center">0.001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.919 (0.795&#x2013;0.968)</td>
<td valign="top" align="center">0.919</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t3fns1">&#x002A;</xref></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t3fns1"><p><italic>&#x002A;Statistically significant difference.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS3">
<title>Intra-Rater Reliability for Rat</title>
<p><xref ref-type="table" rid="T4">Table 4</xref> shows the intra-rater analyses in rats. We found excellent agreement in the combined total score, total crossing time, number of stops, and total time stopped for both raters. Regarding score evaluation, rater I obtained excellent agreement in all the scores for the forelimb (ICC between 0.899 and 0.989/<italic>p</italic> = 0.0001). Rater II achieved excellent agreement in all scores for forelimb (ICC between 0.787 and 0.920), except for score 6, which was considered satisfactory (ICC = 0.652/<italic>p</italic> = 0.13).</p>
<table-wrap position="float" id="T4">
<label>TABLE 4</label>
<caption><p>Intra-rater agreement on outcomes in the analyses of the LRWT in rats.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="3">Rater I<hr/></td>
<td valign="top" align="center" colspan="3">Rater II<hr/></td>
</tr>
<tr>
<td valign="top" align="left">Outcome</td>
<td valign="top" align="center">ICC (IC 95%)</td>
<td valign="top" align="center">Cronbach&#x2019;s alpha</td>
<td valign="top" align="center"><italic>p</italic>-Value</td>
<td valign="top" align="center">ICC (IC 95%)</td>
<td valign="top" align="center">Cronbach&#x2019;s alpha</td>
<td valign="top" align="center"><italic>p</italic>-Value</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Combined total score</td>
<td valign="top" align="center">0.969 (0.922&#x2013;0.988)</td>
<td valign="top" align="center">0.969</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.950 (0.875&#x2013;0.980)</td>
<td valign="top" align="center">0.950</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total crossing time</td>
<td valign="top" align="center">0.993 (0.982&#x2013;0.997)</td>
<td valign="top" align="center">0.993</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.981 (0.953&#x2013;0.993)</td>
<td valign="top" align="center">0.981</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Number of stops</td>
<td valign="top" align="center">0.950 (0.873&#x2013;0.980)</td>
<td valign="top" align="center">0.950</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.915 (0.786&#x2013;0.966)</td>
<td valign="top" align="center">0.915</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total time stopped</td>
<td valign="top" align="center">0.806 (0.509&#x2013;0.923)</td>
<td valign="top" align="center">0.806</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.939 (0.847&#x2013;0.976)</td>
<td valign="top" align="center">0.939</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="7"><bold>Forelimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">0.899 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.899</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.919 (0.796&#x2013;0.968)</td>
<td valign="top" align="center">0,919</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.842 (0.600&#x2013;0.937)</td>
<td valign="top" align="center">0.842</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.989 (0.973&#x2013;0.996)</td>
<td valign="top" align="center">0.989</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.877 (0.688&#x2013;0.951)</td>
<td valign="top" align="center">0.877</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.978 (0.944&#x2013;0.991)</td>
<td valign="top" align="center">0.978</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.920 (0.797&#x2013;0.968)</td>
<td valign="top" align="center">0.920</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">0.941 (0.851&#x2013;0.977)</td>
<td valign="top" align="center">0.941</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.849 (0.618&#x2013;0.940)</td>
<td valign="top" align="center">0.849</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.948 (0.869&#x2013;0.979)</td>
<td valign="top" align="center">0.948</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.787 (0.462&#x2013;0.916)</td>
<td valign="top" align="center">0.787</td>
<td valign="top" align="center">0.001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.905 (0.761&#x2013;0.963)</td>
<td valign="top" align="center">0.905</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.652 (0.121&#x2013;0.862)</td>
<td valign="top" align="center">0.652</td>
<td valign="top" align="center">0.13</td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.916 (0.787&#x2013;0.967)</td>
<td valign="top" align="center">0.916</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.875 (0.685&#x2013;0.951)</td>
<td valign="top" align="center">0.875</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="7"><bold>Hindlimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.962 (0.904&#x2013;0.985)</td>
<td valign="top" align="center">0.962</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.838 (0.591&#x2013;0.936)</td>
<td valign="top" align="center">0.838</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.829 (0.567&#x2013;0.932)</td>
<td valign="top" align="center">0.829</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.904 (0.758&#x2013;0.962)</td>
<td valign="top" align="center">0.904</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.992 (0.980&#x2013;0.997)</td>
<td valign="top" align="center">0.992</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.637 (0.83&#x2013;0.856)</td>
<td valign="top" align="center">0.637</td>
<td valign="top" align="center">0.16</td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.982 (0.954&#x2013;0.993)</td>
<td valign="top" align="center">0.982</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.810 (0.519&#x2013;0.925</td>
<td valign="top" align="center">0.810</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.988 (0.970&#x2013;0.995)</td>
<td valign="top" align="center">0.988</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.970 (0.924&#x2013;0.988)</td>
<td valign="top" align="center">0.970</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t4fns1">&#x002A;</xref></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t4fns1"><p><italic>&#x002A;Statistically significant difference.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
<p>In relation to hindlimb agreement, rater I obtained a similar excellent degree of agreement to that for the forelimb, with ICC ranging from 0.838 to 1/<italic>p</italic> = 0.0001. In contrast, rater II achieved a lower agreement than rater I, and the ICC was very good, ranging from 0.637 to 1, with only score 5 graded as satisfactory (ICC 0.637). Moreover, both raters obtained excellent intra-rater scores in the outcomes, namely, combined total score, total crossing time, number of steps, total time stopped, and total score for forelimb and hindlimb, with ICC ranging from 0.806 to 0.993 for rater I and from 0.915 to 0.981 for rater II.</p>
</sec>
<sec id="S3.SS4">
<title>Intra-Rater Reliability for Rats</title>
<p>Overall, the intra-rater reliability for mice was excellent for both raters (<xref ref-type="table" rid="T5">Table 5</xref>). For rater I, in the forelimb, foot placement agreement for all the 7 scores was excellent (with ICC ranging from 0.939 to 1/<italic>p</italic> = 0.0001). For rater II, the agreement was also excellent, with ICC varying between 0.778 and 0.968 for scores 0&#x2013;5. However, score 6 was considered satisfactory (ICC 0.488/<italic>p</italic> = 0.077). Regarding the hindlimb placement, similar results were found, with the raters only differing in score 6 (rater II obtained a lower ICC: 0.749/<italic>p</italic> = 0.002) (<xref ref-type="table" rid="T5">Table 5</xref>).</p>
<table-wrap position="float" id="T5">
<label>TABLE 5</label>
<caption><p>Intra-rater agreement on outcomes in the analyses of the LRWT in mice.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="3">Rater I<hr/></td>
<td valign="top" align="center" colspan="3">Rater II<hr/></td>
</tr>
<tr>
<td valign="top" align="left">Outcome</td>
<td valign="top" align="center">ICC (IC 95%)</td>
<td valign="top" align="center">Cronbach&#x2019;s alpha</td>
<td valign="top" align="center"><italic>p</italic>-Value</td>
<td valign="top" align="center">ICC (IC 95%)</td>
<td valign="top" align="center">Cronbach&#x2019;s alpha</td>
<td valign="top" align="center"><italic>p</italic>-Value</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Combined total score</td>
<td valign="top" align="center">0.971 (0.926&#x2013;0.988)</td>
<td valign="top" align="center">0.971</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.963 (0.906&#x2013;0.985)</td>
<td valign="top" align="center">0.963</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total crossing time</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.999 (0.998&#x2013;1)</td>
<td valign="top" align="center">0.999</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Number of stops</td>
<td valign="top" align="center">0.948 (0.868&#x2013;0.979)</td>
<td valign="top" align="center">0.948</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.774 (0.429&#x2013;0.911)</td>
<td valign="top" align="center">0.774</td>
<td valign="top" align="center">0.001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total time stopped</td>
<td valign="top" align="center">0.988 (0.969&#x2013;0.995)</td>
<td valign="top" align="center">0.988</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.985 (0.963&#x2013;0.994)</td>
<td valign="top" align="center">0.985</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="7"><bold>Forelimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.919 (0.796&#x2013;0.968)</td>
<td valign="top" align="center">0.919</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.778 (0.440&#x2013;0.912)</td>
<td valign="top" align="center">0.778</td>
<td valign="top" align="center">0.001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.979 (0.947&#x2013;0.992)</td>
<td valign="top" align="center">0.979</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.829 (0.568&#x2013;0.932)</td>
<td valign="top" align="center">0.829</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.979 (0.948&#x2013;0.992)</td>
<td valign="top" align="center">0.979</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.899 (0.746&#x2013;0.960)</td>
<td valign="top" align="center">0.899</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">0.939 (0.846&#x2013;0.976)</td>
<td valign="top" align="center">0.939</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.956 (0.888&#x2013;0.982)</td>
<td valign="top" align="center">0.956</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.982 (0.965&#x2013;0.995)</td>
<td valign="top" align="center">0.982</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.928 (0.817&#x2013;0.971)</td>
<td valign="top" align="center">0.928</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.950 (0.873&#x2013;0.980)</td>
<td valign="top" align="center">0.950</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.488 (0.000&#x2013;0.797)</td>
<td valign="top" align="center">0.488</td>
<td valign="top" align="center">0.077</td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.978 (0.944&#x2013;0.991)</td>
<td valign="top" align="center">0.978</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.934 (0.833&#x2013;0.974)</td>
<td valign="top" align="center">0.934</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left" colspan="7"><bold>Hindlimb placement</bold></td>
</tr>
<tr>
<td valign="top" align="left">Score 0</td>
<td valign="top" align="center">0.919 (0.796&#x2013;0.968)</td>
<td valign="top" align="center">0.919</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 1</td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.889 (0.719&#x2013;0.956)</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 2</td>
<td valign="top" align="center">0.978 (0.945&#x2013;0.991)</td>
<td valign="top" align="center">0.978</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.963 (0.908&#x2013;0.986)</td>
<td valign="top" align="center">0.936</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 3</td>
<td valign="top" align="center">0.936 (0.839&#x2013;0.975)</td>
<td valign="top" align="center">0.936</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.821 (0.548&#x2013;0.929)</td>
<td valign="top" align="center">0.821</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 4</td>
<td valign="top" align="center">1 (1&#x2013;1)</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.886 (0.713&#x2013;0.955)</td>
<td valign="top" align="center">0.886</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 5</td>
<td valign="top" align="center">0.982 (0.953&#x2013;0.993)</td>
<td valign="top" align="center">0.982</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.861 (0.649&#x2013;0.945)</td>
<td valign="top" align="center">0.861</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Score 6</td>
<td valign="top" align="center">0.958 (0.895&#x2013;0.983)</td>
<td valign="top" align="center">0.958</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.749 (0.367&#x2013;0.901)</td>
<td valign="top" align="center">0.749</td>
<td valign="top" align="center">0.002<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Total score</td>
<td valign="top" align="center">0.950 (0.873&#x2013;0.980)</td>
<td valign="top" align="center">0.950</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.951 (0.876&#x2013;0.981)</td>
<td valign="top" align="center">0.951</td>
<td valign="top" align="center">0.0001<xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t5fns1"><p><italic>&#x002A;Statistically significant difference.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec id="S4" sec-type="discussion">
<title>Discussion</title>
<p>Studying skilled walking in rodents is of importance to translational neuroscience, since the irregular distribution of the rungs in the walking path requires the animal&#x2019;s capacity to adjust its stride length and paw placement and control the center of mass. These adaptive motor control strategies are also found and widely studied in humans (<xref ref-type="bibr" rid="B6">Beauchet et al., 2008</xref>). Rodents and humans perform some similar movements to protect an injured limb and/or prevent falls (<xref ref-type="bibr" rid="B19">Jacobs et al., 2014</xref>). The LRWT fulfills the fundamental principles of skilled walking, such as pattern of rhythmic reciprocal limb movement, supporting body balance against gravity and adapting locomotion in response to environmental challenges (<xref ref-type="bibr" rid="B3">Balasubramanian et al., 2014</xref>).</p>
<p>Metz and Whishaw created the LRWT in 2002 to assess forelimb and hindlimb stepping, placing, and coordination in models of cortical and subcortical injury. According to the authors, the test is a sensitive skilled task for assessing slight impairments of walking function and is useful when assessing functional recovery following brain or spinal cord injury and the effectiveness of rehabilitative therapies (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>; <xref ref-type="bibr" rid="B28">Riek-Burchardt et al., 2004</xref>). Locomotion during the LRWT is known to depend on ascending and descending neural pathways, since accurately crossing the rungs requires finely adjusted motor control, balance, limb coordination, and muscle control (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>; <xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>).</p>
<p>However, to determine the psychometric properties of behavioral tests, it is essential to obtain reliable, consistent, and scientifically valid findings (<xref ref-type="bibr" rid="B33">Souza et al., 2017</xref>). Both intra- and inter-rater agreements are important metrics to ensure reliability and reproducibility (<xref ref-type="bibr" rid="B22">Meseguer-Henarejos et al., 2018</xref>). Here, we sought to assess intra- and inter-rater agreement in the foot fault score of the LRWT using two strains of rodents, i.e., Wistar rats and C57BL/6 mice. Two independent researchers (with and without previous experience using the test&#x2019;s scoring system) analyzed the videos. Our findings suggest that the foot fault score system of the LRWT is a useful, reliable, and consistent tool for studying skilled walking performance in rodents. We also found excellent inter and intra-rater reliability for &#x201C;total crossing time,&#x201D; &#x201C;number of stops,&#x201D; and &#x201C;total time stopped.&#x201D; The agreement measures provided by this study suggest that data obtained by different research groups using the LRWT should be comparable (<xref ref-type="bibr" rid="B18">Hutchinson et al., 2017</xref>) and should encourage the use of the test in further studies.</p>
<p>The LRWT is an interesting option for researchers investigating neural mechanisms involved in the ability to adapt walking (<xref ref-type="bibr" rid="B25">Metz et al., 2001</xref>; <xref ref-type="bibr" rid="B12">Faraji and Metz, 2007</xref>; <xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>). Since the score reflects the animal&#x2019;s ability to adapt limb placement and position in a contextual environment (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>; <xref ref-type="bibr" rid="B19">Jacobs et al., 2014</xref>), the foot fault score system is useful to study skilled walking in rodents (<xref ref-type="bibr" rid="B21">Medeiros et al., 2018</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>). While traditional biomechanical models of walking analysis require expensive devices, constant animal handling for placing reflective markers, and development of signal-processing routines (<xref ref-type="bibr" rid="B37">Vrinten and Hamers, 2003</xref>; <xref ref-type="bibr" rid="B7">Berryman et al., 2009</xref>), the LRWT provides skilled walking assessment using a fast, simple, and inexpensive method.</p>
<p>Whereas we observed satisfactory to excellent intraclass correlation indexes in rating individual scores (0&#x2013;6), caution is necessary when using the foot fault score system. Individual scores present subtle differences that may confuse untrained raters. For example, differentiating between scores 3 (replacement) and 4 (correction) requires attention to identify whether the rodent touched the rung before completing paw placement. Moreover, in some situations, the rodent supports a single paw simultaneously on two rungs that are placed too close to each other. This may cause confusion in scores 5 (partial placement) or 6 (correct placement). In addition, rodents sometimes place their paw on the acrylic wall to help walking forward, a behavior that is not considered in the foot fault score system. Furthermore, the subtle differences between scores 1 (deep slip) and 2 (slight slip) may cause uncertainty for untrained raters. Finally, the speed of the video recording may also change the perception of the raters during the gait cycle analysis (<xref ref-type="bibr" rid="B34">Spitz et al., 2017</xref>). Thus, these results suggest that experienced and inexperienced raters can get reliable results if appropriate training is provided. We highly recommended the careful study of the article and videos, as previously published by <xref ref-type="bibr" rid="B26">Metz and Whishaw (2002</xref>, <xref ref-type="bibr" rid="B27">2009)</xref>, and supervised practice before using the foot fault scoring system.</p>
<p>Despite being originally designed for rats, the LRWT can be used in mice with some adjustments to the apparatus, namely, (a) the diameter of the rungs should be reduced to allow a proper grip and paw placement; and (b) the minimal and maximal between-rung interval should be changed, as previously described (<xref ref-type="bibr" rid="B13">Farr et al., 2006</xref>; <xref ref-type="bibr" rid="B38">Wearick-Silva et al., 2018</xref>). Our findings show that these adaptations are valid to obtain reliable results in C57BL/6 mice and may be valid for other mice strains.</p>
<p>It is important to mention that an adaptation of a ladder beam walking task in mice following spinal cord injury was previously tested in terms of the test reliability (<xref ref-type="bibr" rid="B9">Cummings et al., 2007</xref>). However, the authors did not use the foot fault score system (<xref ref-type="bibr" rid="B26">Metz and Whishaw, 2002</xref>, <xref ref-type="bibr" rid="B27">2009</xref>). Thus, we cannot directly compare their obtained findings with this study.</p>
<p>This study has some limitations. First, only two rodent strains were assessed. Anyway, the current findings provide evidence of the accuracy and reliability of the foot fault score in both Wistar rats and C57BL/6 mice. Second, we did not compare specific injury models. Despite this, all individual scores (0&#x2013;6) in the foot fault score were found in the study videos, which minimize this concern. In this study, a third rater analyzed five of the videos, randomly selected, and all the obtained results were within the limits of the 95% confidence intervals (obtained by raters I and II). Thus, to reach the study goal, we concluded that including more raters would be unnecessary. Nevertheless, the diversity of the rater backgrounds, e.g., researchers from different countries or areas of expertise, might have some influence on the foot fault score reliability.</p>
<p>We concluded that the foot fault score of the LRWT is a reliable and useful tool to study skilled walking in rodents. Damage to the nervous system frequently impairs walking adaptability and performance. When assessing the impact of such damage, the foot fault score has been proven useful in detecting skilled walking deficits in rodent models. Our findings show that experienced and inexperienced raters can obtain reliable results when previous supervised training is provided. These findings are of importance for researchers working in the field of translational neuroscience and motor control and impact on the comparability of results obtained worldwide using the foot fault score in the LRWT.</p>
</sec>
<sec id="S5" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="S6">
<title>Ethics Statement</title>
<p>The animal study was reviewed and approved by the CEUA &#x2013; Pontif&#x00ED;cia Universidade Cat&#x00F3;lica do Rio Grande do Sul.</p>
</sec>
<sec id="S7">
<title>Author Contributions</title>
<p>LM, AS, LX, and RM contributed to the conception and design of the study. LM and AS organized the data and performed the statistical analysis. LM, AS, and RM wrote the manuscript. All authors contributed to the manuscript review, read, and approved the submitted version.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="pudiscl1" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="S8" sec-type="funding-information">
<title>Funding</title>
<p>This study was carried out with the support of the Coordination of Improvement of Higher Education Personnel &#x2013; Brazil (CAPES) &#x2013; Financing Code 001 and the National Council of Scientific and Technological Development (CNPq).</p>
</sec>
<ack><p>We thank Filipe Mello Medeiros and Rodrigo Orso for their valuable contribution in acquiring the video recordings.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Altamentova</surname> <given-names>S.</given-names></name> <name><surname>Rumajogee</surname> <given-names>P.</given-names></name> <name><surname>Hong</surname> <given-names>J.</given-names></name> <name><surname>Beldick</surname> <given-names>S. R.</given-names></name> <name><surname>Park</surname> <given-names>S. J.</given-names></name> <name><surname>Yee</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>2020</year>). <article-title>Methylprednisolone reduces persistent post-ischemic inflammation in a rat hypoxia-ischemia model of perinatal stroke.</article-title> <source><italic>Transl. Stroke Res.</italic></source> <volume>11</volume> <fpage>1117</fpage>&#x2013;<lpage>1136</lpage>. <pub-id pub-id-type="doi">10.1007/s12975-020-00792-2</pub-id> <pub-id pub-id-type="pmid">32140998</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Antonow-Schlorke</surname> <given-names>I.</given-names></name> <name><surname>Ehrhardt</surname> <given-names>J.</given-names></name> <name><surname>Knieling</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>Modification of the ladder rung walking task&#x2014;new options for analysis of skilled movements.</article-title> <source><italic>Stroke Res. Treat.</italic></source> <volume>2013</volume>:<issue>418627</issue>. <pub-id pub-id-type="doi">10.1155/2013/418627</pub-id> <pub-id pub-id-type="pmid">23577278</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Balasubramanian</surname> <given-names>C. K.</given-names></name> <name><surname>Clark</surname> <given-names>D. J.</given-names></name> <name><surname>Fox</surname> <given-names>E. J.</given-names></name></person-group> (<year>2014</year>). <article-title>Walking adaptability after a stroke and its assessment in clinical settings.</article-title> <source><italic>Stroke Res. Treat.</italic></source> <volume>2014</volume>:<issue>591013</issue>. <pub-id pub-id-type="doi">10.1155/2014/591013</pub-id> <pub-id pub-id-type="pmid">25254140</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartko</surname> <given-names>J. J.</given-names></name></person-group> (<year>1976</year>). <article-title>On various intraclass correlation reliability coefficients.</article-title> <source><italic>Psychol. Bull.</italic></source> <volume>83</volume> <fpage>762</fpage>&#x2013;<lpage>765</lpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.83.5.762</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bauman</surname> <given-names>J. M.</given-names></name> <name><surname>Chang</surname> <given-names>Y. H.</given-names></name></person-group> (<year>2010</year>). <article-title>High-speed X-ray video demonstrates significant skin movement errors with standard optical kinematics during rat locomotion.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>186</volume> <fpage>18</fpage>&#x2013;<lpage>24</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2009.10.017</pub-id> <pub-id pub-id-type="pmid">19900476</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beauchet</surname> <given-names>O.</given-names></name> <name><surname>Herrmann</surname> <given-names>F. R.</given-names></name> <name><surname>Grandjean</surname> <given-names>R.</given-names></name> <name><surname>Dubost</surname> <given-names>V.</given-names></name> <name><surname>Allali</surname> <given-names>G.</given-names></name></person-group> (<year>2008</year>). <article-title>Concurrent validity of SMTEC<sup>&#x00AE;</sup> footswitches system for the measurement of temporal gait parameters.</article-title> <source><italic>Gait Posture</italic></source> <volume>27</volume>, <fpage>156</fpage>&#x2013;<lpage>159</lpage>. <pub-id pub-id-type="doi">10.1016/j.gaitpost.2006.12.017</pub-id> <pub-id pub-id-type="pmid">17291765</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berryman</surname> <given-names>E. R.</given-names></name> <name><surname>Harris</surname> <given-names>R. L.</given-names></name> <name><surname>Moalli</surname> <given-names>M.</given-names></name> <name><surname>Bagi</surname> <given-names>C. M.</given-names></name></person-group> (<year>2009</year>). <article-title>Digigait quantitation of gait dynamics in rat rheumatoid arthritis model.</article-title> <source><italic>J. Musculoskelet. Neuronal Interact.</italic></source> <volume>9</volume> <fpage>89</fpage>&#x2013;<lpage>98</lpage>. <pub-id pub-id-type="pmid">19516084</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Caetano</surname> <given-names>M. J. D.</given-names></name> <name><surname>Lord</surname> <given-names>S. R.</given-names></name> <name><surname>Brodie</surname> <given-names>M. A.</given-names></name> <name><surname>Schoene</surname> <given-names>D.</given-names></name> <name><surname>Pelicioni</surname> <given-names>P. H. S.</given-names></name> <name><surname>Sturnieks</surname> <given-names>D. L.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Executive functioning, concern about falling and quadriceps strength mediate the relationship between impaired gait adaptability and fall risk in older people.</article-title> <source><italic>Gait Posture</italic></source> <volume>59</volume> <fpage>188</fpage>&#x2013;<lpage>192</lpage>. <pub-id pub-id-type="doi">10.1016/j.gaitpost.2017.10.017</pub-id> <pub-id pub-id-type="pmid">29055270</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cummings</surname> <given-names>B. J.</given-names></name> <name><surname>Engesser-Cesar</surname> <given-names>C.</given-names></name> <name><surname>Anderson</surname> <given-names>A. J.</given-names></name></person-group> (<year>2007</year>). <article-title>Adaptation of a ladder beam walking task to assess locomotor recovery in mice following spinal cord injury.</article-title> <source><italic>Behav. Brain Res.</italic></source> <volume>177</volume> <fpage>232</fpage>&#x2013;<lpage>241</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbr.2006.11.042</pub-id> <pub-id pub-id-type="pmid">17197044</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ducharme</surname> <given-names>S. W.</given-names></name> <name><surname>Liddy</surname> <given-names>J. J.</given-names></name> <name><surname>Haddad</surname> <given-names>J. M.</given-names></name> <name><surname>Busa</surname> <given-names>M. A.</given-names></name> <name><surname>Claxton</surname> <given-names>L. J.</given-names></name> <name><surname>van Emmerik</surname> <given-names>R. E.</given-names></name></person-group> (<year>2018</year>). <article-title>Association between stride time fractality and gait adaptability during unperturbed and asymmetric walking.</article-title> <source><italic>Hum. Mov. Sci.</italic></source> <volume>58</volume> <fpage>248</fpage>&#x2013;<lpage>259</lpage>. <pub-id pub-id-type="doi">10.1016/j.humov.2018.02.011</pub-id> <pub-id pub-id-type="pmid">29505917</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Esteves</surname> <given-names>P. O.</given-names></name> <name><surname>Oliveira</surname> <given-names>L. A. S.</given-names></name> <name><surname>Nogueira-Campos</surname> <given-names>A. A.</given-names></name> <name><surname>Saunier</surname> <given-names>G.</given-names></name> <name><surname>Pozzo</surname> <given-names>T.</given-names></name> <name><surname>Oliveira</surname> <given-names>J. M.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Motor planning of goal-directed action is tuned by the emotional valence of the stimulus: a kinematic study.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>6</volume>:<issue>28780</issue>. <pub-id pub-id-type="doi">10.1038/srep28780</pub-id> <pub-id pub-id-type="pmid">27364868</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Faraji</surname> <given-names>J.</given-names></name> <name><surname>Metz</surname> <given-names>G.</given-names></name></person-group> (<year>2007</year>). <article-title>Sequential bilateral striatal lesions have additive effects on single skilled limb use in rats.</article-title> <source><italic>Behav. Brain Res.</italic></source> <volume>177</volume> <fpage>195</fpage>&#x2013;<lpage>204</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbr.2006.11.034</pub-id> <pub-id pub-id-type="pmid">17182115</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farr</surname> <given-names>T. D.</given-names></name> <name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Colwell</surname> <given-names>K. L.</given-names></name> <name><surname>Whishaw</surname> <given-names>I. Q.</given-names></name> <name><surname>Metz</surname> <given-names>G. A.</given-names></name></person-group> (<year>2006</year>). <article-title>Bilateral alteration in stepping pattern after unilateral motor cortex injury: a new test strategy for analysis of skilled limb movements in neurological mouse models.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>153</volume> <fpage>104</fpage>&#x2013;<lpage>113</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2005.10.011</pub-id> <pub-id pub-id-type="pmid">16309746</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Filipe</surname> <given-names>V. M.</given-names></name> <name><surname>Pereira</surname> <given-names>J. E.</given-names></name> <name><surname>Costa</surname> <given-names>L. M.</given-names></name> <name><surname>Maur&#x00ED;cio</surname> <given-names>A. C.</given-names></name> <name><surname>Couto</surname> <given-names>P. A.</given-names></name> <name><surname>Melo-Pinto</surname> <given-names>P.</given-names></name><etal/></person-group> (<year>2006</year>). <article-title>Effect of skin movement on the analysis of hindlimb kinematics during treadmill locomotion in rats.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>153</volume> <fpage>55</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2005.10.006</pub-id> <pub-id pub-id-type="pmid">16337686</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guo</surname> <given-names>Y.</given-names></name> <name><surname>Hu</surname> <given-names>H.</given-names></name> <name><surname>Wang</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>M.</given-names></name> <name><surname>Chen</surname> <given-names>K.</given-names></name></person-group> (<year>2019</year>). <article-title>Walking function after cervical contusion and distraction spinal cord injuries in rats.</article-title> <source><italic>J. Exp. Neurosci.</italic></source> <volume>13</volume>:<issue>1179069519869615</issue>. <pub-id pub-id-type="doi">10.1177/1179069519869615</pub-id> <pub-id pub-id-type="pmid">31456646</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hawkins</surname> <given-names>K. A.</given-names></name> <name><surname>Clark</surname> <given-names>D. J.</given-names></name> <name><surname>Balasubramanian</surname> <given-names>C. K.</given-names></name> <name><surname>Fox</surname> <given-names>E. J.</given-names></name></person-group> (<year>2017</year>). <article-title>Walking on uneven terrain in healthy adults and the implications for people after stroke.</article-title> <source><italic>NeuroRehabilitation</italic></source> <volume>41</volume> <fpage>765</fpage>&#x2013;<lpage>774</lpage>. <pub-id pub-id-type="doi">10.3233/NRE-172154</pub-id> <pub-id pub-id-type="pmid">28946584</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Houdijk</surname> <given-names>H.</given-names></name> <name><surname>Van Ooijen</surname> <given-names>M. W.</given-names></name> <name><surname>Kraal</surname> <given-names>J. J.</given-names></name> <name><surname>Wiggerts</surname> <given-names>H. O.</given-names></name> <name><surname>Polomski</surname> <given-names>W.</given-names></name> <name><surname>Janssen</surname> <given-names>T.</given-names></name><etal/></person-group> (<year>2012</year>). <article-title>Assessing gait adaptability in people with a unilateral amputation on an instrumented treadmill with a projected visual context.</article-title> <source><italic>Phys. Ther.</italic></source> <volume>92</volume> <fpage>1452</fpage>&#x2013;<lpage>1460</lpage>. <pub-id pub-id-type="doi">10.2522/ptj.20110362</pub-id> <pub-id pub-id-type="pmid">22836005</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hutchinson</surname> <given-names>D.</given-names></name> <name><surname>Hines</surname> <given-names>S.</given-names></name> <name><surname>Vijayaraghavan</surname> <given-names>N.</given-names></name> <name><surname>Sammond</surname> <given-names>A.</given-names></name> <name><surname>Wilson</surname> <given-names>K. M.</given-names></name> <name><surname>Kuchera</surname> <given-names>M. L.</given-names></name></person-group> (<year>2017</year>). <article-title>Interexaminer reliability study of a standardized myofascial diagnostic technique of the superior thoracic inlet.</article-title> <source><italic>J. Bodyw. Mov. Ther.</italic></source> <volume>21</volume> <fpage>658</fpage>&#x2013;<lpage>663</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbmt.2017.05.004</pub-id> <pub-id pub-id-type="pmid">28750981</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jacobs</surname> <given-names>B. Y.</given-names></name> <name><surname>Kloefkorn</surname> <given-names>H. E.</given-names></name> <name><surname>Allen</surname> <given-names>K. D.</given-names></name></person-group> (<year>2014</year>). <article-title>Gait analysis methods for rodent models of osteoarthritis.</article-title> <source><italic>Curr. Pain Headache Rep.</italic></source> <volume>18</volume>:<issue>456</issue>. <pub-id pub-id-type="doi">10.1007/s11916-014-0456-x</pub-id> <pub-id pub-id-type="pmid">25160712</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lanini</surname> <given-names>J.</given-names></name> <name><surname>Duburcq</surname> <given-names>A.</given-names></name> <name><surname>Razavi</surname> <given-names>H.</given-names></name> <name><surname>Le Goff</surname> <given-names>C. G.</given-names></name> <name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name></person-group> (<year>2017</year>). <article-title>Interactive locomotion: investigation and modeling of physically-paired humans while walking.</article-title> <source><italic>PLoS One</italic></source> <volume>12</volume>:<issue>e0179989</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0179989</pub-id> <pub-id pub-id-type="pmid">28877161</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Medeiros</surname> <given-names>F. M.</given-names></name> <name><surname>de Carvalho Myskiw</surname> <given-names>J.</given-names></name> <name><surname>Baptista</surname> <given-names>P. P. A.</given-names></name> <name><surname>Neves</surname> <given-names>L. T.</given-names></name> <name><surname>Martins</surname> <given-names>L. A.</given-names></name> <name><surname>Furini</surname> <given-names>C. R. G.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Can an aversive, extinction-resistant memory trigger impairments in walking adaptability? An experimental study using adult rats.</article-title> <source><italic>Neurosci. Lett.</italic></source> <volume>665</volume> <fpage>224</fpage>&#x2013;<lpage>228</lpage>. <pub-id pub-id-type="doi">10.1016/j.neulet.2017.12.017</pub-id> <pub-id pub-id-type="pmid">29229398</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meseguer-Henarejos</surname> <given-names>A. B.</given-names></name> <name><surname>Sanchez-Meca</surname> <given-names>J.</given-names></name> <name><surname>Lopez-Pina</surname> <given-names>J. A.</given-names></name> <name><surname>Carles-Hernandez</surname> <given-names>R.</given-names></name></person-group> (<year>2018</year>). <article-title>Inter-and intra-rater reliability of the Modified Ashworth Scale: a systematic review and meta-analysis.</article-title> <source><italic>Eur. J. Phys. Rehabil. Med.</italic></source> <volume>54</volume> <fpage>576</fpage>&#x2013;<lpage>590</lpage>. <pub-id pub-id-type="doi">10.23736/S1973-9087.17.04796-7</pub-id> <pub-id pub-id-type="pmid">28901119</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mestriner</surname> <given-names>R. G.</given-names></name> <name><surname>Miguel</surname> <given-names>P. M.</given-names></name> <name><surname>Bagatini</surname> <given-names>P. B.</given-names></name> <name><surname>Saur</surname> <given-names>L.</given-names></name> <name><surname>Boisserand</surname> <given-names>L. S. B.</given-names></name> <name><surname>Baptista</surname> <given-names>P. P.</given-names></name></person-group> (<year>2013</year>). <article-title>Behavior outcome after ischemic and hemorrhagic stroke, with similar brain damage, in rats.</article-title> <source><italic>Behav. Brain Res.</italic></source> <volume>244</volume> <fpage>82</fpage>&#x2013;<lpage>89</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbr.2013.02.001</pub-id> <pub-id pub-id-type="pmid">23403282</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Metz</surname> <given-names>G. A.</given-names></name> <name><surname>Ng</surname> <given-names>J. W.</given-names></name> <name><surname>Kovalchuk</surname> <given-names>I.</given-names></name> <name><surname>Olson</surname> <given-names>D. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Ancestral experience as a game changer in stress vulnerability and disease outcomes.</article-title> <source><italic>Bioessays</italic></source> <volume>37</volume> <fpage>602</fpage>&#x2013;<lpage>611</lpage>. <pub-id pub-id-type="doi">10.1002/bies.201400217</pub-id> <pub-id pub-id-type="pmid">25759985</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Metz</surname> <given-names>G. A. S.</given-names></name> <name><surname>Schwab</surname> <given-names>M. E.</given-names></name> <name><surname>Welzl</surname> <given-names>H.</given-names></name></person-group> (<year>2001</year>). <article-title>The effects of acute and chronic stress on motor and sensory performance in male Lewis rats</article-title>. <source><italic>Physiol Behav</italic></source>. <volume>72</volume>, <fpage>29</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1016/s0031-9384(00)00371-1</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Metz</surname> <given-names>G. A.</given-names></name> <name><surname>Whishaw</surname> <given-names>I. Q.</given-names></name></person-group> (<year>2002</year>). <article-title>Cortical and subcortical lesions impair skilled walking in the ladder rung walking test: a new task to evaluate fore- and hindlimb stepping, placing, and co-ordination.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>115</volume> <fpage>169</fpage>&#x2013;<lpage>179</lpage>. <pub-id pub-id-type="doi">10.1016/s0165-0270(02)00012-2</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Metz</surname> <given-names>G. A.</given-names></name> <name><surname>Whishaw</surname> <given-names>I. Q.</given-names></name></person-group> (<year>2009</year>). <article-title>The ladder rung walking task: a scoring system and its practical application.</article-title> <source><italic>J. Vis. Exp.</italic></source> <volume>28</volume>:<issue>1204</issue>. <pub-id pub-id-type="doi">10.3791/1204</pub-id> <pub-id pub-id-type="pmid">19525918</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Riek-Burchardt</surname> <given-names>M.</given-names></name> <name><surname>Henrich-Noack</surname> <given-names>P.</given-names></name> <name><surname>Metz</surname> <given-names>G. A.</given-names></name> <name><surname>Reymann</surname> <given-names>K. G.</given-names></name></person-group> (<year>2004</year>). <article-title>Detection of chronic sensorimotor impairments in the ladder rung walking task in rats with endothelin-1-induced mild focal ischemia.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>137</volume> <fpage>227</fpage>&#x2013;<lpage>233</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2004.02.012</pub-id> <pub-id pub-id-type="pmid">15262065</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sandner</surname> <given-names>B.</given-names></name> <name><surname>Puttagunta</surname> <given-names>R.</given-names></name> <name><surname>Motsch</surname> <given-names>M.</given-names></name> <name><surname>Bradke</surname> <given-names>F.</given-names></name> <name><surname>Ruschel</surname> <given-names>J.</given-names></name> <name><surname>Blesch</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Systemic epothilone D improves hindlimb function after spinal cord contusion injury in rats.</article-title> <source><italic>Exp. Neurol.</italic></source> <volume>306</volume> <fpage>250</fpage>&#x2013;<lpage>259</lpage>. <pub-id pub-id-type="doi">10.1016/j.expneurol.2018.01.018</pub-id> <pub-id pub-id-type="pmid">29408734</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shimada</surname> <given-names>H.</given-names></name> <name><surname>Ishii</surname> <given-names>K.</given-names></name> <name><surname>Ishiwata</surname> <given-names>K.</given-names></name> <name><surname>Oda</surname> <given-names>K.</given-names></name> <name><surname>Sukukawa</surname> <given-names>M.</given-names></name> <name><surname>Makizako</surname> <given-names>H.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Gait adaptability and brain activity during unaccustomed treadmill walking in healthy elderly females.</article-title> <source><italic>Gait Posture</italic></source> <volume>38</volume> <fpage>203</fpage>&#x2013;<lpage>208</lpage>. <pub-id pub-id-type="doi">10.1016/j.gaitpost.2012.11.008</pub-id> <pub-id pub-id-type="pmid">23266043</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shrout</surname> <given-names>P. E.</given-names></name> <name><surname>Fleiss</surname> <given-names>J. L.</given-names></name></person-group> (<year>1979</year>). <article-title>Intraclass correlations: uses in assessing rater reliability.</article-title> <source><italic>Psychol. Bull.</italic></source> <volume>86</volume> <fpage>420</fpage>&#x2013;<lpage>428</lpage>. <pub-id pub-id-type="doi">10.1037//0033-2909.86.2.420</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Soleman</surname> <given-names>S.</given-names></name> <name><surname>Yip</surname> <given-names>P.</given-names></name> <name><surname>Leasure</surname> <given-names>J. L.</given-names></name> <name><surname>Moon</surname> <given-names>L.</given-names></name></person-group> (<year>2010</year>). <article-title>Sustained sensorimotor impairments after endothelin-1 induced focal cerebral ischemia (stroke) in aged rats.</article-title> <source><italic>Exp. Neurol.</italic></source> <volume>222</volume> <fpage>13</fpage>&#x2013;<lpage>24</lpage>. <pub-id pub-id-type="doi">10.1016/j.expneurol.2009.11.007</pub-id> <pub-id pub-id-type="pmid">19913535</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Souza</surname> <given-names>A. C.</given-names></name> <name><surname>Alexandre</surname> <given-names>N. M. C.</given-names></name> <name><surname>Guirardello</surname> <given-names>E. B.</given-names></name></person-group> (<year>2017</year>). <article-title>Psychometric properties in instruments evaluation of reliability and validity.</article-title> <source><italic>Epidemiol. Serv. Sa&#x00FA;de</italic></source> <volume>26</volume> <fpage>649</fpage>&#x2013;<lpage>659</lpage>. <pub-id pub-id-type="doi">10.5123/S1679-49742017000300022</pub-id> <pub-id pub-id-type="pmid">28977189</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Spitz</surname> <given-names>J.</given-names></name> <name><surname>Put</surname> <given-names>K.</given-names></name> <name><surname>Wagemans</surname> <given-names>J.</given-names></name> <name><surname>Williams</surname> <given-names>A. M.</given-names></name> <name><surname>Helsen</surname> <given-names>W. F.</given-names></name></person-group> (<year>2017</year>). <article-title>Does slow motion impact on the perception of foul play in football?</article-title> <source><italic>Eur. J. Sport Sci.</italic></source> <volume>17</volume> <fpage>748</fpage>&#x2013;<lpage>756</lpage>. <pub-id pub-id-type="doi">10.1080/17461391.2017.1304580</pub-id> <pub-id pub-id-type="pmid">28350233</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ueda</surname> <given-names>Y.</given-names></name> <name><surname>Misumi</surname> <given-names>S.</given-names></name> <name><surname>Suzuki</surname> <given-names>M.</given-names></name> <name><surname>Ogawa</surname> <given-names>S.</given-names></name> <name><surname>Nishigaki</surname> <given-names>R.</given-names></name> <name><surname>Ishida</surname> <given-names>A.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Disorganization of oligodendrocyte development in the layer II/III of the sensorimotor cortex causes motor coordination dysfunction in a model of white matter injury in neonatal rats.</article-title> <source><italic>Neurochem. Res.</italic></source> <volume>43</volume> <fpage>136</fpage>&#x2013;<lpage>146</lpage>. <pub-id pub-id-type="doi">10.1007/s11064-017-2352-3</pub-id> <pub-id pub-id-type="pmid">28762105</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van Ooijen</surname> <given-names>M. W.</given-names></name> <name><surname>Heeren</surname> <given-names>A.</given-names></name> <name><surname>Smulders</surname> <given-names>K.</given-names></name> <name><surname>Geurts</surname> <given-names>A. C. H.</given-names></name> <name><surname>Janssen</surname> <given-names>T. W. J.</given-names></name> <name><surname>Beek</surname> <given-names>P. J.</given-names></name><etal/></person-group> (<year>2015</year>). <article-title>Improved gait adjustments after gait adaptability training are associated with reduced attentional demands in persons with stroke.</article-title> <source><italic>Exp. Brain Res.</italic></source> <volume>233</volume> <fpage>1007</fpage>&#x2013;<lpage>1018</lpage>. <pub-id pub-id-type="doi">10.1007/s00221-014-4175-7</pub-id> <pub-id pub-id-type="pmid">25537466</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vrinten</surname> <given-names>D. H.</given-names></name> <name><surname>Hamers</surname> <given-names>F. F.</given-names></name></person-group> (<year>2003</year>). <article-title>&#x201C;CatWalk&#x201D; automated quantitative gait analysis as a novel method to assess mechanical allodynia in the rat; a comparison with von Frey testing.</article-title> <source><italic>Pain</italic></source> <volume>102</volume> <fpage>203</fpage>&#x2013;<lpage>209</lpage>. <pub-id pub-id-type="doi">10.1016/s0304-3959(02)00382-2</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wearick-Silva</surname> <given-names>L. E.</given-names></name> <name><surname>Orso</surname> <given-names>R.</given-names></name> <name><surname>Martins</surname> <given-names>L. A.</given-names></name> <name><surname>Creutzberg</surname> <given-names>K. C.</given-names></name> <name><surname>Centeno-Silva</surname> <given-names>A.</given-names></name> <name><surname>Xavier</surname> <given-names>L. L.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Dual influences of early life stress induced by limited bedding on walking adaptability and Bdnf/TrkB and Drd1/Drd2 gene expression in different mouse brain regions.</article-title> <source><italic>Behav. Brain Res.</italic></source> <volume>359</volume> <fpage>66</fpage>&#x2013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbr.2018.10.025</pub-id> <pub-id pub-id-type="pmid">30347225</pub-id></citation></ref>
</ref-list>
</back>
</article>