<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2017.00456</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Minimal Window Duration for Accurate HRV Recording in Athletes</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Bourdillon</surname> <given-names>Nicolas</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/239930/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Schmitt</surname> <given-names>Laurent</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/274281/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Yazdani</surname> <given-names>Sasan</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/458622/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Vesin</surname> <given-names>Jean-Marc</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Millet</surname> <given-names>Gr&#x000E9;goire P.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/56036/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Faculty of Biology and Medicine, Institute of Sport Sciences, University of Lausanne</institution> <country>Lausanne, Switzerland</country></aff>
<aff id="aff2"><sup>2</sup><institution>National Centre of Nordic-Ski, Research and Performance</institution> <country>Premanon, France</country></aff>
<aff id="aff3"><sup>3</sup><institution>Applied Signal Processing Group, Ecole Polytechnique F&#x000E9;d&#x000E9;rale de Lausanne</institution> <country>Lausanne, Switzerland</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Mathias Baumert, University of Adelaide, Australia</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: F&#x000E1;bio Yuzo Nakamura, Universidade Estadual de Londrina, Brazil; Linda F. Hayward, University of Florida, United States; Vitor E. Valenti, Universidade Estadual Paulista J&#x000FA;lio Mesquita Filho, Brazil</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Nicolas Bourdillon <email>nicolas.bourdillon&#x00040;unil.ch</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Autonomic Neuroscience, a section of the journal Frontiers in Neuroscience</p></fn></author-notes>
<pub-date pub-type="epub">
<day>10</day>
<month>08</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>11</volume>
<elocation-id>456</elocation-id>
<history>
<date date-type="received">
<day>08</day>
<month>06</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>26</day>
<month>07</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 Bourdillon, Schmitt, Yazdani, Vesin and Millet.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Bourdillon, Schmitt, Yazdani, Vesin and Millet</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>Heart rate variability (HRV) is non-invasive and commonly used for monitoring responses to training loads, fitness, or overreaching in athletes. Yet, the recording duration for a series of RR-intervals varies from 1 to 15 min in the literature. The aim of the present work was to assess the minimum record duration to obtain reliable HRV results. RR-intervals from 159 orthostatic tests (7 min supine, SU, followed by 6 min standing, ST) were analyzed. Reference windows were 4 min in SU (min 3&#x02013;7) and 4 min in ST (min 9&#x02013;13). Those windows were subsequently divided and the analyses were repeated on eight different fractioned windows: the first min (0&#x02013;1), the second min (1&#x02013;2), the third min (2&#x02013;3), the fourth min (3&#x02013;4), the first 2 min (0&#x02013;2), the last 2 min (2&#x02013;4), the first 3 min (0&#x02013;3), and the last 3 min (1&#x02013;4). Correlation and Bland &#x00026; Altman statistical analyses were systematically performed. The analysis window could be shortened to 0&#x02013;2 instead of 0&#x02013;4 for RMSSD only, whereas the 4-min window was necessary for LF and total power. Since there is a need for 1 min of baseline to obtain a steady signal prior the analysis window, we conclude that studies relying on RMSSD may shorten the windows to 3 min (&#x0003D; 1&#x0002B;2) in SU or seated position only and to 6 min (&#x0003D; 1&#x0002B;2 min SU plus 1&#x0002B;2 min ST) if there is an orthostatic test. Studies relying on time- and frequency-domain parameters need a minimum of 5 min (&#x0003D; 1&#x0002B;4) min SU or seated position only but require 10 min (&#x0003D; 1&#x0002B;4 min SU plus 1&#x0002B;4 min ST) for the orthostatic test.</p></abstract>
<kwd-group>
<kwd>accuracy</kwd>
<kwd>HRV</kwd>
<kwd>fatigue</kwd>
<kwd>RMSSD</kwd>
<kwd>LF-HF</kwd>
<kwd>athlete</kwd>
</kwd-group>
<contract-sponsor id="cn001">Schweizerischer Nationalfonds zur F&#x000F6;rderung der Wissenschaftlichen Forschung<named-content content-type="fundref-id">10.13039/501100001711</named-content></contract-sponsor>
<counts>
<fig-count count="3"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="30"/>
<page-count count="9"/>
<word-count count="5434"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>Monitoring fatigue is essential for training optimization, notably for the identification of non-functional overreaching and overtraining (Meeusen et al., <xref ref-type="bibr" rid="B11">2013</xref>). One of the non-invasive most commonly used tool is heart rate variability (HRV) because its changes largely depend on cardiac autonomic control, which is affected by physical training and fatigued state, for review see Buchheit (<xref ref-type="bibr" rid="B3">2014</xref>).</p>
<p>Numerous HRV test procedures have been developed to supervise athletes&#x00027; follow-up: at rest either during sleep (Pichot et al., <xref ref-type="bibr" rid="B17">2000</xref>; Garet et al., <xref ref-type="bibr" rid="B6">2004</xref>) or awake (Schmitt et al., <xref ref-type="bibr" rid="B23">2006</xref>; Plews et al., <xref ref-type="bibr" rid="B19">2013</xref>), in supine and standing positions (Schmitt et al., <xref ref-type="bibr" rid="B25">2013</xref>) or seated (Plews et al., <xref ref-type="bibr" rid="B20">2017</xref>); with recording times varying from 1 to 15 min; during physical exercise (Sandercock and Brodie, <xref ref-type="bibr" rid="B22">2006</xref>), or during the post-exercise recovery phase (Buchheit et al., <xref ref-type="bibr" rid="B4">2007</xref>; Seiler et al., <xref ref-type="bibr" rid="B28">2007</xref>; Hug et al., <xref ref-type="bibr" rid="B9">2014</xref>). Moreover, some authors (Plews et al., <xref ref-type="bibr" rid="B18">2012</xref>) rely on one HRV parameter only from the time domain: the root mean square of the successive differences (RMSSD), while others (Schmitt et al., <xref ref-type="bibr" rid="B24">2016</xref>) prefer looking at multiple parameters from the time and frequency domains, which primarily are mean heart rate (mean HR), RMSSD, power in the low frequency band (LF), the high frequency band (HF), and the total power (LF&#x0002B;HF).</p>
<p>The combination of the time and frequency domains has allowed the identification of four different types of fatigue in the elite athletes, which is valuable in their training periodization (Schmitt et al., <xref ref-type="bibr" rid="B27">2015b</xref>). However, the athletes have to perform a 13-min orthostatic test (7 min of recording supine followed by 6 min standing) on a very regular basis which might compromise their recovery (Schmitt et al., <xref ref-type="bibr" rid="B26">2015a</xref>) or simply install a boring routine all around the year. To avoid problems of athlete compliance to complete HRV recordings, Plews et al. recommended either 5-min records (Plews et al., <xref ref-type="bibr" rid="B18">2012</xref>) or recently a 1-min recording with devices as simple as photoplethysmographic (PPG) data captured at the finger level using a smartphone (Plews et al., <xref ref-type="bibr" rid="B20">2017</xref>). Indeed, for RMSSD only, a 1-min window has been proposed as an alternative to the traditional 5-min window during rest or in post-exercise recovery conditions (Esco and Flatt, <xref ref-type="bibr" rid="B5">2014</xref>; Pereira et al., <xref ref-type="bibr" rid="B16">2016</xref>). However, none of the previous studies reported the impact of selecting a recording window as short as 1 min, on the reliability of LF, HF, and total power measurements.</p>
<p>With such variety in procedures, it remains particularly unclear how long a HRV recording should be in order to offer the best compromise between the quality and accuracy of the recording and the comfort for the athlete. The longer the recording time the more reliable the HRV parameters, the shorter the recording the more convenient for the athletes, especially when the recordings need to be performed on a regular basis (Plews et al., <xref ref-type="bibr" rid="B19">2013</xref>). The aim of the present work is to assess the minimal acceptable recording duration at rest in the supine and the standing positions for mean HR, RMSSD, LF, HF, and total power; that is the duration below which there is a significant bias in the aforementioned HRV parameters, compared to the traditional window duration of several minutes.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>Materials and methods</title>
<p>The RR-interval recordings of 159 orthostatic tests from three elite athletes (53 tests each) have been gathered (Schmitt et al., <xref ref-type="bibr" rid="B27">2015b</xref>). Subjects 1 and 3 are males and subjects 2 is female. Each of the three athletes has won between one and four Olympic medals, either in swimming or biathlon, plus several other titles in international and national championships. The tests selected for the work represent a follow-up between four (subject 1) and 11 (subject 3) years for each athlete. The detailed procedure of the orthostatic test can be found in details elsewhere (Schmitt et al., <xref ref-type="bibr" rid="B25">2013</xref>). Briefly, the orthostatic test relied on a 13-min RR-interval recording at rest with 7 min supine (SU) followed by 6 min standing (ST). The procedures were approved by the Necker Hospital Ethic Committee (Paris, France). All the subjects provided written, voluntary, informed consent. The data analyses are based on the RR-intervals between the 3rd and 7th min SU, and between the 9th and 13th min ST. Inside those two 4-min windows, the HRV analyses were repeated on the entire 4 min (0&#x02013;4) as the reference analyses and then on eight different fractioned windows: the first min (0&#x02013;1), the second min (1&#x02013;2) the third min (2&#x02013;3), the fourth min (3&#x02013;4), the first 2 min (0&#x02013;2), the last 2 min (2&#x02013;4), the first 3 min (0&#x02013;3), and the last 3 min (1&#x02013;4). Analyses were performed separately for SU and ST. Measurement of the interval duration between two R-waves of the cardiac electrical activity was performed with a HR monitor (T6, Suunto&#x000AE;, Vantaa, Finland).</p>
<p>Heartbeats that are not originated from the sino-atrial node have been shown to have drastic effects on the outcome of HRV indexes (<xref ref-type="bibr" rid="B1">1996</xref>). To this end, the RR-intervals from the orthostatic tests were first analyzed to remove ectopic beats from the recordings using automatic and visual inspections of the RR series. Ectopic beats were then compensated by means of interpolation to calculate normal to normal (NN) intervals. From the NN-intervals, HRV parameters were extracted namely: mean HR, RMSSD, LF (0.04&#x02013;0.15 Hz) HF, (0.15&#x02013;0.40 Hz), and total power (LF &#x0002B; HF) in ms<sup>2</sup> (Schmitt et al., <xref ref-type="bibr" rid="B27">2015b</xref>). The spectral power was estimated using the Fast Fourier Transform on the resampled NN-intervals (4 Hz; Vesin et al., <xref ref-type="bibr" rid="B29">2016</xref>). All procedures were carried out in agreement with the Task Force recommendations (<xref ref-type="bibr" rid="B1">1996</xref>).</p>
<p>The statistical analyses include correlation and Bland &#x00026; Altman (B&#x00026;A) plots between the reference window (0&#x02013;4) and each of the tested windows both in SU or ST. Statistical significance was set at an alpha level of 0.05. The Kolmogorov-Smirnov test was used to assess normality of the data. All the parameters presented in this work were normally distributed. All computations were performed separately for SU and ST positions using MATLAB&#x000AE; (MathWorks, Natick, MA, USA).</p>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>Table <xref ref-type="table" rid="T1">1</xref> contains the detailed statistical data for the systematic comparison for all the tested windows against the reference window, for the correlations and the B&#x00026;A. Figure <xref ref-type="fig" rid="F1">1</xref> shows the correlation and the B&#x00026;A plots for LF in SU and ST, comparing the 1&#x02013;4 window to the reference 0&#x02013;4 window. The 1&#x02013;4 window showed the closest characteristics to the reference window for LF. Figure <xref ref-type="fig" rid="F2">2</xref> shows the same windows for RMSSD in SU and ST. Figure <xref ref-type="fig" rid="F3">3</xref> shows the shortest acceptable window for RMSSD (0&#x02013;2) in the supine position only.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Systematic correlation and Bland and Altman data for all windows comparison to the reference 0&#x02013;4 window.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold><italic>HR</italic></bold></th>
<th/>
<th valign="top" align="center"><bold>0&#x02013;1</bold></th>
<th valign="top" align="center"><bold>1&#x02013;2</bold></th>
<th valign="top" align="center"><bold>2&#x02013;3</bold></th>
<th valign="top" align="center"><bold>3&#x02013;4</bold></th>
<th valign="top" align="center"><bold>0&#x02013;2</bold></th>
<th valign="top" align="center"><bold>2&#x02013;4</bold></th>
<th valign="top" align="center"><bold>0&#x02013;3</bold></th>
<th valign="top" align="center"><bold>1&#x02013;4</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><italic>r</italic><sup>2</sup></td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.66</td>
<td valign="top" align="center">0.75</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.90</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.97</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.57</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.59</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">0.94</td>
<td valign="top" align="center">0.86</td>
</tr>
<tr>
<td valign="top" align="left">RMSE</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">3.80</td>
<td valign="top" align="center">3.37</td>
<td valign="top" align="center">3.65</td>
<td valign="top" align="center">3.73</td>
<td valign="top" align="center">2.74</td>
<td valign="top" align="center">2.14</td>
<td valign="top" align="center">2.05</td>
<td valign="top" align="center">1.06</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">16.80</td>
<td valign="top" align="center">7.14</td>
<td valign="top" align="center">9.96</td>
<td valign="top" align="center">9.52</td>
<td valign="top" align="center">7.17</td>
<td valign="top" align="center">7.21</td>
<td valign="top" align="center">3.76</td>
<td valign="top" align="center">5.66</td>
</tr>
<tr>
<td valign="top" align="left">Slope</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.95</td>
<td valign="top" align="center">0.96</td>
<td valign="top" align="center">1.13</td>
<td valign="top" align="center">0.91</td>
<td valign="top" align="center">1.06</td>
<td valign="top" align="center">0.92</td>
<td valign="top" align="center">1.03</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.25</td>
<td valign="top" align="center">0.94</td>
<td valign="top" align="center">0.76</td>
<td valign="top" align="center">0.97</td>
<td valign="top" align="center">1.09</td>
<td valign="top" align="center">0.87</td>
<td valign="top" align="center">1.00</td>
<td valign="top" align="center">0.90</td>
</tr>
<tr>
<td valign="top" align="left">y-intercept</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">10.43</td>
<td valign="top" align="center">3.62</td>
<td valign="top" align="center">3.12</td>
<td valign="top" align="center">&#x02212;9.55</td>
<td valign="top" align="center">6.04</td>
<td valign="top" align="center">&#x02212;4.13</td>
<td valign="top" align="center">5.90</td>
<td valign="top" align="center">&#x02212;2.24</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;10.30</td>
<td valign="top" align="center">2.56</td>
<td valign="top" align="center">9.23</td>
<td valign="top" align="center">1.88</td>
<td valign="top" align="center">&#x02212;3.77</td>
<td valign="top" align="center">5.43</td>
<td valign="top" align="center">&#x02212;0.09</td>
<td valign="top" align="center">4.50</td>
</tr>
<tr>
<td valign="top" align="left">Diff of Mean</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">&#x02212;1.51</td>
<td valign="top" align="center">&#x02212;0.59</td>
<td valign="top" align="center">0.10</td>
<td valign="top" align="center">0.67</td>
<td valign="top" align="center">&#x02212;0.80</td>
<td valign="top" align="center">0.44</td>
<td valign="top" align="center">&#x02212;0.50</td>
<td valign="top" align="center">0.26</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.77</td>
<td valign="top" align="center">&#x02212;0.42</td>
<td valign="top" align="center">&#x02212;2.16</td>
<td valign="top" align="center">0.40</td>
<td valign="top" align="center">0.74</td>
<td valign="top" align="center">&#x02212;0.56</td>
<td valign="top" align="center">&#x02212;0.11</td>
<td valign="top" align="center">&#x02212;0.32</td>
</tr>
<tr>
<td valign="top" align="left"><italic>p</italic>-value</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.03</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">0.03</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.01</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.20</td>
<td valign="top" align="center">0.47</td>
<td valign="top" align="center">0.01</td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="center">0.20</td>
<td valign="top" align="center">0.34</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.49</td>
</tr>
<tr>
<td valign="top" align="left">RPC (abs)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">2</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">34</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">21</td>
<td valign="top" align="center">19</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">15</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">11</td>
</tr>
<tr>
<td valign="top" align="left">RPC (%)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">10</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">8</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">3</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">27</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">26</td>
<td valign="top" align="center">24</td>
<td valign="top" align="center">15</td>
<td valign="top" align="center">20</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">16</td>
</tr> <tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left"><italic><bold>RMSSD</bold></italic></td>
<td/>
<td valign="top" align="center"><bold>0&#x02013;1</bold></td>
<td valign="top" align="center"><bold>1&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;3</bold></td>
<td valign="top" align="center"><bold>3&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;3</bold></td>
<td valign="top" align="center"><bold>1&#x02013;4</bold></td>
</tr> <tr>
<td valign="top" align="left"><italic>r</italic><sup>2</sup></td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.90</td>
<td valign="top" align="center">0.70</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center">0.96</td>
<td valign="top" align="center">0.91</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.94</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.70</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.67</td>
<td valign="top" align="center">0.75</td>
<td valign="top" align="center">0.90</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.95</td>
<td valign="top" align="center">0.92</td>
</tr>
<tr>
<td valign="top" align="left">RMSE</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">11.59</td>
<td valign="top" align="center">9.17</td>
<td valign="top" align="center">11.17</td>
<td valign="top" align="center">9.20</td>
<td valign="top" align="center">5.75</td>
<td valign="top" align="center">6.87</td>
<td valign="top" align="center">3.10</td>
<td valign="top" align="center">5.05</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">45.57</td>
<td valign="top" align="center">30.91</td>
<td valign="top" align="center">42.59</td>
<td valign="top" align="center">37.03</td>
<td valign="top" align="center">23.16</td>
<td valign="top" align="center">26.49</td>
<td valign="top" align="center">15.69</td>
<td valign="top" align="center">19.30</td>
</tr>
<tr>
<td valign="top" align="left">Slope</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">1.38</td>
<td valign="top" align="center">0.54</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">1.05</td>
<td valign="top" align="center">1.08</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.96</td>
<td valign="top" align="center">0.80</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.03</td>
<td valign="top" align="center">0.95</td>
<td valign="top" align="center">0.90</td>
<td valign="top" align="center">0.95</td>
<td valign="top" align="center">1.02</td>
<td valign="top" align="center">0.93</td>
<td valign="top" align="center">1.00</td>
<td valign="top" align="center">0.94</td>
</tr>
<tr>
<td valign="top" align="left">y-intercept</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">&#x02212;13.16</td>
<td valign="top" align="center">11.83</td>
<td valign="top" align="center">9.82</td>
<td valign="top" align="center">&#x02212;3.12</td>
<td valign="top" align="center">&#x02212;3.22</td>
<td valign="top" align="center">2.96</td>
<td valign="top" align="center">1.19</td>
<td valign="top" align="center">5.58</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;3.51</td>
<td valign="top" align="center">2.74</td>
<td valign="top" align="center">5.69</td>
<td valign="top" align="center">9.23</td>
<td valign="top" align="center">&#x02212;3.41</td>
<td valign="top" align="center">9.16</td>
<td valign="top" align="center">&#x02212;2.07</td>
<td valign="top" align="center">8.44</td>
</tr>
<tr>
<td valign="top" align="left">Diff of Mean</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">&#x02212;0.18</td>
<td valign="top" align="center">&#x02212;3.77</td>
<td valign="top" align="center">&#x02212;1.05</td>
<td valign="top" align="center">&#x02212;1.54</td>
<td valign="top" align="center">&#x02212;0.35</td>
<td valign="top" align="center">&#x02212;1.12</td>
<td valign="top" align="center">&#x02212;0.13</td>
<td valign="top" align="center">&#x02212;1.32</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.83</td>
<td valign="top" align="center">&#x02212;4.98</td>
<td valign="top" align="center">&#x02212;12.07</td>
<td valign="top" align="center">0.03</td>
<td valign="top" align="center">0.48</td>
<td valign="top" align="center">&#x02212;2.47</td>
<td valign="top" align="center">&#x02212;1.66</td>
<td valign="top" align="center">&#x02212;1.88</td>
</tr>
<tr>
<td valign="top" align="left"><italic>p</italic>-value</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.34</td>
<td valign="top" align="center">0.04</td>
<td valign="top" align="center">0.48</td>
<td valign="top" align="center">0.06</td>
<td valign="top" align="center">0.62</td>
<td valign="top" align="center">0.02</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.61</td>
<td valign="top" align="center">0.04</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.99</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">0.25</td>
<td valign="top" align="center">0.18</td>
<td valign="top" align="center">0.23</td>
</tr>
<tr>
<td valign="top" align="left">RPC (abs)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">30</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">27</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">15</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">14</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">89</td>
<td valign="top" align="center">61</td>
<td valign="top" align="center">84</td>
<td valign="top" align="center">73</td>
<td valign="top" align="center">45</td>
<td valign="top" align="center">53</td>
<td valign="top" align="center">31</td>
<td valign="top" align="center">39</td>
</tr>
<tr>
<td valign="top" align="left">RPC (%)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">56</td>
<td valign="top" align="center">50</td>
<td valign="top" align="center">44</td>
<td valign="top" align="center">46</td>
<td valign="top" align="center">33</td>
<td valign="top" align="center">32</td>
<td valign="top" align="center">19</td>
<td valign="top" align="center">21</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">41</td>
<td valign="top" align="center">41</td>
<td valign="top" align="center">51</td>
<td valign="top" align="center">38</td>
<td valign="top" align="center">28</td>
<td valign="top" align="center">26</td>
<td valign="top" align="center">20</td>
<td valign="top" align="center">17</td>
</tr> <tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left"><italic><bold>LF</bold></italic></td>
<td/>
<td valign="top" align="center"><bold>0&#x02013;1</bold></td>
<td valign="top" align="center"><bold>1&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;3</bold></td>
<td valign="top" align="center"><bold>3&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;3</bold></td>
<td valign="top" align="center"><bold>1&#x02013;4</bold></td>
</tr> <tr>
<td valign="top" align="left"><italic>r</italic><sup>2</sup></td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.44</td>
<td valign="top" align="center">0.46</td>
<td valign="top" align="center">0.45</td>
<td valign="top" align="center">0.49</td>
<td valign="top" align="center">0.61</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">0.78</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.43</td>
<td valign="top" align="center">0.67</td>
<td valign="top" align="center">0.32</td>
<td valign="top" align="center">0.46</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.64</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.84</td>
</tr>
<tr>
<td valign="top" align="left">RMSE</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">1,199</td>
<td valign="top" align="center">1,383</td>
<td valign="top" align="center">1,931</td>
<td valign="top" align="center">2,235</td>
<td valign="top" align="center">1,249</td>
<td valign="top" align="center">1,199</td>
<td valign="top" align="center">774</td>
<td valign="top" align="center">905</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">9,291</td>
<td valign="top" align="center">4,592</td>
<td valign="top" align="center">5,025</td>
<td valign="top" align="center">6,485</td>
<td valign="top" align="center">4,783</td>
<td valign="top" align="center">3,870</td>
<td valign="top" align="center">2,982</td>
<td valign="top" align="center">2,480</td>
</tr>
<tr>
<td valign="top" align="left">Slope</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.56</td>
<td valign="top" align="center">0.67</td>
<td valign="top" align="center">0.91</td>
<td valign="top" align="center">1.15</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.92</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.91</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.24</td>
<td valign="top" align="center">1.02</td>
<td valign="top" align="center">0.54</td>
<td valign="top" align="center">0.93</td>
<td valign="top" align="center">1.17</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.89</td>
</tr>
<tr>
<td valign="top" align="left">y-intercept</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">637</td>
<td valign="top" align="center">283</td>
<td valign="top" align="center">&#x02212;61</td>
<td valign="top" align="center">&#x02212;920</td>
<td valign="top" align="center">231</td>
<td valign="top" align="center">44</td>
<td valign="top" align="center">390</td>
<td valign="top" align="center">138</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;2,677</td>
<td valign="top" align="center">&#x02212;1,740</td>
<td valign="top" align="center">1,221</td>
<td valign="top" align="center">869</td>
<td valign="top" align="center">&#x02212;1,695</td>
<td valign="top" align="center">1,107</td>
<td valign="top" align="center">&#x02212;493</td>
<td valign="top" align="center">565</td>
</tr> <tr>
<td valign="top" align="left">Diff of Mean</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">&#x02212;684</td>
<td valign="top" align="center">&#x02212;703</td>
<td valign="top" align="center">&#x02212;322</td>
<td valign="top" align="center">&#x02212;483</td>
<td valign="top" align="center">&#x02212;315</td>
<td valign="top" align="center">&#x02212;207</td>
<td valign="top" align="center">&#x02212;146</td>
<td valign="top" align="center">&#x02212;138</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;520</td>
<td valign="top" align="center">&#x02212;1,596</td>
<td valign="top" align="center">&#x02212;2,918</td>
<td valign="top" align="center">210</td>
<td valign="top" align="center">&#x02212;209</td>
<td valign="top" align="center">&#x02212;647</td>
<td valign="top" align="center">&#x02212;664</td>
<td valign="top" align="center">&#x02212;447</td>
</tr>
<tr>
<td valign="top" align="left"><italic>p</italic>-value</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.04</td>
<td valign="top" align="center">0.01</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.03</td>
<td valign="top" align="center">0.03</td>
<td valign="top" align="center">0.06</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.49</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.59</td>
<td valign="top" align="center">0.05</td>
<td valign="top" align="center">0.01</td>
<td valign="top" align="center">0.03</td>
</tr>
<tr>
<td valign="top" align="left">RPC (abs)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">2868</td>
<td valign="top" align="center">2971</td>
<td valign="top" align="center">3786</td>
<td valign="top" align="center">4402</td>
<td valign="top" align="center">2535</td>
<td valign="top" align="center">2364</td>
<td valign="top" align="center">1654</td>
<td valign="top" align="center">1801</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">18406</td>
<td valign="top" align="center">8974</td>
<td valign="top" align="center">11425</td>
<td valign="top" align="center">12705</td>
<td valign="top" align="center">9578</td>
<td valign="top" align="center">7956</td>
<td valign="top" align="center">5831</td>
<td valign="top" align="center">5052</td>
</tr>
<tr>
<td valign="top" align="left">RPC (%)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">104</td>
<td valign="top" align="center">92</td>
<td valign="top" align="center">87</td>
<td valign="top" align="center">88</td>
<td valign="top" align="center">66</td>
<td valign="top" align="center">57</td>
<td valign="top" align="center">41</td>
<td valign="top" align="center">37</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">133</td>
<td valign="top" align="center">120</td>
<td valign="top" align="center">124</td>
<td valign="top" align="center">114</td>
<td valign="top" align="center">97</td>
<td valign="top" align="center">79</td>
<td valign="top" align="center">73</td>
<td valign="top" align="center">48</td>
</tr> <tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left"><italic><bold>HF</bold></italic></td>
<td/>
<td valign="top" align="center"><bold>0&#x02013;1</bold></td>
<td valign="top" align="center"><bold>1&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;3</bold></td>
<td valign="top" align="center"><bold>3&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;3</bold></td>
<td valign="top" align="center"><bold>1&#x02013;4</bold></td>
</tr> <tr>
<td valign="top" align="left"><italic>r</italic><sup>2</sup></td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.19</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.93</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.96</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.46</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">0.57</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center">0.79</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">0.90</td>
<td valign="top" align="center">0.85</td>
</tr>
<tr>
<td valign="top" align="left">RMSE</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">339</td>
<td valign="top" align="center">328</td>
<td valign="top" align="center">598</td>
<td valign="top" align="center">620</td>
<td valign="top" align="center">260</td>
<td valign="top" align="center">266</td>
<td valign="top" align="center">200</td>
<td valign="top" align="center">189</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">12,525</td>
<td valign="top" align="center">5,859</td>
<td valign="top" align="center">6,015</td>
<td valign="top" align="center">8,033</td>
<td valign="top" align="center">5,991</td>
<td valign="top" align="center">4,860</td>
<td valign="top" align="center">3,318</td>
<td valign="top" align="center">3,853</td>
</tr>
<tr>
<td valign="top" align="left">Slope</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.84</td>
<td valign="top" align="center">0.34</td>
<td valign="top" align="center">2.06</td>
<td valign="top" align="center">0.83</td>
<td valign="top" align="center">1.15</td>
<td valign="top" align="center">0.65</td>
<td valign="top" align="center">1.04</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.17</td>
<td valign="top" align="center">1.10</td>
<td valign="top" align="center">0.70</td>
<td valign="top" align="center">1.17</td>
<td valign="top" align="center">1.18</td>
<td valign="top" align="center">0.92</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.92</td>
</tr>
<tr>
<td valign="top" align="left">y-intercept</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">99</td>
<td valign="top" align="center">57</td>
<td valign="top" align="center">395</td>
<td valign="top" align="center">&#x02212;543</td>
<td valign="top" align="center">91</td>
<td valign="top" align="center">&#x02212;71</td>
<td valign="top" align="center">177</td>
<td valign="top" align="center">&#x02212;34</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;259</td>
<td valign="top" align="center">&#x02212;968</td>
<td valign="top" align="center">1,445</td>
<td valign="top" align="center">&#x02212;660</td>
<td valign="top" align="center">&#x02212;923</td>
<td valign="top" align="center">576</td>
<td valign="top" align="center">93</td>
<td valign="top" align="center">462</td>
</tr>
<tr>
<td valign="top" align="left">Diff of Mean</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">&#x02212;6</td>
<td valign="top" align="center">&#x02212;39</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">77</td>
<td valign="top" align="center">&#x02212;11</td>
<td valign="top" align="center">16</td>
<td valign="top" align="center">&#x02212;30</td>
<td valign="top" align="center">&#x02212;10</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1299</td>
<td valign="top" align="center">&#x02212;73</td>
<td valign="top" align="center">&#x02212;1,294</td>
<td valign="top" align="center">848</td>
<td valign="top" align="center">715</td>
<td valign="top" align="center">&#x02212;178</td>
<td valign="top" align="center">&#x02212;88</td>
<td valign="top" align="center">&#x02212;259</td>
</tr>
<tr>
<td valign="top" align="left"><italic>p</italic>-value</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.83</td>
<td valign="top" align="center">0.17</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center">0.37</td>
<td valign="top" align="center">0.64</td>
<td valign="top" align="center">0.50</td>
<td valign="top" align="center">0.29</td>
<td valign="top" align="center">0.49</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.20</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.02</td>
<td valign="top" align="center">0.19</td>
<td valign="top" align="center">0.15</td>
<td valign="top" align="center">0.65</td>
<td valign="top" align="center">0.74</td>
<td valign="top" align="center">0.41</td>
</tr>
<tr>
<td valign="top" align="left">RPC (abs)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">726</td>
<td valign="top" align="center">696</td>
<td valign="top" align="center">1,598</td>
<td valign="top" align="center">2,129</td>
<td valign="top" align="center">584</td>
<td valign="top" align="center">574</td>
<td valign="top" align="center">703</td>
<td valign="top" align="center">375</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">24,699</td>
<td valign="top" align="center">11,608</td>
<td valign="top" align="center">13,144</td>
<td valign="top" align="center">16,025</td>
<td valign="top" align="center">12,223</td>
<td valign="top" align="center">9,633</td>
<td valign="top" align="center">6,495</td>
<td valign="top" align="center">7,686</td>
</tr>
<tr>
<td valign="top" align="left">RPC (%)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">109</td>
<td valign="top" align="center">100</td>
<td valign="top" align="center">93</td>
<td valign="top" align="center">94</td>
<td valign="top" align="center">67</td>
<td valign="top" align="center">60</td>
<td valign="top" align="center">40</td>
<td valign="top" align="center">37</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">98</td>
<td valign="top" align="center">90</td>
<td valign="top" align="center">98</td>
<td valign="top" align="center">88</td>
<td valign="top" align="center">64</td>
<td valign="top" align="center">64</td>
<td valign="top" align="center">48</td>
<td valign="top" align="center">47</td>
</tr> <tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left"><italic><bold>Total p</bold></italic></td>
<td/>
<td valign="top" align="center"><bold>0&#x02013;1</bold></td>
<td valign="top" align="center"><bold>1&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;3</bold></td>
<td valign="top" align="center"><bold>3&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;2</bold></td>
<td valign="top" align="center"><bold>2&#x02013;4</bold></td>
<td valign="top" align="center"><bold>0&#x02013;3</bold></td>
<td valign="top" align="center"><bold>1&#x02013;4</bold></td>
</tr> <tr>
<td valign="top" align="left"><italic>r</italic><sup>2</sup></td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.47</td>
<td valign="top" align="center">0.42</td>
<td valign="top" align="center">0.44</td>
<td valign="top" align="center">0.45</td>
<td valign="top" align="center">0.64</td>
<td valign="top" align="center">0.65</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.73</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.41</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">0.42</td>
<td valign="top" align="center">0.54</td>
<td valign="top" align="center">0.74</td>
<td valign="top" align="center">0.69</td>
<td valign="top" align="center">0.84</td>
<td valign="top" align="center">0.86</td>
</tr>
<tr>
<td valign="top" align="left">RMSE</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">2,468</td>
<td valign="top" align="center">2,848</td>
<td valign="top" align="center">4,624</td>
<td valign="top" align="center">4,964</td>
<td valign="top" align="center">2,661</td>
<td valign="top" align="center">2,773</td>
<td valign="top" align="center">1,731</td>
<td valign="top" align="center">2,306</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">24,685</td>
<td valign="top" align="center">12,279</td>
<td valign="top" align="center">12,504</td>
<td valign="top" align="center">17,189</td>
<td valign="top" align="center">12,769</td>
<td valign="top" align="center">10,508</td>
<td valign="top" align="center">8,119</td>
<td valign="top" align="center">7,004</td>
</tr>
<tr>
<td valign="top" align="left">Slope</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.52</td>
<td valign="top" align="center">0.54</td>
<td valign="top" align="center">0.91</td>
<td valign="top" align="center">0.99</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.79</td>
<td valign="top" align="center">0.84</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.07</td>
<td valign="top" align="center">1.05</td>
<td valign="top" align="center">0.55</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">1.11</td>
<td valign="top" align="center">0.81</td>
<td valign="top" align="center">0.98</td>
<td valign="top" align="center">0.92</td>
</tr>
<tr>
<td valign="top" align="left">y-intercept</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">945</td>
<td valign="top" align="center">768</td>
<td valign="top" align="center">&#x02212;882</td>
<td valign="top" align="center">&#x02212;1529</td>
<td valign="top" align="center">361</td>
<td valign="top" align="center">482</td>
<td valign="top" align="center">891</td>
<td valign="top" align="center">685</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;5,154</td>
<td valign="top" align="center">&#x02212;6,469</td>
<td valign="top" align="center">2,449</td>
<td valign="top" align="center">&#x02212;239</td>
<td valign="top" align="center">&#x02212;4,072</td>
<td valign="top" align="center">2,373</td>
<td valign="top" align="center">&#x02212;1,179</td>
<td valign="top" align="center">938</td>
</tr>
<tr>
<td valign="top" align="left">Diff of Mean</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">&#x02212;2,425</td>
<td valign="top" align="center">&#x02212;2,462</td>
<td valign="top" align="center">&#x02212;1,538</td>
<td valign="top" align="center">&#x02212;1,625</td>
<td valign="top" align="center">-1,197</td>
<td valign="top" align="center">&#x02212;746</td>
<td valign="top" align="center">&#x02212;597</td>
<td valign="top" align="center">&#x02212;429</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">&#x02212;3,276</td>
<td valign="top" align="center">&#x02212;5,141</td>
<td valign="top" align="center">&#x02212;9,177</td>
<td valign="top" align="center">&#x02212;789</td>
<td valign="top" align="center">&#x02212;1,153</td>
<td valign="top" align="center">&#x02212;2,469</td>
<td valign="top" align="center">&#x02212;1,823</td>
<td valign="top" align="center">&#x02212;1,237</td>
</tr>
<tr>
<td valign="top" align="left"><italic>p</italic>-value</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.03</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">0.10</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.00</td>
<td valign="top" align="center">0.56</td>
<td valign="top" align="center">0.26</td>
<td valign="top" align="center">0.01</td>
<td valign="top" align="center">0.01</td>
<td valign="top" align="center">0.03</td>
</tr>
<tr>
<td valign="top" align="left">RPC (abs)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">6,450</td>
<td valign="top" align="center">6,915</td>
<td valign="top" align="center">9,072</td>
<td valign="top" align="center">9,699</td>
<td valign="top" align="center">5,563</td>
<td valign="top" align="center">5,638</td>
<td valign="top" align="center">3,875</td>
<td valign="top" align="center">4,723</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">48,306</td>
<td valign="top" align="center">24,067</td>
<td valign="top" align="center">29,672</td>
<td valign="top" align="center">33,592</td>
<td valign="top" align="center">25,303</td>
<td valign="top" align="center">21,695</td>
<td valign="top" align="center">15,889</td>
<td valign="top" align="center">14,043</td>
</tr>
<tr>
<td valign="top" align="left">RPC (%)</td>
<td valign="top" align="left">ST</td>
<td valign="top" align="center">100</td>
<td valign="top" align="center">92</td>
<td valign="top" align="center">88</td>
<td valign="top" align="center">88</td>
<td valign="top" align="center">68</td>
<td valign="top" align="center">60</td>
<td valign="top" align="center">44</td>
<td valign="top" align="center">39</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">113</td>
<td valign="top" align="center">96</td>
<td valign="top" align="center">104</td>
<td valign="top" align="center">99</td>
<td valign="top" align="center">82</td>
<td valign="top" align="center">71</td>
<td valign="top" align="center">63</td>
<td valign="top" align="center">42</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>SU, supine; ST, standing; r2, Pearson r square; RMSE, root mean square error; RPC, reproducibility coefficient</italic>.</p>
</table-wrap-foot>
</table-wrap>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Correlation <bold>(Left)</bold> and Bland and Altman <bold>(Right)</bold> plots for comparison of LF in the 1&#x02013;4 and the reference 0&#x02013;4 windows. SU, supine; ST, standing; <italic>r</italic><sup>2</sup>, Pearson r square; SSE, sum of square error; RPC, reproducibility coefficient; CV, coefficient of variation. Blue dots: Subject 1; red dots Subject 2; green dots: Subject 3.</p></caption>
<graphic xlink:href="fnins-11-00456-g0001.tif"/>
</fig>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Correlation <bold>(Left)</bold> and Bland and Altman <bold>(Right)</bold> plots for comparison of RMSSD in the 1&#x02013;4 and the reference 0&#x02013;4 windows. SU, supine; ST, standing; <italic>r</italic><sup>2</sup>, Pearson r square; SSE, sum of square error; RPC, reproducibility coefficient; CV, coefficient of variation. Blue dots: Subject 1; red dots Subject 2; green dots: Subject 3.</p></caption>
<graphic xlink:href="fnins-11-00456-g0002.tif"/>
</fig>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Correlation <bold>(Left)</bold> and Bland and Altman <bold>(Right)</bold> plots for comparison of RMSSD in the 0&#x02013;2 and the reference 0&#x02013;4 windows in the supine position. <italic>r</italic><sup>2</sup>, Pearson r square; SSE, sum of square error; RPC, reproducibility coefficient; CV, coefficient of variation. Blue dots: Subject 1; red dots Subject 2; green dots: Subject 3.</p></caption>
<graphic xlink:href="fnins-11-00456-g0003.tif"/>
</fig>
<p>For RMSSD, the 3-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.92 to 0.98, a mean bias between &#x02212;1.88 and &#x02212;0.13 and a significant difference for the 1&#x02013;3 window in ST. The 2-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.85 to 0.96, a mean bias between &#x02212;2.47 and 0.48 and showed no significant difference. The 1-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.67 to 0.90, a mean bias between &#x02212;12.07 and 0.03 and significant differences for 1&#x02013;2, 2&#x02013;3, and 3&#x02013;4 windows.</p>
<p>For LF, the 3-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.78 to 0.84, a mean bias between &#x02212;664 and &#x02212;138 and a significant difference for the 1&#x02013;3 window in ST. The 2-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.61 to 0.71, a mean bias between &#x02212;647 and &#x02212;207 and showed significant difference for the 0&#x02013;2 window in SU. The 1-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.32 to 0.67, a mean bias between &#x02212;2,918 and 210 and significant differences for 0&#x02013;1 and 3&#x02013;4 windows.</p>
<p>For HF, the 3-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.85 to 0.96, a mean bias between &#x02212;259 and &#x02212;30 and showed no significant difference. The 2-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.78 to 0.93, a mean bias between &#x02212;178 and 715 and no significant difference. The 1-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.19 to 0.89, a mean bias between &#x02212;1,294 and 1,299 and a significant difference for the 2&#x02013;3 window in SU.</p>
<p>For total power, the 3-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.73 to 0.86, a mean bias between &#x02212;1,823 and &#x02212;429 and significant difference in all cases. The 2-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.64 to 0.74, a mean bias between &#x02212;2,469 and &#x02212;597 and significant differences for all cases except one. The 1-min windows showed <italic>r</italic><sup>2</sup> values ranging from 0.41 to 0.73, a mean bias between &#x02212;9,177 and &#x02212;789 and significant differences in all cases except two.</p>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>In this work, we present a systematic comparison between an extended version of the orthostatic test, 13 min in total resulting in 4-min long analysis windows, and shortened analysis windows. Our main findings are that the analysis windows, when shortened, become less reliable in a significant manner for LF and total power. However, regarding RMSSD, shortening the analysis windows from 4 to 2 min is acceptable. In all regards 1-min windows led to deteriorated results.</p>
<p>The parameter most sensitive to window time reduction was LF. Cutting the first min of the 4-min reference window induced significant differences between the two windows (<italic>p</italic> &#x0003C; 0.05 SU; <italic>p</italic> &#x02248; 0.06 ST) and diminished the correlation coefficient (<italic>r</italic><sup>2</sup> &#x0003D; 0.84 SU; <italic>r</italic><sup>2</sup> &#x0003D; 0.78 ST) as seen in Figure <xref ref-type="fig" rid="F1">1</xref>. Yet, the 1&#x02013;4 window should be the closest possible to the reference window as the subjects have been resting in a quiet environment, in supine position, for the last 4 min before the start point of that particular window. The LF band encompasses frequencies as low as 0.04 Hz, which means that, in 4 min, there is a maximum of only 9.6 full waveforms, which drops at 7.2 for 3 min. This drop appears sufficient to significantly alter the LF value when the window is shortened by 1 min. In the HF band the lowest selected frequency is 0.15 Hz, which means that over a 4-min window there is a maximum of 36 full waveforms, which drops at 27 for 3 min, a number still sufficient to keep good consistency between 3 and 4-min windows (<italic>r</italic><sup>2</sup> above 0.85 and no significant difference between the windows). The total power is negatively affected (poor <italic>r</italic><sup>2</sup> and significant differences both SU and ST) because LF is affected. Al Haddad et al. (<xref ref-type="bibr" rid="B2">2011</xref>) showed that the frequency domain parameters were less reproducible than the time domain ones during post-exercise recovery; which is in favor of an impaired LF when shortening the recording window.</p>
<p>A previously published study accurately categorizes the individual patterns of five HRV parameters in &#x0201C;no fatigue&#x0201D; and four types of fatigue (Schmitt et al., <xref ref-type="bibr" rid="B27">2015b</xref>). These distinct patterns encompass increases and/or decreases in HR as well as in LF and HF components. These changes are differently sized in supine and standing positions, and sometimes directed contrariwise in each position. A main outcome of this previous work was that supine and standing HRV variables were fully independent, and non-commutable in the clustering of alterations from the individual normal &#x0201C;no fatigue&#x0201D; patterns (Schmitt et al., <xref ref-type="bibr" rid="B26">2015a</xref>). So, LF is a major element of the HRV analysis and should be included on a regular basis, which makes the 4-min window mandatory. In the context of the entire orthostatic test this corresponds to 1 min resting supine followed by 4 min of recording plus 1 min standing followed by 4 min of recording, thus a total of 1&#x0002B;4&#x0002B;1&#x0002B;4 &#x0003D; 10 min.</p>
<p>However, we acknowledge that RMSSD measures are commonly recommended and therefore might have an effective practical usefulness to help the practitioner to identify a global &#x0201C;fatigue&#x0201D; level. In the perspective of reducing the duration of the orthostatic test to the drastic minimum, only using RMSSD, a 2-min window should be used; which in the context of the entire orthostatic test would make 1 min resting supine followed by 2 min of recording plus 1 min standing followed by 2 min of recording, thus a total of 1&#x0002B;2&#x0002B;1&#x0002B;2 &#x0003D; 6 min. Reducing the duration of the HRV data collection any further implies the suppression of the standing position, which would result in the supine only 1&#x0002B;2 &#x0003D; 3 min HRV test, as illustrated in Figure <xref ref-type="fig" rid="F3">3</xref>. Any test shorter than 3 min is dangerously exposed to imprecise computation of both the temporal and frequency domains which may result in the wrong diagnosis of the &#x0201C;fatigue&#x0201D; or &#x0201C;no fatigue&#x0201D; state. Accordingly, Munoz et al. (<xref ref-type="bibr" rid="B13">2015</xref>) studying a cohort of 3,387 adults, concluded that RMSSD should not be assessed using recordings shorter than 2 min, which is in accordance with the present work, focusing on elite athletes.</p>
<p>Esco and Flatt (<xref ref-type="bibr" rid="B5">2014</xref>) proposed to reduce the recording windows to 1 min for RMSSD, despite significant differences vs. their reference 5-min window. Pereira et al. (<xref ref-type="bibr" rid="B16">2016</xref>) also found that a 1-min window was acceptable for RMSSD assessment, however their correlation coefficient was 0.85 (which for us is the edge of the acceptability). Moreover, they did not report whether the 1-min window induced significant difference when compared to the 5-min reference window. Additionally, when assessing the seasonal changes in futsal players, these authors relied on 5-min recordings rather than 1-min (Oliveira et al., <xref ref-type="bibr" rid="B15">2013</xref>). In these studies as in most previous ones (Nakamura et al., <xref ref-type="bibr" rid="B14">2017</xref>), the tested populations were very homogeneous, athletes, usually from a single team, taken at a given moment of their sport season; which is in favor a good reliability when reducing the recording duration, but which is clearly not representative of the intra-individual variations of the HRV parameters over longer periods (e.g., a whole year), potentially including several changes in fitness and fatigue states. In the present dataset, there are recordings corresponding to fatigue and non-fatigue states that were collected at various moments of the season, therefore corresponding to various training and competing modalities, including seasonal changes. In other words, our dataset encompasses a multitude of athletes&#x00027; autonomic responses corresponding to an actual follow-up over several years and shows that under these circumstances the reliability of the 1-min window duration is questionable. Additionally, previous studies providing daily exercise prescription based on HRV over several weeks of follow-up also use windows of several minutes to assess the time domain parameters (Kiviniemi et al., <xref ref-type="bibr" rid="B10">2010</xref>).</p>
<p>Several studies showed good reliability of ultra-short HRV recordings (&#x0003C;1 min) considering RMSSD. However, most of them focused on the post-exercise recovery phase (Goldberger et al., <xref ref-type="bibr" rid="B7">2006</xref>; Al Haddad et al., <xref ref-type="bibr" rid="B2">2011</xref>; Esco and Flatt, <xref ref-type="bibr" rid="B5">2014</xref>; Gomes et al., <xref ref-type="bibr" rid="B8">2017</xref>) which is not the purpose of the present study. Munoz et al. (<xref ref-type="bibr" rid="B13">2015</xref>) claimed that 10 s recordings, showing a <italic>r</italic><sup>2</sup> value of 0.728 compared to 3-min recordings is &#x0201C;substantial,&#x0201D; yet concluded that RMSSD should not be assessed using recordings lasting less than 2 min. To our knowledge, 10, 20, or 30 s recording windows have never been proposed as a procedure to ensure athletes&#x00027; follow-up.</p>
<p>The European and American societies concerned (<xref ref-type="bibr" rid="B1">1996</xref>) recommend that the recording should last for at least 10 times the wavelength of the lower frequency bound of the investigated component, which is the case for our 4-min window encompassing 9.6 waveforms for the LF band. The societies also stated that the LF band requires the most extended recording duration with regard to the time domain parameters, which is in accordance with our present findings. Finally, the societies recommend 5-min recordings of a stationary system. The present work indicates that the last 4 min are sufficient for the window analysis, the first min being dedicated to the reaching of the stationary state of the subject.</p>
<p>In the orthostatic test originally designed by Schmitt et al. (<xref ref-type="bibr" rid="B25">2013</xref>), there are 3 min supine before the analysis window starts. This period is dedicated to let the respiratory rhythm settle to a basal rest level so that the respiratory sinus arrhythmia (RSA) does not drift during the HRV test, possibly jumping from HF to LF (and vice-versa) and consequently inducing misinterpretation of the frequency domain parameters (Saboul et al., <xref ref-type="bibr" rid="B21">2014</xref>; Wessel et al., <xref ref-type="bibr" rid="B30">2016</xref>). Although it is essential that the athletes be in a complete resting state when performing the HRV test (ideally in the morning upon waking up), we believe that reducing the time period before the start of the analysis window to 1 min is sufficient. However, future research is necessary to confirm the minimal duration needed. Also, future research should focus on the development of a tool for the extraction of the respiratory rate without a reference respiration signal (Mirmohamadsadeghi et al., <xref ref-type="bibr" rid="B12">2016</xref>).</p>
</sec>
<sec sec-type="conclusions" id="s5">
<title>Conclusion</title>
<p>The present work shows that reducing the window duration for HRV analysis below 4 min negatively affects the outcomes for the low frequency band and the total power. Additionally, we found that reducing the window duration to 2 min is acceptable when RMSSD only is considered. 1-min windows significantly deteriorate the HRV analysis for all parameters. When both the time and the frequency domain parameters are considered we recommend 5 min supine followed by 5 min standing, the analyses being performed on the last 4-min in each position resulting in a 10-min orthostatic test. When RMSSD only is considered, 3 min supine seems the minimal duration or 3 min supine followed by 3 min standing should be sufficient, resulting in a 6-min orthostatic test.</p>
</sec>
<sec id="s6">
<title>Author contributions</title>
<p>LS and GM designed the study; LS collected the data; NB, SY, and JV performed the signal processing and data analysis; NB drafted and wrote the article; NB prepared the figures and performed the statistical analysis; LS, SY, JV, and GM reviewed the manuscript. All authors approved the final version of the manuscript.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">(<year>1996</year>). <article-title>Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. task force of the European Society of Cardiology and the North American Society of pacing and electrophysiology</article-title>. <source>Eur. Heart J.</source> <volume>17</volume>, <fpage>354</fpage>&#x00023;<lpage>381</lpage>. <pub-id pub-id-type="doi">10.1093/oxfordjournals.eurheartj.a014868</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Al Haddad</surname> <given-names>H.</given-names></name> <name><surname>Laursen</surname> <given-names>P. B.</given-names></name> <name><surname>Chollet</surname> <given-names>D.</given-names></name> <name><surname>Ahmaidi</surname> <given-names>S.</given-names></name> <name><surname>Buchheit</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Reliability of resting and postexercise heart rate measures</article-title>. <source>Int. J. Sports Med.</source> <volume>32</volume>, <fpage>598</fpage>&#x02013;<lpage>605</lpage>. <pub-id pub-id-type="doi">10.1055/s-0031-1275356</pub-id><pub-id pub-id-type="pmid">21574126</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buchheit</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <article-title>Monitoring training status with HR measures: do all roads lead to Rome?</article-title> <source>Front. Physiol.</source> <volume>5</volume>:<fpage>73</fpage>. <pub-id pub-id-type="doi">10.3389/fphys.2014.00073</pub-id><pub-id pub-id-type="pmid">24578692</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buchheit</surname> <given-names>M.</given-names></name> <name><surname>Papelier</surname> <given-names>Y.</given-names></name> <name><surname>Laursen</surname> <given-names>P. B.</given-names></name> <name><surname>Ahmaidi</surname> <given-names>S.</given-names></name></person-group> (<year>2007</year>). <article-title>Noninvasive assessment of cardiac parasympathetic function: postexercise heart rate recovery or heart rate variability?</article-title> <source>Am. J. Physiol. Heart Circ. Physiol.</source> <volume>293</volume>, <fpage>H8</fpage>&#x02013;<lpage>H10</lpage>. <pub-id pub-id-type="doi">10.1152/ajpheart.00335.2007</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Esco</surname> <given-names>M. R.</given-names></name> <name><surname>Flatt</surname> <given-names>A. A.</given-names></name></person-group> (<year>2014</year>). <article-title>Ultra-short-term heart rate variability indexes at rest and post-exercise in athletes: evaluating the agreement with accepted recommendations</article-title>. <source>J. Sports Sci. Med.</source> <volume>13</volume>, <fpage>535</fpage>&#x02013;<lpage>541</lpage>. <pub-id pub-id-type="pmid">25177179</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garet</surname> <given-names>M.</given-names></name> <name><surname>Tournaire</surname> <given-names>N.</given-names></name> <name><surname>Roche</surname> <given-names>F.</given-names></name> <name><surname>Laurent</surname> <given-names>R.</given-names></name> <name><surname>Lacour</surname> <given-names>J. R.</given-names></name> <name><surname>Barth&#x000E9;l&#x000E9;my</surname> <given-names>J. C.</given-names></name> <etal/></person-group>. (<year>2004</year>). <article-title>Individual interdependence between nocturnal ANS activity and performance in swimmers</article-title>. <source>Med. Sci. Sports Exerc.</source> <volume>36</volume>, <fpage>2112</fpage>&#x02013;<lpage>2118</lpage>. <pub-id pub-id-type="doi">10.1249/01.MSS.0000147588.28955.48</pub-id><pub-id pub-id-type="pmid">15570148</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goldberger</surname> <given-names>J. J.</given-names></name> <name><surname>Le</surname> <given-names>F. K.</given-names></name> <name><surname>Lahiri</surname> <given-names>M.</given-names></name> <name><surname>Kannankeril</surname> <given-names>P. J.</given-names></name> <name><surname>Ng</surname> <given-names>J.</given-names></name> <name><surname>Kadish</surname> <given-names>A. H.</given-names></name></person-group> (<year>2006</year>). <article-title>Assessment of parasympathetic reactivation after exercise</article-title>. <source>Am. J. Physiol. Heart Circ. Physiol.</source> <volume>290</volume>, <fpage>H2446</fpage>&#x02013;<lpage>H2452</lpage>. <pub-id pub-id-type="doi">10.1152/ajpheart.01118.2005</pub-id><pub-id pub-id-type="pmid">16415073</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gomes</surname> <given-names>R. L.</given-names></name> <name><surname>Marques Vanderlei</surname> <given-names>L. C.</given-names></name> <name><surname>Garner</surname> <given-names>D. M.</given-names></name> <name><surname>Ramos Santana</surname> <given-names>M. D.</given-names></name> <name><surname>de Abreu</surname> <given-names>L. C.</given-names></name> <name><surname>Valenti</surname> <given-names>V. E.</given-names></name></person-group> (<year>2017</year>). <article-title>Poincar&#x000E9; plot analysis of ultra-short-term heart rate variability during recovery from exercise in physically active men</article-title>. <source>J. Sports Med. Phys. Fitness</source>. [Epub ahead of print]. <pub-id pub-id-type="doi">10.23736/S0022-4707.17.06922-5</pub-id><pub-id pub-id-type="pmid">28474874</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hug</surname> <given-names>B.</given-names></name> <name><surname>Heyer</surname> <given-names>L.</given-names></name> <name><surname>Naef</surname> <given-names>N.</given-names></name> <name><surname>Buchheit</surname> <given-names>M.</given-names></name> <name><surname>Wehrlin</surname> <given-names>J. P.</given-names></name> <name><surname>Millet</surname> <given-names>G. P.</given-names></name></person-group> (<year>2014</year>). <article-title>Tapering for marathon and cardiac autonomic function</article-title>. <source>Int. J. Sports Med.</source> <volume>35</volume>, <fpage>676</fpage>&#x02013;<lpage>683</lpage>. <pub-id pub-id-type="doi">10.1055/s-0033-1361184</pub-id><pub-id pub-id-type="pmid">24595813</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kiviniemi</surname> <given-names>A. M.</given-names></name> <name><surname>Hautala</surname> <given-names>A. J.</given-names></name> <name><surname>Kinnunen</surname> <given-names>H.</given-names></name> <name><surname>Nissil&#x000E4;</surname> <given-names>J.</given-names></name> <name><surname>Virtanen</surname> <given-names>P.</given-names></name> <name><surname>Karjalainen</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>Daily exercise prescription on the basis of HR variability among men and women</article-title>. <source>Med. Sci. Sports Exerc.</source> <volume>42</volume>, <fpage>1355</fpage>&#x02013;<lpage>1363</lpage>. <pub-id pub-id-type="doi">10.1249/MSS.0b013e3181cd5f39</pub-id><pub-id pub-id-type="pmid">20575165</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meeusen</surname> <given-names>R.</given-names></name> <name><surname>Duclos</surname> <given-names>M.</given-names></name> <name><surname>Foster</surname> <given-names>C.</given-names></name> <name><surname>Fry</surname> <given-names>A.</given-names></name> <name><surname>Gleeson</surname> <given-names>M.</given-names></name> <name><surname>Nieman</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Prevention, diagnosis, and treatment of the overtraining syndrome: joint consensus statement of the European College of Sport Science and the American College of Sports Medicine</article-title>. <source>Med. Sci. Sports Exerc.</source> <volume>45</volume>, <fpage>186</fpage>&#x02013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.1249/MSS.0b013e318279a10a</pub-id><pub-id pub-id-type="pmid">23247672</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mirmohamadsadeghi</surname> <given-names>L.</given-names></name> <name><surname>Bourdillon</surname> <given-names>N.</given-names></name> <name><surname>Vesin</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>Cardio-respiratory characterization of the autonomic balance</article-title>, in <source>Computing in Cardiology.</source> (<publisher-loc>Vancouver, BC</publisher-loc>: <publisher-name>IEEE</publisher-name>).</citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Munoz</surname> <given-names>M. L.</given-names></name> <name><surname>van Roon</surname> <given-names>A.</given-names></name> <name><surname>Riese</surname> <given-names>H.</given-names></name> <name><surname>Thio</surname> <given-names>C.</given-names></name> <name><surname>Oostenbroek</surname> <given-names>E.</given-names></name> <name><surname>Westrik</surname> <given-names>I.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Validity of (Ultra-)Short recordings for heart rate variability measurements</article-title>. <source>PLoS ONE</source> <volume>10</volume>:<fpage>e0138921</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0138921</pub-id><pub-id pub-id-type="pmid">26414314</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nakamura</surname> <given-names>F. Y.</given-names></name> <name><surname>Pereira</surname> <given-names>L. A.</given-names></name> <name><surname>Esco</surname> <given-names>M. R.</given-names></name> <name><surname>Flatt</surname> <given-names>A. A.</given-names></name> <name><surname>Moraes</surname> <given-names>J. E.</given-names></name> <name><surname>Cal Abad</surname> <given-names>C. C.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Intraday and interday reliability of ultra-short-term heart rate variability in rugby union players</article-title>. <source>J. Strength Cond. Res.</source> <volume>31</volume>, <fpage>548</fpage>&#x02013;<lpage>551</lpage>. <pub-id pub-id-type="doi">10.1519/JSC.0000000000001514</pub-id><pub-id pub-id-type="pmid">27243917</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oliveira</surname> <given-names>R. S.</given-names></name> <name><surname>Leicht</surname> <given-names>A. S.</given-names></name> <name><surname>Bishop</surname> <given-names>D.</given-names></name> <name><surname>Barbero-&#x000C1;lvarez</surname> <given-names>J. C.</given-names></name> <name><surname>Nakamura</surname> <given-names>F. Y.</given-names></name></person-group> (<year>2013</year>). <article-title>Seasonal changes in physical performance and heart rate variability in high level futsal players</article-title>. <source>Int. J. Sports Med.</source> <volume>34</volume>, <fpage>424</fpage>&#x02013;<lpage>430</lpage>. <pub-id pub-id-type="doi">10.1055/s-0032-1323720</pub-id><pub-id pub-id-type="pmid">23143705</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pereira</surname> <given-names>L. A.</given-names></name> <name><surname>Flatt</surname> <given-names>A. A.</given-names></name> <name><surname>Ramirez-Campillo</surname> <given-names>R.</given-names></name> <name><surname>Loturco</surname> <given-names>I.</given-names></name> <name><surname>Nakamura</surname> <given-names>F. Y.</given-names></name></person-group> (<year>2016</year>). <article-title>Assessing shortened field-based heart-rate-variability-data acquisition in team-sport athletes</article-title>. <source>Int. J. Sports Physiol. Perform.</source> <volume>11</volume>, <fpage>154</fpage>&#x02013;<lpage>158</lpage>. <pub-id pub-id-type="doi">10.1123/ijspp.2015-0038</pub-id><pub-id pub-id-type="pmid">26115088</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pichot</surname> <given-names>V.</given-names></name> <name><surname>Roche</surname> <given-names>F.</given-names></name> <name><surname>Gaspoz</surname> <given-names>J. M.</given-names></name> <name><surname>Enjolras</surname> <given-names>F.</given-names></name> <name><surname>Antoniadis</surname> <given-names>A.</given-names></name> <name><surname>Minini</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2000</year>). <article-title>Relation between heart rate variability and training load in middle-distance runners</article-title>. <source>Med. Sci. Sports Exerc.</source> <volume>32</volume>, <fpage>1729</fpage>&#x02013;<lpage>1736</lpage>. <pub-id pub-id-type="doi">10.1097/00005768-200010000-00011</pub-id><pub-id pub-id-type="pmid">11039645</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Plews</surname> <given-names>D. J.</given-names></name> <name><surname>Laursen</surname> <given-names>P. B.</given-names></name> <name><surname>Kilding</surname> <given-names>A. E.</given-names></name> <name><surname>Buchheit</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>Heart rate variability in elite triathletes, is variation in variability the key to effective training? A case comparison</article-title>. <source>Eur. J. Appl. Physiol.</source> <volume>112</volume>, <fpage>3729</fpage>&#x02013;<lpage>3741</lpage>. <pub-id pub-id-type="doi">10.1007/s00421-012-2354-4</pub-id><pub-id pub-id-type="pmid">22367011</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Plews</surname> <given-names>D. J.</given-names></name> <name><surname>Laursen</surname> <given-names>P. B.</given-names></name> <name><surname>Kilding</surname> <given-names>A. E.</given-names></name> <name><surname>Buchheit</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>Evaluating training adaptation with heart-rate measures: a methodological comparison</article-title>. <source>Int. J. Sports Physiol. Perform.</source> <volume>8</volume>, <fpage>688</fpage>&#x02013;<lpage>691</lpage>. <pub-id pub-id-type="doi">10.1123/ijspp.8.6.688</pub-id><pub-id pub-id-type="pmid">23479420</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Plews</surname> <given-names>D. J.</given-names></name> <name><surname>Scott</surname> <given-names>B.</given-names></name> <name><surname>Altini</surname> <given-names>M.</given-names></name> <name><surname>Wood</surname> <given-names>M.</given-names></name> <name><surname>Kilding</surname> <given-names>A. E.</given-names></name> <name><surname>Laursen</surname> <given-names>P. B.</given-names></name></person-group> (<year>2017</year>). <article-title>Comparison of heart rate variability recording with smart phone photoplethysmographic, polar H7 chest strap and electrocardiogram methods</article-title>. <source>Int. J. Sports Physiol. Perform.</source> <volume>14</volume>, <fpage>1</fpage>&#x02013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1123/ijspp.2016-0668</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saboul</surname> <given-names>D.</given-names></name> <name><surname>Pialoux</surname> <given-names>V.</given-names></name> <name><surname>Hautier</surname> <given-names>C.</given-names></name></person-group> (<year>2014</year>). <article-title>The breathing effect of the LF/HF ratio in the heart rate variability measurements of athletes</article-title>. <source>Eur. J. Sport Sci.</source> <volume>14</volume>(<supplement>Suppl. 1</supplement>), <fpage>S282</fpage>&#x02013;<lpage>S288</lpage>. <pub-id pub-id-type="doi">10.1080/17461391.2012.691116</pub-id><pub-id pub-id-type="pmid">24444219</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sandercock</surname> <given-names>G. R. H.</given-names></name> <name><surname>Brodie</surname> <given-names>D. A.</given-names></name></person-group> (<year>2006</year>). <article-title>The use of heart rate variability measures to assess autonomic control during exercise</article-title>. <source>Scand. J. Med. Sci. Sports</source> <volume>16</volume>, <fpage>302</fpage>&#x02013;<lpage>313</lpage>. <pub-id pub-id-type="doi">10.1111/j.1600-0838.2006.00556.x</pub-id><pub-id pub-id-type="pmid">16774653</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmitt</surname> <given-names>L.</given-names></name> <name><surname>Hellard</surname> <given-names>P.</given-names></name> <name><surname>Millet</surname> <given-names>G. P.</given-names></name> <name><surname>Roels</surname> <given-names>B.</given-names></name> <name><surname>Richalet</surname> <given-names>J. P.</given-names></name> <name><surname>Fouillot</surname> <given-names>J. P.</given-names></name></person-group> (<year>2006</year>). <article-title>Heart rate variability and performance at two different altitudes in well-trained swimmers</article-title>. <source>Int. J. Sports Med.</source> <volume>27</volume>, <fpage>226</fpage>&#x02013;<lpage>231</lpage>. <pub-id pub-id-type="doi">10.1055/s-2005-865647</pub-id><pub-id pub-id-type="pmid">16541379</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmitt</surname> <given-names>L.</given-names></name> <name><surname>Regnard</surname> <given-names>J.</given-names></name> <name><surname>Auguin</surname> <given-names>D.</given-names></name> <name><surname>Millet</surname> <given-names>G. P.</given-names></name></person-group> (<year>2016</year>). <article-title>Monitoring training and fatigue with heart rate variability: case study in a swimming Olympic champion</article-title>. <source>J. Fitness Res.</source> <fpage>5</fpage>.</citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmitt</surname> <given-names>L.</given-names></name> <name><surname>Regnard</surname> <given-names>J.</given-names></name> <name><surname>Desmarets</surname> <given-names>M.</given-names></name> <name><surname>Mauny</surname> <given-names>F.</given-names></name> <name><surname>Mourot</surname> <given-names>L.</given-names></name> <name><surname>Fouillot</surname> <given-names>J.-P.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Fatigue shifts and scatters heart rate variability in elite endurance athletes</article-title>. <source>PLoS ONE</source> <volume>8</volume>:<fpage>e71588</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0071588</pub-id><pub-id pub-id-type="pmid">23951198</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmitt</surname> <given-names>L.</given-names></name> <name><surname>Regnard</surname> <given-names>J.</given-names></name> <name><surname>Millet</surname> <given-names>G. P.</given-names></name></person-group> (<year>2015a</year>). <article-title>Monitoring fatigue status with HRV measures in elite athletes: an avenue beyond RMSSD?</article-title> <source>Front. Physiol.</source> <volume>6</volume>:<fpage>343</fpage>. <pub-id pub-id-type="doi">10.3389/fphys.2015.00343</pub-id><pub-id pub-id-type="pmid">26635629</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmitt</surname> <given-names>L.</given-names></name> <name><surname>Regnard</surname> <given-names>J.</given-names></name> <name><surname>Parmentier</surname> <given-names>A. L.</given-names></name> <name><surname>Mauny</surname> <given-names>F.</given-names></name> <name><surname>Mourot</surname> <given-names>L.</given-names></name> <name><surname>Coulmy</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2015b</year>). <article-title>Typology of &#x0201C;fatigue&#x0201D; by heart rate variability analysis in elite nordic-skiers</article-title>. <source>Int. J. Sports Med.</source> <volume>36</volume>, <fpage>999</fpage>&#x02013;<lpage>1007</lpage>. <pub-id pub-id-type="doi">10.1055/s-0035-1548885</pub-id><pub-id pub-id-type="pmid">26252552</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seiler</surname> <given-names>S.</given-names></name> <name><surname>Haugen</surname> <given-names>O.</given-names></name> <name><surname>Kuffel</surname> <given-names>E.</given-names></name></person-group> (<year>2007</year>). <article-title>Autonomic recovery after exercise in trained athletes: intensity and duration effects</article-title>. <source>Med. Sci. Sports Exerc.</source> <volume>39</volume>, <fpage>1366</fpage>&#x02013;<lpage>1373</lpage>. <pub-id pub-id-type="doi">10.1249/mss.0b013e318060f17d</pub-id><pub-id pub-id-type="pmid">17762370</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Vesin</surname> <given-names>J. M.</given-names></name> <name><surname>Yazdani</surname> <given-names>S.</given-names></name> <name><surname>Mirmohamadsadeghi</surname> <given-names>L.</given-names></name> <name><surname>Bourdillon</surname> <given-names>N.</given-names></name></person-group> (<year>2016</year>). <article-title>Extraction and analysis of short-time excursions in rr-interval time series</article-title>, in <source>Computing in Cardiology</source>. (<publisher-loc>Vancouver, BC</publisher-loc>: <publisher-name>IEEE</publisher-name>).</citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wessel</surname> <given-names>N.</given-names></name> <name><surname>Sidorenko</surname> <given-names>L.</given-names></name> <name><surname>Kraemer</surname> <given-names>J. F.</given-names></name> <name><surname>Schoebel</surname> <given-names>C.</given-names></name> <name><surname>Baumann</surname> <given-names>G.</given-names></name></person-group> (<year>2016</year>). <article-title>Assessing cardiac autonomic function via heart rate variability analysis requires monitoring respiration</article-title>. <source>Europace.</source> <volume>18</volume>:<fpage>1280</fpage>. <pub-id pub-id-type="doi">10.1093/europace/euv460</pub-id><pub-id pub-id-type="pmid">27496953</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> This study was performed in the framework of the Nano-Tera initiative supported by the Swiss National Science Foundation (SNSF).</p>
</fn>
</fn-group>
</back>
</article>