<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Physiol.</journal-id>
<journal-title>Frontiers in Physiology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Physiol.</abbrev-journal-title>
<issn pub-type="epub">1664-042X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fphys.2021.777137</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Physiology</subject>
<subj-group>
<subject>Mini Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Proposition for Bipolar Depression Forecasting Based on Wearable Data Collection</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Llamocca</surname> <given-names>Pavel</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>L&#x00F3;pez</surname> <given-names>Victoria</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>&#x010C;uki&#x0107;</surname> <given-names>Milena</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/821493/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Computer Architecture Department, Complutense University of Madrid</institution>, <addr-line>Madrid</addr-line>, <country>Spain</country></aff>
<aff id="aff2"><sup>2</sup><institution>Quantitative Methods Department, Cunef University</institution>, <addr-line>Madrid</addr-line>, <country>Spain</country></aff>
<aff id="aff3"><sup>3</sup><institution>Institute for Technology of Knowledge, Complutense University of Madrid</institution>, <addr-line>Madrid</addr-line>, <country>Spain</country></aff>
<aff id="aff4"><sup>4</sup><institution>3EGA</institution>, <addr-line>Amsterdam</addr-line>, <country>Netherlands</country></aff>
<aff id="aff5"><sup>5</sup><institution>Department for General Physiology and Biophysics, Belgrade University</institution>, <addr-line>Belgrade</addr-line>, <country>Serbia</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Carlo Massaroni, Campus Bio-Medico University, Italy</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Beth Lewandowski, Glenn Research Center, United States; Frank Pernett, Mid Sweden University, Sweden; Fernando Marmolejo-Ramos, University of South Australia, Australia</p></fn>
<corresp id="c001">&#x002A;Correspondence: Milena &#x010C;uki&#x0107;, <email>micukic@ucm.es</email>; <email>micu@3ega.nl</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Physio-logging, a section of the journal Frontiers in Physiology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>25</day>
<month>01</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>12</volume>
<elocation-id>777137</elocation-id>
<history>
<date date-type="received">
<day>14</day>
<month>09</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>29</day>
<month>11</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Llamocca, L&#x00F3;pez and &#x010C;uki&#x0107;.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Llamocca, L&#x00F3;pez and &#x010C;uki&#x0107;</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Bipolar depression is treated wrongly as unipolar depression, on average, for 8 years. It is shown that this mismedication affects the occurrence of a manic episode and aggravates the overall condition of patients with bipolar depression. Significant effort was invested in early detection of depression and forecasting of responses to certain therapeutic approaches using a combination of features extracted from standard and online testing, wearables monitoring, and machine learning. In the case of unipolar depression, this approach yielded evidence that this data-based computational psychiatry approach would be helpful in clinical practice. Following a similar pipeline, we examined the usefulness of this approach to foresee a manic episode in bipolar depression, so that clinicians and family of the patient can help patient navigate through the time of crisis. Our projects combined the results from self-reported daily questionnaires, the data obtained from smart watches, and the data from regular reports from standard psychiatric interviews to feed various machine learning models to predict a crisis in bipolar depression. Contrary to satisfactory predictions in unipolar depression, we found that bipolar depression, having more complex dynamics, requires personalized approach. A previous work on physiological complexity (complex variability) suggests that an inclusion of electrophysiological data, properly quantified, might lead to better solutions, as shown in other projects of our group concerning unipolar depression. Here, we make a comparison of previously performed research in a methodological sense, revisiting and additionally interpreting our own results showing that the methodological approach to mania forecasting may be modified to provide an accurate prediction in bipolar depression.</p>
</abstract>
<kwd-group>
<kwd>bipolar depression</kwd>
<kwd>detection</kwd>
<kwd>forecasting</kwd>
<kwd>wearables</kwd>
<kwd>telehealth</kwd>
<kwd>physiological complexity</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="58"/>
<page-count count="8"/>
<word-count count="5876"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="intro">
<title>Introduction</title>
<p>Those who suffer from bipolar depressive disorder (BDD) are often misdiagnosed with unipolar depression and treated as such in average for 8 years (<xref ref-type="bibr" rid="B50">Singh and Rajput, 2006</xref>; <xref ref-type="bibr" rid="B29">Lloyd et al., 2011</xref>). In addition, there are findings suggesting that antidepressant medication can aggravate their condition (<xref ref-type="bibr" rid="B35">Patel et al., 2015</xref>; <xref ref-type="bibr" rid="B47">Robillard et al., 2021</xref>). Bipolar disorder in its various forms affects 2.4% of the population of the world (World Mental Health Survey, 2011; <xref ref-type="bibr" rid="B57">World Health Organization [WHO], 2017</xref>). It is a recurrent mood disorder that produces everything from extreme euphoria to severe depression. It is accompanied by alterations in thought and behavior and can produce psychotic symptoms, such as delusions and hallucinations. People who suffer from it have a high risk of suicide, 20 times more than general population (<xref ref-type="bibr" rid="B2">Baldessarini et al., 2020</xref>). Even with treatment, more than a third of patients will suffer at least one relapse in the first year after diagnosis and more than 60% will have a new crisis in the first 2 years. It is a disease that typically appears during adolescence or early adulthood, affecting the person throughout his/her entire life (<xref ref-type="bibr" rid="B58">World Health Organization [WHO], 2018</xref>). Pharmacological treatment is the main pillar in the approach to this debilitating disease. It aims to shorten crises and prevent their occurrence but the medication has serious side effects, especially at high doses. It is therefore particularly important to detect the onset of a crisis as soon as possible. Rapid treatment of a new crisis can make a big difference in the overall effectiveness. However, this early detection is very difficult from a current standardized clinical approach. At the beginning of a crisis, the symptoms and changes can be very subtle, almost impossible to notice. It is very challenging to differentiate between unipolar and bipolar depression. We showed that the detection of unipolar depression is possible by combination of machine learning and non-linear characterization of electroencephalographic (EEG) signals (<xref ref-type="bibr" rid="B10">&#x010C;uki&#x0107; et al., 2020a</xref>,<xref ref-type="bibr" rid="B11">b</xref>,<xref ref-type="bibr" rid="B12">c</xref>; <xref ref-type="bibr" rid="B7">&#x010C;uki&#x0107; and Lopez, 2020</xref>). Additionally, we demonstrated that with the same methodological approach, it is possible to differentiate between two phases of the disease, episode, and remission (<xref ref-type="bibr" rid="B9">&#x010C;uki&#x0107; et al., 2019</xref>), which can have immense significance for clinical decisions.</p>
<p>A common denominator at the onset of crises is the change in sleep and activity pattern. Weeks before the crisis, there are always changes in these variables (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). The early detection of these changes would allow for the improved possibility of social and occupational integration of the patients and would also allow for the decrease of the dose of drug needed for stabilization.</p>
<p>In our previous work, we dealt with prediction of the occurrence of crisis in BDD based on actigraphy measurements combined with standard reports from psychiatrists and self-report data obtained from outpatients <italic>via</italic> a mobile application (<xref ref-type="bibr" rid="B26">Llamocca et al., 2018</xref>, <xref ref-type="bibr" rid="B28">2019</xref>, <xref ref-type="bibr" rid="B27">2021</xref>). We used a number of methods for feature selection and a number of machine learning models that were previously applied in similar detection tasks (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). In conclusion, we stated that this methodology led to a real precision medicine application. It was shown that non-linear analysis of electrophysiological data could be used for monitoring state of patients with bipolar depression (<xref ref-type="bibr" rid="B40">Pincus, 2006</xref>; <xref ref-type="bibr" rid="B30">Migliorini et al., 2012</xref>; <xref ref-type="bibr" rid="B31">Moon et al., 2013</xref>; <xref ref-type="bibr" rid="B33">Nardelli et al., 2017</xref>; <xref ref-type="bibr" rid="B4">Byun et al., 2019</xref>). Spectral and non-linear biomarkers extracted from ECG are corresponding to the aberrations of the autonomous nervous system (ANS) of patients, but also to the severity of the disease. The relation between variability of heart rate (VHR) and depression is well described (<xref ref-type="bibr" rid="B20">Kemp et al., 2010</xref>, <xref ref-type="bibr" rid="B21">2011</xref>, <xref ref-type="bibr" rid="B19">2012</xref>). Based on the non-linear analysis of ECG (as a robust marker of vagal control), it is possible to differentiate between comorbid disorders (<xref ref-type="bibr" rid="B19">Kemp et al., 2012</xref>) or subtypes of depression (<xref ref-type="bibr" rid="B22">Kemp et al., 2014</xref>), and to point to the unreported suicidal ideation (<xref ref-type="bibr" rid="B23">Khandoker et al., 2017</xref>), an information of enormous significance for accurate diagnosis and effective treatment. We argue here that electrophysiological data (ECG measured by portable monitoring device) as a source of detection and forecast, properly characterized by non-linear measures, can be a game changer. We revisited and additionally interpret some of our already published data, important for developing an accurate warning system for the proximity of the crisis, allowing timely and appropriate action.</p>
</sec>
<sec id="S2" sec-type="discussion">
<title>Comparative Analysis and Discussion</title>
<p>Our main aim in the most recent publication was to isolate relevant variables for BDD (irritability and duration of sleep turned out to be the most significant) and discover the relations between them (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). Being successful in the detection of unipolar depression states/phases, we applied the same method to BDD and revealed quite different dynamics of the disease with more phases than in unipolar depression (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). According to our results (based on accumulated clinical observations and advanced analytics), there are five distinct states with as many intermediary (bidirectional) states in BDD dynamics, described by directed graph approach (for more details of our methodology, please consult the original publication, <xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). We could not discuss all aspects of our results, due to the scope and the limitations of the journal. In this retrospective analysis together with additional interpretation of those results, we are discussing suggestions for improvement of the future methodology that might lead to a simpler solution, more attractive to clinicians. Due to very complex dynamics of bipolar depression, the personal analysis of every single case is still required, as in the classical personalized approach (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). Other research aiming at forecasting for BDD, also concluded that the time series extracted from similarly collected data are not possible to generalize since they are very <italic>heterogenous</italic>; this is actually preventing the automated mood forecasting in BDD (<xref ref-type="bibr" rid="B32">Moore et al., 2012</xref>). Moore and colleagues reported that for some patients the mania scores were always zero during the monitoring period, which is probably the effect of medication. <xref ref-type="fig" rid="F1">Figure 1</xref> shows the periods for defined states (depression, euthymia, manic, or mixed) in which some patients were, as well as the evolution of self-report variable D irritability and the actigraph variable S sleep efficiency. For detailed definitions of states, please consult original publication (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). From <xref ref-type="fig" rid="F1">Figure 1</xref>, we can see different dynamics in four different patients; P03 exhibited mania and mixed state, P04 experienced euthymia and mixed state, P06 exhibited all possible states in the same period, while P09 was in the phases of long euthymia and mania, with a brief phase of depression. Although these four persons are all diagnosed with <italic>the same clinical entity</italic>, it is difficult to compare their dynamics as they are so different. Knowing that the mood (or states, as we labeled them) is the outcome of many complex physiological processes (that generate series of sequential data), the problem of forecasting seems to be more complicated than previously thought [in various artificial intelligence (AI) applications]. Addition of physiological complexity (fractal and non-linear) analysis to this methodology, based on our interpretation coming from Information theory, may improve the characterization of their states leading to better crisis prediction.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Clinical record of episodes and evolution of irritability and sleep efficiency variables in 4 patients. Patient P03 <bold>(A)</bold> went through all possible states and a short period in euthymic state (high-risk patient). Patient P04 <bold>(B)</bold> went through all possible states, however, stayed in euthymic state most of the time. Patient P06 <bold>(C)</bold> went through all possible states and usually got depressed with few manic episodes. Patient P09 <bold>(D)</bold> got depressed, manic but stayed in euthymic state most of the time. All the data depicted on the above graphs are interpolated. For detailed definitions of states, please consult original publication (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). On abscissa are months of collection of the data, and on ordinate are the variable values.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fphys-12-777137-g001.tif"/>
</fig>
<p>One of the first authors to write about the quantitative assessment strategies in mood disorders, Steven M. Pincus, introduced a novel understanding of physiological complexity, based on his rich experience with deciphering hormonal dynamics. Pincus argues that we should pay closer attention to time series that reflect essential physiological information, for there is very important history of the data, i.e., the order of samples in the time series. Pincus is the author of the Approximate Entropy algorithm (ApEn), which is a model-independent quantification of the regularity (complexity) of the data (<xref ref-type="bibr" rid="B37">Pincus, 1991</xref>, <xref ref-type="bibr" rid="B36">1995</xref>; <xref ref-type="bibr" rid="B43">Pincus and Huang, 1992</xref>; <xref ref-type="bibr" rid="B46">Pincus and Viscarello, 1992</xref>). The fundamental difference between regularity statistics (such as, ApEn) and conventional variability measures is that the conventional approach is focusing on tasks of quantifying the degree of spread about the central value, while the order of the input data is irrelevant; whereas in irregularity statistics, ApEn tracks changes from random to very regular and the order of samples is <italic>essential</italic> to the algorithm (<xref ref-type="bibr" rid="B39">Pincus, 2003</xref>). If we shuffle the data, the intrinsic dynamics is lost, since time series reflect the essential physiological information (<xref ref-type="bibr" rid="B38">Pincus, 1994</xref>). Since the sequential order of mood data is relevant to diagnosis, we must use something beyond SD and means currently used in medicine, to adequately quantify the serial nature of those data (<xref ref-type="bibr" rid="B39">Pincus, 2003</xref>). Since ApEn and other similar entropy measures (Shannon entropy, sample entropy, multiscale entropy, etc.) started gathering attention, various research results confirmed that they are indispensable for detecting the slightest changes in the complex physiological systems, that cannot be discovered by conventional methods. In our most recent research, we detected that among those entropy-based measures, Shannon entropy yields the best result, overperforming any previously reported conventional heart rate variability (HRV) analysis (<xref ref-type="bibr" rid="B8">&#x010C;uki&#x0107; and Savi&#x0107;, 2021</xref>). That has sense since Shannon entropy reflects the amount of information generated by the signal (process), which can lead to discerning the system (and its states) that is functioning in a different way than the healthy one (<xref ref-type="bibr" rid="B52">Vajapeyam, 2014</xref>). ApEn can detect subclinical changes (the patterns that mostly remain undetected), unlike conventional time series analyses (<xref ref-type="bibr" rid="B41">Pincus et al., 1993</xref>). In addition, Pincus advises a combined approach of non-linear analysis of atypical heart rate (HR) dynamics and/or EEG, given the hereditary nature of bipolar disorder (<xref ref-type="bibr" rid="B39">Pincus, 2003</xref>, <xref ref-type="bibr" rid="B40">2006</xref>). ApEn showed to be capable of detecting changes not in peaks or amplitudes, but in underlying episodic behavior, corresponding to subsystem anatomy, feedback, or coupling (<xref ref-type="bibr" rid="B44">Pincus and Keefe, 1992</xref>; <xref ref-type="bibr" rid="B38">Pincus, 1994</xref>). It can be therefore useful to predict subsequent clinical changes, such as in mood disorders. Cook used this kind of quantification (irregularity statistics) (<xref ref-type="bibr" rid="B6">Cook et al., 2002</xref>) to show that patients with bipolar depression exhibit changes in EEG as a reaction to antidepressant therapy. Glenn and her colleagues managed to distinguish an episode of mania or depression, in 49 patients with bipolar disorder, from the 60 days of prior euthymia, 60 days prior the change by using ApEn algorithm on time series of self-reported state (<xref ref-type="bibr" rid="B16">Glenn et al., 2006</xref>). Their research showed that the larger ApEn value suggests that the 60 days prior to manic episode are more disordered (<italic>irregular</italic>) than the 60 days prior to a depressive episode. They argued that non-linear and linear techniques of analysis may measure different underlying components of mood changes capturing patterns that are embedded in the order of the data. Their research suggested that non-linear techniques should complement traditional measures to better delineate the onset (and extent) of an episode, preventing the costly hospitalization, but also the recovery from the crisis. <xref ref-type="bibr" rid="B32">Moore et al. (2012)</xref> noted that the quality that seems to vary among the patients with BDD they observed is so-called <italic>roughness</italic>, which they addressed by application of Detrended Fluctuation Analysis (DFA), a fractal methodology belonging to the family of non-linear methods of analysis. Another important study by <xref ref-type="bibr" rid="B30">Migliorini et al. (2012)</xref>, used portable ECG sensor embedded in T-shirts, so the patients could sleep without restraints while the constant monitoring of heart dynamics was performed. The rationale here is that underlying aberrated dynamics of ANS or cortico-vagal control (known to be disrupted in mood disorders (<xref ref-type="bibr" rid="B48">Rothenberg, 2007</xref>), could be used for the detection and forecasting. Again, non-linear measures showed to be superior to conventional ones (see also <xref ref-type="bibr" rid="B17">Gottschalk et al., 1995</xref>), and the ratings extracted from signals recorded during the whole 4 nights were more accurate than the result of the standard diagnostic procedure performed before sleep (they used ML models to differentiate between BDD and healthy controls). <xref ref-type="bibr" rid="B13">Faurholt-Jepsen et al. (2014)</xref> showed that self-reported (labeled &#x201C;subjective&#x201D;) assessment was more efficient in identifying BDD states, as in using mobile technology (smartphones) or online platforms, such as Mechanical Turk (<xref ref-type="bibr" rid="B15">Gillan and Whelan, 2017</xref>). Hence, some electrophysiological recording could significantly improve the chances of BDD mania prediction. Irregularity data would probably act as much more reliable features accurately representing underlying physiological information leading to better predictions. It is also important to distinguish between <italic>detection</italic> and <italic>forecasting</italic> since the latter is a much more demanding task. Having in mind that the symptoms of mood disorders are the consequences of cortico-vagal control or better, the lack of it (<xref ref-type="bibr" rid="B48">Rothenberg, 2007</xref>; <xref ref-type="bibr" rid="B56">Willner et al., 2013</xref>; <xref ref-type="bibr" rid="B53">Van der Kolk, 2014</xref>), non-linear measures as indicators of intrinsic dynamics (provided their sensitive quantification power) of the system are the optimal choice. <xref ref-type="bibr" rid="B24">Kim et al. (2013)</xref> showed that in bipolar depression, based on network analysis of EEG, there is an underlying disruption of functional connectivity.</p>
<p>Here, we propose two classes of methodology improvements that can result in more feasible solution for forecasting of manic episodes.</p>
<p>The first one is to add to the method the recording of ECG from the patients with BDD, with portable monitoring devices with medical-grade quality of signal. There are plenty of solutions, such as recording from the fingers, or from the wrists; to perform sufficiently accurate analysis, the recording from the chest is required. The signal should be analyzed by some of the abovementioned non-linear methods, irregularity statistics (entropy-based) and some form of fractal analysis. This kind of characterization of signal would eventually lead to much better prediction. The aim is to connect the values of certain measures/variables to certain diagnostic entities and their phases.</p>
<p>We are proposing recording of portable ECG, and not EEG (that was used for many EEG based depression detection in literature, among others, <xref ref-type="bibr" rid="B1">Alimardani and Boostani, 2018</xref>), aware of the problems in acquisition of the signal that can jeopardize the whole project. Telemedicine [with internet of things (IoT)] is gradually entering homes; outpatients are already using mobile applications, and the collection of data is easier than before. It is already shown that non-linear measures of ECG make it possible to differentiate between comorbid disorders (as shown in refs. <xref ref-type="bibr" rid="B20">Kemp et al., 2010</xref>, <xref ref-type="bibr" rid="B21">2011</xref>), to delineate melancholic from non-melancholic depression (<xref ref-type="bibr" rid="B22">Kemp et al., 2014</xref>), or to detect the suicide ideation (<xref ref-type="bibr" rid="B23">Khandoker et al., 2017</xref>), which is particularly important in BDD where the risk of suicide is high (20-fold risk in comparison with controls, <xref ref-type="bibr" rid="B2">Baldessarini et al., 2020</xref>). Those are all immensely important for the clinician to make effective treatment decisions. In addition, since sleep is disrupted in BDD, it would make sense to measure ECG during sleep (<xref ref-type="bibr" rid="B30">Migliorini et al., 2012</xref>). <xref ref-type="bibr" rid="B39">Pincus (2003)</xref> predicted that some form of sleep recording of ECG would be the most sufficient for this task (see also <xref ref-type="bibr" rid="B49">Saad et al., 2019</xref>).</p>
<p>An example from our publication (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>) is illustrating how variables connected to sleep (sleep duration as the most significant one) are changing in relation to the state defined for that day (either as self-reported or pronounced by a clinician, since both are included in dataset). <xref ref-type="fig" rid="F2">Figure 2</xref> shows how real data from patient P14 differ in respect to the interpolated data. We can conclude that P14 usually sleeps about 8 h in euthymic state, but this time-period varies when P14 is about to enter crisis or is already suffering from one. <xref ref-type="fig" rid="F2">Figure 2</xref> shows the periods for states in which patient P14 was, as well as the evolution of self-report variable D sleep duration (duration of their sleep).</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Evolution of sleep duration variable and the states the patient P14 went through. <bold>(A)</bold> Real data. <bold>(B)</bold> Interpolated data. For detailed definitions of states, please consult the original publication (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). On abscissa are months of collection of the data, and on ordinate are the variable values.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fphys-12-777137-g002.tif"/>
</fig>
<p>The second part of our proposition for further improvement of approach to prediction would be in connection to ML models. We were using various forms of supervised learning to learn from the data. The authors who are dealing with more theoretical approach to computational psychiatry (<xref ref-type="bibr" rid="B55">Whelan and Garavan, 2014</xref>) are advocating avoidance of &#x2018;unwarranted optimism&#x2019; by collecting more data and lowering the number of variables per person (<xref ref-type="bibr" rid="B25">Kohavi, 1995</xref>; <xref ref-type="bibr" rid="B51">Tibshirani, 1996</xref>; <xref ref-type="bibr" rid="B34">Ng, 1997</xref>). Relying on Bayesian approaches is recommendable. Special care should be given to dimensionality problem, which our group addressed entirely (<xref ref-type="bibr" rid="B27">Llamocca et al., 2021</xref>). In addition, support vector machines (SVM) might be one of the most popular models, but other methods could be used, such as embedded regularization (Whelan et al., 2013). Knowing the heterogeneity problem, we suggest introducing some of unsupervised learning methods, such as subgroup discovery (which is a binary classifier and works on labeled data) and association rule discovery (which is unsupervised ML Model), or predictive and descriptive clustering (distance-based models) (<xref ref-type="bibr" rid="B14">Flach, 2012</xref>). The problem with clusters can be 2-fold: either you have a trivial solution (which corresponds to overfitting in linear models, let us say clustering overfitting) that can be resolved if we penalize the large K, or if we fix the number of clusters K in advance; the problem cannot be solved for large datasets (but a typical dataset is not large). Soft clustering generalizes the notion of partition, in the same way that a probability estimator generalizes a classifier (<xref ref-type="bibr" rid="B14">Flach, 2012</xref>). With the abovementioned suggestion, the algorithm can learn from the (properly characterized) data. We can conclude what the subgroups are and what the relations between present instances are, so we can try to interpret them in the light of information theory approach to physiological processes.</p>
<p><xref ref-type="bibr" rid="B3">Busk et al. (2020)</xref> used a similar manner of collecting the data, with different items in the questionnaire. They tested the feasibility of forecasting daily subjective mood scores based on daily self-assessment from 84 patients with bipolar disorders via smartphone in a randomized clinical trial. Combined historic data and currently collected data improved forecasting and used Hierarchical Bayesian approach, a multi-task learning method. They used data from different subjects as additional cases to learn. Ordinal regression (or ordinal classification) is a method of predicting a discrete variable that has a relative ordering of the possible outcomes. First, they started with 1-day forecast with several scenarios (two time-series cross-validation experiments) and applied best model to evaluate 7-day forecast. When increasing the forecast horizon, forecast errors also increased and the forecast regression shifted toward the mean of data distribution; the best model used a 4-day history of self-assessment. Interestingly, authors used similar organization of the dataset that is usually used for entropy-based analysis of physiological data, discussed above; maybe the historicity of the data would be the key for successful forecasting. Besides, some shift in ML models used for much needed realistic forecasting includes much preferred unsupervised learning or functional data analysis (<xref ref-type="bibr" rid="B54">Wang et al., 2016</xref>). <xref ref-type="table" rid="T1">Table 1</xref> is offering some recommended techniques with our justification.</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Methods of detection and prediction of bipolar depression, used in the literature and recommended, with practical explanations and citation.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td/>
<td valign="top" align="center">Methods used</td>
<td valign="top" align="center">Methods recommended</td>
<td valign="top" align="center">Practical explanation</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" colspan="4"><bold>Detection</bold></td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">Patient&#x2019;s medical history, scales, epidemiological data</td>
<td valign="top" align="center">Electrophysiological signals (EEG, ECG.)</td>
<td valign="top" align="center"><xref ref-type="bibr" rid="B5">Coley et al. (2021)</xref> showed that epidemiological data cannot help in prediction; physiological dynamics can</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">EEG based detection of depression</td>
<td valign="top" align="center">ECG based detection of depression</td>
<td valign="top" align="center">Portable monitoring devices for EEG are still few and expensive, those for ECG are more accessible</td>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="center">Sub-bands analysis</td>
<td valign="top" align="center">Broad-band analysis</td>
<td valign="top" align="center">There is no physiological explanation of support for importance of sub-bands</td>
</tr>
<tr>
<td valign="top" align="left">4</td>
<td valign="top" align="center">Small sample sizes</td>
<td valign="top" align="center">Larger (collaborative) sample sizes</td>
<td valign="top" align="center">Existing effect can be better detected with decent effect size, demonstrating practically useful results</td>
</tr>
<tr>
<td valign="top" align="left">5</td>
<td valign="top" align="center">Big number of variables per person</td>
<td valign="top" align="center">Keep the ratio under 10</td>
<td valign="top" align="center">Unwarranted optimism (<xref ref-type="bibr" rid="B34">Ng, 1997</xref>; Whelan et al., 2013)</td>
</tr>
<tr>
<td valign="top" align="left">6</td>
<td valign="top" align="center">ECG detected from fingers or wrist</td>
<td valign="top" align="center">ECG detected from the chest</td>
<td valign="top" align="center">Medical-grade quality of signal leads to higher accuracies of detection/prediction</td>
</tr>
<tr>
<td valign="top" align="left">7</td>
<td valign="top" align="center">Conventional time and frequency measures of HRV</td>
<td valign="top" align="center">Fractal and non-linear measures of HRV (HFD, DFA, entropy based measures, Poincare plots.)</td>
<td valign="top" align="center">Effect sizes for non-linear detection overperform conventional measures detection for a whole magnitude on scale (corrected Cohen&#x2019;s d&#x223C; 0.2 vs. 7.7, <xref ref-type="bibr" rid="B8">&#x010C;uki&#x0107; and Savi&#x0107;, 2021</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">8</td>
<td valign="top" align="center">Aggressive pre-processing of electrophysiological signals</td>
<td valign="top" align="center">Using artifact free unfiltered signals, or Deep Learning of raw signal to correct for artifacts</td>
<td valign="top" align="center">By overly filtering and Fourier&#x2019;s decomposition (reductionistic approach) important information about history of data (sequentionality important for regularity statistics) is lost</td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>Prediction/Forecasting</bold></td>
</tr>
<tr>
<td valign="top" align="left">1</td>
<td valign="top" align="center">Frequentist statistics</td>
<td valign="top" align="center">Bayesian approach</td>
<td valign="top" align="center">Improved accuracy for real life use</td>
</tr>
<tr>
<td valign="top" align="left">2</td>
<td valign="top" align="center">Historical medical data</td>
<td valign="top" align="center">Non-linear measures as feature extraction</td>
<td valign="top" align="center">Features based on complex systems dynamics approach lead to realistic results</td>
</tr>
<tr>
<td valign="top" align="left">3</td>
<td valign="top" align="center">Variation around mean values</td>
<td valign="top" align="center">Complex variability (physiological complexity)</td>
<td valign="top" align="center">Irregularity statistics is much better suitable for quantifying physiological dynamics which is non-stationary, non-linear and noisy</td>
</tr>
<tr>
<td valign="top" align="left">4</td>
<td valign="top" align="center">SVM and other popular ML models</td>
<td valign="top" align="center">LASO embedded regularisation, unsupervised learning, clustering, FDA</td>
<td valign="top" align="center">Practically useful prediction</td>
</tr>
<tr>
<td valign="top" align="left">5</td>
<td valign="top" align="center">Outliers removal</td>
<td valign="top" align="center">Deep learning on raw data (ECG)</td>
<td valign="top" align="center">Keeping the intrinsic structure of the data intact</td>
</tr>
<tr>
<td valign="top" align="left">6</td>
<td valign="top" align="center">Feature extraction based on t (ANOVA)</td>
<td valign="top" align="center">PCA, GA or FDA</td>
<td valign="top" align="center">Much better sensitivity and specificity</td>
</tr>
<tr>
<td valign="top" align="left">7</td>
<td valign="top" align="center">Non-existing external validation</td>
<td valign="top" align="center">ROC curve application (AUC)</td>
<td valign="top" align="center">More realistic results</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>We hope that an improved research methodology, based on abovementioned comparison and analysis, would eventually lead to a much better theragnostic and improve the quality of life of patients.</p>
</sec>
<sec id="S3">
<title>Author Contributions</title>
<p>VL developed the idea for research. PL, VL, and M&#x010C; performed the research, wrote the manuscript, and reviewed the manuscript. PL and VL collected and analyzed the data. PL generated figures. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="pudiscl1" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="S4" sec-type="funding-information">
<title>Funding</title>
<p>This work was partially supported by the grant PID2020-113192GB-I00 (Mathematical Visualization: Foundations, Algorithms, and Applications) from the Spanish MICINN.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alimardani</surname> <given-names>F.</given-names></name> <name><surname>Boostani</surname> <given-names>R.</given-names></name></person-group> (<year>2018</year>). <article-title>DB-FFR: a modified feature selection algorithm to improve discrimination rate between bipolar mood disorder (BMD) and schizophrenic patients.</article-title> <source><italic>Iran. J. Sci. Technol. Trans. Electric. Eng.</italic></source> <volume>42</volume> <fpage>251</fpage>&#x2013;<lpage>260</lpage>. <pub-id pub-id-type="doi">10.1007/s40998-018-0060-x</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baldessarini</surname> <given-names>R. J.</given-names></name> <name><surname>V&#x00E1;zquez</surname> <given-names>G. H.</given-names></name> <name><surname>Tondo</surname> <given-names>L.</given-names></name></person-group> (<year>2020</year>). <article-title>Bipolar depression: a major unsolved challenge.</article-title> <source><italic>Int. J. Bipolar Disord.</italic></source> <volume>8</volume>:<issue>1</issue>. <pub-id pub-id-type="doi">10.1186/s40345-019-0160-1</pub-id> <pub-id pub-id-type="pmid">31903509</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Busk</surname> <given-names>J.</given-names></name> <name><surname>Faurholt-Jepsen</surname> <given-names>M.</given-names></name> <name><surname>Frost</surname> <given-names>M.</given-names></name> <name><surname>Bardram</surname> <given-names>J. E.</given-names></name> <name><surname>Kessing</surname> <given-names>L. V.</given-names></name> <name><surname>Winther</surname> <given-names>O.</given-names></name></person-group> (<year>2020</year>). <article-title>Forecasting mood in bipolar disorder from smartphone self-assessments: hierarchical bayesian approach.</article-title> <source><italic>JMIR Mhealth Uhealth</italic></source> <volume>8</volume>:<issue>e15028</issue>. <pub-id pub-id-type="doi">10.2196/15028</pub-id> <pub-id pub-id-type="pmid">32234702</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Byun</surname> <given-names>S.</given-names></name> <name><surname>Kim</surname> <given-names>A. Y.</given-names></name> <name><surname>Jang</surname> <given-names>E. H.</given-names></name> <name><surname>Kim</surname> <given-names>S.</given-names></name> <name><surname>Choi</surname> <given-names>K. W.</given-names></name> <name><surname>Yu</surname> <given-names>H. Y.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Entropy analysis of heart rate variability and its application to recognize major depressive disorder: a pilot study.</article-title> <source><italic>Technol. Health Care</italic></source> <volume>27</volume> <fpage>407</fpage>&#x2013;<lpage>424</lpage>. <pub-id pub-id-type="doi">10.3233/THC-199037</pub-id> <pub-id pub-id-type="pmid">31045557</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Coley</surname> <given-names>R. Y.</given-names></name> <name><surname>Boggs</surname> <given-names>J. M.</given-names></name> <name><surname>Beck</surname> <given-names>A.</given-names></name> <name><surname>Simon</surname> <given-names>G. E.</given-names></name></person-group> (<year>2021</year>). <article-title>Predicting outcomes of psychotherapy for depression with electronic health record data.</article-title> <source><italic>J. Affect. Disord. Rep.</italic></source> <volume>6</volume>:<issue>100198</issue>. <pub-id pub-id-type="doi">10.1016/j.jadr.2021.100198</pub-id> <pub-id pub-id-type="pmid">34541567</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname> <given-names>I. A.</given-names></name> <name><surname>Leuchter</surname> <given-names>A. F.</given-names></name> <name><surname>Morgan</surname> <given-names>M.</given-names></name> <name><surname>Witte</surname> <given-names>E.</given-names></name> <name><surname>Stubbeman</surname> <given-names>W. F.</given-names></name> <name><surname>Abrams</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2002</year>). <article-title>Early changes in prefrontal activity characterize clinical responders to antidepressants.</article-title> <source><italic>Neuropsychopharmacology</italic></source> <volume>27</volume> <fpage>120</fpage>&#x2013;<lpage>131</lpage>. <pub-id pub-id-type="doi">10.1016/S0893-133X(02)00294-4</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Lopez</surname> <given-names>V.</given-names></name></person-group> (<year>2020</year>). &#x201C;<article-title>On mistakes we made in prior computational psychiatry data driven approach projects and how they jeopardize translation of those findings in clinical practice</article-title>,&#x201D; in <source><italic>IntelliSys Conference, Amsterdam 3-5 September 2020. &#x201C;Advances in Intelligent Systems and Computing&#x201D;</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Arai</surname> <given-names>K.</given-names></name> <name><surname>Kapoor</surname> <given-names>S.</given-names></name> <name><surname>Bhatia</surname> <given-names>R.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer Verlag</publisher-name>), <fpage>493</fpage>&#x2013;<lpage>510</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-55190-2_37</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Savi&#x0107;</surname> <given-names>D.</given-names></name></person-group> (<year>2021</year>). <article-title>Another Godot who is still not coming: more on biomarkers for depression</article-title>. <source><italic>Revista de Psiquiatr&#x00ED;a y Salud Mental</italic></source> <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.rpsm.2021.12.006">doi: 10.1016/j.rpsm.2021.12.006</ext-link> (in press)</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Stoki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Radenkovi&#x0107;</surname> <given-names>S.</given-names></name> <name><surname>Ljubisavljevi&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Simi&#x0107;</surname> <given-names>S.</given-names></name> <name><surname>Savi&#x0107;</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Nonlinear analysis of EEG complexity in episode and remission phase of recurrent depression</article-title>. <source><italic>Int. J. Methods Psychiatry Res.</italic></source> <volume>29</volume>:<issue>e1816</issue>. <pub-id pub-id-type="doi">10.1002/MPR.1816</pub-id> <pub-id pub-id-type="pmid">31820528</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>L&#x00F3;pez</surname> <given-names>V.</given-names></name> <name><surname>Pav&#x00F3;n</surname> <given-names>J.</given-names></name></person-group> (<year>2020a</year>). <article-title>Classification of depression through resting-state electroencephalogram as a novel practice in psychiatry.</article-title> <source><italic>J. Med. Internet Res.</italic></source> <volume>22</volume>:<issue>e19548</issue>. <pub-id pub-id-type="doi">10.2196/19548</pub-id> <pub-id pub-id-type="pmid">33141088</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Stoki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Radenkovi&#x0107;</surname> <given-names>S.</given-names></name> <name><surname>Ljubisavljevi&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Simi&#x0107;</surname> <given-names>S.</given-names></name> <name><surname>Savi&#x0107;</surname> <given-names>D.</given-names></name></person-group> (<year>2020b</year>). <article-title>Nonlinear analysis of EEG complexity in episode and remission phase of recurrent depression.</article-title> <source><italic>Int. J. Methods Psychiatr. Res.</italic></source> <volume>29</volume>:<issue>e1816</issue>. <pub-id pub-id-type="doi">10.1002/MPR.1816</pub-id> <pub-id pub-id-type="pmid">31820528</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Stoki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Simi&#x0107;</surname> <given-names>S.</given-names></name> <name><surname>Pokrajac</surname> <given-names>D.</given-names></name></person-group> (<year>2020c</year>). <article-title>The successful discrimination of depression from EEG could be attributed to proper feature extraction and not to a particular classification method.</article-title> <source><italic>Cogn. Neurodyn.</italic></source> <volume>14</volume> <fpage>443</fpage>&#x2013;<lpage>455</lpage>. <pub-id pub-id-type="doi">10.1007/s11571-020-09581-x</pub-id> <pub-id pub-id-type="pmid">32655709</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Faurholt-Jepsen</surname> <given-names>M.</given-names></name> <name><surname>Vinberg</surname> <given-names>M.</given-names></name> <name><surname>Frost</surname> <given-names>M.</given-names></name> <name><surname>Christensen</surname> <given-names>E. M.</given-names></name> <name><surname>Bardram</surname> <given-names>J.</given-names></name> <name><surname>Kessing</surname> <given-names>L. V.</given-names></name></person-group> (<year>2014</year>). <article-title>Daily electronic monitoring of subjective and objective measures of illness activity in bipolar disorder using smartphones&#x2013;the MONARCA II trial protocol: a randomized controlled single-blind parallel-group trial.</article-title> <source><italic>BMC Psychiatry</italic></source> <volume>14</volume>:<issue>309</issue>. <pub-id pub-id-type="doi">10.1186/s12888-014-0309-5</pub-id> <pub-id pub-id-type="pmid">25420431</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flach</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <source><italic>Machine Learning: The Art And Science Of Algorithms That Make Sense Of Data.</italic></source> <publisher-loc>Cambrdige</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gillan</surname> <given-names>C. M.</given-names></name> <name><surname>Whelan</surname> <given-names>R.</given-names></name></person-group> (<year>2017</year>). <article-title>What big data can do for treatment in psychiatry.</article-title> <source><italic>Curr. Opin. Behav. Sci.</italic></source> <volume>18</volume> <fpage>34</fpage>&#x2013;<lpage>42</lpage>.</citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Glenn</surname> <given-names>T.</given-names></name> <name><surname>Whybrow</surname> <given-names>P. C.</given-names></name> <name><surname>Rasgon</surname> <given-names>N.</given-names></name> <name><surname>Grof</surname> <given-names>P.</given-names></name> <name><surname>Alda</surname> <given-names>M.</given-names></name> <name><surname>Baethge</surname> <given-names>C.</given-names></name><etal/></person-group> (<year>2006</year>). <article-title>Approximate entropy of self-reported mood prior to episodes in bipolar disorder.</article-title> <source><italic>Bipolar Disord.</italic></source> <volume>8</volume> <fpage>424</fpage>&#x2013;<lpage>429</lpage>. <pub-id pub-id-type="doi">10.1111/j.1399-5618.2006.00373.x</pub-id> <pub-id pub-id-type="pmid">17042880</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gottschalk</surname> <given-names>A.</given-names></name> <name><surname>Bauer</surname> <given-names>M. S.</given-names></name> <name><surname>Whybrow</surname> <given-names>P. C.</given-names></name></person-group> (<year>1995</year>). <article-title>Evidence of chaotic mood variation in bipolar disorder.</article-title> <source><italic>Arch. Gen. Psychiatry</italic></source> <volume>52</volume> <fpage>947</fpage>&#x2013;<lpage>959</lpage>. <pub-id pub-id-type="doi">10.1001/archpsyc.1995.03950230061009</pub-id> <pub-id pub-id-type="pmid">7487343</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Depression, antidepressant treatment and the cardiovascular system.</article-title> <source><italic>Acta Neuropsychiatr.</italic></source> <volume>23</volume> <fpage>82</fpage>&#x2013;<lpage>83</lpage>. <pub-id pub-id-type="doi">10.1111/j.1601-5215.2011.00535.x</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname> <given-names>A. H.</given-names></name> <name><surname>Quintana</surname> <given-names>D. S.</given-names></name> <name><surname>Felmingham</surname> <given-names>K. L.</given-names></name> <name><surname>Matthews</surname> <given-names>S.</given-names></name> <name><surname>Jelinek</surname> <given-names>H. F.</given-names></name></person-group> (<year>2012</year>). <article-title>Depression, comorbid anxiety disorders, and heart rate variability in physically healthy, unmedicated patients: implications for cardiovascular risk.</article-title> <source><italic>PLoS One</italic></source> <volume>7</volume>:<issue>e30777</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0030777</pub-id> <pub-id pub-id-type="pmid">22355326</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname> <given-names>A. H.</given-names></name> <name><surname>Quintana</surname> <given-names>D. S.</given-names></name> <name><surname>Gray</surname> <given-names>M. A.</given-names></name> <name><surname>Felmingham</surname> <given-names>K. L.</given-names></name> <name><surname>Brown</surname> <given-names>K.</given-names></name> <name><surname>Gatt</surname> <given-names>J. M.</given-names></name></person-group> (<year>2010</year>). <article-title>Impact of depression and antidepressant treatment on heart rate variability: a review and meta-analysis.</article-title> <source><italic>Biol. Psychiatry</italic></source> <volume>67</volume> <fpage>1067</fpage>&#x2013;<lpage>1074</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopsych.2009.12.012</pub-id> <pub-id pub-id-type="pmid">20138254</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname> <given-names>A. H.</given-names></name> <name><surname>Quintana</surname> <given-names>D. S.</given-names></name> <name><surname>Malhi</surname> <given-names>G. S.</given-names></name></person-group> (<year>2011</year>). <article-title>Effects of serotonin reuptake inhibitors on heart rate variability: methodological issues, medical comorbidity, and clinical relevance.</article-title> <source><italic>Biol. Psychiatry</italic></source> <volume>69</volume> <fpage>e25</fpage>&#x2013;<lpage>e26</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopsych.2010.10.10.0365</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname> <given-names>A. H.</given-names></name> <name><surname>Quintana</surname> <given-names>D. S.</given-names></name> <name><surname>Quinn</surname> <given-names>C. R.</given-names></name> <name><surname>Hopkinson</surname> <given-names>P.</given-names></name> <name><surname>Harris</surname> <given-names>A. W.</given-names></name></person-group> (<year>2014</year>). <article-title>Major depressive disorder with melancholia displays robust alterations in resting state heart rate and its variability: implications for future morbidity and mortality.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>5</volume>:<issue>1387</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2014.01387</pub-id> <pub-id pub-id-type="pmid">25505893</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Khandoker</surname> <given-names>A. H.</given-names></name> <name><surname>Luthra</surname> <given-names>V.</given-names></name> <name><surname>Abouallaban</surname> <given-names>Y.</given-names></name> <name><surname>Saha</surname> <given-names>S.</given-names></name> <name><surname>Ahmed</surname> <given-names>K. I.</given-names></name> <name><surname>Mostafa</surname> <given-names>R.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Predicting depressed patients with suicidal ideation from ECG recordings.</article-title> <source><italic>Med. Biol. Eng. Comput.</italic></source> <volume>55</volume> <fpage>793</fpage>&#x2013;<lpage>805</lpage>. <pub-id pub-id-type="doi">10.1007/s11517-016-1557-y</pub-id> <pub-id pub-id-type="pmid">27538398</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>D. J.</given-names></name> <name><surname>Bolbecker</surname> <given-names>A. R.</given-names></name> <name><surname>Howell</surname> <given-names>J.</given-names></name> <name><surname>Rass</surname> <given-names>O.</given-names></name> <name><surname>Sporns</surname> <given-names>O.</given-names></name> <name><surname>Hetrick</surname> <given-names>W. P.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Disturbed resting state EEG synchronization in bipolar disorder: a graph-theoretic analysis.</article-title> <source><italic>NeuroImage Clin.</italic></source> <volume>2</volume> <fpage>414</fpage>&#x2013;<lpage>423</lpage>. <pub-id pub-id-type="doi">10.1016/j.nicl.2013.03.007</pub-id> <pub-id pub-id-type="pmid">24179795</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kohavi</surname> <given-names>R.</given-names></name></person-group> (<year>1995</year>). <article-title>A study of cross-validation and bootstrap for accuracy estimation and model selection.</article-title> <source><italic>IJCAI</italic></source> <volume>14</volume> <fpage>1137</fpage>&#x2013;<lpage>1145</lpage>.</citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Llamocca</surname> <given-names>P.</given-names></name> <name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name> <name><surname>Junestrand</surname> <given-names>A.</given-names></name> <name><surname>Urgel&#x00E9;s</surname> <given-names>D.</given-names></name> <name><surname>L&#x00F3;pez</surname> <given-names>V. L.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>Data source analysis in mood disorder research</article-title>,&#x201D; in <source><italic>In XVIII Conferencia de la Asociaci&#x00F3;n Espa&#x00F1;ola para la Inteligencia Artificial (CAEPIA 2018) 23-26 de octubre de 2018 Granada</italic></source> (<publisher-loc>Espa&#x00F1;a</publisher-loc>: <publisher-name>Asociaci&#x00F3;n Espa&#x00F1;ola para la Inteligencia Artificial (AEPIA)</publisher-name>), <fpage>893</fpage>&#x2013;<lpage>898</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Llamocca</surname> <given-names>P.</given-names></name> <name><surname>L&#x00F3;pez</surname> <given-names>V.</given-names></name> <name><surname>Santos</surname> <given-names>M.</given-names></name> <name><surname>&#x010C;uki&#x0107;</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Personalized characterization of emotional states in patients with bipolar disorder.</article-title> <source><italic>Mathematics</italic></source> <volume>9</volume>:<issue>1174</issue>. <pub-id pub-id-type="doi">10.3390/math9111174</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Llamocca</surname> <given-names>P.</given-names></name> <name><surname>Urgel&#x00E9;s</surname> <given-names>D.</given-names></name> <name><surname>Cukic</surname> <given-names>M.</given-names></name> <name><surname>Lopez</surname> <given-names>V.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Bip4Cast: some advances in mood disorders data analysis</article-title>,&#x201D; in <source><italic>Proceedings of the 1st International Alan Turing Conference on Decision Support and Recommender Systems, London</italic></source> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>5</fpage>&#x2013;<lpage>10</lpage>.</citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lloyd</surname> <given-names>L. C.</given-names></name> <name><surname>Giaroli</surname> <given-names>G.</given-names></name> <name><surname>Taylor</surname> <given-names>D.</given-names></name> <name><surname>Tracy</surname> <given-names>D. K.</given-names></name></person-group> (<year>2011</year>). <article-title>Bipolar depression: clinically missed, pharmacologically mismanaged.</article-title> <source><italic>Ther. Adv. Psychopharmacol.</italic></source> <volume>1</volume> <fpage>153</fpage>&#x2013;<lpage>162</lpage>. <pub-id pub-id-type="doi">10.1177/2045125311420752</pub-id> <pub-id pub-id-type="pmid">23983940</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Migliorini</surname> <given-names>M.</given-names></name> <name><surname>Mendez</surname> <given-names>M. O.</given-names></name> <name><surname>Bianchi</surname> <given-names>A. M.</given-names></name></person-group> (<year>2012</year>). <article-title>Study of heart rate variability in bipolar disorder: linear and non-linear parameters during sleep.</article-title> <source><italic>Front. Neuroeng.</italic></source> <volume>4</volume>:<issue>22</issue>. <pub-id pub-id-type="doi">10.3389/fneng.2011.00022</pub-id> <pub-id pub-id-type="pmid">22291638</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moon</surname> <given-names>E.</given-names></name> <name><surname>Lee</surname> <given-names>S. H.</given-names></name> <name><surname>Kim</surname> <given-names>D. H.</given-names></name> <name><surname>Hwang</surname> <given-names>B.</given-names></name></person-group> (<year>2013</year>). <article-title>Comparative study of heart rate variability in patients with schizophrenia, bipolar disorder, post-traumatic stress disorder, or major depressive disorder.</article-title> <source><italic>Clin. Psychopharmacol. Neurosci.</italic></source> <volume>11</volume> <fpage>137</fpage>&#x2013;<lpage>43</lpage>. <pub-id pub-id-type="doi">10.9758/cpn.2013.11.3.137</pub-id> <pub-id pub-id-type="pmid">24465250</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moore</surname> <given-names>P. J.</given-names></name> <name><surname>Little</surname> <given-names>M. A.</given-names></name> <name><surname>McSharry</surname> <given-names>P. E.</given-names></name> <name><surname>Geddes</surname> <given-names>J. R.</given-names></name> <name><surname>Goodwin</surname> <given-names>G. M.</given-names></name></person-group> (<year>2012</year>). <article-title>Forecasting depression in bipolar disorder.</article-title> <source><italic>IEEE Trans. Biomed. Eng.</italic></source> <volume>59</volume> <fpage>2801</fpage>&#x2013;<lpage>2807</lpage>. <pub-id pub-id-type="doi">10.1109/TBME.2012.2210715</pub-id> <pub-id pub-id-type="pmid">22855220</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nardelli</surname> <given-names>M.</given-names></name> <name><surname>Lanata</surname> <given-names>A.</given-names></name> <name><surname>Bertschy</surname> <given-names>G.</given-names></name> <name><surname>Scilingo</surname> <given-names>E. P.</given-names></name> <name><surname>Valenza</surname> <given-names>G.</given-names></name></person-group> (<year>2017</year>). <article-title>Heartbeat complexity modulation in bipolar disorder during daytime and nighttime</article-title>. <source><italic>Sci. Rep.</italic></source> <volume>7</volume>:<issue>17920</issue>. <pub-id pub-id-type="doi">10.1038/s41598-017-18036-z</pub-id> <pub-id pub-id-type="pmid">29263393</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ng</surname> <given-names>A. Y.</given-names></name></person-group> (<year>1997</year>). <article-title>Preventing &#x201C;Overfitting&#x201D; of Cross-Validation Data. Presented at the 14th International Conference on Machine Learning (ICML) (1997)</article-title>. Available Online at: <ext-link ext-link-type="uri" xlink:href="http://robotics.stanford.edu/&#x00E3;ng/papers/cv-final.pdf">http://robotics.stanford.edu/&#x00E3;ng/papers/cv-final.pdf</ext-link></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Patel</surname> <given-names>R.</given-names></name> <name><surname>Reiss</surname> <given-names>P.</given-names></name> <name><surname>Shetty</surname> <given-names>H.</given-names></name> <name><surname>Broadbent</surname> <given-names>M.</given-names></name> <name><surname>Stewart</surname> <given-names>R.</given-names></name> <name><surname>McGuire</surname> <given-names>P.</given-names></name><etal/></person-group> (<year>2015</year>). <article-title>Do antidepressants increase the risk of mania and bipolar disorder in people with depression? A retrospective electronic case register cohort study.</article-title> <source><italic>BMJ Open</italic></source> <volume>5</volume>:<issue>e008341</issue>. <pub-id pub-id-type="doi">10.1136/bmjopen-2015-008341</pub-id> <pub-id pub-id-type="pmid">26667012</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S.</given-names></name></person-group> (<year>1995</year>). <article-title>Approximate entropy (ApEn) as a complexity measure.</article-title> <source><italic>Chaos</italic></source> <volume>5</volume> <fpage>110</fpage>&#x2013;<lpage>117</lpage>. <pub-id pub-id-type="doi">10.1063/1.166092</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name></person-group> (<year>1991</year>). <article-title>Approximate entropy as a measure of system complexity.</article-title> <source><italic>Proc. Natl. Acad. Sci. U. S. A.</italic></source> <volume>88</volume> <fpage>2297</fpage>&#x2013;<lpage>2301</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.88.6.2297</pub-id> <pub-id pub-id-type="pmid">11607165</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name></person-group> (<year>1994</year>). <article-title>Greater signal regularity may indicate increased system isolation.</article-title> <source><italic>Math. Biosci.</italic></source> <volume>122</volume> <fpage>161</fpage>&#x2013;<lpage>181</lpage>. <pub-id pub-id-type="doi">10.1016/0025-5564(94)90056-6</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name></person-group> (<year>2003</year>). <article-title>Quantitative assessment strategies and issues for mood and other psychiatric serial study data.</article-title> <source><italic>Bipolar Disord.</italic></source> <volume>5</volume> <fpage>287</fpage>&#x2013;<lpage>294</lpage>. <pub-id pub-id-type="doi">10.1034/j.1399-5618.2003.00036.x</pub-id> <pub-id pub-id-type="pmid">12895206</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name></person-group> (<year>2006</year>). <article-title>Approximate entropy as a measure of irregularity for psychiatric serial metrics.</article-title> <source><italic>Bipolar Disord.</italic></source> <volume>8</volume> <fpage>430</fpage>&#x2013;<lpage>440</lpage>. <pub-id pub-id-type="doi">10.1111/j.1399-5618.2006.00375.x</pub-id> <pub-id pub-id-type="pmid">17042881</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name> <name><surname>Cummins</surname> <given-names>T. R.</given-names></name> <name><surname>Haddad</surname> <given-names>G. G.</given-names></name></person-group> (<year>1993</year>). <article-title>Heart rate control in normal and aborted-SIDS infants.</article-title> <source><italic>Am. J. Physiol. Regul. Integr. Comp. Physiol.</italic></source> <volume>264</volume> <fpage>R638</fpage>&#x2013;<lpage>R646</lpage>. <pub-id pub-id-type="doi">10.1152/ajpregu.1993.264.3.R638</pub-id> <pub-id pub-id-type="pmid">8457020</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name> <name><surname>Goldberger</surname> <given-names>A. L.</given-names></name></person-group> (<year>1994</year>). <article-title>Physiological time-series analysis: what does regularity quantify?</article-title> <source><italic>Am. J. Physiol. Heart Circ. Physiol.</italic></source> <volume>266</volume> <fpage>H1643</fpage>&#x2013;<lpage>H1656</lpage>. <pub-id pub-id-type="doi">10.1152/ajpheart.1994.266.4.H1643</pub-id> <pub-id pub-id-type="pmid">8184944</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name> <name><surname>Huang</surname> <given-names>W. M.</given-names></name></person-group> (<year>1992</year>). <article-title>Approximate entropy: statistical properties and applications.</article-title> <source><italic>Commun. Stat. Theory Methods</italic></source> <volume>21</volume> <fpage>3061</fpage>&#x2013;<lpage>3077</lpage>. <pub-id pub-id-type="doi">10.1080/03610929208830963</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name> <name><surname>Keefe</surname> <given-names>D. L.</given-names></name></person-group> (<year>1992</year>). <article-title>Quantification of hormone pulsatility via an approximate entropy algorithm.</article-title> <source><italic>Am. J. Physiol. Endocrinol. Metab.</italic></source> <volume>262</volume> <fpage>E741</fpage>&#x2013;<lpage>E754</lpage>. <pub-id pub-id-type="doi">10.1152/ajpendo.1992.262.5.E741</pub-id> <pub-id pub-id-type="pmid">1590385</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name> <name><surname>Mulligan</surname> <given-names>T.</given-names></name> <name><surname>Iranmanesh</surname> <given-names>A.</given-names></name> <name><surname>Gheorghiu</surname> <given-names>S.</given-names></name> <name><surname>Godschalk</surname> <given-names>M.</given-names></name> <name><surname>Veldhuis</surname> <given-names>J. D.</given-names></name></person-group> (<year>1996</year>). <article-title>Older males secrete luteinizing hormone and testosterone more irregularly, and jointly more asynchronously, than younger males.</article-title> <source><italic>Proc. Natl. Acad. Sci. U. S. A.</italic></source> <volume>93</volume> <fpage>14100</fpage>&#x2013;<lpage>14105</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.93.24.14100</pub-id> <pub-id pub-id-type="pmid">8943067</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pincus</surname> <given-names>S. M.</given-names></name> <name><surname>Viscarello</surname> <given-names>R. R.</given-names></name></person-group> (<year>1992</year>). <article-title>Approximate entropy: a regularity measure for fetal heart rate analysis.</article-title> <source><italic>Obstetr. Gynecol.</italic></source> <volume>79</volume> <fpage>249</fpage>&#x2013;<lpage>255</lpage>.</citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Robillard</surname> <given-names>R.</given-names></name> <name><surname>Saad</surname> <given-names>M.</given-names></name> <name><surname>Ray</surname> <given-names>L. B.</given-names></name> <name><surname>BuJ&#x00E1;ki</surname> <given-names>B.</given-names></name> <name><surname>Douglass</surname> <given-names>A.</given-names></name> <name><surname>Lee</surname> <given-names>E. K.</given-names></name><etal/></person-group> (<year>2021</year>). <article-title>Selective serotonin reuptake inhibitor use is associated with worse sleep-related breathing disturbances in individuals with depressive disorders and sleep complaints: a retrospective study.</article-title> <source><italic>J. Clin. Sleep Med.</italic></source> <volume>17</volume> <fpage>505</fpage>&#x2013;<lpage>513</lpage>. <pub-id pub-id-type="doi">10.5664/jcsm.8942</pub-id> <pub-id pub-id-type="pmid">33118928</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rothenberg</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Cardiac vagal control in depression: a critical analysis.</article-title> <source><italic>Biol. Psychol.</italic></source> <volume>74</volume> <fpage>200</fpage>&#x2013;<lpage>211</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopsycho.2005.08.010</pub-id> <pub-id pub-id-type="pmid">17045728</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saad</surname> <given-names>M.</given-names></name> <name><surname>Ray</surname> <given-names>L. B.</given-names></name> <name><surname>Bujaki</surname> <given-names>B.</given-names></name> <name><surname>Parvaresh</surname> <given-names>A.</given-names></name> <name><surname>Palamarchuk</surname> <given-names>I.</given-names></name> <name><surname>De Koninck</surname> <given-names>J.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Using heart rate profiles during sleep as a biomarker of depression.</article-title> <source><italic>BMC Psychiatry</italic></source> <volume>19</volume>:<issue>168</issue>. <pub-id pub-id-type="doi">10.1186/s12888-019-2152-1</pub-id> <pub-id pub-id-type="pmid">31174510</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Singh</surname> <given-names>T.</given-names></name> <name><surname>Rajput</surname> <given-names>M.</given-names></name></person-group> (<year>2006</year>). <article-title>Misdiagnosis of bipolar disorder.</article-title> <source><italic>Psychiatry (Edgmont)</italic></source> <volume>3</volume> <fpage>57</fpage>&#x2013;<lpage>63</lpage>.</citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tibshirani</surname> <given-names>R.</given-names></name></person-group> (<year>1996</year>). <article-title>Regression shrinkage and selection via the lasso.</article-title> <source><italic>J. R. Stat. Soc. B (Methodol.)</italic></source> <volume>58</volume> <fpage>267</fpage>&#x2013;<lpage>288</lpage>. <pub-id pub-id-type="doi">10.1111/j.2517-6161.1996.tb02080.x</pub-id></citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vajapeyam</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>Understanding Shannon&#x2019;s entropy metric for information.</article-title> <source><italic>arXiv</italic></source> <comment>[Preprint]</comment>. Available Online at: <ext-link ext-link-type="uri" xlink:href="https://arxiv.org/abs/1405.2061">https://arxiv.org/abs/1405.2061</ext-link>.</citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van der Kolk</surname> <given-names>B.</given-names></name></person-group> (<year>2014</year>). <source><italic>The Body Keeps The Score: Mind, Brain And Body In The Transformation Of Trauma.</italic></source> <publisher-loc>New York</publisher-loc>: <publisher-name>Penguin</publisher-name>.</citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>J.-L.</given-names></name> <name><surname>Chiou</surname> <given-names>J.-M.</given-names></name> <name><surname>M&#x00FC;ller</surname> <given-names>H.-G.</given-names></name></person-group> (<year>2016</year>). <article-title>Review of functional data analysis.</article-title> <source><italic>Annu. Rev. Stat. Appl.</italic></source> <volume>3</volume> <fpage>257</fpage>&#x2013;<lpage>295</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-statistics-041715-033624</pub-id></citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Whelan</surname> <given-names>R.</given-names></name> <name><surname>Garavan</surname> <given-names>H.</given-names></name></person-group> (<year>2014</year>). <article-title>When optimism hurts: inflated predictions in psychiatric neuroimaging.</article-title> <source><italic>Biol. Psychiatry</italic></source> <volume>75</volume> <fpage>746</fpage>&#x2013;<lpage>748</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopsych.2013.05.014</pub-id> <pub-id pub-id-type="pmid">23778288</pub-id></citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Willner</surname> <given-names>P.</given-names></name> <name><surname>Scheel-Kr&#x00FC;ger</surname> <given-names>J.</given-names></name> <name><surname>Belzung</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <article-title>The neurobiology of depression and antidepressant action.</article-title> <source><italic>Neurosci. Biobehav. Rev.</italic></source> <volume>37</volume> <fpage>2331</fpage>&#x2013;<lpage>2371</lpage>. <pub-id pub-id-type="doi">10.1016/j.neubiorev.2012.12.007</pub-id> <pub-id pub-id-type="pmid">23261405</pub-id></citation></ref>
<ref id="B57"><citation citation-type="journal"><collab>World Health Organization [WHO]</collab> (<year>2017</year>). <source><italic>Depression And Other Common Mental Disorders.</italic></source> Available Online at: <ext-link ext-link-type="uri" xlink:href="http://apps.who.int/iris/bitstream/10665/254610/1/WHO-MSD-MER-2017.2-eng.pdf">http://apps.who.int/iris/bitstream/10665/254610/1/WHO-MSD-MER-2017.2-eng.pdf</ext-link></citation></ref>
<ref id="B58"><citation citation-type="journal"><collab>World Health Organization [WHO]</collab> (<year>2018</year>). <source><italic>International Suicide Rates, 2018.</italic></source> Available Online at: <ext-link ext-link-type="uri" xlink:href="http://www.who.int/gho/mental_health/suicide_ratescrude/en/">http://www.who.int/gho/mental_health/suicide_ratescrude/en/</ext-link></citation></ref>
</ref-list>
<glossary>
<title>Abbreviations</title>
<def-list id="DL1">
<def-item><term>EEG</term><def><p>Electroencephalogram</p></def></def-item>
<def-item><term>ECG</term><def><p>Electrocardiogram</p></def></def-item>
<def-item><term>HRV</term><def><p>Heart rate variability</p></def></def-item>
<def-item><term>CVC</term><def><p>Cardio-vagal control</p></def></def-item>
<def-item><term>HFD</term><def><p>Higuchi Fractal Dimension</p></def></def-item>
<def-item><term>DFA</term><def><p>Detrended Fluctuation Analysis</p></def></def-item>
<def-item><term>ROC</term><def><p>Receiver operating characteristic</p></def></def-item>
<def-item><term>AUC</term><def><p>Area under the curve</p></def></def-item>
<def-item><term>PCA</term><def><p>Principal component analysis</p></def></def-item>
<def-item><term>GA</term><def><p>Genetic algorithm</p></def></def-item>
<def-item><term>FDA</term><def><p>Functional data analysis</p></def></def-item>
<def-item><term>LASO</term><def><p>the name of the algorithm, a type of linear regression that uses shrinkage</p></def></def-item>
<def-item><term>ANOVA</term><def><p>Analysis of variance</p></def></def-item>
<def-item><term>SVM</term><def><p>Support vector machines.</p></def></def-item>
</def-list>
</glossary>
</back>
</article>
