<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article article-type="methods-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Physiol.</journal-id>
<journal-title>Frontiers in Physiology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Physiol.</abbrev-journal-title>
<issn pub-type="epub">1664-042X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">859127</article-id>
<article-id pub-id-type="doi">10.3389/fphys.2022.859127</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Physiology</subject>
<subj-group>
<subject>Methods</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Early Warning Signals in Phase Space: Geometric Resilience Loss Indicators From Multiplex Cumulative Recurrence Networks</article-title>
<alt-title alt-title-type="left-running-head">Hasselman</alt-title>
<alt-title alt-title-type="right-running-head">Multivariate Geometric Resilience Loss Indicators</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Hasselman</surname>
<given-names>Fred</given-names>
</name>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/29824/overview"/>
</contrib>
</contrib-group>
<aff>
<institution>Behavioural Science Institute</institution>, <institution>Radboud University</institution>, <addr-line>Nijmegen</addr-line>, <country>Netherlands</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/148439/overview">Francoise Argoul</ext-link>, Centre National de la Recherche Scientifique (CNRS), France</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/75772/overview">Norbert Marwan</ext-link>, Potsdam Institute for Climate Impact Research (PIK), Germany</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/33929/overview">Sebastian Wallot</ext-link>, Leuphana University L&#xfc;neburg, Germany</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Fred Hasselman, <email>fred.hasselman@ru.nl</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Fractal Physiology, a section of the journal Frontiers in Physiology</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>04</day>
<month>05</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>859127</elocation-id>
<history>
<date date-type="received">
<day>20</day>
<month>01</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>22</day>
<month>03</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Hasselman.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Hasselman</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>The detection of Early Warning Signals (EWS) of imminent phase transitions, such as sudden changes in symptom severity could be an important innovation in the treatment or prevention of disease or psychopathology. Recurrence-based analyses are known for their ability to detect differences in behavioral modes and order transitions in extremely noisy data. As a proof of principle, the present paper provides an example of a recurrence network based analysis strategy which can be implemented in a clinical setting in which data from an individual is continuously monitored for the purpose of making decisions about diagnosis and intervention. Specifically, it is demonstrated that measures based on the geometry of the phase space can serve as Early Warning Signals of imminent phase transitions. A publicly available multivariate time series is analyzed using so-called cumulative Recurrence Networks (cRN), which are recurrence networks with edges weighted by recurrence time and directed towards previously observed data points. The results are compared to previous analyses of the same data set, benefits, limitations and future directions of the analysis approach are discussed.</p>
</abstract>
<kwd-group>
<kwd>multiplex recurrence networks</kwd>
<kwd>multivariate time series analysis</kwd>
<kwd>resilience loss indicator</kwd>
<kwd>multidimensional recurrence quantification analysis</kwd>
<kwd>complex adapt system (CAS)</kwd>
<kwd>process monitoring</kwd>
<kwd>transition network</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>The detection of Early Warning Signals (EWS) of imminent transitions in states of the body and mind has been a topic of great interest in the sciences that study health and wellbeing. In a clinical setting, such transitions often concern sudden changes in symptom severity associated with the onset of disease or psychopathology (see e.g., <xref ref-type="bibr" rid="B40">Leemput et al., 2014</xref>; <xref ref-type="bibr" rid="B14">Cramer et al., 2016</xref>; <xref ref-type="bibr" rid="B25">Fartacek et al., 2016</xref>; <xref ref-type="bibr" rid="B82">Wichers et al., 2016</xref>), or, conversely, they might herald onset of recovery due to psychological or medical interventions (see e.g., <xref ref-type="bibr" rid="B38">Kowalik et al., 2010</xref>; <xref ref-type="bibr" rid="B44">Lichtwarck-Aschoff et al., 2012</xref>; <xref ref-type="bibr" rid="B53">Olthof et al., 2019a</xref>, <xref ref-type="bibr" rid="B54">Olthof et al., 2019b</xref>). These transitions are often conceived of as the phase transitions of complex dynamical systems (cf. <xref ref-type="bibr" rid="B52">Olthof et al., 2022</xref>) and the EWS generally refer to well-known critical phenomena observed around the tipping points of thermodynamical, chemical and ecological systems (<xref ref-type="bibr" rid="B66">Scholz et al., 1987</xref>; <xref ref-type="bibr" rid="B60">Scheffer et al., 2009</xref>; <xref ref-type="bibr" rid="B42">Lenton, 2013</xref>).</p>
<p>Most EWS are so-called indicators of a loss of resilience (<xref ref-type="bibr" rid="B61">Scheffer et al., 2018</xref>), that is, a state of the system that is currently stable starts to display characteristic signs of instability such as critical slowing down, or, critical fluctuations. Critical slowing down refers to the increase in return times after perturbation which can be directly observed in perturbation experiments (<xref ref-type="bibr" rid="B66">Scholz et al., 1987</xref>), or, can be inferred from data, for example by evidencing an increase in magnitude of short-range temporal autocorrelations or variance (<xref ref-type="bibr" rid="B40">Leemput et al., 2014</xref>; <xref ref-type="bibr" rid="B81">Weinans et al., 2021</xref>). Critical fluctuations can be evidenced by a change in power law scaling behavior (e.g., <xref ref-type="bibr" rid="B4">Bak et al., 1987</xref>; <xref ref-type="bibr" rid="B72">Stephen et al., 2009</xref>), an increase in fluctuation intensity (e.g., <xref ref-type="bibr" rid="B36">Kelso et al., 1986</xref>; <xref ref-type="bibr" rid="B25">Fartacek et al., 2016</xref>; <xref ref-type="bibr" rid="B54">Olthof et al., 2019b</xref>) or an increase of entropy and related measures (e.g., <xref ref-type="bibr" rid="B72">Stephen et al., 2009</xref>; <xref ref-type="bibr" rid="B44">Lichtwarck-Aschoff et al., 2012</xref>). The ability to detect such periods of destabilization is hypothesized to be informative for the optimal planning of interventions which attempt to facilitate a transition to a more healthy state. There is also a great potential use in the context of prevention, that is, EWS could be used for the timing of activities intended to prevent a maladaptive state to emerge in the first place (e.g., <xref ref-type="bibr" rid="B63">Schiepek et al., 2011</xref>; <xref ref-type="bibr" rid="B64">Schiepek et al., 2016</xref>; <xref ref-type="bibr" rid="B52">Olthof et al., 2022</xref>). It is important to note that EWS like critical fluctuations and critical slowing down are associated with particular types of transitions that involve one or more control parameters of the system to approach a critical value. Not all order transitions can be attributed to changes in control parameters (<xref ref-type="bibr" rid="B11">Burthe et al., 2016</xref>; <xref ref-type="bibr" rid="B29">Guttal et al., 2016</xref>), an apparent transition to a qualitatively different mode of behavior can for example be noise-induced, continuous, or, due to nonlinear dynamics evolving within a specific regime without a change in control parameters (see e.g., <xref ref-type="bibr" rid="B42">Lenton, 2013</xref>). For the purpose of the present paper we will assume the data under scrutiny contain at least one critical transition that is expected to be preceded by EWS.</p>
<sec id="s1-1">
<title>Weak Versus Strong Complexity Assumptions</title>
<p>The multivariate time series data analyzed in the literature on health and wellbeing mostly concern self-reports of human experience collected through the Experience Sampling Method (ESM), or Ecological Momentary Assessment (EMA) in which participants are prompted one or more times per day to answer some questions, which are often self-ratings of psychological or physical states. Another data source concerns the measurements of physiological variables recorded by wearable sensors. Both types of data are known to be non-stationary, contain sudden shifts in level, trend, or variance (<xref ref-type="bibr" rid="B68">Shiffman, 2014</xref>; <xref ref-type="bibr" rid="B51">Nezlek, 2015</xref>; <xref ref-type="bibr" rid="B62">Schiepek et al., 2016</xref>) and contain evidence of long-range temporal correlations and power-law scaling (<xref ref-type="bibr" rid="B18">Deligni&#xe8;res et al., 2004</xref>; <xref ref-type="bibr" rid="B31">Hasselman and Bosman, 2020</xref>; <xref ref-type="bibr" rid="B55">Olthof et al., 2020</xref>).</p>
<p>Many researchers do acknowledge the data generating processes underlying time series appear to violate the ergodic assumptions of stationarity, homogeneity (<xref ref-type="bibr" rid="B50">Molenaar, 2004</xref>) and memorylessness (<xref ref-type="bibr" rid="B59">Ramachandran, 1979</xref>), but will consider these facts to be nuisance factors that should be removed from the data, or handled by (statistical) models as a covariates or random effects (<italic>weak complexity assumption</italic>).</p>
<p>One approach suggested to &#x201c;deal with&#x201d; non-stationarity is to collect data during a short, but very intensive, measurement period, for example, one or 2&#xa0;weeks in which a participant is prompted 10 or more times per day to provide self-reports of activities, emotional, psychological or physiological states (<xref ref-type="bibr" rid="B74">Trull and Ebner-Priemer, 2009</xref>; <xref ref-type="bibr" rid="B71">Smith, 2012</xref>; <xref ref-type="bibr" rid="B43">Liao et al., 2016</xref>). A post-data collection approach is data-segmentation based on the identification of relatively stable or homogeneous epochs in the time series data and fit a model for each stable epoch separately (<xref ref-type="bibr" rid="B3">Bak et al., 2016</xref>; <xref ref-type="bibr" rid="B82">Wichers et al., 2016</xref>). This is of course disrupting potential long range dependencies in the data and introduces a problem for use in practice: The epochs can only be identified and analyzed after the data collection has ended. Less destructive, but still aimed at removing potentially nonlinear phenomena are the practices of detrending, &#x201c;artefact&#x201d; removal and imputation (<xref ref-type="bibr" rid="B1">Adolf and Fried, 2019</xref>; <xref ref-type="bibr" rid="B58">Piccirillo and Rodebaugh, 2019</xref>). On the data analysis side, these phenomena are often modeled as nuisance factors, noise, or, explicitly as model parameters, for example, time varying parameters to deal with nonstationarity like Time Varying Auto Regressive models (TV-AR, <xref ref-type="bibr" rid="B10">Bringmann et al., 2017</xref>), identifying homogeneous subgroups to deal with heterogeneity (GIMME, <xref ref-type="bibr" rid="B6">Beltz and Gates, 2017</xref>; <xref ref-type="bibr" rid="B28">Gates et al., 2014</xref>), or, using fractional integration components to deal with long-range dependence (ARfiMA, <xref ref-type="bibr" rid="B19">Diniz et al., 2011</xref>; <xref ref-type="bibr" rid="B73">Torre and Wagenmakers, 2009</xref>; <xref ref-type="bibr" rid="B33">Hasselman, 2013</xref>). These statistical models generally limit estimating temporal dynamics to the linear domain and very short time scales (e.g., lag-1 vector autoregression <xref ref-type="bibr" rid="B22">Epskamp et al., 2012</xref>). This is also the case for network models estimated from time series, like the Gaussian Graphical Model (GGM, <xref ref-type="bibr" rid="B22">Epskamp et al., 2012</xref>) and the Ising graphical model (<xref ref-type="bibr" rid="B75">Van Borkulo et al., 2014</xref>). Finally, a practice that is commonly observed is the aggregation of time series, which often concerns the simple averaging of different time series to achieve dimension reduction. In general, such naive approaches to the aggregation of time series are not recommended (cf., <xref ref-type="bibr" rid="B57">Petitjean et al., 2011</xref>). As a consequence, the techniques used under the weak complexity assumption greatly reduce the range of potential data generating processes that can be considered to underlie the observed (multivariate) time series.</p>
<p>These examples also reveal that current methods (measurement and data analysis) and models (inference and interpretation) used to detect EWS in time series data of physiological and psychological variables impair their potential for being applicable in a clinical setting. The first, rather obvious point is that clinical practice requires personalized, idiographic methods, that is, EWS should be reliably detectable in data observed in a single individual and ideally make use of the particular facts pertaining to the case (personal history, social-economic context, pre-existing conditions, etc.). This requirement excludes all methods that have been used in studies to evidence EWS based on samples of many individuals (e.g., <xref ref-type="bibr" rid="B40">Leemput et al., 2014</xref>). Second, although methods and models from complexity science are available, many authors focus on developing (linear) statistical models to evidence EWS. Two recent reviews of the personalized approach to psychopathology (<xref ref-type="bibr" rid="B58">Piccirillo and Rodebaugh, 2019</xref>; <xref ref-type="bibr" rid="B86">Wright and Woods, 2020</xref>) fail to discuss, or even mention, the use of complexity methods. As a consequence analyses often have to be conducted post-data collection, which renders the techniques impractical for analyzing and intervening on continuously sampled patient data. Studying which EWS predicted a transition, after the transition has already occurred may be of value to the researcher, but the clinician has to be able to make decisions in the here and now.</p>
<sec id="s1-1-1">
<title>The present study: &#x201c;First Analyze, then Aggregate!&#x201d;</title>
<p>It is the purpose of the present paper to showcase an analytic approach to detecting EWS under a <italic>strong complexity assumption</italic>, that is, analytic techniques will be used that were developed to quantify the dynamics of complex systems, even in the context of nonstationary and nonhomogeneous time series data. Moreover, the explicit goal is to provide an analysis strategy that meets the requirements for potential use as a tool in a clinical setting for the diagnosis and treatment of individuals. The analysis strategy is based on recurrence networks, to which some constraints are added, resulting in a so-called <italic>cumulative Recurrence Network</italic> (cRN). The cRN is constructed from a recurrence matrix based on measurements of the state variables of the system (<xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>; <xref ref-type="bibr" rid="B78">Wallot et al., 2016</xref>) and is a directed, weighted, network (<xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>) in which the nodes represent time points, the edges connect recurring values and the weights represent the distance (in time) between two recurring values. The direction of the edges is always towards previously observed time points (out-degree only). This mimics the situation in which only data up to the most recently observed point in time is available to decide on the presence of EWS. In order to show we can dispense with unnecessary aggregation or dimension reduction of multivariate time series data, cRN representing the phase spaces of different subsystems will be constructed into a Multiplex Recurrence Network (<xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>).</p>
<p>To demonstrate the potential of Multiplex cumulative Recurrence Network analysis for multivariate time series data, a publicly available data set was analyzed (the data were published as: <xref ref-type="bibr" rid="B37">Kossakowski et al., 2017</xref>). The data were acquired in the context of a double-blind N &#x3d; 1 experiment in which the antidepressant medication of a participant diagnosed with Major Depressive Disorder (MDD) was gradually reduced (<xref ref-type="bibr" rid="B82">Wichers et al., 2016</xref>). The participant generated 1,478 questionnaire responses (on average 43.4 per day) over a period of 239 consecutive days. The purpose of the original paper was to detect <italic>critical slowing down</italic> as an EWS for the critical transition that occurred. The transition concerned going from a non-depressed state to a depressed state, likely due to the reduction of antidepressant medication. <xref ref-type="fig" rid="F1">Figure 1</xref> panel A, displays the mean of weekly measurements of the SCL-90-R depression scale, which will be interpreted as the global state variable in which the transition is observable. During the time of the critical transition, data collection was partly stopped, so the apparent drop in symptom severity in fact reflects a period in which the global state variable was not observed. The daily measurements will be analyzed for the presence of EWS. It is assumed the multivariate data at least approximately capture the internal state dynamics of several different subsystems of the entire phase space that represents the micro-scale configurations from which the macroscopic, system-wide depressive state emerges.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Panel <bold>(A)</bold> shows the state variable (SCL-90-R). Panel <bold>(B)</bold> is an example of the subset of Mood time series.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g001.tif"/>
</fig>
<p>First, a brief overview of recurrence analysis and recurrence networks is provided, second, the concept of the (multiplex) cRN is introduced as a tool for analyzing multivariate time-series data obtained through the real-time monitoring of an individual. Finally the technique is applied to the data and compared to the original analyses by <xref ref-type="bibr" rid="B82">Wichers et al. (2016)</xref>.</p>
</sec>
</sec>
</sec>
<sec id="s2">
<title>Time Series Analyses Based on Recurrences in Phase Space</title>
<p>Recurrence Quantification Analysis and its derivatives (<xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>; <xref ref-type="bibr" rid="B13">Cox et al., 2016</xref>) are not new to the behavioral and life sciences and have been successfully applied to study the temporal dynamics underlying human physiology (<xref ref-type="bibr" rid="B65">Schinkel et al., 2009</xref>; <xref ref-type="bibr" rid="B17">De Graag et al., 2012</xref>), motor coordination (<xref ref-type="bibr" rid="B70">Shockley et al., 2003</xref>; <xref ref-type="bibr" rid="B2">A&#xdf;mann et al., 2007</xref>; <xref ref-type="bibr" rid="B84">Wijnants et al., 2011</xref>), perception (<xref ref-type="bibr" rid="B30">Hasselman, 2015</xref>), language (<xref ref-type="bibr" rid="B85">Wijnants et al., 2012</xref>; <xref ref-type="bibr" rid="B77">Wallot et al., 2013</xref>), cognitive performance (<xref ref-type="bibr" rid="B72">Stephen et al., 2009</xref>; <xref ref-type="bibr" rid="B56">Oomens et al., 2015</xref>) and dyadic interaction (<xref ref-type="bibr" rid="B16">Dale and Spivey, 2006</xref>; <xref ref-type="bibr" rid="B47">Louwerse et al., 2012</xref>). A large number of studies use RQA to quantify dynamics of physiological or performance measurements in different populations, for example comparing literacy skills in average and dyslexic readers (<xref ref-type="bibr" rid="B85">Wijnants et al., 2012</xref>; <xref ref-type="bibr" rid="B30">Hasselman, 2015</xref>), or searching for biomarkers of Asperger&#x2019;s syndrome, schizophrenia, ASD (<xref ref-type="bibr" rid="B26">Fusaroli et al., 2013</xref>, <xref ref-type="bibr" rid="B27">2016</xref>), absence epilepsy (<xref ref-type="bibr" rid="B9">Bosl et al., 2017</xref>) and speech pathology (<xref ref-type="bibr" rid="B46">Little et al., 2007</xref>).</p>
<p>Recurrence analytic approaches to time series analysis are essentially model-free (descriptive) and make only a few assumptions about the data related the observation of dynamics/variance (<xref ref-type="bibr" rid="B7">Bianciardi et al., 2007</xref>). Moreover they allow for:<list list-type="simple">
<list-item>
<p>&#x2022; The description of linear as well as nonlinear dynamical phenomena (<xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>).</p>
</list-item>
<list-item>
<p>&#x2022; The description of (transitions between) dynamical regimes, even in exceptionally noisy environments (<xref ref-type="bibr" rid="B87">Zbilut et al., 1998</xref>).</p>
</list-item>
<list-item>
<p>&#x2022; The quantification of recurrent dynamics across all available time scales (<xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>; <xref ref-type="bibr" rid="B21">Donner et al., 2011</xref>).</p>
</list-item>
<list-item>
<p>&#x2022; The quantification of attractor geometry across all available time scales (<xref ref-type="bibr" rid="B88">Zou et al., 2012</xref>).</p>
</list-item>
<list-item>
<p>&#x2022; The quantification of structural similarities between different time series represented as Multiplex Recurrence Networks (<xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>), suspending the need for potentially problematic aggregation and/or dimension reduction of multivariate time series data.</p>
</list-item>
</list>
</p>
<p>It is not the case that results from recurrence-based analyses are immune, or &#x201c;robust&#x201d; to nonstationarity and nonhomogeneity, rather, it is the case that these methods can be understood as descriptive of such dynamics. The goal is not to infer a true model, process or estimate a population model parameter, but to characterize the dynamics displayed during the observation time, either as observed, or, after a reconstruction of the phase space.</p>
<sec id="s2-1">
<title>Recurrence Quantification Analysis</title>
<p>Recurrence analyses are based on a recurrence matrix which represents the states of the system that are re-visited at least once during the time the system was observed. If a sequence of states is recurring, this is referred to as a trajectory in phase space, a relatively stable state, or, orbit of the system. In this paper the observed variables in a multivariate time series are considered to be measurements of the state variables of the system (cf. <xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>; <xref ref-type="bibr" rid="B78">Wallot et al., 2016</xref>).</p>
<p>An observed time series can be interpreted as a finite representation of the trajectory or state-evolution of a stochastic or deterministic dynamic system: <inline-formula id="inf1">
<mml:math id="m1">
<mml:msubsup>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>y</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:math>
</inline-formula>, with <italic>y</italic>
<sub>
<italic>i</italic>
</sub> &#x3d; <italic>y</italic> (<italic>t</italic>
<sub>
<italic>i</italic>
</sub>) (cf. <xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>). The open data set analysed in the present paper is a multivariate time series of at least 70 variables observed in a single participant over the period of 239 days. The variables can be conceptually grouped into six subsystems (<italic>Mood</italic>, <italic>Physical</italic>, <italic>Self Esteem</italic>, <italic>Mental Unrest</italic>, <italic>Sleep</italic> and <italic>Day</italic>). Each time series is considered a state vector <inline-formula id="inf2">
<mml:math id="m2">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>y</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
</mml:math>
</inline-formula> of the <italic>m</italic>-dimensional phase space of the (sub)system. For example, the Mood subsystem consists of 12 time series representing a 12-dimensional state space. The 12 values that were simultaneously observed at each time point represent a specific Mood-state, which can be regarded as a 12-tuple coordinate in the 12 dimensional space. As the observed values change over time, they trace a trajectory through this space representing the mood dynamics of the participant. By evaluating the observed values as coordinates it is possible to quantify whether the system (approximately) returns to the same regions and revisits previously traversed trajectories. In the current context this would refer to recurring emotional states.</p>
<p>The recurrence matrix <bold>R</bold>
<sub>
<italic>i</italic>,<italic>j</italic>
</sub> is defined as:<disp-formula id="e1">
<mml:math id="m3">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">R</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mi mathvariant="normal">&#x398;</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mo stretchy="false">&#x2016;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>y</mml:mi>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>y</mml:mi>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">&#x2016;</mml:mo>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
<mml:mspace width="0.3333em"/>
<mml:mspace width="0.3333em"/>
<mml:mspace width="0.3333em"/>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mspace width="0.3333em"/>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:math>
<label>(1)</label>
</disp-formula>where &#x2016; &#x22c5; &#x2016; is a distance norm (e.g., Euclidean, Chebyshev, Manhattan) calculated for each coordinate relative to every other coordinate, <italic>&#x25b;</italic> is a threshold value for the distances between coordinates, and &#x398; is the Heaviside function, which returns one if a distance value falls below <italic>&#x25b;</italic> and 0 otherwise. The threshold value <italic>&#x25b;</italic> directly determines how many recurring values appear in the matrix, which is called the Recurrence Rate (proportion of recurrent points in <bold>R</bold>
<sub>
<italic>i</italic>,<italic>j</italic>
</sub>). <xref ref-type="fig" rid="F2">Figure 2</xref> represents the distance matrix of all observed coordinates in the 12-dimensional Mood phase space. The color-bar displays distance values on the right side, which, should they be chosen as the threshold value <italic>&#x25b;</italic>, would result in the Recurrence Rate displayed on the left.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Distance matrix based on 12 time series (displayed as grey lines) representing self-reports of the mood of an individual.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g002.tif"/>
</fig>
<p>Many other measures can be calculated from the matrix, such as the proportion of recurrent points that form line structures which represent larger patterns of recurring values (<xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>; <xref ref-type="bibr" rid="B21">Donner et al., 2011</xref>).</p>
</sec>
<sec id="s2-2">
<title>Recurrence Networks</title>
<p>To create a recurrence network, we consider the recurrence matrix <bold>R</bold>(<italic>&#x25b;</italic>) to be an adjacency matrix <bold>A</bold>(<italic>&#x25b;</italic>) of an adjoint complex network. By removing the diagonal this matrix represents an unweighted, undirected, simple graph called an <italic>&#x25b;</italic>-Recurrence Network (<xref ref-type="bibr" rid="B48">Marwan et al., 2007</xref>; <xref ref-type="bibr" rid="B21">Donner et al., 2011</xref>). The vertices <italic>V</italic>
<sub>
<italic>i</italic>
</sub> of the network represent the state coordinates and are indexed by their time order. The edges indicate whether the state observed at one point in time will recur at another point in time and this is of course conditional on the threshold <italic>&#x25b;</italic>. It is also possible to create a weighted network, either by keeping the distances that are smaller than <italic>&#x25b;</italic>, or, by creating edge weights that are based on the time between recurring states, the <italic>recurrence time</italic>, or <italic>recurrence time frequency</italic>. (<xref ref-type="bibr" rid="B31">Hasselman and Bosman, 2020</xref>). <xref ref-type="fig" rid="F3">Figure 3</xref> displays the <italic>&#x25b;</italic>-RN based on the distance matrix shown in <xref ref-type="fig" rid="F2">Figure 2</xref> with a threshold of <italic>&#x25b;</italic> of 0.889 yielding a Recurrence Rate of 0.05. The RN is presented in a so-called spiral layout, which preserves the time order of the vertices (see <xref ref-type="bibr" rid="B31">Hasselman and Bosman, 2020</xref>).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>A Recurrence Network in spiral layout based on the distance matrix of 12 time series representing self-reports of the mood of an individual recorded over a period of 238&#xa0;days.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g003.tif"/>
</fig>
<p>Recurrence networks are formally equivalent to Random Geometric Graphs (RGG), a full analytic theory of <italic>&#x25b;</italic>-RN&#x2019;s is provided by <xref ref-type="bibr" rid="B89">Zou et al. (2019)</xref>. For the purpose of the present paper it is important to understand the differences between the information obtained about the phase space trajectory based on RQA measures and the complex network measures extracted from the <italic>&#x25b;</italic>-RN. The line structures analyzed in RQA represent the evolution of state coordinates, so those measures quantify dynamic properties of the trajectory in phase space. Most network measures extracted from a <italic>&#x25b;</italic>-RN will quantify topological or geometric properties of the attractor (<xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>), when used as in the context of EWS, they can be referred to as geometric resilience loss indicators. In a <italic>&#x25b;</italic>-RN local and global measures can be identified for roughly two types of measure: Path- and Neighborhood-based measures. For the present study, we focus on Neighborhood-based measures.</p>
<p>In what follows a description of unweighted, undirected local and global characteristics of the vertices in a Recurrence Network is provided. This description is not exhaustive, but covers the most important vertex characteristics for the present context (descriptions and formula&#x2019;s presented here were adapted from various sources, most can be found in <xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>).</p>
</sec>
<sec id="s2-3">
<title>Local Complexity Measures</title>
<p>Graph-neighborhood measures calculated from a <italic>&#x25b;</italic>-RN capture information about the local density or space filling behavior of the phase space trajectory. This has led to the novel measures such as the notion of a transitivity dimensions and local clustering dimensions (<xref ref-type="bibr" rid="B20">Donges et al., 2012</xref>; <xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>), which evaluate the dependence of these measures on the threshold value <italic>&#x25b;</italic>. In the present context more familiar network measures will be presented, starting with the <italic>degree centrality</italic> of a vertex <inline-formula id="inf3">
<mml:math id="m4">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>:<disp-formula id="e2">
<mml:math id="m5">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:munderover accentunder="false" accent="false">
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mspace width="0.3333em"/>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
<mml:msub>
<mml:mrow>
<mml:mi>A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
</mml:math>
<label>(2)</label>
</disp-formula>
</p>
<p>Where <italic>A</italic>
<sub>
<italic>ij</italic>
</sub>(<italic>&#x25b;</italic>) is the Adjacency matrix. In <italic>&#x25b;</italic>-RNs the local degree is normalized to the time series length, rather than to a theoretical maximum, and the <italic>degree density</italic> is calculated as:<disp-formula id="e3">
<mml:math id="m6">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfrac>
</mml:math>
<label>(3)</label>
</disp-formula>
</p>
<p>The degree density of a vertex <italic>V</italic>
<sub>
<italic>i</italic>
</sub> indicates the probability that a randomly chosen state represented by <italic>V</italic>
<sub>
<italic>j</italic>
</sub> is <italic>&#x25b;</italic>-close to the state represented by <italic>V</italic>
<sub>
<italic>i</italic>
</sub>. It can be interpreted as a localized recurrence rate.</p>
<p>Another value is the <italic>local clustering coefficient</italic> <inline-formula id="inf4">
<mml:math id="m7">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">C</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, which measures the fraction of pairs of vertices around <italic>V</italic>
<sub>
<italic>i</italic>
</sub> that are <italic>&#x25b;</italic>-close:<disp-formula id="e4">
<mml:math id="m8">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">C</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:munderover accentunder="false" accent="false">
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mspace width="0.3333em"/>
<mml:mi>h</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
<mml:msub>
<mml:mrow>
<mml:mi>A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mi>A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>h</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mi>A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mi>h</mml:mi>
</mml:mrow>
</mml:msub>
</mml:math>
<label>(4)</label>
</disp-formula>
</p>
<p>This measure quantifies the geometric alignment of the state vectors <inline-formula id="inf5">
<mml:math id="m9">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>y</mml:mi>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
</mml:math>
</inline-formula>, which occurs for example close to dynamic invariant structures in phase space like quasi-periodic behavior or unstable periodic orbits (UPOs, <xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>).</p>
<p>The degree density and clustering coefficient quantify vertex properties at a local scale, a neighborhood, whereas measures based on shortest paths quantify vertex connectivity relative to the scale of the network as a whole. The <italic>closeness centrality</italic> measure <inline-formula id="inf6">
<mml:math id="m10">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>c</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is defined as the inverse of the arithmetic mean of shortest path lengths <italic>l</italic>
<sub>
<italic>ij</italic>
</sub>:<disp-formula id="e5">
<mml:math id="m11">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>c</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:munderover accentunder="false" accent="false">
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
<mml:msub>
<mml:mrow>
<mml:mi>l</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msup>
</mml:math>
<label>(5)</label>
</disp-formula>
</p>
<p>The <italic>local efficiency</italic> is the inverse geometric mean of <italic>l</italic>
<sub>
<italic>ij</italic>
</sub>:<disp-formula id="e6">
<mml:math id="m12">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:munderover accentunder="false" accent="false">
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
<mml:msubsup>
<mml:mrow>
<mml:mi>l</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
</mml:math>
<label>(6)</label>
</disp-formula>
</p>
<p>In the path length calculation &#x2018;disconnected&#x2019; vertices are assigned a local average path length of <italic>N</italic> &#x2212; 1. This occurs quite often in <italic>&#x25b;</italic>-RN, a state occurring at <italic>V</italic>
<sub>
<italic>i</italic>
</sub> does not recur at every other vertex by construction of the matrix <bold>R</bold>(<italic>&#x25b;</italic>). It is known that the efficiency measure <inline-formula id="inf7">
<mml:math id="m13">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is well-behaved, even if the graph has many disconnected components (cf. <xref ref-type="bibr" rid="B8">Boccaletti et al., 2006</xref>)</p>
</sec>
<sec id="s2-4">
<title>Global Complexity Measures</title>
<p>
<xref ref-type="table" rid="T1">Table 1</xref> displays some of the global measures commonly used to describe the structure of complex networks. The <italic>edge density</italic> <inline-formula id="inf8">
<mml:math id="m14">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is simply the average of the local degree density. The <italic>global clustering coefficient</italic> <inline-formula id="inf9">
<mml:math id="m15">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">C</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is the arithmetic mean of the local clustering coefficients (cf. <xref ref-type="bibr" rid="B79">Watts and Strogatz, 1998</xref>). An alternative definition exists called <italic>network transitivity</italic> <inline-formula id="inf10">
<mml:math id="m16">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, which represents the effective global dimensionality of the system (<xref ref-type="bibr" rid="B5">Barrat and Weigt, 2000</xref>) as opposed to the average local dimensionality in phase space quantified by <inline-formula id="inf11">
<mml:math id="m17">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">C</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. The <italic>average path length</italic> <inline-formula id="inf12">
<mml:math id="m18">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">L</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> and <italic>global efficiency</italic> <inline-formula id="inf13">
<mml:math id="m19">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">E</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> are the arithmetic mean of the inverse local closeness, and the inverse arithmetic mean of the local efficiency, respectively (see <xref ref-type="bibr" rid="B89">Zou et al., 2019</xref> for details). The <italic>edge density</italic> is equal to the <italic>Recurrence Rate</italic> in RQA.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Global recurrence network measures.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">Mood</th>
<th align="center">Physical</th>
<th align="center">Self Esteem</th>
<th align="center">Mental Unrest</th>
<th align="center">Sleep</th>
<th align="center">Day</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Recurrence Threshold <italic>&#x25b;</italic>
</td>
<td align="center">0.889</td>
<td align="center">0.389</td>
<td align="center">0.283</td>
<td align="center">0.443</td>
<td align="center">1.237</td>
<td align="center">1.331</td>
</tr>
<tr>
<td align="left">Edge Density <inline-formula id="inf14">
<mml:math id="m20">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</td>
<td align="center">1.662</td>
<td align="center">1.791</td>
<td align="center">2.323</td>
<td align="center">1.753</td>
<td align="center">2.052</td>
<td align="center">6.524</td>
</tr>
<tr>
<td align="left">Global Clustering <inline-formula id="inf15">
<mml:math id="m21">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">C</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</td>
<td align="center">0.17</td>
<td align="center">0.18</td>
<td align="center">0.22</td>
<td align="center">0.19</td>
<td align="center">0.17</td>
<td align="center">0.27</td>
</tr>
<tr>
<td align="left">Network Transitivity <inline-formula id="inf16">
<mml:math id="m22">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</td>
<td align="center">0.49</td>
<td align="center">0.48</td>
<td align="center">0.58</td>
<td align="center">0.55</td>
<td align="center">0.49</td>
<td align="center">0.63</td>
</tr>
<tr>
<td align="left">Average Path Length <inline-formula id="inf17">
<mml:math id="m23">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">L</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</td>
<td align="center">74.2</td>
<td align="center">60.6</td>
<td align="center">42.1</td>
<td align="center">61.0</td>
<td align="center">103.5</td>
<td align="center">11.0</td>
</tr>
<tr>
<td align="left">Global Efficiency <inline-formula id="inf18">
<mml:math id="m24">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="script">E</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</td>
<td align="center">245.857</td>
<td align="center">752.248</td>
<td align="center">484.290</td>
<td align="center">353.830</td>
<td align="center">1,577.394</td>
<td align="center">92.836</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2-5">
<title>Cumulative Recurrence Networks for Real-Time Process Monitoring</title>
<p>In order to fulfill the goal of serving as a potential tool for assessing an imminent regime change in a clinical, real-time monitoring setting, we should not use any information about states that recur at some point in the future, because these are of course only known ex post facto. It is possible to use windowed analyses on the time series and construct a recurrence matrix based on a right aligned window and compute RQA or <italic>&#x25b;</italic>-RN measures within each of the sliding windows. The minimal window size is of course limited by the time series length, but also cannot be too small. To achieve the same goal, it is also possible to create a directed (weighted) network with recurrent points based on an adjacency matrix with the upper triangle set to zero. The structure of the network is evaluated based on measures that only consider the vertex out-degree. Such a network represents vertex properties that are cumulative with respect to the number of edges that represent whether the current vertex is a recurring state of the past, a cumulative Recurrence Network (cRN). <xref ref-type="fig" rid="F4">Figure 4</xref> displays the first 50 vertices of a directed, weighted network, with edges connecting only to vertices of a lower time index.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>The first 50 vertices of a weighted, directed cumulative Recurrence Network (cRN) based on the lower triangle of the recurrence matrix of the Mood subsystem.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g004.tif"/>
</fig>
</sec>
<sec id="s2-6">
<title>Multiplex (Cumulative) Recurrence Networks</title>
<p>Multiplex recurrence networks provide a framework for studying the temporal structure in multivariate records of the observables of a complex dynamical system. Multiplex networks have recently been constructed from horizontal visibility graphs (HVG, <xref ref-type="bibr" rid="B39">Lacasa et al., 2015</xref>) and recurrence networks (<xref ref-type="bibr" rid="B23">Eroglu et al., 2018</xref>). To obtain a <italic>Multiplex Recurrence Network</italic> (MRN), the <italic>M</italic> time series of length <italic>n</italic> in the multivariate data set are turned into <italic>M</italic> recurrence networks, each with <italic>n</italic> nodes, to constitute the <italic>&#x3ba;</italic> &#x3d; <italic>M</italic> layers of he MRN. In the present example the MRN is built from six weighted, directed recurrence networks, that represent cumulative time by only considering the vertex out-degree when computing vertex properties, see <xref ref-type="fig" rid="F5">Figure 5</xref>
</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>The Multiplex network with each cRN as a layer. The edge weights and color represent the magnitude Inter-layer Mutual Information.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g005.tif"/>
</fig>
</sec>
<sec id="s2-7">
<title>Multiplex Recurrence Network Measures</title>
<p>The purpose of constructing a multi-layer network is to evaluate the structural similarities between the dimensions of the multivariate time series that constitute the layers. Formally, based on the <italic>M</italic>-dimensional time series <inline-formula id="inf19">
<mml:math id="m25">
<mml:msubsup>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>X</mml:mi>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:math>
</inline-formula> with <inline-formula id="inf20">
<mml:math id="m26">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>X</mml:mi>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfenced open="" close=")">
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:msubsup>
<mml:mrow>
<mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mo>,</mml:mo>
<mml:msubsup>
<mml:mrow>
<mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msubsup>
<mml:mrow>
<mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>M</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>, RNs can be constructed for each of the <italic>&#x3b1;</italic> components of <inline-formula id="inf21">
<mml:math id="m27">
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi>X</mml:mi>
</mml:mrow>
<mml:mo>&#x20d7;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:math>
</inline-formula> (cf. <xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>). The multiplex network can be represented as a giant <italic>NM</italic> &#xd7; <italic>NM</italic> matrix <inline-formula id="inf22">
<mml:math id="m28">
<mml:mi mathvariant="script">A</mml:mi>
</mml:math>
</inline-formula>, with a diagonal of <italic>M</italic> adjacency matrices <italic>A</italic>
<sup>[<italic>&#x3b1;</italic>]</sup> and off-diagonal identity matrices <italic>I</italic>
<sub>
<italic>N</italic>
</sub> of size <italic>N</italic> &#xd7; <italic>N</italic>:<disp-formula id="e7">
<mml:math id="m29">
<mml:mi mathvariant="script">A</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mtable class="matrix">
<mml:mtr>
<mml:mtd columnalign="center">
<mml:msup>
<mml:mrow>
<mml:mi mathvariant="bold">A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:mo>&#x2026;</mml:mo>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd columnalign="center">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:msup>
<mml:mrow>
<mml:mi mathvariant="bold">A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:mo>&#x22f1;</mml:mo>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:mo>&#x22ee;</mml:mo>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd columnalign="center">
<mml:mo>&#x22ee;</mml:mo>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:mo>&#x22f1;</mml:mo>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:mo>&#x22f1;</mml:mo>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd columnalign="center">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:mo>&#x2026;</mml:mo>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
<mml:mtd columnalign="center">
<mml:msup>
<mml:mrow>
<mml:mi mathvariant="bold">A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>M</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mfenced>
</mml:math>
<label>(7)</label>
</disp-formula>
</p>
<p>In practice, the giant matrix is not constructed, rather, a projection of <inline-formula id="inf23">
<mml:math id="m30">
<mml:mi mathvariant="script">A</mml:mi>
</mml:math>
</inline-formula> as a weighted matrix with the RN as vertices connected by edges. The association between layers <italic>&#x3b1;</italic> and <italic>&#x3b2;</italic>, (<italic>I</italic>
<sub>
<italic>&#x3b1;</italic>,<italic>&#x3b2;</italic>
</sub>) in the MRN can be quantified by some measure of association, for example, the <italic>Inter-layer Mutual Information</italic>, <italic>Inter-layer Correlation</italic>, which are based on the degree distributions <inline-formula id="inf24">
<mml:math id="m31">
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> (<xref ref-type="bibr" rid="B39">Lacasa et al., 2015</xref>; <xref ref-type="bibr" rid="B23">Eroglu et al., 2018</xref>). The mutual information is calculated as:<disp-formula id="e8">
<mml:math id="m32">
<mml:msub>
<mml:mrow>
<mml:mi>I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:munder>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:munder>
<mml:munder>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:munder>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
<mml:mi>log</mml:mi>
<mml:mfrac>
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
</mml:math>
<label>(8)</label>
</disp-formula>
</p>
<p>The term <inline-formula id="inf25">
<mml:math id="m33">
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> denotes the joint probability of observing the same node with degree <italic>&#x3ba;</italic>
<sup>[<italic>&#x3b1;</italic>]</sup> in layer <italic>&#x3b1;</italic> and degree <italic>&#x3ba;</italic>
<sup>[<italic>&#x3b2;</italic>]</sup> in layer <italic>&#x3b2;</italic>. <inline-formula id="inf26">
<mml:math id="m34">
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> and <inline-formula id="inf27">
<mml:math id="m35">
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> represent the marginal probabilities of observing the degree distribution in each layer. Taking <italic>I</italic>
<sub>
<italic>&#x3b1;</italic>,<italic>&#x3b2;</italic>
</sub> as the weight between two layers in a multiplex network can be interpreted as the quantification of structural regularities between the time series in the multivariate data set. Instead of the mutual information, one can simply calculate the Pearson correlation between the degree vectors <italic>R</italic>
<sub>
<italic>&#x3b1;</italic>,<italic>&#x3b2;</italic>
</sub>. The averaged mutual information <inline-formula id="inf28">
<mml:math id="m36">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> or correlation <inline-formula id="inf29">
<mml:math id="m37">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>R</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> across all layers in a multiplex network can be interpreted as a quantification of typical information flow between the dimensions of the multivariate system (<xref ref-type="bibr" rid="B39">Lacasa et al., 2015</xref>; <xref ref-type="bibr" rid="B23">Eroglu et al., 2018</xref>). In the present application, the <italic>I</italic>
<sub>
<italic>&#x3b1;</italic>,<italic>&#x3b2;</italic>
</sub> between individual layers indicates the characteristic way in which self-reports of internal states are structurally associated across all observed timescales in the multivariate dataset. If the layers of the MRN are weighted RN (denoted as MwRN, or McRN), the Multi-layer MI and correlation are based on the strength distributions in each layer and can be constructed as the association between <inline-formula id="inf30">
<mml:math id="m38">
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> and <inline-formula id="inf31">
<mml:math id="m39">
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">[</mml:mo>
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula> (cf. <xref ref-type="bibr" rid="B31">Hasselman and Bosman, 2020</xref>):<disp-formula id="e9">
<mml:math id="m40">
<mml:msub>
<mml:mrow>
<mml:mi>I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:munder>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:munder>
<mml:munder>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:munder>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
<mml:mi>log</mml:mi>
<mml:mfrac>
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
<mml:mo>,</mml:mo>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
<mml:mo>,</mml:mo>
<mml:mi>P</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>s</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>&#x3ba;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
</mml:math>
<label>(9)</label>
</disp-formula>
</p>
<p>Another measure that can be used to represent the weights in the MRN is the <italic>Edge Overlap</italic> <italic>&#x3c9;</italic>. It represents the proportion of edges that are shared between any two vertices across all layer-pairs in the multiplex network (<xref ref-type="bibr" rid="B23">Eroglu et al., 2018</xref>):<disp-formula id="e10">
<mml:math id="m41">
<mml:mi>&#x3c9;</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x3e;</mml:mo>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msubsup>
<mml:mrow>
<mml:mi>A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
<mml:mrow>
<mml:mi>M</mml:mi>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x3e;</mml:mo>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>&#x3b4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>0</mml:mn>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msubsup>
<mml:mrow>
<mml:mi>A</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="[" close="]">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>,</mml:mo>
</mml:math>
<label>(10)</label>
</disp-formula>
</p>
<p>Where <italic>&#x3b4;</italic>
<sub>
<italic>ij</italic>
</sub> is the Kronecker delta. The edge overlap measure estimates similarity and coherence between network layers and its average <inline-formula id="inf32">
<mml:math id="m42">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:mi>&#x3c9;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>, is a global network measure of coherence between the different layers which, together with the averaged Inter-layer MI, can be used to detect transitions between dynamic regimes in the multivariate time series (see e.g., <xref ref-type="bibr" rid="B23">Eroglu et al., 2018</xref>).</p>
<p>Once the MRN is constructed, it is possible to calculate any of the aforementioned network measures. The local measures now provide information about the properties of the layer relative to the other layers in the MRN. In order to get a time course of these layer association measures a windowed analysis can be conducted on the MRN.</p>
<p>The MRN allows for the study of structural similarities between the network layers. In the present context this refers to subsets of the different ESM variables in the multivariate data set, which were considered the dimensions of a subsystem phase space. The MRN structure is expected to change near tipping points due to the reconfiguration of the available degrees of freedom in phase space and the creation of new associations between different dimensions of the phase space. Note that all the time series are in principle still accessible, that is, there was no aggregation of observations. For the MRN, it is possible to evaluate which layers might be responsible for structural changes, but it is also possible to evaluate the role of individual variables within the RN by evaluating the contribution of each dimension to the recurring phases of the system (see <xref ref-type="bibr" rid="B34">Heino et al., 2021</xref> for an example).</p>
</sec>
<sec id="s2-8">
<title>Analysis Strategy</title>
<p>
<xref ref-type="bibr" rid="B14">Cramer et al. (2016)</xref> used a window of 30 days to calculate the autocorrelation function and variance as an EWS, which were both expected to increase around the critical transition. The windowed function was calculated from a detrended, overall mental state variable, which the authors describe as &#x201c;the total mental state score based on a moving window over time&#x201d;. For data analysis the authors present a Gaussian Graphical Model (GGM) fitted to different epochs in the experiment, prior to the transition. The GGM consisted of five nodes, three of which represented different aspects of the mental state variable consisting of sets of time series selected from the multivariate data set. The time series were detrended and aggregated to yield a mean series representing: <italic>positive affect</italic> (&#x201c;content&#x201d;, &#x201c;cheerful&#x201d;, &#x201c;enthusiastic&#x201d;); <italic>mental unrest</italic> (&#x201c;restless&#x201d;, &#x201c;agitated&#x201d;, &#x201c;indecisive&#x201d;); <italic>negative affect</italic> (&#x2018;irritated&#x201d;, &#x201c;lonely&#x201d;, &#x201c;anxious&#x201d;, &#x201c;guilty&#x201d;). The other two nodes consisted of a single observed time series <italic>worry</italic> and <italic>suspicious</italic>. It is likely the authors chose these specific variables from the set of about 70 available variables based on theoretical and practical considerations, but they do not explain why and how the time series were aggregated and subsequently analyzed in a moving window. Time series aggregation should be done with care, especially if the series are correlated (<xref ref-type="bibr" rid="B83">Wigley et al., 1984</xref>) or otherwise temporally aligned (<xref ref-type="bibr" rid="B57">Petitjean et al., 2011</xref>).</p>
<p>Irrespective of the validity of time series aggregation, or the specifics of the method used, the effect of time series aggregation is data reduction, and data smoothing. The use of moving windows is warranted because the aim is to detect changes in the correlational structure and variance of the time series, however, sliding window statistics will introduce smoothing in addition to the averaging of the time series. Finally, detrending is a basic method for dealing with non-stationary time series, but it does not guarantee a stationary series if there are multiple stable levels, nonlinear trends, discontinuous changes or heterogeneity of variance. Such phenomena will almost certainly occur in ESM data due to the bounded nature of self-ratings on a an ordinal scale combined with the long observation time: The projection function of the internal state onto the ordinal scale will likely not be constant over 200 &#x2b; days. <xref ref-type="bibr" rid="B55">Olthof et al. (2020)</xref> also analyzed the <xref ref-type="bibr" rid="B14">Cramer et al. (2016)</xref> data set and indeed found evidence for long-range dependence, non-stationarity of the autocorrelation function and divergence (nonlinear prediction error) in many of the time series in the data set.</p>
<p>The first analysis will try establish whether the major transition in the state variable can indeed be considered a critical transition. To do so, the data-segmentation approach from the original paper will be followed, by creating McRN for each of the phases of the experiment. The difference being that the McRN will include all relevant variables This method does not meet the goals set in the introduction, as it can only be performed after the entire series has been observed. It does provide an opportunity to compare the two methods. The second analysis will concern a windowed analysis of the time evolution of the different measures that quantify structural similarities between the layers of the multiplex network and evaluate whether they could serve as Geometric Resilience Loss Indicators.</p>
</sec>
<sec id="s2-9">
<title>Data Preparation</title>
<p>The original data set contains over 80 variables, several of which concern date and time information, or, concerned answers to questions that were only triggered in certain contexts. There were 42 variables containing densely sampled self-ratings, for the analyses in this paper 32 variables were used. Selection of variables was based on a support criterion: Only variables with less than 5% missing values were considered and in addition, the differenced series had to contain less than 33% zeroes (indicative of sufficient dynamics) to be included in the analysis. An exception was made for a set of variables that contained more than 5% missing due to the fact they were prompted only in the morning (about the quality of sleep the previous night) and in the evening (about the experience of the day). These variables were included because of their theoretical relevance (e.g., their potential dual role as symptom and cause (cf. <xref ref-type="bibr" rid="B14">Cramer et al., 2016</xref>)) and because the aggregation level was at the level of a day which is what the questions assessed (e.g., &#x201c;I found this a nice day&#x201d; rated in the evening). The 32 variables were grouped into subsets that can conceptually be considered to be subsystems: <italic>Mood</italic>, <italic>Physical</italic>, <italic>Self Esteem</italic>, <italic>Mental Unrest</italic>, <italic>Sleep</italic> and <italic>Today</italic>. Because some of the variables of interest were observed several times each day, while others only less frequently or only once per day each variable was aggregated so the sampling frequency was 1/day. The rating scales that were used could also vary between variables, therefore, all variables were rescaled to a range of one&#x2013;7. Some variables were also recoded, for example, the questions asking to rate the experience of a positive mood (e.g., &#x201c;I feel strong&#x201d;) were reversed such that higher ratings represent a less positive mood. Any missing values were imputed using multivariate imputation by chained equations based on each subset of variables (using R package <italic>mice</italic>, <xref ref-type="bibr" rid="B12">Buuren and Groothuis-Oudshoorn, 2011</xref>). <xref ref-type="table" rid="T2">Table 2</xref> lists which variables were grouped with each subset.</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Variables used to construct Recurrence Networks.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Subset</th>
<th align="center">Variable name</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Mood</td>
<td align="left">mood_relaxed<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>, mood_down, mood_irritat, mood_satisfi<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>, mood_lonely, mood_enthus<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">mood_suspic, mood_cheerf<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>, mood_guilty, mood_doubt, mood_strong<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
</tr>
<tr>
<td align="left">Physical</td>
<td align="left">phy_hungry, phy_pain, phy_headache, phy_physact<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
</tr>
<tr>
<td align="left">SelfEsteem</td>
<td align="left">se_selflike<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>, se_selfdoub, se_handle<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
</tr>
<tr>
<td align="left">Patience</td>
<td align="left">pat_restl, pat_agitate, pat_worry, pat_concent<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
</tr>
<tr>
<td align="left">Sleep</td>
<td align="left">mor_asleep, mor_nrwakeup, mor_lieawake, mor_qualsleep<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>, phy_tired, phy_sleepy</td>
</tr>
<tr>
<td align="left">Day</td>
<td align="left">evn_ordinary, evn_niceday<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>, evn_inflmood, mor_feellike<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="Tfn1">
<label>a</label>
<p>Variable was recoded.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>The output and figures displayed in this paper were created with R-package <italic>casnet</italic> (v. 0.2.1, <xref ref-type="bibr" rid="B32">Hasselman, 2022</xref>), there are however many more ways to conduct the recurrence-based analyses discussed here (e.g. in Python, Matlab, or stand-alone software). A comparison of software packages for performing RQA can be found here: <ext-link ext-link-type="uri" xlink:href="https://github.com/JuliaDynamics/RecurrenceAnalysis.jl/wiki/Comparison-of-software-packages-for-RQA">https://github.com/JuliaDynamics/RecurrenceAnalysis.jl/wiki/Comparison-of-software-packages-for-RQA</ext-link>.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec id="s3-1">
<title>Comparison to Previous Analysis: Data Segmentation</title>
<p>In the case of a critical phase transition, an increase in temporal autocorrelations and variance is expected near tipping points (<xref ref-type="bibr" rid="B81">Weinans et al., 2021</xref>). Some of these phenomena are known to be quantified by RQA measures, a windowed RQA analysis is for example able to detect control parameter changes of the logistic map from periodic-chaos, but also chaos-chaos transitions (cf. <xref ref-type="bibr" rid="B49">Marwan et al., 2009</xref>). Especially the expected changes in the geometric structure of the phase space trajectory is expected to be quantified by the RN measures, this occurs when previously inaccessible degrees of freedom become available to the system, while availability of others may be constrained. Note that these assumptions only hold if it is indeed the case that the phase transition is of the critical type and not e.g. a noise induced transition.</p>
<p>
<xref ref-type="fig" rid="F6">Figure 6</xref> is conceptually similar to <xref ref-type="fig" rid="F1">Figure 1B</xref> in the paper by <xref ref-type="bibr" rid="B14">Cramer et al. (2016)</xref>, which shows the 5-node GGM symptom network fitted to data from different phases of the experiment (data-segmentation). The purpose of constructing a GGM for the different phases of the experiment prior to the major shift in depressive symptoms was to evaluate whether the graph structure would represent the hypothesized increase in correlation between different symptoms. <xref ref-type="bibr" rid="B14">Cramer et al. (2016)</xref> indeed found this at the level of the aggregated dimensions <italic>mental unrest</italic>, <italic>positive affect</italic>, <italic>negative affect</italic>, and vertices based on single time series <italic>worry</italic> and <italic>suspicious</italic>. The graphs displayed in <xref ref-type="fig" rid="F6">Figure 6</xref> are Multiplex cumulative Recurrence Networks based on six <italic>&#x25b;</italic>-cRN, constructed from distance matrices that represent a phase space composed of subsets of the multivariate data (see the matrices in <xref ref-type="fig" rid="F7">Figure 7</xref>). The Inter-layer MI (blue) and Edge Overlap (red) are shown as edge weights (the edges with lower weights are more transparent to make structural differences more visually apparent). <xref ref-type="table" rid="T3">Table 3</xref> displays the average Inter-layer MI (which is the same as the average Edge Strength Density), the average Inter-layer Correlation, the average Edge Overlap and the Global Efficiency of the McRN for the different phases of the experiment. For each measure, it is the case that the McRN of the epoch marked as <italic>critical transition</italic> has the highest value relative to other phases of the experiment.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Multiplex cumulative Recurrence Networks for different phases of the experiment: <bold>(A)</bold> Baseline; <bold>(B)</bold> Start double blind; <bold>(C)</bold> Start reduction; <bold>(D)</bold> Post reduction; <bold>(E)</bold> Critical transition; <bold>(F)</bold> Post reduction (additional). Each vertex represents a cumulative Recurrence Network (see <xref ref-type="fig" rid="F5">Figure 5</xref>). The edges represent Inter-layer Mutual information (blue) and Edge Overlap (red). The second part of the post reduction phase after the critical transition is not shown here.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g006.tif"/>
</fig>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Weighted, directed matrices for constructing cumulative Recurrence Networks of selected variables of the multivariate dataset. The weights represent recurrence times. The direction is implemented by only considering the recurrent points in the lower triangle, and calculating measures based on the out-degree.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g007.tif"/>
</fig>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>The Average Edge Strength Density, Global Efficiency, Average Inter-layer MI and Average Edge Overlap of the Multiplex Recurrence Network based on Different Phases in the Experiment.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">Edge Strength</th>
<th align="center">Efficiency</th>
<th align="center">MI</th>
<th align="center">R</th>
<th align="center">Edge Overlap</th>
</tr>
<tr>
<td align="left"/>
<td align="center">
<inline-formula id="inf33">
<mml:math id="m43">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">&#x3c1;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi mathvariant="bold">&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>
</td>
<td align="center">
<inline-formula id="inf34">
<mml:math id="m44">
<mml:mrow>
<mml:mover accent="true">
<mml:mrow>
<mml:mi mathvariant="bold">E</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">&#x302;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>&#x3b5;</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</td>
<td align="center">
<inline-formula id="inf35">
<mml:math id="m45">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">I</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="bold">&#x3b1;</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold">&#x3b2;</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>
</td>
<td align="center">
<inline-formula id="inf36">
<mml:math id="m46">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="bold">R</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="bold">&#x3b1;</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold">&#x3b2;</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>
</td>
<td align="center">
<inline-formula id="inf37">
<mml:math id="m47">
<mml:mfenced open="&#x27e8;" close="&#x27e9;">
<mml:mrow>
<mml:mi mathvariant="bold">&#x3c9;</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>
</td>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">baseline [N &#x3d; 28]</td>
<td align="center">0.24</td>
<td align="center">0.18</td>
<td align="center">0.24</td>
<td align="center">0.06</td>
<td align="center">0.06</td>
</tr>
<tr>
<td align="left">start double blind [N &#x3d; 14]</td>
<td align="center">0.19</td>
<td align="center">0.11</td>
<td align="center">0.19</td>
<td align="center">0.02</td>
<td align="center">0.06</td>
</tr>
<tr>
<td align="left">start reduction [N &#x3d; 56]</td>
<td align="center">0.03</td>
<td align="center">0.02</td>
<td align="center">0.03</td>
<td align="center">0.30</td>
<td align="center">0.07</td>
</tr>
<tr>
<td align="left">post reduction 1 [N &#x3d; 29]</td>
<td align="center">0.09</td>
<td align="center">0.07</td>
<td align="center">0.09</td>
<td align="center">0.06</td>
<td align="center">0.05</td>
</tr>
<tr>
<td align="left">critical transition [N &#x3d; 10]</td>
<td align="center">0.31</td>
<td align="center">0.28</td>
<td align="center">0.31</td>
<td align="center">0.15</td>
<td align="center">0.10</td>
</tr>
<tr>
<td align="left">post reduction 2 [N &#x3d; 15]</td>
<td align="center">0.24</td>
<td align="center">0.22</td>
<td align="center">0.24</td>
<td align="center">0.18</td>
<td align="center">0.04</td>
</tr>
<tr>
<td align="left">post reduction (additional) [N &#x3d; 91]</td>
<td align="center">0.01</td>
<td align="center">0.01</td>
<td align="center">0.01</td>
<td align="center">0.25</td>
<td align="center">0.06</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>Note: Values were calculated on different number of data points [N].</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>In addition to the fact that the analysis strategy by <xref ref-type="bibr" rid="B14">Cramer et al. (2016)</xref> can only be conducted post data collection, another problem is that it is not possible to &#x201c;de-aggregate&#x201d; their mental-unrest and affect dimensions to study which variables might be driving the evolution towards the regime shift. The same holds for the windowed analysis of the autocorrelation and variance, based on the summed, detrended score of the five mental states and a window of 30&#xa0;days. At the level of the multiplex network, one can examine the vertex properties of each individual layer, for example centrality. An example is displayed in <xref ref-type="fig" rid="F8">Figure 8</xref>: The upper triangle of the matrix is a representation of the weighted matrix of the McRN based on Inter-layer MI shown in <xref ref-type="fig" rid="F6">Figure 6</xref> for the period &#x201c;post reduction (planned),&#x201d; the lower triangle displays an weighted matrix based on the Edge Overlap for the same period.</p>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption>
<p>An example of a distance matrix from which a Multiplex Recurrence Network can be constructed. The upper triangle is based on the Inter-layer Mutual Information, the lower triangle represents the Average Edge Overlap between network layers. The values were transformed to the unit scale, using the maxima and minima observed during the post reduction period.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g008.tif"/>
</fig>
</sec>
<sec id="s3-2">
<title>Geometric Resilience Loss Indicators</title>
<p>
<xref ref-type="bibr" rid="B14">Cramer et al. (2016)</xref> evidenced critical slowing down by means of a windowed analysis of the variance and the autocorrelation function in a window of 30&#xa0;days. An increase in the lag-1 autocorrelation and variance was observed with the autocorrelation reaching a peak just before the critical transition. The variance steadily increased during the observation period. A window of 30&#xa0;days would not be a practical time period for detecting EWS in a clinical setting. Moreover, a closer inspection of the state variable suggests that there are more sudden changes in symptom severity than the one which caused a temporary halt on the measurement of some of the variables starting at day 127.</p>
<p>
<xref ref-type="fig" rid="F9">Figure 9</xref> displays sliding window analyses (7&#xa0;days window) of three layer-similarity measures: Edge Overlap, Strength-based Inter-layer Mutual Information, strength based Inter-layer Correlation. The red and green areas represent a period of 14 days before a major change in the state variable (an increase or decrease in symptom severity respectively) occurred. Visual inspection shows that major shifts in symptom severity are often preceded by clear peaks in the Edge Overlap. The Inter-layer MI is similar to the Edge Overlap, but less clear, for the correlation between the strength distributions of the layers it is difficult to assess clear peaks. There are also shifts in symptom severity without any, or, less pronounced peaks preceding it.</p>
<fig id="F9" position="float">
<label>FIGURE 9</label>
<caption>
<p>The time course of the Multiplex Recurrence Network measures calculated in a 7&#xa0;days sliding window: average Edge Overlap, strength-based Inter-layer Mutual Information, strength based Inter-layer degree correlation R. All values are transformed to the unit scale. The grey line represents the major shifts in the global state variable, the depression symptom scale SCL-R-90 which was measured weekly. The colored regions represent a seven or 14&#xa0;day period before an major change in symptom severity.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g009.tif"/>
</fig>
<p>The average Edge Overlap (as well as Inter-layer MI and R) can be considered a global network measure of coherence between the layers of the multiplex. In the present context of EWS, the fact a peak is observed before transitions is similar to the hypothesized increase in autocorrelation associated with critical slowing down, which can also be evidenced by performing a PCA on multivariate time series data and observing that most variables load on the principle component with the highest eigenvalue (cf. <xref ref-type="bibr" rid="B81">Weinans et al., 2021</xref>). <xref ref-type="fig" rid="F10">Figure 10</xref> show the average of local network measures across all 7&#xa0;days windows, for each subsystem separately. Several observations can be made, it appears that the layers &#x201c;Day&#x201d; and &#x201c;Self Esteem&#x201d; often play a central role in the multiplex network, as indicated by their relatively high mean values for Clustering, Closeness and Efficiency. In the context of recurrence networks, Clustering (and Strength Density) are indicative of the geometric alignment of the state vectors which can occur close to dynamic invariant structures in phase space (<xref ref-type="bibr" rid="B89">Zou et al., 2019</xref>). Closeness Centrality and Efficiency represent measures of the shortest path lengths between vertices where the Efficiency measure is less affected by disconnected networks.</p>
<fig id="F10" position="float">
<label>FIGURE 10</label>
<caption>
<p>Mean Local vertex characteristics over all 7-days windows (<italic>N</italic> &#x3d; 232) for each layer in the Multiplex cRN. The figure displays the results based on the MRN with inter-layer MI as edge weights.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g010.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>The goal of the present paper was to examine the potential of recurrence based analyses as a method for use in a clinical context in which process monitoring of physical and mental states is used to detect early warning signals of imminent shifts in a state variable, for example, the severity of depressive symptoms. The analysis strategy focused on analyzing only those data points that would be available to a clinician in real time, using sliding window analyses with a window size that would be acceptable in setting in which a patient receives an intervention (7 days).</p>
<p>The analyses reveal that layer similarity measures of a Multiplex network of which the layers consist of cumulative (directed and weighted) recurrence networks display peaks within a 7&#x2013;14&#xa0;days window before a major shift occurred in the state variable. Local network measures were examined and revealed two subsystems, &#x201c;Day&#x201d; and &#x201c;Self Esteem,&#x201d; which played a central role in the Multiplex network. The peaks in the layer similarity measures are most clearly visible in the Edge Overlap and Inter-layer Mutual Information. However, not every transition is preceded by a peak, and not every peak indicates a transition is imminent within 7&#x2013;14&#xa0;days. For comparison, see <xref ref-type="fig" rid="F11">Figure 11</xref> which approximately mimics the original analysis by (<xref ref-type="bibr" rid="B82">Wichers et al., 2016</xref>) evidencing Critical Slowing Down in the windowed autocorrelation and variance of the Mood subset of variables. There are several reasons why the measures in <xref ref-type="fig" rid="F11">Figure 11</xref> are not suitable for the goals set for the present study. First, a 30&#xa0;days window was used which is not practical for most clinical settings. Second, the autocorrelation has its highest peak at exactly the moment of the transition (day 127). Third, the windowed variance actually increases after the transition, and reaches its highest peak after the experiment was re-started. Fourth, there are no apparent associations between peaks in these measures and other major transitions in the state variable.</p>
<fig id="F11" position="float">
<label>FIGURE 11</label>
<caption>
<p>Variance and Autocorrelation of the variables in the Mood subsystem calculated in a sliding window of 30&#xa0;days. The grey line represents the depression symptom scale SCL-R-90. See text for details.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g011.tif"/>
</fig>
<p>An advantage of the current analysis strategy over the original study is that there is no aggregation of the multivariate time series for the purpose of dimension reduction. That is, it is possible to go back to the individual dimensions to further investigate the profiles of recurring phases (coordinates in phase space) and construct a transition matrix (see <xref ref-type="bibr" rid="B34">Heino et al., 2021</xref>). <xref ref-type="fig" rid="F12">Figure 12</xref> displays the profiles of states in the &#x201c;Day&#x201d; subsystem, sorted from most-to-least frequently recurring. The most frequently recurring phase can be characterized as a mundane experience of the day (high on ordinary day, neutral to positive on prospective and reflective evaluation of the day)<xref ref-type="fn" rid="fn1">
<sup>1</sup>
</xref>. The second phase is different due to the response to &#x201c;I found this a nice day,&#x201d; which is now in the direction of strong disagreement. The other phases are characterized by higher disagreement with &#x201c;looking forward&#x201d; to the day. This provides a detailed window into phase space dynamics that would have obviously been lost if the six series of the Day subsystem were aggregated into 1 time series. Based on the sequences of phases it is possible to construct a transition matrix and the corresponding directed graph is displayed in <xref ref-type="fig" rid="F13">Figure 13</xref>. The transition network can reveal insights into the existence of certain paths that frequently lead to certain phases. In <xref ref-type="fig" rid="F13">Figure 13</xref> it is clear that Phase 1 and Phase 2 are highly connected, but Phase 1 is the default state, to which the system most frequently returns.</p>
<fig id="F12" position="float">
<label>FIGURE 12</label>
<caption>
<p>Profiles of recurring phases of the Day subsystem.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g012.tif"/>
</fig>
<fig id="F13" position="float">
<label>FIGURE 13</label>
<caption>
<p>Transition Network of the phases of the subsystem Day. Edges with a transition probability below 0.10 are not displayed.</p>
</caption>
<graphic xlink:href="fphys-13-859127-g013.tif"/>
</fig>
<sec id="s4-1">
<title>Limitations and Future Directions</title>
<p>As can be seen in <xref ref-type="fig" rid="F9">Figure 9</xref> it is often the case a peak in the daily measurements precedes a shift in the weekly observed symptom severity, but not in every case and not for every measure examined. There are several explanations, for example, the symptom severity scale was observed less frequently and fluctuations occurring within a week were not observed by design. A solution could be to consider a (set of) daily measured variables to represent the state variable, but there are also benefits to using a diagnostic scale (e.g., norms exist). Perhaps a more dynamic test could be developed and normed, one which allows for daily assessment of symptoms (e.g., by creating several parallel tests).</p>
<p>Another limitation of the method as presented in this paper is the lack of a reference for determining whether a peak is a potential EWS or merely a random fluctuation. There are several ways to at least check whether the observed peaks are &#x201c;real&#x201d;, for example, by repeating the analysis several times on surrogate data (e.g., <xref ref-type="bibr" rid="B35">Jacob et al., 2018</xref>) or perform a block-randomization on the windowed time course (e.g., <xref ref-type="bibr" rid="B76">Vink et al., 2018</xref>). Another way to construct a randomization test could be by randomly re-wiring the network layers and re-construct the Multiplex network and evaluate and compare the layer similarities to the observed measures.</p>
<p>A related issue concerns the fact that EWS are naive to the direction of change, that is, to be of clinical use it would be helpful to know whether an EWS implies the current state is deteriorating (higher symptom severity) or not. There have been theoretical advances to finding the direction of least resilience in multivariate time series data (<xref ref-type="bibr" rid="B80">Weinans et al., 2019</xref>) or based on formal models (<xref ref-type="bibr" rid="B15">Cui et al., 2021</xref>). Recently <xref ref-type="bibr" rid="B67">Schreuder et al. (2022)</xref> used a technique based on two variables obtained from windowed principal component analysis (the variance explained by the first component and the skewness of the scores projected onto this component) to identify the direction of the critical transition in the same data set used in the present paper. In the same study, the method was confirmed to predict the direction of transition in a larger sample of 34 individuals. Further study is needed to evaluate whether the technique can be used in a clinical setting according to the goals set for the purpose of the current paper. The EWS phenomenon evidenced by <xref ref-type="bibr" rid="B67">Schreuder et al. (2022)</xref> (uni-dimensional behavior of system dimensions before a critical transition), is very similar to the phenomena indicated by the geometric recurrence network measures used in the present study: Layers in the McRN become structurally more similar (MI or correlation between degree distributions, edges connecting to the same vertices) and the local centrality measures indicate geometric alignment of the phase space vectors.</p>
<p>To summarize, recurrence network analysis of multivariate time series data has been shown to have great potential for use in clinical practice, specifically in the context of real-time process monitoring of individual patients. The current example has been a proof of principle, more thorough study and development is required into the relationship between transitions and the behavior of the (multiplex) recurrence measures.</p>
</sec>
</sec>
</body>
<back>
<sec id="s5">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author. The data from <xref ref-type="bibr" rid="B82">Wichers et al. (2016)</xref> were published in the Journal of Open Psychology Data (<ext-link ext-link-type="uri" xlink:href="https://openpsychologydata.metajnl.com/articles/10.5334/jopd.29/">https://openpsychologydata.metajnl.com/articles/10.5334/jopd.29/</ext-link>) and are publicly available at: <ext-link ext-link-type="uri" xlink:href="https://osf.io/j4fg8">https://osf.io/j4fg8</ext-link> unde a CC-By Attribution 4.0 International (CC-By) License. The analysis scripts used in this paper are available at: <ext-link ext-link-type="uri" xlink:href="https://osf.io/5947r">https://osf.io/5947r</ext-link>.</p>
</sec>
<sec id="s6">
<title>Ethics Statement</title>
<p>Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent was not required as publicly available datasets with participant consent were analyzed.</p>
</sec>
<sec id="s7">
<title>Author Contributions</title>
<p>FH conceived of and wrote the article.</p>
</sec>
<sec sec-type="COI-statement" id="s8">
<title>Conflict of Interest</title>
<p>The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<fn-group>
<fn id="fn1">
<label>1</label>
<p>The questions were: &#x201c;I found this an ordinary day,&#x201d; &#x201c;I found this a nice day&#x201d; (recoded), &#x201c;Filling in this questionnaire influenced my mood,&#x201d; &#x201c;I am looking forward to this day&#x201d; (recoded).</p>
</fn>
</fn-group>
<ref-list>
<title>Reference</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Adolf</surname>
<given-names>J. K.</given-names>
</name>
<name>
<surname>Fried</surname>
<given-names>E. I.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Ergodicity Is Sufficient but Not Necessary for Group-To-Individual Generalizability</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>116</volume>, <fpage>6540</fpage>&#x2013;<lpage>6541</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1818675116</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>A&#xdf;mann</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Romano</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Thiel</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Niemitz</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Hierarchical Organization of a Reference System in Newborn Spontaneous Movements</article-title>. <source>Infant Behav. Development</source> <volume>30</volume>, <fpage>568</fpage>&#x2013;<lpage>586</lpage>. <pub-id pub-id-type="doi">10.1016/j.infbeh.2007.04.004</pub-id> </citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bak</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Drukker</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hasmi</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>van Os</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>An N&#x3d;1 Clinical Network Analysis of Symptoms and Treatment in Psychosis</article-title>. <source>PLOS ONE</source> <volume>11</volume>, <fpage>e0162811</fpage>&#x2013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0162811</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bak</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Tang</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Wiesenfeld</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>1987</year>). <article-title>Self-organized Criticality: An Explanation of the 1/fnoise</article-title>. <source>Phys. Rev. Lett.</source> <volume>59</volume>, <fpage>381</fpage>&#x2013;<lpage>384</lpage>. <pub-id pub-id-type="doi">10.1103/physrevlett.59.381</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Barrat</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Weigt</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>On the Properties of Small-World Network Models</article-title>. <source>Eur. Phys. J. B</source> <volume>13</volume>, <fpage>547</fpage>&#x2013;<lpage>560</lpage>. <pub-id pub-id-type="doi">10.1007/s100510050067</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Beltz</surname>
<given-names>A. M.</given-names>
</name>
<name>
<surname>Gates</surname>
<given-names>K. M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Network Mapping with GIMME</article-title>. <source>Multivariate Behav. Res.</source> <volume>52</volume>, <fpage>789</fpage>&#x2013;<lpage>804</lpage>. <pub-id pub-id-type="doi">10.1080/00273171.2017.1373014</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bianciardi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Sirabella</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Hagberg</surname>
<given-names>G. E.</given-names>
</name>
<name>
<surname>Giuliani</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Zbilut</surname>
<given-names>J. P.</given-names>
</name>
<name>
<surname>Colosimo</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Model-free Analysis of Brain fMRI Data by Recurrence Quantification</article-title>. <source>Neuroimage</source> <volume>37</volume>, <fpage>489</fpage>&#x2013;<lpage>503</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2007.05.025</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Boccaletti</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Latora</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Moreno</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Chavez</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hwang</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Complex Networks: Structure and Dynamics</article-title>. <source>Phys. Rep.</source> <volume>424</volume>, <fpage>175</fpage>&#x2013;<lpage>308</lpage>. <pub-id pub-id-type="doi">10.1016/j.physrep.2005.10.009</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bosl</surname>
<given-names>W. J.</given-names>
</name>
<name>
<surname>Loddenkemper</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Nelson</surname>
<given-names>C. A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Nonlinear EEG Biomarker Profiles for Autism and Absence Epilepsy</article-title>. <source>Neuropsychiatr. Electrophysiol.</source> <volume>3</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1186/s40810-017-0023-x</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bringmann</surname>
<given-names>L. F.</given-names>
</name>
<name>
<surname>Hamaker</surname>
<given-names>E. L.</given-names>
</name>
<name>
<surname>Vigo</surname>
<given-names>D. E.</given-names>
</name>
<name>
<surname>Aubert</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Borsboom</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Tuerlinckx</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Changing Dynamics: Time-Varying Autoregressive Models Using Generalized Additive Modeling</article-title>. <source>Psychol. Methods</source> <volume>22</volume>, <fpage>409</fpage>&#x2013;<lpage>425</lpage>. <pub-id pub-id-type="doi">10.1037/met0000085</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Burthe</surname>
<given-names>S. J.</given-names>
</name>
<name>
<surname>Henrys</surname>
<given-names>P. A.</given-names>
</name>
<name>
<surname>Mackay</surname>
<given-names>E. B.</given-names>
</name>
<name>
<surname>Spears</surname>
<given-names>B. M.</given-names>
</name>
<name>
<surname>Campbell</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Carvalho</surname>
<given-names>L.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). <article-title>Do early Warning Indicators Consistently Predict Nonlinear Change in Long-Term Ecological Data?</article-title> <source>J. Appl. Ecol.</source> <volume>53</volume>, <fpage>666</fpage>&#x2013;<lpage>676</lpage>. <pub-id pub-id-type="doi">10.1111/1365-2664.12519</pub-id> </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Buuren</surname>
<given-names>S. v.</given-names>
</name>
<name>
<surname>Groothuis-Oudshoorn</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Mice: Multivariate Imputation by Chained Equations inR</article-title>. <source>J. Stat. Soft.</source> <volume>45</volume>, <fpage>1</fpage>&#x2013;<lpage>67</lpage>. <pub-id pub-id-type="doi">10.18637/jss.v045.i03</pub-id> </citation>
</ref>
<ref id="B13">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Cox</surname>
<given-names>R. F. A.</given-names>
</name>
<name>
<surname>van der Steen</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Guevara</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>de Jonge-Hoekstra</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>van Dijk</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>Chromatic and Anisotropic Cross-Recurrence Quantification Analysis of Interpersonal Behavior</article-title>,&#x201d; in <source>Recurrence Plots and Their Quantifications: Expanding Horizons</source> (<publisher-name>Springer</publisher-name>), <fpage>209</fpage>&#x2013;<lpage>225</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-29922-8_11</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cramer</surname>
<given-names>A. O. J.</given-names>
</name>
<name>
<surname>van Borkulo</surname>
<given-names>C. D.</given-names>
</name>
<name>
<surname>Giltay</surname>
<given-names>E. J.</given-names>
</name>
<name>
<surname>van der Maas</surname>
<given-names>H. L. J.</given-names>
</name>
<name>
<surname>Kendler</surname>
<given-names>K. S.</given-names>
</name>
<name>
<surname>Scheffer</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). <article-title>Major Depression as a Complex Dynamic System</article-title>. <source>PLoS One</source> <volume>11</volume>, <fpage>e0167490</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0167490</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cui</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Lichtwarck-Aschoff</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Olthof</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>From Metaphor to Computation: Constructing the Potential Landscape for Multivariate Psychological Formal Models</article-title>. <source>PsyArXiv</source>. <pub-id pub-id-type="doi">10.31234/osf.io/49xyg</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dale</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Spivey</surname>
<given-names>M. J.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Unraveling the Dyad: Using Recurrence Analysis to Explore Patterns of Syntactic Coordination between Children and Caregivers in Conversation</article-title>. <source>Lang. Learn.</source> <volume>56</volume>, <fpage>391</fpage>&#x2013;<lpage>430</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-9922.2006.00372.x</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>De Graag</surname>
<given-names>J. a.</given-names>
</name>
<name>
<surname>Cox</surname>
<given-names>R. F. a.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Jansen</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>De Weerth</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Functioning within a Relationship: Mother-Infant Synchrony and Infant Sleep</article-title>. <source>Infant Behav. Development</source> <volume>35</volume>, <fpage>252</fpage>&#x2013;<lpage>263</lpage>. <pub-id pub-id-type="doi">10.1016/j.infbeh.2011.12.006</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Deligni&#xe8;res</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Fortes</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Ninot</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>The Fractal Dynamics of Self-Esteem and Physical Self</article-title>. <source>Nonlinear Dyn. Psychol Life Sci</source> <volume>8</volume>, <fpage>479</fpage>&#x2013;<lpage>510</lpage>. </citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Diniz</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Wijnants</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Torre</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Barreiros</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Crato</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Bosman</surname>
<given-names>A. M. T.</given-names>
</name>
<etal/>
</person-group> (<year>2011</year>). <article-title>Contemporary Theories of 1/f Noise in Motor Control</article-title>. <source>Hum. Movement Sci.</source> <volume>30</volume>, <fpage>889</fpage>&#x2013;<lpage>905</lpage>. <pub-id pub-id-type="doi">10.1016/j.humov.2010.07.006</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Donges</surname>
<given-names>J. F.</given-names>
</name>
<name>
<surname>Heitzig</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Donner</surname>
<given-names>R. V.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Analytical Framework for Recurrence Network Analysis of Time Series</article-title>. <source>Phys. Rev. E</source> <volume>85</volume>, <fpage>046105</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.85.046105</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Donner</surname>
<given-names>R. V.</given-names>
</name>
<name>
<surname>Small</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Donges</surname>
<given-names>J. F.</given-names>
</name>
<name>
<surname>Marwan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Zou</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Xiang</surname>
<given-names>R.</given-names>
</name>
<etal/>
</person-group> (<year>2011</year>). <article-title>Recurrence-based Time Series Analysis by Means of Complex Network Methods</article-title>. <source>Int. J. Bifurcation Chaos</source> <volume>21</volume>, <fpage>1019</fpage>&#x2013;<lpage>1046</lpage>. <pub-id pub-id-type="doi">10.1142/S0218127411029021</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Epskamp</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Cramer</surname>
<given-names>A. O. J.</given-names>
</name>
<name>
<surname>Waldorp</surname>
<given-names>L. J.</given-names>
</name>
<name>
<surname>Schmittmann</surname>
<given-names>V. D.</given-names>
</name>
<name>
<surname>Borsboom</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Qgraph: Network Visualizations of Relationships in Psychometric Data</article-title>. <source>J. Stat. Softw.</source> <volume>48</volume>, <fpage>1</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.18637/jss.v048.i04</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Eroglu</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Marwan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Stebich</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Multiplex Recurrence Networks</article-title>. <source>Phys. Rev. E</source> <volume>97</volume>, <fpage>012312</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.97.012312</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fartacek</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Schiepek</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Kunrath</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Fartacek</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Pl&#xf6;derl</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Real-time Monitoring of Non-linear Suicidal Dynamics: Methodology and a Demonstrative Case Report</article-title>. <source>Front. Psychol.</source> <volume>7</volume>, <fpage>130</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.00130</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Fusaroli</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Bang</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Weed</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Non-linear Analyses of Speech and Prosody in Asperger&#x2019;s Syndrome</article-title>,&#x201d; in <conf-name>International meeting for autism research</conf-name>. </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fusaroli</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Lambrechts</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Yarrow</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Maras</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Gaigg</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Conversational Voice Patterns in Adult English Speakers with ASD</article-title>. <source>IMFAR</source> <volume>2016</volume>. </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gates</surname>
<given-names>K. M.</given-names>
</name>
<name>
<surname>Molenaar</surname>
<given-names>P. C. M.</given-names>
</name>
<name>
<surname>Iyer</surname>
<given-names>S. P.</given-names>
</name>
<name>
<surname>Nigg</surname>
<given-names>J. T.</given-names>
</name>
<name>
<surname>Fair</surname>
<given-names>D. A.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Organizing Heterogeneous Samples Using Community Detection of GIMME-Derived Resting State Functional Networks</article-title>. <source>PLoS ONE</source> <volume>9</volume>, <fpage>e91322</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0091322</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Guttal</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Raghavendra</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Goel</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Hoarau</surname>
<given-names>Q.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Lack of Critical Slowing Down Suggests that Financial Meltdowns Are Not Critical Transitions, yet Rising Variability Could Signal Systemic Risk</article-title>. <source>PLOS ONE</source> <volume>11</volume>, <fpage>e0144198</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0144198</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2015</year>). <source>Beyond the Boundary: An Analysis of Verisimilitude and Causal Ontology of Scientific Claims: &#xc6;tiologies of Developmental Dyslexia as a Case in point</source>. </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Bosman</surname>
<given-names>A. M. T.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Studying Complex Adaptive Systems with Internal States: A Recurrence Network Approach to the Analysis of Multivariate Time Series Data Representing Self-Reports of Human Experience</article-title>. <source>Front. Appl. Mathematics ann Stat.</source> <pub-id pub-id-type="doi">10.3389/fams.2020.00009</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Casnet: A Toolbox for Studying Complex Adaptive Systems and NETworks</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://fredhasselman.com/casnet/">https://fredhasselman.com/casnet/</ext-link>
</comment>. </citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>When the Blind Curve Is Finite: Dimension Estimation and Model Inference Based on Empirical Waveforms</article-title>. <source>Front. Physiol.</source> <volume>4</volume>, <fpage>75</fpage>. <pub-id pub-id-type="doi">10.3389/fphys.2013.00075</pub-id> </citation>
</ref>
<ref id="B34">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Heino</surname>
<given-names>M. T. J.</given-names>
</name>
<name>
<surname>Knittle</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Noone</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Hankonen</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Studying Behaviour Change Mechanisms under Complexity</article-title>. <source>Behav. Sci.</source> <volume>11</volume>, <fpage>77</fpage>. <pub-id pub-id-type="doi">10.3390/bs11050077</pub-id> </citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jacob</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Harikrishnan</surname>
<given-names>K. P.</given-names>
</name>
<name>
<surname>Misra</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ambika</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Recurrence Network Measures for Hypothesis Testing Using Surrogate Data: Application to Black Hole Light Curves</article-title>. <source>Commun. Nonlinear Sci. Numer. Simulation</source> <volume>54</volume>, <fpage>84</fpage>&#x2013;<lpage>99</lpage>. <pub-id pub-id-type="doi">10.1016/j.cnsns.2017.05.018</pub-id> </citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kelso</surname>
<given-names>J. A. S.</given-names>
</name>
<name>
<surname>Scholz</surname>
<given-names>J. P.</given-names>
</name>
<name>
<surname>Sch&#xf6;ner</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>1986</year>). <article-title>Nonequilibrium Phase Transitions in Coordinated Biological Motion: Critical Fluctuations</article-title>. <source>Phys. Lett. A</source> <volume>118</volume>, <fpage>279</fpage>&#x2013;<lpage>284</lpage>. <pub-id pub-id-type="doi">10.1016/0375-9601(86)90359-2</pub-id> </citation>
</ref>
<ref id="B37">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kossakowski</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Groot</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Haslbeck</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Borsboom</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Wichers</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Data from &#x201c;Critical Slowing Down as a Personalized Early Warning Signal for Depression</article-title>. <source>J. Open Psychol. Data</source> <volume>5</volume>. <pub-id pub-id-type="doi">10.5334/jopd.29</pub-id> </citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kowalik</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Schiepek</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Kumpf</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Roberts</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Elbert</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Psychotherapy as a Chaotic Process II. The Application of Nonlinear Analysis Methods on Quasi Time Series of the Client-Therapist Interaction: A Nonstationary Approach</article-title>. <source>Psychotherapy Res.</source> <volume>7</volume>, <fpage>197</fpage>&#x2013;<lpage>218</lpage>. <pub-id pub-id-type="doi">10.1080/10503309712331331973</pub-id> </citation>
</ref>
<ref id="B39">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lacasa</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Nicosia</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Latora</surname>
<given-names>V.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Network Structure of Multivariate Time Series</article-title>. <source>Sci. Rep.</source> <volume>5</volume>, <fpage>15508</fpage>. <pub-id pub-id-type="doi">10.1038/srep15508</pub-id> </citation>
</ref>
<ref id="B40">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Leemput</surname>
<given-names>I. A. van. de.</given-names>
</name>
<name>
<surname>Wichers</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Cramer</surname>
<given-names>A. O.</given-names>
</name>
<name>
<surname>Borsboom</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Tuerlinckx</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Kuppens</surname>
<given-names>P.</given-names>
</name>
<etal/>
</person-group> (<year>2014</year>). <article-title>Critical Slowing Down as Early Warning for the Onset and Termination of Depression</article-title>. <source>Proc. Natl. Acad. Sci. U S A.</source> <volume>111</volume>, <fpage>87</fpage>&#x2013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1312114110</pub-id> </citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lenton</surname>
<given-names>T. M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Environmental Tipping Points</article-title>. <source>Annu. Rev. Environ. Resour.</source> <volume>38</volume>, <fpage>1</fpage>&#x2013;<lpage>29</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-environ-102511-084654</pub-id> </citation>
</ref>
<ref id="B43">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liao</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Skelton</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Dunton</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Bruening</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>A Systematic Review of Methods and Procedures Used in Ecological Momentary Assessments of Diet and Physical Activity Research in Youth: An Adapted STROBE Checklist for Reporting EMA Studies (CREMAS)</article-title>. <source>J. Med. Internet Res.</source> <volume>18</volume>, <fpage>e151</fpage>. <pub-id pub-id-type="doi">10.2196/jmir.4954</pub-id> </citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lichtwarck-Aschoff</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Cox</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Pepler</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Granic</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>A Characteristic Destabilization Profile in Parent-Child Interactions Associated with Treatment Efficacy for Aggressive Children</article-title>. <source>Nonlinear Dyn. Psychol Life Sci</source> <volume>16</volume>, <fpage>353</fpage>&#x2013;<lpage>379</lpage>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://devpsychopathologyru.nl/wp-content/uploads/2012/11/2012-A-characteristic-destabilization-profile-in-parent-child.pdf">http://devpsychopathologyru.nl/wp-content/uploads/2012/11/2012-A-characteristic-destabilization-profile-in-parent-child.pdf</ext-link>
</comment>. </citation>
</ref>
<ref id="B46">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Little</surname>
<given-names>M. a.</given-names>
</name>
<name>
<surname>McSharry</surname>
<given-names>P. E.</given-names>
</name>
<name>
<surname>Roberts</surname>
<given-names>S. J.</given-names>
</name>
<name>
<surname>Costello</surname>
<given-names>D. A.</given-names>
</name>
<name>
<surname>Moroz</surname>
<given-names>I. M.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Exploiting Nonlinear Recurrence and Fractal Scaling Properties for Voice Disorder Detection</article-title>. <source>Biomed. Eng. Online</source> <volume>6</volume>, <fpage>23</fpage>. <pub-id pub-id-type="doi">10.1186/1475-925X-6-23</pub-id> </citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Louwerse</surname>
<given-names>M. M.</given-names>
</name>
<name>
<surname>Dale</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Bard</surname>
<given-names>E. G.</given-names>
</name>
<name>
<surname>Jeuniaux</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Behavior Matching in Multimodal Communication Is Synchronized</article-title>. <source>Cogn. Sci.</source> <volume>36</volume>, <fpage>1404</fpage>&#x2013;<lpage>1426</lpage>. <pub-id pub-id-type="doi">10.1111/j.1551-6709.2012.01269.x</pub-id> </citation>
</ref>
<ref id="B48">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Marwan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Carmenromano</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Thiel</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Recurrence Plots for the Analysis of Complex Systems</article-title>. <source>Phys. Rep.</source> <volume>438</volume>, <fpage>237</fpage>&#x2013;<lpage>329</lpage>. <pub-id pub-id-type="doi">10.1016/j.physrep.2006.11.001</pub-id> </citation>
</ref>
<ref id="B49">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Marwan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Donges</surname>
<given-names>J. F.</given-names>
</name>
<name>
<surname>Zou</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Donner</surname>
<given-names>R. V.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Complex Network Approach for Recurrence Analysis of Time Series</article-title>. <source>Phys. Lett. A</source> <volume>373</volume>, <fpage>4246</fpage>&#x2013;<lpage>4254</lpage>. <pub-id pub-id-type="doi">10.1016/j.physleta.2009.09.042</pub-id> </citation>
</ref>
<ref id="B50">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Molenaar</surname>
<given-names>P. C. M.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>A Manifesto on Psychology as Idiographic Science: Bringing the Person Back into Scientific Psychology, This Time Forever</article-title>. <source>Meas. Interdiscip. Res. Perspective</source> <volume>2</volume>, <fpage>201</fpage>&#x2013;<lpage>218</lpage>. <pub-id pub-id-type="doi">10.1207/s15366359mea0204_1</pub-id> </citation>
</ref>
<ref id="B51">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nezlek</surname>
<given-names>J. B.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Ecological Momentary Assessment: Statistical Issues</article-title>. <source>Eur. Psychiatry</source> <volume>30</volume>, <fpage>121</fpage>. <pub-id pub-id-type="doi">10.1016/s0924-9338(15)31837-x</pub-id> </citation>
</ref>
<ref id="B52">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Olthof</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Oude Maatman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Bosman</surname>
<given-names>A. M. T.</given-names>
</name>
<name>
<surname>Lichtwarck-Aschoff</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Complexity Theory of Psychopathology</article-title>. <source>J. Abnormal Psychol.</source> <pub-id pub-id-type="doi">10.31234/osf.io/f68ej</pub-id> </citation>
</ref>
<ref id="B53">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Olthof</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Strunk</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Aas</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Schiepek</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Lichtwarck-Aschoff</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2019a</year>). <article-title>Destabilization in Self-Ratings of the Psychotherapeutic Process Is Associated with Better Treatment Outcome in Patients with Mood Disorders</article-title>. <source>Psychotherapy Res.</source> <volume>30</volume>, <fpage>520</fpage>&#x2013;<lpage>531</lpage>. <pub-id pub-id-type="doi">10.1080/10503307.2019.1633484</pub-id> </citation>
</ref>
<ref id="B54">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Olthof</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Strunk</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>van Rooij</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Aas</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Helmich</surname>
<given-names>M. A.</given-names>
</name>
<etal/>
</person-group> (<year>2019b</year>). <article-title>Critical Fluctuations as an Early-Warning Signal for Sudden Gains and Losses in Patients Receiving Psychotherapy for Mood Disorders</article-title>. <source>Clin. Psychol. Sci.</source> <volume>8</volume>, <fpage>25</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1177/2167702619865969</pub-id> </citation>
</ref>
<ref id="B55">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Olthof</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Wijnants</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Lichtwarck-Aschoff</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Psychological Dynamics Are Complex: A Comparison of Scaling, Variance, and Dynamic Complexity in Simulated and Observed Data</article-title>,&#x201d; in <source>Selbstorganisation &#x2013; ein paradigma f&#xfc;r die humanwissenschaften: Zu ehren von g&#xfc;nter schiepek und seiner forschung zu komplexit&#xe4;t und dynamik in der psychologie</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Viol</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Sch&#xf6;ller</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Aichhorn</surname>
<given-names>W.</given-names>
</name>
</person-group> (<publisher-loc>Wiesbaden</publisher-loc>: <publisher-name>Springer Fachmedien Wiesbaden</publisher-name>), <fpage>303</fpage>&#x2013;<lpage>316</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-658-29906-4_17</pub-id> </citation>
</ref>
<ref id="B56">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oomens</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Maes</surname>
<given-names>J. H. R.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Egger</surname>
<given-names>J. I. M.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>A Time Series Approach to Random Number Generation: Using Recurrence Quantification Analysis to Capture Executive Behavior</article-title>. <source>Front. Hum. Neurosci.</source> <volume>9</volume>, <fpage>319</fpage>. <pub-id pub-id-type="doi">10.3389/fnhum.2015.00319</pub-id> </citation>
</ref>
<ref id="B57">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Petitjean</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Ketterlin</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Gan&#xe7;arski</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>A Global Averaging Method for Dynamic Time Warping, with Applications to Clustering</article-title>. <source>Pattern Recognition</source> <volume>44</volume>, <fpage>678</fpage>&#x2013;<lpage>693</lpage>. <pub-id pub-id-type="doi">10.1016/j.patcog.2010.09.013</pub-id> </citation>
</ref>
<ref id="B58">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Piccirillo</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Rodebaugh</surname>
<given-names>T. L.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Foundations of Idiographic Methods in Psychology and Applications for Psychotherapy</article-title>. <source>Clin. Psychol. Rev.</source> <volume>71</volume>, <fpage>90</fpage>&#x2013;<lpage>100</lpage>. <pub-id pub-id-type="doi">10.1016/j.cpr.2019.01.002</pub-id> </citation>
</ref>
<ref id="B59">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ramachandran</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>1979</year>). <article-title>On the&#x201d; strong Memorylessness Property&#x201d; of the Exponential and Geometric Probability Laws</article-title>. <source>Sankhya&#x304;: Indian J. Stat.</source> <volume>41</volume>, <fpage>244</fpage>&#x2013;<lpage>261</lpage>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://www.jstor.org/stable/25050199">http://www.jstor.org/stable/25050199</ext-link>
</comment>. </citation>
</ref>
<ref id="B60">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Scheffer</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bascompte</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Brock</surname>
<given-names>W. A.</given-names>
</name>
<name>
<surname>Brovkin</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Carpenter</surname>
<given-names>S. R.</given-names>
</name>
<name>
<surname>Dakos</surname>
<given-names>V.</given-names>
</name>
<etal/>
</person-group> (<year>2009</year>). <article-title>Early-warning Signals for Critical Transitions</article-title>. <source>Nature</source> <volume>461</volume>, <fpage>53</fpage>&#x2013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.1038/nature08227</pub-id> </citation>
</ref>
<ref id="B61">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Scheffer</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bolhuis</surname>
<given-names>J. E.</given-names>
</name>
<name>
<surname>Borsboom</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Buchman</surname>
<given-names>T. G.</given-names>
</name>
<name>
<surname>Gijzel</surname>
<given-names>S. M. W.</given-names>
</name>
<name>
<surname>Goulson</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Quantifying Resilience of Humans and Other Animals</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>115</volume>, <fpage>11883</fpage>&#x2013;<lpage>11890</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1810630115</pub-id> </citation>
</ref>
<ref id="B62">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schiepek</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Aichhorn</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Gruber</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Strunk</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Bachler</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Aas</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2016a</year>). <article-title>Real-time Monitoring of Psychotherapeutic Processes: Concept and Compliance</article-title>. <source>Front. Psychol.</source> <volume>7</volume>, <fpage>604</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.00604</pub-id> </citation>
</ref>
<ref id="B63">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schiepek</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Fartacek</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Sturm</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kralovec</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Fartacek</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Pl&#xf6;derl</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Nonlinear Dynamics: Theoretical Perspectives and Application to Suicidology</article-title>. <source>Suicide Life Threat Behav.</source> <volume>41</volume>, <fpage>661</fpage>&#x2013;<lpage>675</lpage>. <pub-id pub-id-type="doi">10.1111/j.1943-278X.2011.00062.x</pub-id> </citation>
</ref>
<ref id="B64">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schiepek</surname>
<given-names>G. K.</given-names>
</name>
<name>
<surname>St&#xf6;ger-Schmidinger</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Aichhorn</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Sch&#xf6;ller</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Aas</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2016b</year>). <article-title>Systemic Case Formulation, Individualized Process Monitoring, and State Dynamics in a Case of Dissociative Identity Disorder</article-title>. <source>Front. Psychol.</source> <volume>7</volume>, <fpage>1545</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.01545</pub-id> </citation>
</ref>
<ref id="B65">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schinkel</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Marwan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Brain Signal Analysis Based on Recurrences</article-title>. <source>J. Physiology-Paris</source> <volume>103</volume>, <fpage>315</fpage>&#x2013;<lpage>323</lpage>. <pub-id pub-id-type="doi">10.1016/j.jphysparis.2009.05.007</pub-id> </citation>
</ref>
<ref id="B66">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Scholz</surname>
<given-names>J. P.</given-names>
</name>
<name>
<surname>Kelso</surname>
<given-names>J. A. S.</given-names>
</name>
<name>
<surname>Sch&#xf6;ner</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>1987</year>). <article-title>Nonequilibrium Phase Transitions in Coordinated Biological Motion: Critical Slowing Down and Switching Time</article-title>. <source>Phys. Lett. A</source> <volume>123</volume>, <fpage>390</fpage>&#x2013;<lpage>394</lpage>. <pub-id pub-id-type="doi">10.1016/0375-9601(87)90038-7</pub-id> </citation>
</ref>
<ref id="B67">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Schreuder</surname>
<given-names>M. J.</given-names>
</name>
<name>
<surname>Wigman</surname>
<given-names>J. T. W.</given-names>
</name>
<name>
<surname>Groen</surname>
<given-names>R. N.</given-names>
</name>
<name>
<surname>Weinans</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Wichers</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hartman</surname>
<given-names>C. A.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Anticipating the Direction of Symptom Progression Using Critical Slowing Down: A Proof-Of-Concept Study</article-title>. <source>BMC Psychiatry</source> <volume>22</volume>, <fpage>49</fpage>. <pub-id pub-id-type="doi">10.1186/s12888-022-03686-9</pub-id> </citation>
</ref>
<ref id="B68">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shiffman</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Conceptualizing Analyses of Ecological Momentary Assessment Data</article-title>. <source>Nicotine Tob. Res.</source> <volume>16</volume> (<issue>Suppl. 2</issue>), <fpage>S76</fpage>&#x2013;<lpage>S87</lpage>. <pub-id pub-id-type="doi">10.1093/ntr/ntt195</pub-id> </citation>
</ref>
<ref id="B69">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shockley</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Butwill</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Zbilut</surname>
<given-names>J. P.</given-names>
</name>
<name>
<surname>Webber</surname>
<given-names>C. L.</given-names>
<suffix>Jr</suffix>
</name>
</person-group> (<year>2002</year>). <article-title>Cross Recurrence Quantification of Coupled Oscillators</article-title>. <source>Phys. Lett. A</source> <volume>305</volume>, <fpage>59</fpage>&#x2013;<lpage>69</lpage>. <pub-id pub-id-type="doi">10.1016/s0375-9601(02)01411-1</pub-id> </citation>
</ref>
<ref id="B70">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shockley</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Santana</surname>
<given-names>M.-V.</given-names>
</name>
<name>
<surname>Fowler</surname>
<given-names>C. a.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>Mutual Interpersonal Postural Constraints Are Involved in Cooperative Conversation</article-title>. <source>J. Exp. Psychol. Hum. Perception Perform.</source> <volume>29</volume>, <fpage>326</fpage>&#x2013;<lpage>332</lpage>. <pub-id pub-id-type="doi">10.1037/0096-1523.29.2.326</pub-id> </citation>
</ref>
<ref id="B71">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smith</surname>
<given-names>J. D.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Single-case Experimental Designs: A Systematic Review of Published Research and Current Standards</article-title>. <source>Psychol. Methods</source> <volume>17</volume>, <fpage>510</fpage>&#x2013;<lpage>550</lpage>. <pub-id pub-id-type="doi">10.1037/a0029312</pub-id> </citation>
</ref>
<ref id="B72">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stephen</surname>
<given-names>D. G.</given-names>
</name>
<name>
<surname>Dixon</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Isenhower</surname>
<given-names>R. W.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Dynamics of Representational Change: Entropy, Action, and Cognition</article-title>. <source>J. Exp. Psychol. Hum. Perception Perform.</source> <volume>35</volume>, <fpage>1811</fpage>&#x2013;<lpage>1832</lpage>. <pub-id pub-id-type="doi">10.1037/a0014510</pub-id> </citation>
</ref>
<ref id="B73">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Torre</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Wagenmakers</surname>
<given-names>E.-J.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Theories and Models for 1/f&#x3b2; Noise in Human Movement Science</article-title>. <source>Hum. Move. Sci.</source> <volume>28</volume>, <fpage>297</fpage>&#x2013;<lpage>318</lpage>. <pub-id pub-id-type="doi">10.1016/j.humov.2009.01.001</pub-id> </citation>
</ref>
<ref id="B74">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Trull</surname>
<given-names>T. J.</given-names>
</name>
<name>
<surname>Ebner-Priemer</surname>
<given-names>U. W.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Using Experience Sampling Methods/ecological Momentary Assessment (ESM/EMA) in Clinical Assessment and Clinical Research: Introduction to the Special Section</article-title>. <source>Psychol. Assess.</source> <volume>21</volume>, <fpage>457</fpage>&#x2013;<lpage>462</lpage>. <pub-id pub-id-type="doi">10.1037/a0017653</pub-id> </citation>
</ref>
<ref id="B75">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Van Borkulo</surname>
<given-names>C. D.</given-names>
</name>
<name>
<surname>Borsboom</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Epskamp</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Blanken</surname>
<given-names>T. F.</given-names>
</name>
<name>
<surname>Boschloo</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Schoevers</surname>
<given-names>R. A.</given-names>
</name>
<etal/>
</person-group> (<year>2014</year>). <article-title>A New Method for Constructing Networks from Binary Data</article-title>. <source>Sci. Rep.</source> <volume>4</volume>, <fpage>1</fpage>&#x2013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.1038/srep05918</pub-id> </citation>
</ref>
<ref id="B76">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vink</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Cillessen</surname>
<given-names>A. H.</given-names>
</name>
<name>
<surname>Wijnants</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Bosman</surname>
<given-names>A. M.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Does Competence Determine Who Leads in a Dyadic Cooperative Task? A Study of Children with and without a Neurodevelopmental Disorder</article-title>. <source>Complexity</source> <volume>2018</volume>. <pub-id pub-id-type="doi">10.1155/2018/5379531</pub-id> </citation>
</ref>
<ref id="B77">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wallot</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Hollis</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>van Rooij</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Connected Text reading and Differences in Text reading Fluency in Adult Readers</article-title>. <source>PLoS One</source> <volume>8</volume>, <fpage>e71914</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0071914</pub-id> </citation>
</ref>
<ref id="B78">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wallot</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Roepstorff</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>M&#xf8;nster</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Multidimensional Recurrence Quantification Analysis (MdRQA) for the Analysis of Multidimensional Time-Series: A Software Implementation in MATLAB and its Application to Group-Level Data in Joint Action</article-title>. <source>Front. Psychol.</source> <volume>7</volume>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.01835</pub-id> </citation>
</ref>
<ref id="B79">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Watts</surname>
<given-names>D. J.</given-names>
</name>
<name>
<surname>Strogatz</surname>
<given-names>S. H.</given-names>
</name>
</person-group> (<year>1998</year>). <article-title>Collective Dynamics of &#x27;small-World&#x27; Networks</article-title>. <source>Nature</source> <volume>393</volume>, <fpage>440</fpage>&#x2013;<lpage>442</lpage>. <pub-id pub-id-type="doi">10.1038/30918</pub-id> </citation>
</ref>
<ref id="B80">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Weinans</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Lever</surname>
<given-names>J. J.</given-names>
</name>
<name>
<surname>Bathiany</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Quax</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Bascompte</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>van Nes</surname>
<given-names>E. H.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>Finding the Direction of Lowest Resilience in Multivariate Complex Systems</article-title>. <source>J. R. Soc. Interf.</source> <volume>16</volume>, <fpage>20190629</fpage>. <pub-id pub-id-type="doi">10.1098/rsif.2019.0629</pub-id> </citation>
</ref>
<ref id="B81">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Weinans</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Quax</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>van Nes</surname>
<given-names>E. H.</given-names>
</name>
<name>
<surname>Leemputvan de</surname>
<given-names>I. A. v. d.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Evaluating the Performance of Multivariate Indicators of Resilience Loss</article-title>. <source>Sci. Rep.</source> <volume>11</volume>, <fpage>9148</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-021-87839-y</pub-id> </citation>
</ref>
<ref id="B82">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wichers</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Groot</surname>
<given-names>P. C.</given-names>
</name>
<name>
<surname>Psychosystems</surname>
<given-names>E. S. M. G. E. W. S. G.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Critical Slowing Down as a Personalized Early Warning Signal for Depression</article-title>. <source>Psychother Psychosom</source> <volume>85</volume>, <fpage>114</fpage>&#x2013;<lpage>116</lpage>. <pub-id pub-id-type="doi">10.1159/000441458</pub-id> </citation>
</ref>
<ref id="B83">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wigley</surname>
<given-names>T. M. L.</given-names>
</name>
<name>
<surname>Briffa</surname>
<given-names>K. R.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>P. D.</given-names>
</name>
</person-group> (<year>1984</year>). <article-title>On the Average Value of Correlated Time Series, with Applications in Dendroclimatology and Hydrometeorology</article-title>. <source>J. Clim. Appl. Meteorol.</source> <volume>23</volume>, <fpage>201</fpage>&#x2013;<lpage>213</lpage>. <pub-id pub-id-type="doi">10.1175/1520-0450(1984)023&#x3c;0201:OTAVOC&#x3e;2.0.CO;2</pub-id> </citation>
</ref>
<ref id="B84">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Wijnants</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Bosman</surname>
<given-names>A. M. T.</given-names>
</name>
<name>
<surname>Cox</surname>
<given-names>R. F. A.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Van Orden</surname>
<given-names>G. C.</given-names>
</name>
</person-group> (<year>2011</year>). &#x201c;<source>Nested Timescales of Motor Control : A Trade-Off Study</source>,&#x201d; in, eds. <person-group person-group-type="editor">
<name>
<surname>Charles</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Smart</surname>
<given-names>L. J.</given-names>
</name>
</person-group> (<publisher-name>Taylor &#x26; Francis Group, LLC</publisher-name>). </citation>
</ref>
<ref id="B85">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wijnants</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Hasselman</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Cox</surname>
<given-names>R. F. a.</given-names>
</name>
<name>
<surname>Bosman</surname>
<given-names>a. M. T.</given-names>
</name>
<name>
<surname>Van Orden</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>An Interaction-Dominant Perspective on reading Fluency and Dyslexia</article-title>. <source>Ann. Dyslexia</source> <volume>62</volume>, <fpage>100</fpage>&#x2013;<lpage>119</lpage>. <pub-id pub-id-type="doi">10.1007/s11881-012-0067-3</pub-id> </citation>
</ref>
<ref id="B86">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wright</surname>
<given-names>A. G. C.</given-names>
</name>
<name>
<surname>Woods</surname>
<given-names>W. C.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Personalized Models of Psychopathology</article-title>. <source>Annu. Rev. Clin. Psychol.</source> <volume>16</volume>, <fpage>49</fpage>&#x2013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-clinpsy-102419-125032</pub-id> </citation>
</ref>
<ref id="B87">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zbilut</surname>
<given-names>J. P.</given-names>
</name>
<name>
<surname>Giuliani</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Webber</surname>
<given-names>C. L.</given-names>
<suffix>Jr.</suffix>
</name>
</person-group> (<year>1998</year>). <article-title>Detecting Deterministic Signals in Exceptionally Noisy Environments Using Cross-Recurrence Quantification</article-title>. <source>Phys. Lett. A</source> <volume>246</volume>, <fpage>122</fpage>&#x2013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1016/S0375-9601(98)00457-5</pub-id> </citation>
</ref>
<ref id="B88">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zou</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Donner</surname>
<given-names>R. V.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Geometric and Dynamic Perspectives on Phase-Coherent and Noncoherent Chaos</article-title>. <source>Chaos</source> <volume>22</volume>, <fpage>013115</fpage>. <pub-id pub-id-type="doi">10.1063/1.3677367</pub-id> </citation>
</ref>
<ref id="B89">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zou</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Donner</surname>
<given-names>R. V.</given-names>
</name>
<name>
<surname>Marwan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Donges</surname>
<given-names>J. F.</given-names>
</name>
<name>
<surname>Kurths</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Complex Network Approaches to Nonlinear Time Series Analysis</article-title>. <source>Phys. Rep.</source> <volume>787</volume>, <fpage>1</fpage>&#x2013;<lpage>97</lpage>. <pub-id pub-id-type="doi">10.1016/j.physrep.2018.10.005</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>