<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<?covid-19-tdm?>
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="brief-report">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychiatry</journal-id>
<journal-title>Frontiers in Psychiatry</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychiatry</abbrev-journal-title>
<issn pub-type="epub">1664-0640</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyt.2021.788926</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychiatry</subject>
<subj-group>
<subject>Brief Research Report</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Exploring the Neuropsychiatric Sequalae of Perceived COVID-19 Exposure in College Students: A Pilot Digital Phenotyping Study</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Patel</surname> <given-names>Suraj K.</given-names></name>
<xref ref-type="author-notes" rid="fn001"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1503456/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Torous</surname> <given-names>John</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/308334/overview"/>
</contrib>
</contrib-group>
<aff><institution>The Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School</institution>, <addr-line>Boston, MA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Rosa M. Ba&#x000F1;os, University of Valencia, Spain</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Samma Faiz Rasool, Zhejiang University of Technology, China; Congyu Wu, University of Texas at Austin, United States; Gerard Anmella, Hospital Cl&#x000ED;nic de Barcelona, Spain</p></fn>
<corresp id="c001">&#x0002A;Correspondence: John Torous <email>jtorous&#x00040;bidmc.harvard.edu</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Digital Mental Health, a section of the journal Frontiers in Psychiatry</p></fn>
<fn fn-type="equal" id="fn002"><p>&#x02020;ORCID: Suraj K. Patel <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0002-6267-7223">orcid.org/0000-0002-6267-7223</ext-link></p></fn></author-notes>
<pub-date pub-type="epub">
<day>10</day>
<month>01</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>12</volume>
<elocation-id>788926</elocation-id>
<history>
<date date-type="received">
<day>03</day>
<month>10</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>13</day>
<month>12</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2022 Patel and Torous.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Patel and Torous</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract><p>The urgency to understand the long-term neuropsychiatric sequala of COVID-19, a part of the Post-Acute COVID-19 Syndrome (PACS), is expanding as millions of infected individuals experience new unexplained symptoms related to mood, anxiety, insomnia, headache, pain, and more. Much research on PACS involves cross sectional surveys which limits ability to understand the dynamic trajectory of this emerging phenomenon. In this secondary analysis, we analyzed data from a 4-week observational digital phenotyping study using the mindLAMP app for 695 college students with elevated stress who specified if they were exposed to COVID-19. Students also completed a biweekly survey of clinical assessments to obtain active data. Additionally, passive data streams like GPS, accelerometer, and screen state were extracted from phone sensors and through features the group built. Three hundred and eighty-second number participants successfully specified their COVID-19 exposure and completed the biweekly survey. From active smartphone data, we found significantly higher scores for the Prodromal Questionnaire (PQ) and the Pittsburgh Sleep Quality Index (PSQI) for students reporting exposure to COVID-19 compared to those who were not (<italic>p</italic>s &#x0003C; 0.05). Additionally, we found significantly decreased sleep duration as captured from the smartphone via passive data for the COVID-19 exposed group (<italic>p</italic> &#x0003C; 0.05). No significant differences were detected for other surveys or passive sensors. Smartphones can capture both self-reported symptoms and behavioral changes related to PACS. Our results around changes in sleep highlight how digital phenotyping methods can be used in a scalable and accessible manner toward better capturing the evolving phenomena of PACS. The present study further provides a foundation for future research to implement improving digital phenotyping methods.</p></abstract>
<kwd-group>
<kwd>COVID-19</kwd>
<kwd>smartphone application</kwd>
<kwd>psychosis</kwd>
<kwd>mood</kwd>
<kwd>students</kwd>
</kwd-group>
<counts>
<fig-count count="3"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="32"/>
<page-count count="8"/>
<word-count count="5344"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>As the neuropsychiatric sequalae of COVID-19 become clearer, the urgency to both better understand this cluster of symptoms and respond with scalable interventions expands. An April 2021 study from Lancet Psychiatry estimated a 33% incidence for neurological or psychiatric diagnosis in the following 6-months after COVID-19 exposure (<xref ref-type="bibr" rid="B1">1</xref>). Symptoms from Post-Acute COVID-19 Syndrome (PACS), popularly known as &#x0201C;long COVID,&#x0201D; include headache, anxiety, fatigue, and mood symptoms in addition to anosmia, insomnia, myalgia, dysgeusia, and weakness (<xref ref-type="bibr" rid="B2">2</xref>). New longitudinal research suggests symptoms vary in both severity and prevalence over time with fatigue and cognitive dysfunction as the most prominent symptoms (<xref ref-type="bibr" rid="B3">3</xref>). These diverse symptoms and their temporal dynamics thus require multimodal and longitudinal monitoring for which monitoring via smartphone mobile apps is well-suited.</p>
<p>Advantages of smartphone monitoring via digital phenotyping, the &#x0201C;moment-by-moment quantification of the individual-level human phenotype <italic>in situ</italic> using data from personal digital devices&#x0201D; for understanding PACS are highlighted when compared to cross sectional methods that are often employed instead today. Cross sectional methods are only able to detect self-reported symptoms at a certain time point and subject to retrospective recall which is especially of note given cognitive impairment is a common symptom of PACS. Given this is likely a longitudinal syndrome that is dynamic and changes with time and perhaps environment, it is thus not surprising that cross sectional reports are often conflicting. For example, some studies have found higher rates of depression (<xref ref-type="bibr" rid="B4">4</xref>) and anxiety (<xref ref-type="bibr" rid="B5">5</xref>) during the pandemic while some other have conflicting reports of sometimes even lower rates of depression (<xref ref-type="bibr" rid="B6">6</xref>) and anxiety (<xref ref-type="bibr" rid="B7">7</xref>, <xref ref-type="bibr" rid="B8">8</xref>) when comparing symptom rates from before the pandemic. Thus, cross-sectional data only paints a partial picture of how COVID-19 may affect symptomology.</p>
<p>Digital phenotyping methods instead allow data capture of repeated surveys but also continuous collection of sensors that be help inform behavioral, cognitive, and physiological symptoms as well. In prior research our team has shown how we can transform smartphone geolocation data into metrics related to home time, mobility patterns, and entropy; accelerometer into metrics related to sleep, sedentary, and activity periods; screen taps into metrics of memory and attention, and screen on/off logs into metrics of screen time. This multimodal data offers clear potential for understanding the evolving symptoms of PACS. Further, digital phenotyping methods allow to close gaps created by partial understanding of PACS from cross-sectional studies.</p>
<p>Among studying how COVID-19 affects various populations, young people are of important interest. Younger people may be at greater risks of the neuropsychiatric effects of COVID-19 because of how disruptive the pandemic has been to previously stable lifestyles, which could lead to greater rates of anxiety and depression (<xref ref-type="bibr" rid="B9">9</xref>). College students have also been found to generally display greater rates of anxiety, depression, and trouble sleeping (<xref ref-type="bibr" rid="B4">4</xref>). These mental health troubles may also contribute to decreased academic performance based on findings of associations between emotional self-regulation and greater academic performance during COVID-19 (<xref ref-type="bibr" rid="B10">10</xref>). However, as younger populations often also have the highest rates of smartphone ownership, they have a greater interest in using technology to better understand and improve their health.</p>
<p>In this study we aimed to explore if there are differences in psychiatric symptoms based on COVID-19 exposure in students using smartphones to capture two types of longitudinal data: active and passive. Passive data includes home time, sleep duration, and screen duration and is useful to study as decreased sleep, fatigue, and myalgia are known symptoms of PACS (<xref ref-type="bibr" rid="B3">3</xref>, <xref ref-type="bibr" rid="B11">11</xref>). In line with clinical reports and a passive data study using a wearable to estimate sleep (<xref ref-type="bibr" rid="B12">12</xref>), we hypothesize those exposed would sleep less on average and that we could detect this change now from smartphone passive data. As an exploratory hypothesis, we propose that people exposed to COVID-19 may have spent less time at home. As a control, we propose that total screen duration should not be associated with COVID-19 exposure status as there is no clear literature that use of technology is any greater or less based on exposure.</p>
<p>Overall, the objective of this study is to examine how traditional survey and novel digital phenotyping methods can be used to understand the difference in neuropsychiatric symptoms based on perceived COVID-19 exposure. Literature has shown how symptoms associated with PACS may be related to COVID-19 exposure, thus this study will further highlight how current and future studies can implement similar methods and expand upon usage of current digital phenotyping techniques. This will allow for practitioners and researchers alike to be exposed to more comprehensive approaches for implementing and understanding contemporary mental health care.</p>
</sec>
<sec sec-type="methods" id="s2">
<title>Methods</title>
<p>The present study is a secondary analysis of a digital phenotyping of college students, which used the opensource mindLAMP app. The app is under regular development and maintains quality and stability checks for both iPhone and Android versions on a bi-weekly basis. From November 2020 to May 2021, 695 college students were recruited for a 4-week study through university Reddit forums to use the mindLAMP app to take daily and bi-weekly surveys about their mental health for $50 over the study. Six hundred and twelfth number students successfully went on to use the app. Recruitment was through online advertisements for a paid mental health study for college students. Recruited students then took an enrollment survey through REDCap of the Perceived Stress Scale (PSS) (<xref ref-type="bibr" rid="B13">13</xref>). Additionally, the enrollment survey included a demographic questionnaire with the following question to specify if they were exposed to or unsure of COVID-19 exposure: &#x0201C;<italic>Have you had COVID-19?&#x0201D;</italic>, to which participants could respond &#x0201C;Yes,&#x0201D; &#x0201C;No,&#x0201D; and &#x0201C;Unsure, but I think so.&#x0201D; Eligibility criteria consisted of (1) fluency in English, (2) ownership either of a capable iPhone or Android smartphone to run the study app, (3) college student verification with a college email and student ID card, and (4) a PSS score of 14 or higher. PSS reports of 14 or higher indicate at least moderate stress. The PSS threshold was used to screen for students who were already at elevated levels of stress to exclude healthy students which could skew results of average reports for stressed students. Of the 612 participants, 507 completed their weekly surveys. Of the 507 participants with survey data, 382 had responded to the COVID-19 exposure question and were included for the present study&#x00027;s analysis.</p>
<sec>
<title>Measures</title>
<sec>
<title>Active Data/Surveys</title>
<p>Enrolled students received a daily survey of 11 items with questions from various gold standard clinical assessments to gauge their mental health on an everyday basis. The assessments drawn from are the Patient Health Questionnaire (PHQ-9), the General Anxiety Disorder 7 questionnaire (GAD-7), the Prodromal Questionnaire (PQ), and the PSS. Participants also received a longer bi-weekly survey which included full-length assessments for the PHQ-9, the GAD-7, the PSS, the UCLA Loneliness scale, the PQ, the Pittsburgh Sleep Quality Index (PSQI), and the Digital Working Alliance Inventory (D-WAI). The bi-weekly survey data was used for analyses.</p>
<p>The selected surveys were chosen for various relevant reasons. The PHQ-9 and GAD-7 are often used as assessments for mood and anxiety, respectively, which as often cited as elevated in COVID-19 patients and during the overall pandemic. The PQ is used to detect early onset psychotic symptoms, as psychotic symptoms have been seen manifesting in COVID-19-related conditions (<xref ref-type="bibr" rid="B14">14</xref>). The PSQI is used a self-report sleep measure that is often cited in COVID-19 symptoms (<xref ref-type="bibr" rid="B15">15</xref>). The UCLA Loneliness scale measures reports of loneliness that could result from social isolation faced during quarantine (<xref ref-type="bibr" rid="B4">4</xref>). Lastly, the D-WAI was used as a quality metric to assess participant interactions with the mindLAMP app (<xref ref-type="bibr" rid="B16">16</xref>).</p>
</sec>
<sec>
<title>Passive Data/Sensors</title>
<p>Passive sensor data was also collected for the duration of the study. Accepted permissions for phone sensors like GPS, screen duration, and motion are referred to as raw features. This passive data was then used to create various markers for analysis through mindLAMP&#x00027;s regularly updated data analysis pipeline, Cortex which is freely available at <ext-link ext-link-type="uri" xlink:href="https://github.com/BIDMCDigitalPsychiatry/LAMP-cortex">https://github.com/BIDMCDigitalPsychiatry/LAMP-cortex</ext-link>. Primary features, for example, include &#x0201C;Significant Locations,&#x0201D; which processes raw GPS data and groups data points together into weighted traveled regions of significance. This data was then further developed into secondary features like home time, which buckets Significant Locations by the specified resolution and determines the amount of time an individual spent at home within that time window. The present study looks at the passive features of home time, sleep duration, and screen duration. Sleep duration was a feature created by making an optimal sleep window by finding the 8-h period within the overnight interval [18:00, 10:00] which minimized accelerometer activity across all nights of their participation. To estimate nightly sleep durations, the optimal window was adjusted based on the accelerometer activity for the specific night. Screen duration was computed using accelerometer/motion and screen state data from the inherent smartphone metric by summing the bouts of time where the phone went from being in the &#x0201C;on&#x0201D; to the &#x0201C;off&#x0201D; state.</p>
</sec>
<sec>
<title>Analysis</title>
<p>All statistical analyses and visualizations were carried out using the R (version 4.1.1) packages &#x0201C;<italic>psych</italic>&#x0201D; (<xref ref-type="bibr" rid="B17">17</xref>), and &#x0201C;<italic>ggplot2</italic>&#x0201D; (<xref ref-type="bibr" rid="B18">18</xref>). Participants were split into groups based on COVID-19 exposure from the screening survey, with one group consisting of students who were not exposed to COVID-19 and another group for students who were either exposed to COVID-19 or were unsure if they were exposed or not. These two groups had their biweekly survey scores compared from an individual survey level. Averages for the entries each participant completed were taken from the biweekly surveys and then stratified based on each individual survey the biweekly survey was composed of. Survey averages were normalized to be put on the same scale since individual surveys differed in length. A series of two-sample <italic>t</italic>-tests were carried out to compare individual surveys between COVID-19 exposure groups. For passive data, sensor means based on COVID-19 exposure were compared.</p>
</sec>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>Of the 382 participants, 237 (62%) identified as female and 133 (35%) identified as male, with 11 (3%) reporting identification as a different gender identity After testing for differences in each individual survey based on perceived COVID-19 exposure, the exposed group (M = 11.82, SD = 11.53) compared to the non-exposed groups (M = 8.67, SD = 8.69) had significantly higher PQ-16 scores, <italic>t</italic><sub>(380)</sub> = 2.34, <italic>p</italic> &#x0003C; 0.05. In addition, it was found that the exposed group (M = 7.13, SD = 4.26) compared to the non-exposed groups (M = 5.84, SD = 3.82) had significantly higher PSQI scores, <italic>t</italic><sub>(380)</sub> = 2.27, <italic>p</italic> &#x0003C; 0.05. See <xref ref-type="fig" rid="F1">Figure 1</xref> for visual comparison of all surveys between exposure groups. Significantly different survey scores are starred.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Average individual survey scores from larger biweekly survey based on COVID-19 exposure groups. As the app offered daily surveys similar to the larger assessments, &#x0201C;_W&#x0201D; at the end of each survey indicates the survey being a part of the biweekly survey. &#x0002A;refers to <italic>p</italic> &#x0003C; 0.05.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyt-12-788926-g0001.tif"/>
</fig>
<p>After further question level breakdown, we found significantly greater scores based on perceived COVID-19 exposure in the PQ-16 for the following items coded based on the symptom being assessed (<italic>p</italic>s &#x0003C; 0.05): &#x0201C;Smell/Taste,&#x0201D; &#x0201C;Sounds,&#x0201D; &#x0201C;Reality,&#x0201D; &#x0201C;Seeing things,&#x0201D; &#x0201C;Thoughts,&#x0201D; &#x0201C;Meaning,&#x0201D; &#x0201C;Distracting Sounds.&#x0201D; See <xref ref-type="fig" rid="F2">Figure 2</xref> for a graphical depiction of average question scores by exposure group with significant symptoms starred.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Average PQ-16 question scores based on exposure groups. Labels are coded based on the symptom being assessed. &#x0002A; refers to <italic>p</italic> &#x0003C; 0.05 and &#x0002A;&#x0002A; refers to <italic>p</italic> &#x0003C; 0.001.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyt-12-788926-g0002.tif"/>
</fig>
<p>Question level breakdown for the PSQI showed significant differences based on perceived COVID-19 exposure for the following items coded based on the symptoms the question assessed (<italic>p</italic>s &#x0003C; 0.05): &#x0201C;Restless,&#x0201D; &#x0201C;Waking up,&#x0201D; &#x0201C;Breathing,&#x0201D; &#x0201C;Cough/Snore,&#x0201D; &#x0201C;Bad dreams,&#x0201D; &#x0201C;Tired.&#x0201D; See <xref ref-type="fig" rid="F3">Figure 3</xref> for a graphical depiction of average question scores by exposure group with significant symptoms starred. Additionally, see <xref ref-type="table" rid="T1">Table 1</xref> for all <italic>t</italic>-test statistics for both PQ-16 and PSQI related analyses.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Average PSQI question scores based on exposure groups. Labels are coded based on the symptom being assessed. &#x0002A; refers to <italic>p</italic> &#x0003C; 0.05 and &#x0002A;&#x0002A; refers to <italic>p</italic> &#x0003C; 0.001.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyt-12-788926-g0003.tif"/>
</fig>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Comprehensive results for all t-tests for individual question breakdowns for PQ16 and PSQI.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="left"><bold>Code</bold></th>
<th valign="top" align="left"><bold>Question</bold></th>
<th valign="top" align="center"><bold>COVID-19 exposed</bold></th>
<th valign="top" align="center"><bold>COVID-19 not exposed</bold></th>
<th valign="top" align="left"><bold><italic>t</italic></bold></th>
<th valign="top" align="left"><bold><italic>P</italic></bold></th>
<th valign="top" align="center" colspan="2"><bold>95% CI</bold></th>
</tr>
<tr>
<th/>
<th/>
<th/>
<th/>
<th/>
<th/>
<th/>
<th valign="top" align="left"><bold>Lower bound</bold></th>
<th valign="top" align="left"><bold>Upper bound</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">PQ16</td>
<td valign="top" align="left">Uninterested</td>
<td valign="top" align="left"><italic>I feel uninterested in the things I used to enjoy</italic></td>
<td valign="top" align="left">1.01 (1.29)</td>
<td valign="top" align="left">1.03 (1.26)</td>
<td valign="top" align="left">&#x02212;0.14</td>
<td valign="top" align="left">0.56</td>
<td valign="top" align="left">&#x02212;0.33</td>
<td valign="top" align="left">0.28</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Deja Vu</td>
<td valign="top" align="left"><italic>I often seem to live through events exactly as they happened before</italic>.</td>
<td valign="top" align="left">1.31 (1.32)</td>
<td valign="top" align="left">1.09 (1.26)</td>
<td valign="top" align="left">1.17</td>
<td valign="top" align="left">0.12</td>
<td valign="top" align="left">&#x02212;0.09</td>
<td valign="top" align="left">0.53</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Smell/Taste</td>
<td valign="top" align="left"><italic>I sometimes smell or taste things that other people can&#x00027;t smell or taste</italic>.</td>
<td valign="top" align="left">0.50 (0.99)</td>
<td valign="top" align="left">0.26 (0.70)</td>
<td valign="top" align="left">2.22</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.06</td>
<td valign="top" align="left">0.43</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Sounds</td>
<td valign="top" align="left"><italic>I often hear unusual sounds like banging, clicking, hissing, clapping or ringing in my ears</italic>.</td>
<td valign="top" align="left">0.75 (1.16)</td>
<td valign="top" align="left">0.49 (1.01)</td>
<td valign="top" align="left">1.73</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.01</td>
<td valign="top" align="left">0.51</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Reality</td>
<td valign="top" align="left"><italic>I have been confused at times whether something I experienced was real or imaginary</italic>.</td>
<td valign="top" align="left">0.42 (0.97)</td>
<td valign="top" align="left">0.11 (0.47)</td>
<td valign="top" align="left">3.68</td>
<td valign="top" align="left">&#x0003C;0.001<xref ref-type="table-fn" rid="TN2"><sup>&#x0002A;&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.16</td>
<td valign="top" align="left">0.64</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Hallucination</td>
<td valign="top" align="left"><italic>When I look at a person, or look at myself in a mirror, I have seen the face change right before my eyes</italic>.</td>
<td valign="top" align="left">0.24 (0.80)</td>
<td valign="top" align="left">0.13 (0.52)</td>
<td valign="top" align="left">1.39</td>
<td valign="top" align="left">0.08</td>
<td valign="top" align="left">&#x02212;0.02</td>
<td valign="top" align="left">0.25</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Meeting anxiety</td>
<td valign="top" align="left"><italic>I get extremely anxious when meeting people for the first time</italic>.</td>
<td valign="top" align="left">1.46 (1.35)</td>
<td valign="top" align="left">1.39 (1.42)</td>
<td valign="top" align="left">0.21</td>
<td valign="top" align="left">0.42</td>
<td valign="top" align="left">&#x02212;0.29</td>
<td valign="top" align="left">0.38</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Seeing things</td>
<td valign="top" align="left"><italic>I have seen things that other people apparently can&#x00027;t see</italic>.</td>
<td valign="top" align="left">0.38 (0.90)</td>
<td valign="top" align="left">0.12 (0.51)</td>
<td valign="top" align="left">3.14</td>
<td valign="top" align="left">&#x0003C;0.001<xref ref-type="table-fn" rid="TN2"><sup>&#x0002A;&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.13</td>
<td valign="top" align="left">0.41</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Thoughts</td>
<td valign="top" align="left"><italic>My thoughts are sometimes so strong that I can almost hear them</italic>.</td>
<td valign="top" align="left">0.87 (1.26)</td>
<td valign="top" align="left">0.55 (1.01)</td>
<td valign="top" align="left">2.06</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.06</td>
<td valign="top" align="left">0.57</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Meaning</td>
<td valign="top" align="left"><italic>I sometimes see special meanings in advertisements, shop windows, or in the way things are arranged around me</italic>.</td>
<td valign="top" align="left">0.84 (1.21)</td>
<td valign="top" align="left">0.48 (0.95)</td>
<td valign="top" align="left">2.47</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.12</td>
<td valign="top" align="left">0.6</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Control</td>
<td valign="top" align="left"><italic>Sometimes I have felt that I&#x00027;m not in control of my own ideas or thoughts</italic>.</td>
<td valign="top" align="left">0.84 (1.17)</td>
<td valign="top" align="left">0.67 (1.11)</td>
<td valign="top" align="left">1.04</td>
<td valign="top" align="left">0.15</td>
<td valign="top" align="left">&#x02212;0.09</td>
<td valign="top" align="left">0.44</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Distracting sounds</td>
<td valign="top" align="left"><italic>Sometimes I feel suddenly distracted by distant sounds that I am not normally aware of</italic></td>
<td valign="top" align="left">0.95 (1.26)</td>
<td valign="top" align="left">0.69 (1.11)</td>
<td valign="top" align="left">1.55</td>
<td valign="top" align="left">0.06</td>
<td valign="top" align="left">&#x02212;0.02</td>
<td valign="top" align="left">0.53</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Voices</td>
<td valign="top" align="left"><italic>I have heard things other people can&#x00027;t hear like voices of people whispering or talking</italic>.</td>
<td valign="top" align="left">0.84 (1.21)</td>
<td valign="top" align="left">0.44 (0.93)</td>
<td valign="top" align="left">2.79</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.17</td>
<td valign="top" align="left">0.45</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Paranoia</td>
<td valign="top" align="left"><italic>I often feel that others have it in for me</italic>.</td>
<td valign="top" align="left">0.29 (0.76)</td>
<td valign="top" align="left">0.30 (0.79)</td>
<td valign="top" align="left">&#x02212;0.13</td>
<td valign="top" align="left">0.55</td>
<td valign="top" align="left">&#x02212;0.2</td>
<td valign="top" align="left">0.18</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Nearby</td>
<td valign="top" align="left"><italic>I have had the sense that some person or force is around me, even though I could not see anyone</italic>.</td>
<td valign="top" align="left">0.41 (0.85)</td>
<td valign="top" align="left">0.35 (0.86)</td>
<td valign="top" align="left">0.52</td>
<td valign="top" align="left">0.3</td>
<td valign="top" align="left">&#x02212;0.14</td>
<td valign="top" align="left">0.27</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Body</td>
<td valign="top" align="left"><italic>I feel that parts of my body have changed in some way, or that parts of my body are working differently than before</italic>.</td>
<td valign="top" align="left">0.69 (1.11)</td>
<td valign="top" align="left">0.55 (1.00)</td>
<td valign="top" align="left">0.99</td>
<td valign="top" align="left">0.16</td>
<td valign="top" align="left">&#x02212;0.1</td>
<td valign="top" align="left">0.39</td>
</tr>
<tr>
<td valign="top" align="left">PSQI</td>
<td valign="top" align="left">Restless</td>
<td valign="top" align="left"><italic>How often is it that you cannot get to sleep within 30 min</italic></td>
<td valign="top" align="left">1.48 (1.08)</td>
<td valign="top" align="left">1,22 (0.99)</td>
<td valign="top" align="left">1.74</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.01</td>
<td valign="top" align="left">0.49</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Waking up</td>
<td valign="top" align="left"><italic>How often is it that you wake up in the middle of the night or early morning</italic>,</td>
<td valign="top" align="left">1.40 (0.99)</td>
<td valign="top" align="left">1.13 (0.96)</td>
<td valign="top" align="left">1.88</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.33</td>
<td valign="top" align="left">0.5</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Breathing</td>
<td valign="top" align="left"><italic>How often have you had trouble sleeping because you cannot breathe comfortably</italic></td>
<td valign="top" align="left">0.49 (0.75)</td>
<td valign="top" align="left">0.32 (0.62)</td>
<td valign="top" align="left">1.85</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.02</td>
<td valign="top" align="left">0.33</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Cough/Snore</td>
<td valign="top" align="left"><italic>How often have you had trouble sleeping because you cough or snore loudly</italic></td>
<td valign="top" align="left">0.27 (0.58)</td>
<td valign="top" align="left">0.09 (0.26)</td>
<td valign="top" align="left">2.98</td>
<td valign="top" align="left">&#x0003C;0.001<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">0.08</td>
<td valign="top" align="left">0.27</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Hot</td>
<td valign="top" align="left"><italic>How often have you had trouble sleeping because you feel too hot</italic></td>
<td valign="top" align="left">0.86 (0.77)</td>
<td valign="top" align="left">0.72 (0.73)</td>
<td valign="top" align="left">1.29</td>
<td valign="top" align="left">0.09</td>
<td valign="top" align="left">&#x02212;0.04</td>
<td valign="top" align="left">0.32</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Bad dreams</td>
<td valign="top" align="left"><italic>How often have you had trouble sleeping because you have bad dreams</italic></td>
<td valign="top" align="left">0.55 (0.71)</td>
<td valign="top" align="left">0.39 (0.63)</td>
<td valign="top" align="left">1.73</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">&#x0003C;0.01</td>
<td valign="top" align="left">0.32</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Pain</td>
<td valign="top" align="left"><italic>How often have you had trouble sleeping because you have pain</italic></td>
<td valign="top" align="left">0.40 (0.57)</td>
<td valign="top" align="left">0.33 (0.59)</td>
<td valign="top" align="left">0.84</td>
<td valign="top" align="left">0.19</td>
<td valign="top" align="left">&#x02212;0.07</td>
<td valign="top" align="left">0.22</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Tired</td>
<td valign="top" align="left"><italic>During the past week, how often have you had trouble staying awake while driving, eating meals, or engaging in social activity?</italic></td>
<td valign="top" align="left">0.48 (0.59)</td>
<td valign="top" align="left">0.35 (0.56)</td>
<td valign="top" align="left">1.65</td>
<td valign="top" align="left">&#x0003C;0.05<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="left">&#x0003C;0.01</td>
<td valign="top" align="left">0.27</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">Mood</td>
<td valign="top" align="left"><italic>During the past week, how much of a problem has it been for you to keep up enthusiasm to get things done?</italic></td>
<td valign="top" align="left">1.19 (0.85)</td>
<td valign="top" align="left">1.30 (0.92)</td>
<td valign="top" align="left">&#x02212;0.77</td>
<td valign="top" align="left">0.78</td>
<td valign="top" align="left">&#x02212;0.32</td>
<td valign="top" align="left">0.12</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>Formatting for Group Statistics are Mean (Standard Deviation).</italic></p>
<fn id="TN1"><label>&#x0002A;</label><p><italic>Indicates p &#x0003C; 0.05,</italic></p></fn> 
<fn id="TN2"><label>&#x0002A;&#x0002A;</label> <p><italic>indicates p &#x0003C; 0.001</italic>.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>For passive data, average sleep duration differed between groups based on COVID-19 exposure, with students who had been or were unsure of their exposure had a lower average sleep duration in hours (M = 6.77, SD = 1.54) than students who were not exposed (M = 7.25, SD = 1.60), <italic>t</italic><sub>(425)</sub> = &#x02212;2.11, <italic>p</italic> &#x0003C; 0.05 Differences in home time and screen duration were not significantly different across exposure groups (<italic>p</italic> &#x0003E; 0.05).</p>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>Using digital phenotyping methods to collect longitudinal data in 382 college students for &#x0007E;30 days, we showed significant differences in passive data sleep duration and self-reported sleep and psychosis assessments among self-reported COVID-19 exposed students as compared to unexposed. These results around sleep and psychosis also match ongoing research and suggest how passive data may complement clinical characterization and offer potentially useful data toward understanding symptoms and functional outcomes related to illness.</p>
<p>The combination of active and passive sensor capture smartphone apps may help elucidate how COVID-19 exposure affects both mental and physical health. For example, our results around both subjective and more objective measures related to sleep offer the ability to examine different facets of people&#x00027;s experience of the illness. While correlational, the finding that those with self-reported exposure had shortened sleep duration as measured by the smartphone sensors and reported significant differences around cough and breathing with sleep suggest targets for a next phase of longitudinal and mechanistic focused research. Our lack of significant results in other domains such as mood is also notable as the personal nature of smartphone data capture enables examination of the intra-individual correlations and trajectories of illness. The challenges in characterizing PACS may be that certain aspects of the syndrome are common (e.g., sleep) while others are more variable and will require a digital phenotyping approach to find longitudinal clusters among patients.</p>
<p>Our results are in line with ongoing research on PACS around sleep. Active data smartphone surveys results found that sleep disturbances with individuals who perceived they were exposed to COVID-19 reported lower quality sleep and their passive data correlates supporting these results with a shorter sleep duration average of &#x0007E;30 min. Similar changes in sleep have been noted in other research such as Huang et al. (<xref ref-type="bibr" rid="B19">19</xref>) reporting survey results of coughing and trouble breathing while sleeping, with a follow up study finding these symptoms persist after COVID-19 exposure (<xref ref-type="bibr" rid="B20">20</xref>). Other studies have also found self-reports of sleep have also reported greater rates of insomnia and breathing issues tied to sleep disturbances (<xref ref-type="bibr" rid="B21">21</xref>, <xref ref-type="bibr" rid="B22">22</xref>). Our findings around sleep passive data are also in line with previous findings of PACS being associated with lower sleep quality where studies finding fatigue and sleep disturbances as prominent among PACS patients (<xref ref-type="bibr" rid="B23">23</xref>). Sleep related findings persist in other countries as well, which find decreased sleep quality as part of COVID-19&#x00027;s sequalae symptoms (<xref ref-type="bibr" rid="B24">24</xref>).</p>
<p>In this study we asked questions about prodromal psychosis with the PQ-16. There have been case reports of psychosis associated with COVID-19 and ongoing research suggests the syndrome may be associated with symptoms similar to those prodromal psychosis such as delirium and delusions (<xref ref-type="bibr" rid="B25">25</xref>, <xref ref-type="bibr" rid="B26">26</xref>). Elevated prodromal scores may stem from stress and fear of the pandemic, which may be associated with the greater rates of self-reported psychotic symptoms. The ability of the smartphone platform to capture these symptoms may allow for new investigations on this evolving aspect of the syndrome.</p>
<p>In contrast to our hypothesis, students who reported exposure to COVID-19 did not spend less time at home an average than those not exposed. This could be because the public has been generally quarantining during the pandemic and because those exposed to COVID-19 may be at home as often as average as those not exposed because of subsequent quarantining after exposure. Our data and study is not designed to explore causality so we caution any further interpretation.</p>
<p>As proposed, our control found differences in screen time between exposure groups. While screen time has been found to be elevated during the COVID-19 pandemic due to lockdown including social isolation and greater rates of time spent at home (<xref ref-type="bibr" rid="B27">27</xref>), screen exposure rates may be the same regardless of condition. Other research has found that screen time has become increasingly less useful as metric of understanding mental and physical health since the rapid adoption of technology causing screen time to be high universally among populations, especially youths (<xref ref-type="bibr" rid="B28">28</xref>). Additionally, we did not find elevated scores in the most common mental health assessments, such as the PHQ-9 and GAD-7. These are symptoms that have often been found to be elevated during the pandemic [(<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B29">29</xref>)]. However, this finding is possible because the present study screened for students who were already of elevated stress levels.</p>
<p>Regardless, understanding COVID-19&#x00027;s sequalae remains a challenging and evolving question. However, smartphone-based passive data could play a key role in shedding light on this condition. Previous studies investigating passive data during COVID-19 have found similar results to our own. One study using smartwatch wearable passive data where average sleep in minutes was found to be decreased between pre- and post-lockdown (<xref ref-type="bibr" rid="B12">12</xref>), while another study also using smartwatch wearables found sleep differences between COVID-19 positive and negative individuals (<xref ref-type="bibr" rid="B30">30</xref>). While these studies support our sleep findings, our study presents a more accessible method of collecting passive data through smartphones vs. smartwatch wearables, as only 1 in 5 of Americans have found to own smartwatches or fitness trackers (<xref ref-type="bibr" rid="B31">31</xref>) while 85% own a smartphone (<xref ref-type="bibr" rid="B31">31</xref>, <xref ref-type="bibr" rid="B32">32</xref>).</p>
<sec>
<title>Limitations and Future Directions</title>
<p>Our findings also present several limitations. Exposure to COVID was self-reported and not verified. Our sample was recruited from college students via the internet and thus there is a selection bias in who may have responded and agreed to partake in this work. While we studied students for &#x0007E;1 month, this duration itself is likely too short to capture the trajectory of long-COVID which makes our results more exploratory in nature. Additionally, while the app in use is under consistent development and quality checks, digital phenotyping is readily evolving field and poses the question of what better methods could be used to measure the studied features.</p>
</sec>
</sec>
<sec sec-type="conclusions" id="s5">
<title>Conclusions</title>
<p>Using novel digital phenotyping methods, the present study offers supporting evidence of ongoing research regarding PACS, finding greater levels of sleep disturbances among college students. Additionally, these methods and analyses provide an example for future and larger scale studies.</p>
</sec>
<sec sec-type="data-availability" id="s6">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.</p>
</sec>
<sec id="s7">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Beth Israel Deaconess Medical Center. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="s8">
<title>Author Contributions</title>
<p>All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taquet</surname> <given-names>M</given-names></name> <name><surname>Geddes</surname> <given-names>JR</given-names></name> <name><surname>Husain</surname> <given-names>M</given-names></name> <name><surname>Luciano</surname> <given-names>S</given-names></name> <name><surname>Harrison</surname> <given-names>PJ</given-names></name></person-group>. <article-title>6-month neurological and psychiatric outcomes in 236 379 survivors of COVID-19: a retrospective cohort study using electronic health records</article-title>. <source>Lancet Psychiatry.</source> (<year>2021</year>) <volume>8</volume>:<fpage>416</fpage>&#x02013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1016/S2215-0366(21)00084-5</pub-id><pub-id pub-id-type="pmid">33836148</pub-id></citation></ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wildwing</surname> <given-names>T</given-names></name> <name><surname>Holt</surname> <given-names>N</given-names></name></person-group>. <article-title>The neurological symptoms of COVID-19: a systematic overview of systematic reviews, comparison with other neurological conditions and implications for healthcare services</article-title>. <source>Therap Adv Chronic Dis.</source> (<year>2021</year>) <volume>12</volume>:<fpage>2040622320976979</fpage>. <pub-id pub-id-type="doi">10.1177/2040622320976979</pub-id><pub-id pub-id-type="pmid">33796241</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Davis</surname> <given-names>HE</given-names></name> <name><surname>Assaf</surname> <given-names>GS</given-names></name> <name><surname>McCorkell</surname> <given-names>L</given-names></name> <name><surname>Wei</surname> <given-names>H</given-names></name> <name><surname>Low</surname> <given-names>RJ</given-names></name> <name><surname>Re&#x00027;em</surname> <given-names>Y</given-names></name> <etal/></person-group>. <article-title>Characterizing long COVID in an international cohort: 7 months of symptoms and their impact</article-title>. <source>EClinicalMedicine</source>. (<year>2021</year>) <volume>38</volume>:<fpage>101019</fpage>. <pub-id pub-id-type="doi">10.1016/j.eclinm.2021.101019</pub-id><pub-id pub-id-type="pmid">34308300</pub-id></citation></ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>X</given-names></name> <name><surname>Hegde</surname> <given-names>S</given-names></name> <name><surname>Son</surname> <given-names>C</given-names></name> <name><surname>Keller</surname> <given-names>B</given-names></name> <name><surname>Smith</surname> <given-names>A</given-names></name> <name><surname>Sasangohar</surname> <given-names>F</given-names></name></person-group>. <article-title>Investigating mental health of US college students during the COVID-19 pandemic: cross-sectional survey study</article-title>. <source>J Med Internet Res.</source> (<year>2020</year>) <volume>22</volume>:<fpage>e22817</fpage>. <pub-id pub-id-type="doi">10.2196/22817</pub-id><pub-id pub-id-type="pmid">32897868</pub-id></citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kibbey</surname> <given-names>MM</given-names></name> <name><surname>Fedorenko</surname> <given-names>EJ</given-names></name> <name><surname>Farris</surname> <given-names>SG</given-names></name></person-group>. <article-title>Anxiety, depression, and health anxiety in undergraduate students living in initial US outbreak hotspot during COVID-19 pandemic</article-title>. <source>Cogn Behav Ther.</source> (<year>2021</year>) <volume>50</volume>:<fpage>409</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1080/16506073.2020.1853805</pub-id><pub-id pub-id-type="pmid">33433271</pub-id></citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horita</surname> <given-names>R</given-names></name> <name><surname>Nishio</surname> <given-names>A</given-names></name> <name><surname>Yamamoto</surname> <given-names>M</given-names></name></person-group>. <article-title>The effect of remote learning on the mental health of first year university students in Japan</article-title>. <source>Psychiatry Res.</source> (<year>2021</year>) <volume>295</volume>:<fpage>113561</fpage>. <pub-id pub-id-type="doi">10.1016/j.psychres.2020.113561</pub-id><pub-id pub-id-type="pmid">33223271</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deng</surname> <given-names>CH</given-names></name> <name><surname>Wang</surname> <given-names>JQ</given-names></name> <name><surname>Zhu</surname> <given-names>LM</given-names></name> <name><surname>Liu</surname> <given-names>HW</given-names></name> <name><surname>Guo</surname> <given-names>Y</given-names></name> <name><surname>Peng</surname> <given-names>XH</given-names></name> <etal/></person-group>. <article-title>Association of web-based physical education with mental health of college students in wuhan during the COVID-19 outbreak: cross-sectional survey study</article-title>. <source>J Med Internet Res.</source> (<year>2020</year>) <volume>22</volume>:<fpage>e21301</fpage>. <pub-id pub-id-type="doi">10.2196/21301</pub-id><pub-id pub-id-type="pmid">32997639</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wathelet</surname> <given-names>M</given-names></name> <name><surname>Duhem</surname> <given-names>S</given-names></name> <name><surname>Vaiva</surname> <given-names>G</given-names></name> <name><surname>Baubet</surname> <given-names>T</given-names></name> <name><surname>Habran</surname> <given-names>E</given-names></name> <name><surname>Veerapa</surname> <given-names>E</given-names></name> <etal/></person-group>. <article-title>Factors associated with mental health disorders among university students in France confined during the COVID-19 pandemic</article-title>. <source>JAMA Network Open.</source> (<year>2020</year>) <volume>3</volume>:<fpage>e2025591</fpage>. <pub-id pub-id-type="doi">10.1001/jamanetworkopen.2020.25591</pub-id><pub-id pub-id-type="pmid">33095252</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>F</given-names></name> <name><surname>Zheng</surname> <given-names>D</given-names></name> <name><surname>Liu</surname> <given-names>J</given-names></name> <name><surname>Gong</surname> <given-names>Y</given-names></name> <name><surname>Guan</surname> <given-names>Z</given-names></name> <name><surname>Lou</surname> <given-names>D</given-names></name></person-group>. <article-title>Depression and anxiety among adolescents during COVID-19: a cross-sectional study</article-title>. <source>Brain Behav Immun.</source> (<year>2020</year>) <volume>88</volume>:<fpage>36</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbi.2020.05.061</pub-id><pub-id pub-id-type="pmid">34609316</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iqbal</surname> <given-names>J</given-names></name> <name><surname>Qureshi</surname> <given-names>N</given-names></name> <name><surname>Ashraf</surname> <given-names>MA</given-names></name> <name><surname>Rasool</surname> <given-names>SF</given-names></name> <name><surname>Asghar</surname> <given-names>MZ</given-names></name></person-group>. <article-title>The effect of emotional intelligence and academic social networking sites on academic performance during the COVID-19 pandemic</article-title>. <source>Psychol Res Behav Manage.</source> (<year>2021</year>) <volume>14</volume>:<fpage>905</fpage>&#x02013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.2147/PRBM.S316664</pub-id><pub-id pub-id-type="pmid">34234587</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sykes</surname> <given-names>DL</given-names></name> <name><surname>Holdsworth</surname> <given-names>L</given-names></name> <name><surname>Jawad</surname> <given-names>N</given-names></name> <name><surname>Gunasekera</surname> <given-names>P</given-names></name> <name><surname>Morice</surname> <given-names>AH</given-names></name> <name><surname>Crooks</surname> <given-names>MG</given-names></name></person-group>. <article-title>Post-COVID-19 symptom burden: what is long-COVID and how should we manage it?</article-title> <source>Lung.</source> (<year>2021</year>) <volume>199</volume>:<fpage>113</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1007/s00408-021-00423-z</pub-id><pub-id pub-id-type="pmid">33569660</pub-id></citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leightley</surname> <given-names>D</given-names></name> <name><surname>Lavelle</surname> <given-names>G</given-names></name> <name><surname>White</surname> <given-names>KM</given-names></name> <name><surname>Sun</surname> <given-names>S</given-names></name> <name><surname>Matcham</surname> <given-names>F</given-names></name> <name><surname>Ivan</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Investigating the impact of COVID-19 lockdown on adults with a recent history of recurrent major depressive disorder: a multi-Centre study using remote measurement technology</article-title>. <source>BMC Psychiatry.</source> (<year>2021</year>) <volume>21</volume>:<fpage>435</fpage>. <pub-id pub-id-type="doi">10.1186/s12888-021-03434-5</pub-id><pub-id pub-id-type="pmid">34488697</pub-id></citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>S</given-names></name> <name><surname>Kamarck</surname> <given-names>T</given-names></name> <name><surname>Mermelstein</surname> <given-names>R</given-names></name></person-group>. <article-title>A global measure of perceived stress</article-title>. <source>J Health Soc Behav.</source> (<year>1983</year>) <volume>24</volume>:<fpage>385</fpage>&#x02013;<lpage>96</lpage>. <pub-id pub-id-type="doi">10.2307/2136404</pub-id></citation>
</ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Parker</surname> <given-names>C</given-names></name> <name><surname>Slan</surname> <given-names>A</given-names></name> <name><surname>Shalev</surname> <given-names>D</given-names></name> <name><surname>Critchfield</surname> <given-names>A</given-names></name></person-group>. <article-title>Abrupt late-onset psychosis as a presentation of coronavirus 2019 disease (COVID-19): a longitudinal case report</article-title>. <source>J Psychiatric Pract.</source> (<year>2021</year>) <volume>27</volume>:<fpage>131</fpage>. <pub-id pub-id-type="doi">10.1097/PRA.0000000000000533</pub-id><pub-id pub-id-type="pmid">33656820</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Souza</surname> <given-names>LFF</given-names></name> <name><surname>Paineiras-Domingos</surname> <given-names>LL</given-names></name> <name><surname>Melo-Oliveira</surname> <given-names>MES</given-names></name> <name><surname>Pessanha-Freitas</surname> <given-names>J</given-names></name> <name><surname>Moreira-Marconi</surname> <given-names>E</given-names></name> <name><surname>Lacerda</surname> <given-names>ACR</given-names></name> <etal/></person-group>. <article-title>The impact of COVID-19 pandemic in the quality of sleep by pittsburgh sleep quality index: a systematic review</article-title>. <source>Ci&#x000EA;ncia Sa&#x000FA;de Coletiva.</source> (<year>2021</year>) <volume>26</volume>:<fpage>1457</fpage>&#x02013;<lpage>66</lpage>. <pub-id pub-id-type="doi">10.1590/1413-81232021264.45952020</pub-id><pub-id pub-id-type="pmid">33886773</pub-id></citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Goldberg</surname> <given-names>SB</given-names></name> <name><surname>Baldwin</surname> <given-names>SA</given-names></name> <name><surname>Riordan</surname> <given-names>KM</given-names></name> <name><surname>Torous</surname> <given-names>J</given-names></name> <name><surname>Dahl</surname> <given-names>CJ</given-names></name> <name><surname>Davidson</surname> <given-names>RJ</given-names></name> <etal/></person-group>. <article-title>Alliance with an unguided smartphone app: validation of the digital working alliance inventory</article-title>. <source>Assessment.</source> (<year>2021</year>). <pub-id pub-id-type="doi">10.1177/10731911211015310.</pub-id> [Epub ahead of print].<pub-id pub-id-type="pmid">34000843</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>Revelle W,. psych: Procedures for Personality Psychological Research, Northwestern University, Evanston, Illinois, USA.</collab></person-group> (<year>2019</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="https://CRAN.R-project.org/package=psych">https://CRAN.R-project.org/package=psych</ext-link> Version = 1.9.12 (accessed August 27, 2021).</citation>
</ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wickham</surname> <given-names>H</given-names></name></person-group>. <source>ggplot2: Elegant Graphics for Data Analysis</source>. New York: Springer-Verlag (<year>2016</year>). <pub-id pub-id-type="doi">10.1007/978-3-319-24277-4_9</pub-id></citation>
</ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>C</given-names></name> <name><surname>Wang</surname> <given-names>Y</given-names></name> <name><surname>Li</surname> <given-names>X</given-names></name> <name><surname>Ren</surname> <given-names>L</given-names></name> <name><surname>Zhao</surname> <given-names>J</given-names></name> <name><surname>Hu</surname> <given-names>Y</given-names></name> <etal/></person-group>. <article-title>Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China</article-title>. <source>Lancet.</source> (<year>2020</year>) <volume>395</volume>:<fpage>497</fpage>&#x02013;<lpage>506</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(20)30183-5</pub-id><pub-id pub-id-type="pmid">32502551</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>C</given-names></name> <name><surname>Huang</surname> <given-names>L</given-names></name> <name><surname>Wang</surname> <given-names>Y</given-names></name> <name><surname>Li</surname> <given-names>X</given-names></name> <name><surname>Ren</surname> <given-names>L</given-names></name> <name><surname>Gu</surname> <given-names>X</given-names></name> <etal/></person-group>. <article-title>6-month consequences of COVID-19 in patients discharged from hospital: a cohort study</article-title>. <source>Lancet.</source> (<year>2021</year>) <volume>397</volume>:<fpage>220</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(20)32656-8</pub-id><pub-id pub-id-type="pmid">33428867</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Islam</surname> <given-names>M</given-names></name> <name><surname>Islam</surname> <given-names>US</given-names></name> <name><surname>Mosaddek</surname> <given-names>ASM</given-names></name> <name><surname>Potenza</surname> <given-names>MN</given-names></name> <name><surname>Pardhan</surname> <given-names>S</given-names></name></person-group>. <article-title>Treatment, persistent symptoms, and depression in people infected with COVID-19 in Bangladesh</article-title>. <source>Int J Environ Res Public Health.</source> (<year>2021</year>) <volume>18</volume>:<fpage>1453</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph18041453</pub-id><pub-id pub-id-type="pmid">33562427</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Orr&#x000F9;</surname> <given-names>G</given-names></name> <name><surname>Bertelloni</surname> <given-names>D</given-names></name> <name><surname>Diolaiuti</surname> <given-names>F</given-names></name> <name><surname>Mucci</surname> <given-names>F</given-names></name> <name><surname>Di Giuseppe</surname> <given-names>M</given-names></name> <name><surname>Biella</surname> <given-names>M</given-names></name> <etal/></person-group>. <article-title>Long-covid syndrome? A study on the persistence of neurological, psychological and physiological symptoms</article-title>. <source>Healthcare (Basel)</source>. (<year>2021</year>) <volume>9</volume>:<fpage>575</fpage>. <pub-id pub-id-type="doi">10.3390/healthcare9050575</pub-id><pub-id pub-id-type="pmid">34068009</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Crook</surname> <given-names>H</given-names></name> <name><surname>Raza</surname> <given-names>S</given-names></name> <name><surname>Nowell</surname> <given-names>J</given-names></name> <name><surname>Young</surname> <given-names>M</given-names></name> <name><surname>Edison</surname> <given-names>P</given-names></name></person-group>. <article-title>Long covid&#x02014;mechanisms, risk factors, and management</article-title>. <source>BMJ.</source> (<year>2021</year>) <volume>374</volume>:<fpage>n1648</fpage>. <pub-id pub-id-type="doi">10.1136/bmj.n1648</pub-id><pub-id pub-id-type="pmid">34312178</pub-id></citation></ref>
<ref id="B24">
<label>24.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fern&#x000E1;ndez-de-Las-Pe&#x000F1;as</surname> <given-names>C</given-names></name> <name><surname>G&#x000F3;mez-Mayordomo</surname> <given-names>V</given-names></name> <name><surname>de-la-Llave-Rinc&#x000F3;n</surname> <given-names>AI</given-names></name> <name><surname>Palacios-Ce&#x000F1;a</surname> <given-names>M</given-names></name> <name><surname>Rodr&#x000ED;guez-Jim&#x000E9;nez</surname> <given-names>J</given-names></name> <name><surname>Florencio</surname> <given-names>LL</given-names></name> <etal/></person-group>. <article-title>Anxiety, depression and poor sleep quality as long-term post-COVID sequelae in previously hospitalized patients: a multicenter study</article-title>. <source>J Infect</source>. (<year>2021</year>) <volume>83</volume>:<fpage>496</fpage>&#x02013;<lpage>522</lpage>. <pub-id pub-id-type="doi">10.1016/j.jinf.2021.06.022</pub-id><pub-id pub-id-type="pmid">34192525</pub-id></citation></ref>
<ref id="B25">
<label>25.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Correa-Palacio</surname> <given-names>AF</given-names></name> <name><surname>Hernandez-Huerta</surname> <given-names>D</given-names></name> <name><surname>G&#x000F3;mez-Arnau</surname> <given-names>J</given-names></name> <name><surname>Loeck</surname> <given-names>C</given-names></name> <name><surname>Caballero</surname> <given-names>I</given-names></name></person-group>. <article-title>Affective psychosis after COVID-19 infection in a previously healthy patient: a case report</article-title>. <source>Psychiatry Res.</source> (<year>2020</year>) <volume>290</volume>:<fpage>113115</fpage>. <pub-id pub-id-type="doi">10.1016/j.psychres.2020.113115</pub-id><pub-id pub-id-type="pmid">32512352</pub-id></citation></ref>
<ref id="B26">
<label>26.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rentero</surname> <given-names>D</given-names></name> <name><surname>Juanes</surname> <given-names>A</given-names></name> <name><surname>Losada</surname> <given-names>CP</given-names></name> <name><surname>&#x000C1;lvarez</surname> <given-names>S</given-names></name> <name><surname>Parra</surname> <given-names>A</given-names></name> <name><surname>Santana</surname> <given-names>V</given-names></name> <etal/></person-group>. <article-title>New-onset psychosis in COVID-19 pandemic: a case series in Madrid</article-title>. <source>Psychiatry Res.</source> (<year>2020</year>) <volume>290</volume>:<fpage>113097</fpage>. <pub-id pub-id-type="doi">10.1016/j.psychres.2020.113097</pub-id><pub-id pub-id-type="pmid">32480119</pub-id></citation></ref>
<ref id="B27">
<label>27.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nagata</surname> <given-names>JM</given-names></name> <name><surname>Abdel Magid</surname> <given-names>HS</given-names></name> <name><surname>Pettee Gabriel</surname> <given-names>K</given-names></name></person-group>. <article-title>Screen Time for children and adolescents during the coronavirus disease 2019 pandemic</article-title>. <source>Obesity.</source> (<year>2020</year>) <volume>28</volume>:<fpage>1582</fpage>&#x02013;<lpage>3</lpage>. <pub-id pub-id-type="doi">10.1002/oby.22917</pub-id><pub-id pub-id-type="pmid">32463530</pub-id></citation></ref>
<ref id="B28">
<label>28.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Odgers</surname> <given-names>CL</given-names></name> <name><surname>Jensen</surname> <given-names>MR</given-names></name></person-group>. <article-title>Annual research review: adolescent mental health in the digital age: facts, fears, and future directions</article-title>. <source>J Child Psychol Psychiatry.</source> (<year>2020</year>) <volume>61</volume>:<fpage>336</fpage>&#x02013;<lpage>48</lpage>. <pub-id pub-id-type="doi">10.1111/jcpp.13190</pub-id><pub-id pub-id-type="pmid">31951670</pub-id></citation></ref>
<ref id="B29">
<label>29.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Majumdar</surname> <given-names>P</given-names></name> <name><surname>Biswas</surname> <given-names>A</given-names></name> <name><surname>Sahu</surname> <given-names>S</given-names></name></person-group>. <article-title>COVID-19 pandemic and lockdown: cause of sleep disruption, depression, somatic pain, and increased screen exposure of office workers and students of India</article-title>. <source>Chronobiol Int.</source> (<year>2020</year>) <volume>37</volume>:<fpage>1191</fpage>&#x02013;<lpage>1200</lpage>. <pub-id pub-id-type="doi">10.1080/07420528.2020.1786107</pub-id><pub-id pub-id-type="pmid">32660352</pub-id></citation></ref>
<ref id="B30">
<label>30.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Quer</surname> <given-names>G</given-names></name> <name><surname>Radin</surname> <given-names>JM</given-names></name> <name><surname>Gadaleta</surname> <given-names>M</given-names></name> <name><surname>Baca-Motes</surname> <given-names>K</given-names></name> <name><surname>Ariniello</surname> <given-names>L</given-names></name> <name><surname>Ramos</surname> <given-names>E</given-names></name> <etal/></person-group>. <article-title>Wearable sensor data and self-reported symptoms for COVID-19 detection</article-title>. <source>Nat Med.</source> (<year>2021</year>) <volume>27</volume>:<fpage>73</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1038/s41591-020-1123-x</pub-id><pub-id pub-id-type="pmid">33122860</pub-id></citation></ref>
<ref id="B31">
<label>31.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>Pew Research,. Demographics of Mobile Device Ownership Adoption in the United States. Pew Research Centre.</collab></person-group> (<year>2021</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.pewresearch.org/internet/fact-sheet/mobile/">https://www.pewresearch.org/internet/fact-sheet/mobile/</ext-link> (accessed October 05, 2021).</citation>
</ref>
<ref id="B32">
<label>32.</label>
<citation citation-type="web"><person-group person-group-type="author"><collab>Vogels EA,. 21% of Americans Use a Smart Watch or Fitness Tracker. Pew Research Center.</collab></person-group> (<year>2020</year>). Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.pewresearch.org/fact-tank/2020/01/09/about-one-in-five-americans-use-a-smart-watch-or-fitness-tracker/">https://www.pewresearch.org/fact-tank/2020/01/09/about-one-in-five-americans-use-a-smart-watch-or-fitness-tracker/</ext-link></citation>
</ref>
</ref-list> 
</back>
</article> 