<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<?covid-19-tdm?>
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="systematic-review">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2022.1096857</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Systematic Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Effects of COVID-19 pandemic on mental health among frontline healthcare workers: A systematic review and meta-analysis</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Tong</surname> <given-names>Jie</given-names></name>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/998322/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhang</surname> <given-names>Jie</given-names></name>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhu</surname> <given-names>Na</given-names></name>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Pei</surname> <given-names>Yu</given-names></name>
</contrib>
<contrib contrib-type="author">
<name><surname>Liu</surname> <given-names>Weiqing</given-names></name>
</contrib>
<contrib contrib-type="author">
<name><surname>Yu</surname> <given-names>Wei</given-names></name>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Hu</surname> <given-names>Chengping</given-names></name>
<xref ref-type="corresp" rid="c002"><sup>&#x0002A;</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Sun</surname> <given-names>Xirong</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/342675/overview"/>
</contrib>
</contrib-group>
<aff><institution>Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Tongji University</institution>, <addr-line>Shanghai</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Morena Muzi, University of Macerata, Italy</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Deborah Talamonti, Centre &#x000C9;PIC, Institut de Cardiologie de Montr&#x000E9;al, Universit&#x000E9; de Montr&#x000E9;al, Canada; Reparata Rosa Di Prinzio, Catholic University of the Sacred Heart, Italy</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Xirong Sun &#x02709; <email>xirongsun&#x00040;163.com</email></corresp>
<corresp id="c002">Chengping Hu &#x02709; <email>huchengping71&#x00040;163.com</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Health Psychology, a section of the journal Frontiers in Psychology</p></fn>
<fn fn-type="equal" id="fn002"><p>&#x02020;These authors have contributed equally to this work</p></fn></author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>01</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>1096857</elocation-id>
<history>
<date date-type="received">
<day>12</day>
<month>11</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>12</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Tong, Zhang, Zhu, Pei, Liu, Yu, Hu and Sun.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Tong, Zhang, Zhu, Pei, Liu, Yu, Hu and Sun</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract>
<sec>
<title>Background</title>
<p>As some countries announced to remove Coronavirus Disease 2019 (COVID-19) border, it indicates that the COVID-19 may have entered its terminal stage. In this COVID-19 pandemic, the mental health of frontline healthcare workers (HCWs) experienced unprecedented challenges. However, the impact of the COVID-19 pandemic on mental health among frontline HCWs lacks a high-quality and long-term systematic review and meta-analysis.</p></sec>
<sec>
<title>Methods</title>
<p>We conducted a systematic review and meta-analysis according to PRISMA guidelines. The system searches EMBASE, MEDLINE, PsycINFO, Cochrane Library, ScienceNet, and ERIC. Analyze the mental health problems of frontline HCWs in different regions and periods, including insomnia, stress, anxiety and depression. This study was registered in PROSPERO under the number CRD42021253821.</p></sec>
<sec>
<title>Results</title>
<p>A total of 19 studies on the effects of COVID-19 pandemic on mental health among frontline HCWs were included in this study. The overall prevalence of insomnia was 42.9% (95% CI, 33.9&#x02013;51.9%, <italic>I</italic><sup>2</sup> = 99.0%) extracted from data from 14 cross-sectional studies (<italic>n</italic> = 10 127), 1 cohort study (<italic>n</italic> = 4,804), and 1 randomized controlled trial (RCT; <italic>n</italic> = 482) in 10 countries. The overall prevalence of stress was 53.0% (95% CI, 41.1&#x02013;64.9%, <italic>I</italic><sup>2</sup> = 78.3%) extracted from data from nine cross-sectional studies (<italic>n</italic> = 5,494) and 1 RCT study (<italic>n</italic> = 482) from eight countries. The overall prevalence of anxiety and depression was 43.0% (95% CI, 33.8&#x02013;52.3%, <italic>I</italic><sup>2</sup> = 99.0%) and 44.6% (95% CI, 36.1&#x02013;53.1%, <italic>I</italic><sup>2</sup> = 99.0%) extracted from data from 17 cross-sectional studies (<italic>n</italic> = 11,727), one cohort study (<italic>n</italic> = 4,804), and one RCT study (<italic>n</italic> = 482) from 12 countries. The prevalence of stress and depression was higher in 2020, while the prevalence of insomnia and anxiety was higher in 2021. The prevalence of mental health problems among physicians was higher than that of other frontline HCWs. The prevalence of mental health problems among frontline HCWs is higher in South America and lower in North America.</p></sec>
<sec>
<title>Conclusions</title>
<p>This systematic review and meta-analysis showed that the COVID-19 pandemic have significant effects on mental health among frontline HCWs. The overall prevalence of insomnia, stress, anxiety and depression among frontline HCWs is high. Therefore, the health policy-makers should pay attention to and respond to the mental health problems of frontline HCWs in the context of public health emergencies.</p></sec>
<sec>
<title>Systematic review registration</title>
<p><ext-link ext-link-type="uri" xlink:href="https://www.crd.york.ac.uk/PROSPERO/">https://www.crd.york.ac.uk/PROSPERO/</ext-link>.</p></sec></abstract>
<kwd-group>
<kwd>mental health</kwd>
<kwd>frontline healthcare workers</kwd>
<kwd>COVID-19</kwd>
<kwd>systematic review</kwd>
<kwd>meta-analysis</kwd>
</kwd-group>
<contract-sponsor id="cn001">Health and Family Planning Committee of Pudong New Area<named-content content-type="fundref-id">10.13039/501100011488</named-content></contract-sponsor>
<counts>
<fig-count count="1"/>
<table-count count="8"/>
<equation-count count="0"/>
<ref-count count="62"/>
<page-count count="20"/>
<word-count count="10912"/>
</counts>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Background</title>
<p>The Coronavirus Disease 2019 (COVID-19) pandemic has existed since January 2020 and has become a major global health crisis (Chu et al., <xref ref-type="bibr" rid="B6">2020</xref>; Wu et al., <xref ref-type="bibr" rid="B61">2020</xref>; Gottlieb et al., <xref ref-type="bibr" rid="B19">2021</xref>). The mental health of frontline HCWs has encountered unprecedented challenges because of long-term and high load medical care, COVID-19 prevention, nucleic acid detection and vaccination (Wang W. et al., <xref ref-type="bibr" rid="B57">2020</xref>; Dai et al., <xref ref-type="bibr" rid="B9">2021</xref>; Skowronski and De Serres, <xref ref-type="bibr" rid="B49">2021</xref>). Some studies shows that the prevalence of mental health disorders among frontline HCWs during the COVID-19 pandemic is very high, but the prevalence rates in different studies vary greatly (Wasserman et al., <xref ref-type="bibr" rid="B58">2020</xref>; Lotta et al., <xref ref-type="bibr" rid="B32">2021</xref>; Lumley et al., <xref ref-type="bibr" rid="B33">2021</xref>). Insomnia among frontline HCWs varied across studies from 19.7 to 73.7% (Giardino et al., <xref ref-type="bibr" rid="B18">2020</xref>; Wang L. Q. et al., <xref ref-type="bibr" rid="B56">2020</xref>), those of stress varied from 26.8 to 83.1% (Alshekaili et al., <xref ref-type="bibr" rid="B2">2020</xref>; Elkholy et al., <xref ref-type="bibr" rid="B14">2021</xref>), those of anxiety varied from 14.2 to 77.3% (Wang L. Q. et al., <xref ref-type="bibr" rid="B56">2020</xref>; Elkholy et al., <xref ref-type="bibr" rid="B14">2021</xref>), and those of depression varied from 14.3 to 81.0% (Giardino et al., <xref ref-type="bibr" rid="B18">2020</xref>; Lee et al., <xref ref-type="bibr" rid="B29">2021</xref>). Consequently, there are systematic differences in most of what we know about the mental health risks and problems among frontline HCWs.</p>
<p>Although systematic differences in studies have been the subject of frequent inquiry, the differences may be more prominent under the special background of COVID-19 (Salehi et al., <xref ref-type="bibr" rid="B43">2020</xref>). Particularly, the specialty of HCWs, online surveys, severity of COVID-19, or study regions may lead to substantial changes in the results (B&#x000F6;ger et al., <xref ref-type="bibr" rid="B5">2021</xref>). Studies also report conflicting findings about whether frontline HCWs&#x00027; insomnia, stress, anxiety, and depression vary by sex, specialty, region, or other characteristics (Haravuori et al., <xref ref-type="bibr" rid="B23">2020</xref>; Wang L. Q. et al., <xref ref-type="bibr" rid="B56">2020</xref>). However, few studies have synthesized the effects of various factors on the results. Furthermore, the current studies on the effects of COVID-19 pandemic on mental health mainly focuses on the general population, students, or patients with COVID-19 (Kinder and Harvey, <xref ref-type="bibr" rid="B25">2020</xref>; Salari et al., <xref ref-type="bibr" rid="B42">2020</xref>; Deng et al., <xref ref-type="bibr" rid="B11">2021</xref>). There is a lack of high-quality and long-term systematic review and meta-analysis of the effects of the COVID-19 pandemic on the mental health of frontline HCWs.</p>
<p>Although some rapid systematic reviews or meta-analysis during the outbreak of the pandemic also focused on the mental health of frontline HCWs, they lacked high-quality meta-analysis or did not cover the whole process of the COVID-19 pandemic, and could not obtain long-term, more professional evidence-based data (Pappa et al., <xref ref-type="bibr" rid="B41">2020</xref>; Schneider et al., <xref ref-type="bibr" rid="B44">2022</xref>). As some countries announced to remove COVID-19 border, it indicates that the COVID-19 may have entered its terminal stage. In order to better understand the effects of COVID-19 pandemic on the mental health among frontline HCWs in different periods and regions, we conducted a comprehensive systematic review and meta-analysis focused on evaluating the following questions: (1) What is the overall estimated prevalence of insomnia, stress, anxiety, and depression among frontline HCWs during the COVID-19 pandemic? (2) What are the differences of mental health problems among frontline HCWs in different periods and regions during COVID-19? This unified framework can highlight the mental health problems of frontline HCWs in public health emergencies, and provide health policy-makers with strategic information based on evidence-based medicine.</p></sec>
<sec sec-type="methods" id="s2">
<title>Methods</title>
<sec>
<title>Search strategy and selection criteria</title>
<p>All studies published between January 1, 2019, and December 31, 2021, that reported on the mental health of frontline HCWs affected by the COVID-19 pandemic, such as insomnia, stress, anxiety, and depression, were identified using EMBASE, MEDLINE, PsycINFO, Cochrane Central Register of Controlled Trials, Cochrane Database of Systematic Reviews, Web of Science, and ERIC. Government databases websites, conference proceedings, and medical society websites were also searched (independently performed by J.T. and W.Q.L.). The investigators screened the reference lists of identified articles using the approaches recommended by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA; Moher et al., <xref ref-type="bibr" rid="B38">2009</xref>). Computer-based searches used terms related to the mental health of frontline HCWs during the COVID-19 pandemic (see <xref ref-type="table" rid="T1">Table 1</xref>). Studies which published in peer-reviewed journals that reported data on frontline HCWs and used a validated method to assess insomnia, stress, anxiety, and depression were also included.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Search strategy.</p></caption>
<table frame="box" rules="all">
<thead><tr>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Insomnia</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Stress</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Anxiety</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Depression</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Frontline healthcare workers</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>COVID-19</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Others</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. Insomnia<break/> 2. Sleep disorders<break/> 3. Sleep problems<break/> 4. OR /&#x00023; 1 &#x02013;&#x00023; 3</td>
<td valign="top" align="left">5. Stress<break/> 6. Stress response<break/> 7. Stress disorder<break/> 8. Acute stress disorder<break/> 9. Traumatic stress disorder<break/> 10. OR /&#x00023;5 &#x02013;&#x00023;9</td>
<td valign="top" align="left">11. Anxiety<break/> 12. Anxiety disorder<break/> 13. Anxious distress<break/> 14. OR / &#x00023;11 &#x02013;&#x00023;13</td>
<td valign="top" align="left">15. Depress<break/> 16. Depressed<break/> 17. Depression<break/> 18. Depressive disorder<break/> 19. Major depression<break/> 20. Major depressive disorder<break/> 21. MDD<break/> 22. OR / &#x00023;15 &#x02013;&#x00023;21</td>
<td valign="top" align="left">23. Doctor<break/> 24. Physician<break/> 25. Nurse<break/> 26. Health Personnel<break/> 27. Health care Provider<break/> 28. Health worker<break/> 29. Healthcare provider<break/> 30. Healthcare worker<break/> 31. Frontline healthcare workers<break/> 32. Healthcare professional<break/> 33. Medical staff<break/> 34. Medical worker<break/> 35. OR / &#x00023;23 &#x02013;&#x00023;34</td>
<td valign="top" align="left">36. SARS-CoV-2<break/> 37. Infection<break/> 38. COVID-19 virus disease<break/> 39. 2019 novel coronavirus infection<break/> 40. 2019-nCoV infection<break/> 41. Coronavirus disease 2019<break/> 42. 2019-nCoV disease<break/> 43. COVID-19<break/> 44. OR / &#x00023;36 &#x02013;&#x00023;43</td>
<td valign="top" align="left">45. Mental health<break/> 46. Psychological problems<break/> 47. Psychological disorder<break/> 48. Prevalence<break/> 49. Incidence<break/> 50. OR / &#x00023;45 &#x02013;&#x00023;49</td>
</tr> <tr>
<td valign="top" align="left">Combined search</td>
<td valign="top" align="left" colspan="4">&#x00023;4 OR &#x00023;10 OR &#x00023;14 OR &#x00023;22 AND &#x00023;35 AND &#x00023;44 AND &#x00023;50</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Inclusion criteria must be that the study population is frontline healthcare workers in COVID-19 affected countries or areas. Only high-quality studies evaluating the prevalence rates of specific mental health problems such as insomnia, stress, anxiety and depression are eligible for inclusion. However, mental health problems such as post-traumatic stress disorder, psychotic disorder and obsessive-compulsive disorder were excluded because of the limited number of high-quality studies. Additionally, broad terms such as &#x0201C;psychological distress and psychological abnormality&#x0201D; were excluded as they can be difficult to quantify.</p></sec>
<sec>
<title>Data extraction</title>
<p>The investigators (J.Z. and W.Y.) independently extracted the following information from each article using a standardized form: study design, country, survey period, specialty, sample size, average age, diagnostic methods, screening instrument outcome, and reported prevalence of insomnia, stress, anxiety, and depression. To eliminate studies involving the same population or multiple identical publications. The quality of non-randomized studies was assessed by the modified version of the Newcastle-Ottawa Scale (NOS; Stang, <xref ref-type="bibr" rid="B50">2010</xref>). This scale assesses the quality of the study through five dimensions: sample representativeness, sample size, comparability between respondents and non-respondents, ascertainment of insomnia, stress, anxiety, and depression, and statistical quality (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table 1</xref>). Studies were judged to be at low risk of bias (&#x02265;3 points) or high risk of bias (&#x0003C;3 points). The third reviewer (N.Z.) adjudicates all discrepancies.</p></sec>
<sec>
<title>Data analysis</title>
<p>Prevalence estimates of insomnia, stress, anxiety, and depression were calculated by pooling the study-specific estimates using random-effects meta-analysis. It accounted for between study heterogeneity. The 95% confidence intervals of the studies were calculated by the Clopper Pearson method, which considered the asymmetry. Study heterogeneity was assessed by standard &#x003C7;<sup>2</sup>-tests and <italic>I</italic><sup>2</sup> statistics. Heterogeneity values &#x02265;75% indicated considerable heterogeneity. The characteristics of different study levels were grouped, and hierarchical meta-analysis and meta-regression were carried out (van Houwelingen et al., <xref ref-type="bibr" rid="B55">2002</xref>). The impact of individual studies on the estimation of overall prevalence was explored by sensitivity analysis. Bias secondary to study effects was studied by funnel diagram and Egger&#x00027;s test. All analysis were performed using R Foundation for Statistical Computing (version 4.1.1; Computing, <xref ref-type="bibr" rid="B7">2022</xref>). The statistical test of all studies was two-sided and used a significance threshold of <italic>P</italic> &#x0003C; 0.05. This study is registered on PROSPERO, number CRD42021253821.</p></sec>
<sec>
<title>Role of the funding source</title>
<p>The funder of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report.</p></sec>
<sec>
<title>Patient and public involvement</title>
<p>The development of the research question was informed by the mental health status among frontline HCWs during the COVID-19 pandemic. Patients were not advisers in this study, nor were they involved in the design, recruitment or conduct of the study. Results of this study will be made publicly available through open-access publication where study participants may access them.</p></sec></sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec>
<title>Study characteristics</title>
<p>Seventeen cross-sectional studies (<italic>n</italic> = 11,727), one cohort study (<italic>n</italic> = 4,804), and one RCT study (<italic>n</italic> = 482) involving 17,013 individuals were included in this study (<xref ref-type="fig" rid="F1">Figure 1</xref>). The study involved 12 countries, including one in North America, one in South America, five in Europe, four in Asia, and one in Africa. Sixteen studies recruited participants from first frontline physicians and nurses, while three recruited participants exclusively from physicians. There were an average of 895 participants per study, ranging from 98 to 4,804. Thirteen studies assessed insomnia using the Insomnia Severity Index (ISI), 2 used the Pittsburgh Sleep Quality Index (PSQI), and one used the Sleep Condition Indicator (SCI). Five studies assessed stress using the Depression, Anxiety and Stress Scale (DASS-21), two used the 10-item Perceived Stress Scale (PSS-10), one used the 22-item Impact of Event Scale&#x02013;Revised (IES-R), one used the Effort Reward Imbalance (ERI), and one used the 4-item Primary Care PTSD screen (PC-PTSD). Nine studies assessed anxiety using the Generalized Anxiety Disorder 7-item (GAD-7), five used the Depression, Anxiety and Stress Scale (DASS-21), two used the Goldberg depression and anxiety scale (GADS), one used the Effort Reward Imbalance (ERI). Eight studies assessed for depression using the Patient Health Questionnaire-9 (PHQ-9), five used the Depression, Anxiety and Stress Scale (DASS-21), two used the Goldberg Depression and Anxiety Scale (GADS), two used the 2-item Patient Health Questionnaire (PHQ-2), one used the Hospital Anxiety and Depression Scale (HADS), and 1 used the Patient Health Questionnaire-8 (PHQ-8). All studies were evaluated by the NOS quality assessment criteria, two studies received five points, six received four points, five received three points, and six received two points (<xref ref-type="table" rid="T2">Table 2</xref>, <xref ref-type="supplementary-material" rid="SM1">Supplementary Table 2</xref>).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Flow diagram for identifying studies and selection.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyg-13-1096857-g0001.tif"/>
</fig>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Selected characteristics of the 19 studies included in this systematic review and meta-analysis.</p></caption>
<table frame="box" rules="all">
<thead><tr>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>References</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Country</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Survey period</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Specialty</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Number of<break/> participants</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Age, <italic>y</italic></bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Men, No. (%)</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Study design<break/> (survey methods)</bold></th>
<th valign="top" align="left" style="background-color:#919497;color:#ffffff"><bold>Diagnostic methods</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>Outcome<break/> definition</bold></th>
<th valign="top" align="center" style="background-color:#919497;color:#ffffff"><bold>NOS</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Giardino et al. (<xref ref-type="bibr" rid="B18">2020</xref>)</td>
<td valign="top" align="left">Argentina</td>
<td valign="top" align="left">June 5, 2020<break/> to June 25, 2020</td>
<td valign="top" align="left">Physicians, physicians in trainee, psychologists</td>
<td valign="top" align="center">1,059</td>
<td valign="top" align="left">Mean (SD), 41.7 (10.7)</td>
<td valign="top" align="center">287 (27.1)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> GADS</td>
<td valign="top" align="center">&#x02265;8 <break/> A &#x02265; 5 <break/> D &#x02265; 2</td>
<td valign="top" align="center">2</td>
</tr> <tr>
<td valign="top" align="left">Wang L. Q. et al. (<xref ref-type="bibr" rid="B56">2020</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">February 26, 2020<break/> to March 3, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">274</td>
<td valign="top" align="left">NR</td>
<td valign="top" align="center">62 (22.6)</td>
<td valign="top" align="left">Cross-sectional study (online survey)</td>
<td valign="top" align="left">PSQI <break/> PHQ-9 <break/> GAD-7</td>
<td valign="top" align="center">&#x02265;6 <break/> &#x02265;5 <break/> &#x02265;5</td>
<td valign="top" align="center">4</td>
</tr> <tr>
<td valign="top" align="left">Alshekaili et al. (<xref ref-type="bibr" rid="B2">2020</xref>)</td>
<td valign="top" align="left">Oman</td>
<td valign="top" align="left">April 8, 2020<break/> to April 17,2020</td>
<td valign="top" align="left">Physicians, nurses, allied health</td>
<td valign="top" align="center">574</td>
<td valign="top" align="left">Mean (SD), 36.3 (6.5)</td>
<td valign="top" align="center">228 (20.0)</td>
<td valign="top" align="left">Multicenter cross-sectional online study (online survey)</td>
<td valign="top" align="center">ISI <break/> DASS</td>
<td valign="top" align="center">&#x02265;8 <break/> S &#x02265; 16 <break/> A &#x02265; 8 <break/> D &#x02265; 10</td>
<td valign="top" align="left">3</td>
</tr> <tr>
<td valign="top" align="left">Elkholy et al. (<xref ref-type="bibr" rid="B14">2021</xref>)</td>
<td valign="top" align="left">Egypt</td>
<td valign="top" align="left">April 2020<break/> to May 2020</td>
<td valign="top" align="left">Physicians, nurses, non-specialized nurse</td>
<td valign="top" align="center">502</td>
<td valign="top" align="left">No. (%) &#x02264; 30 y: 232 (46.2)</td>
<td valign="top" align="center">251 (50.0)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-9 <break/> GAD-7 <break/> PSS-10</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;5 <break/> &#x02265;5 <break/> &#x02265;9</td>
<td valign="top" align="center">4</td>
</tr> <tr>
<td valign="top" align="left">Lee et al. (<xref ref-type="bibr" rid="B29">2021</xref>)</td>
<td valign="top" align="left">Korean</td>
<td valign="top" align="left">June 22 2020<break/> to July 8, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">406</td>
<td valign="top" align="left">No. (%) &#x0003C; 40 y: 225 (55.4)</td>
<td valign="top" align="center">115 (28.3)</td>
<td valign="top" align="left">Cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-9 <break/> GAD-7</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;10 <break/> &#x02265;5</td>
<td valign="top" align="center">4</td>
</tr> <tr>
<td valign="top" align="left">Haravuori et al. (<xref ref-type="bibr" rid="B23">2020</xref>)</td>
<td valign="top" align="left">Finland</td>
<td valign="top" align="left">June 4, 2020<break/> to June 26, 2020</td>
<td valign="top" align="left">Physicians, nurses, psychologists</td>
<td valign="top" align="center">4,804</td>
<td valign="top" align="left">Mean (SD), 44.2 (11.3)</td>
<td valign="top" align="center">538 (11.4)</td>
<td valign="top" align="left">Prospective multicenter cohort study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-2 <break/> OASIS</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;3 <break/> &#x02265;8</td>
<td valign="top" align="center">2</td>
</tr> <tr>
<td valign="top" align="left">Liu et al. (<xref ref-type="bibr" rid="B31">2020</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">March 7, 2020<break/> to March 17, 2020</td>
<td valign="top" align="left">Obstetrician, midwive</td>
<td valign="top" align="center">2,126</td>
<td valign="top" align="left">NR</td>
<td valign="top" align="center">49 (2.3)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-9 <break/> GAD-7</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;5 <break/> &#x02265;5</td>
<td valign="top" align="center">2</td>
</tr> <tr>
<td valign="top" align="left">Almater et al. (<xref ref-type="bibr" rid="B1">2020</xref>)</td>
<td valign="top" align="left">Saudi Arabia</td>
<td valign="top" align="left">28 March 2020<break/> to 4 April 2020</td>
<td valign="top" align="left">Ophthalmologists</td>
<td valign="top" align="center">107</td>
<td valign="top" align="left">Mean (SD), 32.9 (9.6)</td>
<td valign="top" align="center">60 (56.1)</td>
<td valign="top" align="left">Cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-9 <break/> GAD-7 <break/> PSS-10</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;5 <break/> &#x02265;5 <break/> &#x02265;9</td>
<td valign="top" align="center">2</td>
</tr> <tr>
<td valign="top" align="left">Cui et al. (<xref ref-type="bibr" rid="B8">2020</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">February 1, 2020<break/> to February 19, 2020</td>
<td valign="top" align="left">Female nurses</td>
<td valign="top" align="center">334</td>
<td valign="top" align="left">No. (%) &#x02264; 30 y: 202 (54.0)</td>
<td valign="top" align="center">NR</td>
<td valign="top" align="left">Cross-sectional online study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-9 <break/> GAD-7</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;5 <break/> &#x02265;5</td>
<td valign="top" align="center">3</td>
</tr> <tr>
<td valign="top" align="left">Lai et al. (<xref ref-type="bibr" rid="B27">2020</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">January 29, 2020<break/> to February 3, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">1,257</td>
<td valign="top" align="left">No. (%) &#x02264; 30 y: 605 (48.1)</td>
<td valign="top" align="center">293 (23.3)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> PHQ-9 <break/> GAD-7 <break/> IES-R</td>
<td valign="top" align="center">&#x02265;8 <break/> &#x02265;5 <break/> &#x02265;5 <break/> &#x02265;9</td>
<td valign="top" align="center">5</td>
</tr> <tr>
<td valign="top" align="left">Magnavita et al. (<xref ref-type="bibr" rid="B35">2020a</xref>)</td>
<td valign="top" align="left">Italy</td>
<td valign="top" align="left">April 27, 2020<break/> to May 27, 2020</td>
<td valign="top" align="left">Anesthetists</td>
<td valign="top" align="center">155</td>
<td valign="top" align="left">No. (%) &#x02264; 35 y: 118 (76.7)</td>
<td valign="top" align="center">74 (47.8)</td>
<td valign="top" align="left">Cross-sectional study (online survey)</td>
<td valign="top" align="left">SCI <break/> ERI <break/> GADS</td>
<td valign="top" align="center">&#x02265;16 <break/> &#x02265;2 <break/> A &#x02265; 5 <break/> D &#x02265; 2</td>
<td valign="top" align="center">2</td>
</tr>
<tr>
<td valign="top" align="left">Shechter et al. (<xref ref-type="bibr" rid="B46">2020</xref>)</td>
<td valign="top" align="left">United States</td>
<td valign="top" align="left">April 9, 2020<break/> to Apr 24, 2020</td>
<td valign="top" align="left">Physicians, residents/fellows, nurses</td>
<td valign="top" align="center">657</td>
<td valign="top" align="left">No. (%) &#x02264; 35 y: 347 (76.7)</td>
<td valign="top" align="center">143 (19.9)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">PHQ-2 <break/> GAD-2 <break/> PC-PTSD</td>
<td valign="top" align="center">&#x02265;3 <break/> &#x02265;3 <break/> &#x02265;3</td>
<td valign="top" align="center">3</td>
</tr> <tr>
<td valign="top" align="left">Tiete et al. (<xref ref-type="bibr" rid="B54">2020</xref>)</td>
<td valign="top" align="left">Belgium</td>
<td valign="top" align="left">April 17 2020<break/> to May 25, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">647</td>
<td valign="top" align="left">No. (%) &#x02264; 30 y: 149 (23.0)</td>
<td valign="top" align="center">140 (21.6)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> DASS-21</td>
<td valign="top" align="center">&#x02265;8 <break/> S &#x02265; 16 <break/> A &#x02265; 8 <break/> D &#x02265; 10</td>
<td valign="top" align="center">3</td>
</tr> <tr>
<td valign="top" align="left">Youssef et al. (<xref ref-type="bibr" rid="B62">2020</xref>)</td>
<td valign="top" align="left">Egypt</td>
<td valign="top" align="left">April 1, 2020<break/> to April 15, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">540</td>
<td valign="top" align="left">Mean (SD), 37.3 (9.2)</td>
<td valign="top" align="center">294 (94.4)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">ISI <break/> DASS-21</td>
<td valign="top" align="center">&#x02265;8 <break/> S &#x02265; 16 <break/> A &#x02265; 8 <break/> D &#x02265; 10</td>
<td valign="top" align="center">5</td>
</tr> <tr>
<td valign="top" align="left">Azoulay et al. (<xref ref-type="bibr" rid="B3">2021</xref>)</td>
<td valign="top" align="left">France</td>
<td valign="top" align="left">October 30, 2020<break/> to December 1, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">845</td>
<td valign="top" align="left">NR</td>
<td valign="top" align="center">274 (32.4)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">HADS</td>
<td valign="top" align="center">A &#x02265; 8 <break/> D &#x02265; 8</td>
<td valign="top" align="center">4</td>
</tr> <tr>
<td valign="top" align="left">Di Mattei et al. (<xref ref-type="bibr" rid="B12">2021</xref>)</td>
<td valign="top" align="left">Italy</td>
<td valign="top" align="left">May 9, 2020<break/> to July 13, 2020</td>
<td valign="top" align="left">Physicians, nurses, psychologists, healthcare assistants</td>
<td valign="top" align="center">1,055</td>
<td valign="top" align="left">Mean (SD), 44.7 (11.3)</td>
<td valign="top" align="center">256 (24.3)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="center">ISI <break/> DASS-21</td>
<td valign="top" align="center">&#x02265;8 <break/> S &#x02265; 16 <break/> A &#x02265; 8 <break/> D &#x02265; 10</td>
<td valign="top" align="left">3</td>
</tr> <tr>
<td valign="top" align="left">Fiol-DeRoque et al. (<xref ref-type="bibr" rid="B16">2021</xref>)</td>
<td valign="top" align="left">Spain</td>
<td valign="top" align="left">May 14, 2020<break/> to July 25, 2020</td>
<td valign="top" align="left">Physicians, nurses, nurse assistants</td>
<td valign="top" align="center">482</td>
<td valign="top" align="left">Mean (SD), 41.3 (10.4)</td>
<td valign="top" align="center">81 (16.8)</td>
<td valign="top" align="left">RCT (Online and mobile phone survey)</td>
<td valign="top" align="left">ISI <break/> DASS-21</td>
<td valign="top" align="center">&#x02265;8 <break/> S &#x02265; 16 <break/> A &#x02265; 8 <break/> D &#x02265; 10</td>
<td valign="top" align="center">4</td>
</tr> <tr>
<td valign="top" align="left">Guo et al. (<xref ref-type="bibr" rid="B22">2021</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">May 15, 2020<break/> to May 31, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">1,091</td>
<td valign="top" align="left">No. (%) &#x02264; 45 y: 888 (81.4)</td>
<td valign="top" align="center">356 (32.6)</td>
<td valign="top" align="left">Multicenter cross-sectional study (online survey)</td>
<td valign="top" align="left">PSQI <break/> PHQ-9 <break/> GAD-7</td>
<td valign="top" align="center">&#x02265;6 <break/> &#x02265;5 <break/> &#x02265;5</td>
<td valign="top" align="center">4</td>
</tr> <tr>
<td valign="top" align="left">Wright et al. (<xref ref-type="bibr" rid="B60">2021</xref>)</td>
<td valign="top" align="left">United States</td>
<td valign="top" align="left">April 1, 2020<break/> to May 7, 2020</td>
<td valign="top" align="left">Physicians, nurses</td>
<td valign="top" align="center">98</td>
<td valign="top" align="left">Mean (SD), 42.9 (11.0)</td>
<td valign="top" align="center">NR</td>
<td valign="top" align="left">Cross-sectional study (online survey)</td>
<td valign="top" align="left">PHQ-8 <break/> GAD-7</td>
<td valign="top" align="center">&#x02265;10 <break/> &#x02265;5</td>
<td valign="top" align="center">2</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>A, Anxiety; D, Depression; DASS-21, The Depression, Anxiety and Stress Scale; ERI, Effort Reward Imbalance; GAD-7, Generalized Anxiety Disorder 7-item; GAD-2, 2-item Generalized Anxiety Disorder Scale; GADS, Goldberg depression and anxiety scale; HADS, Hospital Anxiety and Depression Scale; S, Stress; ISI, The seven-item Insomnia Severity Index; IES-R, 22-item Impact of Event Scale&#x02013;Revised; NOS, Newcastle-Ottawa Score; OASIS, Overall Anxiety Severity and Impairment Scale; PC-PTSD, 4-item Primary Care PTSD screen; PHQ-9, Patient Health Questionnaire-9; PHQ-2, 2-item Patient Health Questionnaire; PSS-10, 10-item Perceived Stress Scale; PSQI, Pittsburgh Sleep Quality Index; NR, not reported; S, Stress; SCI, Sleep Condition Indicator.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Prevalence of insomnia or insomnia symptoms</title>
<p>A meta-analysis of insomnia or insomnia symptoms among frontline HCWs during the COVID-19 pandemic reported by 16 studies showed a summary prevalence of 42.9% (7,068/15 413 individuals, 95% CI, 33.9&#x02013;51.9%). There was significant evidence of between study heterogeneity (<italic>Q</italic> = 2,106.2, <italic>P</italic> &#x0003C; 0.001, &#x003C4;<sup>2</sup> = 0.03, <italic>I</italic><sup>2</sup> = 99.0%). A sensitivity analysis showed that no individual study had an impact on the overall prevalence estimate of more than 3% (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table 3</xref>). The estimated values were stratified by screening instrument and outcome definition. Summary prevalence estimates ranged from 43.5% of the ISI (6,121/13,893 individuals, 95% CI, 35.4&#x02013;51.6%, <italic>Q</italic> = 1,149.3, &#x003C4;<sup>2</sup> = 0.02, <italic>I</italic><sup>2</sup> = 99.0%) and 49.3% of the PSQI (914/1,365 individuals, 95% CI, &#x02212;8.6&#x02013;107.2%, <italic>Q</italic> = 185.1, &#x003C4;<sup>2</sup> = 0.17, <italic>I</italic><sup>2</sup> = 100.0%; <xref ref-type="table" rid="T3">Table 3</xref>).</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Meta-analysis of the prevalence of insomnia or insomnia symptoms among frontline HCWs during the COVID-19 pandemic.</p></caption>
<graphic xlink:href="fpsyg-13-1096857-t0003.tif"/>
<table-wrap-foot>
<p>Studies are stratified by screening modality. The vertical dashed lines indicate the pooled summary estimate (95% CI) for all studies and horizontal lines indicate 95% confidence intervals of the estimate.</p>
</table-wrap-foot>
</table-wrap>
<p>According to study-level characteristics, there were statistically significant differences in prevalence estimates between multi-center studies [6,504/13,655 (49.0%; 95% CI, 37.7&#x02013;60.4%)] and non-multi-center studies [564/1,758 (32.1%; 95% CI, 23.6&#x02013;40.7%)] (<italic>Q</italic> = 0.02, <italic>P</italic> = 0.02). Studies were further stratified by continent or region. Studies performed in the South America [780/1,059 (73.7%; 95% CI, 70.9&#x02013;76.4%)] has the highest prevalence, which is significantly different from those performed on other continents (<italic>Q</italic> = 47.1, <italic>P</italic> &#x0003C; 0.001). When studies were stratified by study period and individual specialty, prevalence estimates were not statistically significant differences (<italic>P</italic> &#x0003E; 0.05; <bold>Table 7</bold>A). By NOS criteria, studies with more thorough descriptive statistics reporting [2,968/5,183; 54.2% (95% CI, 37.5&#x02013;70.9%)] had higher prevalence estimates than those with less comprehensive descriptive statistics reporting [4,100/10,230; 34.2% (95% CI, 27.0&#x02013;41.3%); <italic>Q</italic> = 4.7, <italic>P</italic> = 0.03]. The estimated prevalence was not significantly different when studies were stratified by sample representativeness, size, comparability between respondents and non-respondents, ascertainment of insomnia, or total NOS score (<italic>P</italic> &#x0003E; 0.05; <bold>Table 8</bold>A; details of the NOS appear in <xref ref-type="supplementary-material" rid="SM1">Supplementary Table 1</xref>).</p></sec>
<sec>
<title>Prevalence of stress or stress symptoms</title>
<p>There were 10 studies on the prevalence of stress or stress symptoms among frontline HCWs during the COVID-19 pandemic. The meta-analysis pooling of the prevalence estimates was 53.0% (3,284/5,976 individuals, 95% CI, 41.1&#x02013;64.9%), with significant evidence of between study heterogeneity (<italic>Q</italic> = 897.7, <italic>P</italic> &#x0003C; 0.001, &#x003C4;<sup>2</sup> = 0.04, <italic>I</italic><sup>2</sup> = 99.0%). A sensitivity analysis showed that the impact of individual studies on the estimation of the overall prevalence estimate was &#x0003C;6% (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table 4</xref>). The estimated values were stratified according to screening instrument and outcome definition, showing that summary prevalence estimates ranged from 78.3% for the PSS-10 (6,121/13,893 individuals, 95% CI, 67.5&#x02013;89.0%, <italic>Q</italic> = 5.8, &#x003C4;<sup>2</sup> = 0.01, <italic>I</italic><sup>2</sup> = 83.0%) and 41.1% for the DASS-21 (1,453/3,298 individuals, 95% CI, 28.6&#x02013;53.7%, <italic>Q</italic> = 234.6, &#x003C4;<sup>2</sup> = 0.02, <italic>I</italic><sup>2</sup> = 98.0%; <xref ref-type="table" rid="T4">Table 4</xref>).</p>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Meta-analysis of the prevalence of stress or stress symptoms among frontline HCWs during the COVID-19 pandemic.</p></caption>
<graphic xlink:href="fpsyg-13-1096857-t0004.tif"/>
<table-wrap-foot>
<p>Studies are stratified by screening modality. The vertical dashed lines indicate the pooled summary estimate (95% CI) for all studies and horizontal lines indicate 95% confidence intervals of the estimate.</p>
</table-wrap-foot>
</table-wrap>
<p>According to the study-level characteristics of the study period, study design, individuals&#x02018; specialty, and continent or region, prevalence estimates were not significantly different (<italic>P</italic> &#x0003E; 0.05; <bold>Table 7</bold>B). Prevalence estimates of studies with more sample representative reporting [3,207/5,869; 50.9% (95% CI, 38.3&#x02013;63.6%)] were lower than those with less sample representative reporting [77/107; 72.0% (95% CI, 63.6&#x02013;80.4%); <italic>Q</italic> = 7.4, <italic>P</italic> = 0.007] when evaluated by NOS criteria. There was a significant difference (<italic>Q</italic> = 4.3, <italic>P</italic> = 0.04) between the prevalence estimates of studies with lower valid of ascertainment [261/647 (40.3%; 95% CI, 36.6&#x02013;44.0%)] and more valid of ascertainment [3,023/5,329 (54.4%; 95% CI, 41.6&#x02013;67.2%)]. The prevalence estimates were not significantly different when studies were stratified by comparability between respondent and non-respondent, sample size, descriptive statistics reporting, or total NOS score (<italic>P</italic> &#x0003E; 0.05; <bold>Table 8</bold>; details of the NOS appear in <xref ref-type="supplementary-material" rid="SM1">Supplementary Table 1</xref>).</p></sec>
<sec>
<title>Prevalence of anxiety or anxiety symptoms</title>
<p>The meta-analysis of anxiety or anxiety symptoms among frontline HCWs during the COVID-19 pandemic reported by the 19 studies showed a summary prevalence of 43.0% (6,509/17,013 individuals, 95% CI, 33.8&#x02013;52.3%), and there was significant heterogeneity between studies (<italic>Q</italic> = 3,019.0, <italic>P</italic> &#x0003C; 0.001, &#x003C4;<sup>2</sup> = 0.04, <italic>I</italic><sup>2</sup> = 99.0%). A sensitivity analysis showed that the impact of individual studies on the overall prevalence estimate was &#x0003C;7% (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table 5</xref>). According to stratification by instrument and outcome definition, summary prevalence estimates ranged from 44.0% for the GAD-7 (2,644/6,195 individuals, 95% CI, 31.6&#x02013;56.5%, <italic>Q</italic> = 818.0, &#x003C4;<sup>2</sup> = 0.04, <italic>I</italic><sup>2</sup> = 99.0%), 43.2% for the DASS-21 (1,373/3,298 individuals, 95% CI, 34.1&#x02013;51.5%, <italic>Q</italic> =98.3, &#x003C4;<sup>2</sup> = 0.01, <italic>I</italic><sup>2</sup> = 96.0%), and 46.4% for the GADS (835/1,214 individuals, 95% CI, &#x02212;12.8&#x02013;105.6%, <italic>Q</italic> = 341.3, &#x003C4;<sup>2</sup> = 0.18, <italic>I</italic><sup>2</sup> = 100.0%; <xref ref-type="table" rid="T5">Table 5</xref>).</p>
<table-wrap position="float" id="T5">
<label>Table 5</label>
<caption><p>Meta-analysis of the prevalence of anxiety or anxiety symptoms among frontline HCWs during the COVID-19 pandemic.</p></caption>
<graphic xlink:href="fpsyg-13-1096857-t0005.tif"/>
<table-wrap-foot>
<p>Studies are stratified by screening modality. The vertical dashed lines indicate the pooled summary estimate (95% CI) for all studies and horizontal lines indicate 95% confidence intervals of the estimate.</p>
</table-wrap-foot>
</table-wrap>
<p>According to study-level characteristics, the prevalence of studies performed in South America [810/1,059 (76.5%; 95% CI, 73.9&#x02013;79.1%)] was higher than that on other continents, and the difference was statistically significant (<italic>Q</italic> = 152.9, <italic>P</italic> &#x0003C; 0.001). When studies were stratified by study design, period, and individuals specialty, the prevalence estimates of anxiety were not significantly different (<italic>P</italic> &#x0003E; 0.05; <bold>Table 7</bold>C). There were no statistically significant differences in prevalence estimates of six-dimensional stratification when evaluated by NOS criteria (<italic>P</italic> &#x0003E; 0.05; <bold>Table 8</bold>C; details of the NOS appear in <xref ref-type="supplementary-material" rid="SM1">Supplementary Table 1</xref>).</p></sec>
<sec>
<title>Prevalence of depression or depressive symptoms</title>
<p>A meta-analysis of depression or depressive symptoms among frontline HCWs during the COVID-19 pandemic reported by the 19 studies yielded a summary prevalence of 44.6% (7,452/17,013 individuals, 95% CI, 36.1&#x02013;53.1%), with significant difference between study heterogeneity (<italic>Q</italic> = 2,410.8, <italic>P</italic> &#x0003C; 0.001, &#x003C4;<sup>2</sup> = 0.04, <italic>I</italic><sup>2</sup> = 99.0%). Sensitivity analysis suggested that no individual study had an impact on the overall prevalence estimate of more than 5% (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table 6</xref>). According to stratification by instrument and outcome definition, prevalence estimates ranged from 46.3% for the PHQ-9 (2,896/6,097 individuals, 95% CI, 32.0&#x02013;60.5%, <italic>Q</italic> = 975.6, &#x003C4;<sup>2</sup> = 0.04, <italic>I</italic><sup>2</sup> = 99.0%), 45.8% for the DASS-21 (1,485/3,298 individuals, 95% CI, 37.0&#x02013;54.5%, <italic>Q</italic> =105.5, &#x003C4;<sup>2</sup> = 0.01, <italic>I</italic><sup>2</sup> = 96.0%), 55.5% for the GADS (904/1,214 individuals, 95% CI, 5.2&#x02013;105.7%, <italic>Q</italic> = 173.9, &#x003C4;<sup>2</sup> = 0.13, <italic>I</italic><sup>2</sup> = 99.0%), and 39.8% for the PHQ-2 (1,849/5,461 individuals, 95% CI, 24.1&#x02013;55.5%, <italic>Q</italic> = 62.4, &#x003C4;<sup>2</sup> = 0.01, <italic>I</italic><sup>2</sup> = 98.0%; <xref ref-type="table" rid="T6">Table 6</xref>).</p>
<table-wrap position="float" id="T6">
<label>Table 6</label>
<caption><p>Meta-analysis of the prevalence of depression or depressive symptoms among frontline HCWs during the COVID-19 pandemic.</p></caption>
<graphic xlink:href="fpsyg-13-1096857-t0006.tif"/>
<table-wrap-foot>
<p>Studies are stratified by screening modality. The vertical dashed lines indicate the pooled summary estimate (95% CI) for all studies and horizontal lines indicate 95% confidence intervals of the estimate.</p>
</table-wrap-foot>
</table-wrap>
<p>The estimated values were stratified according to study-level characteristics. The prevalence estimates between multi-center studies [5,286/10,353 (52.6%; 95% CI, 42.7&#x02013;62.6%)] and non-multi-center studies [2,141/6,660 (33.3%; 95% CI, 23.7&#x02013;42.9%); <italic>Q</italic> = 7.5, <italic>P</italic> = 0.006] were statistically significance. Studies were further stratified by continent or region. Studies performed in the South America [858/1,059 (81.0%; 95% CI, 78.7&#x02013;83.4%)] had the highest prevalence, which was significantly different from those performed on other continents (<italic>Q</italic> = 187.8, <italic>P</italic> &#x0003C; 0.001). The prevalence estimates were not significantly different when studies were stratified by study period and individual specialty (<italic>P</italic> &#x0003E; 0.05; <xref ref-type="table" rid="T7">Table 7</xref>D). When assessed by NOS criteria, studies with more thorough descriptive statistics reporting [3,005/5,183; 56.5% (95% CI, 45.3&#x02013;67.7%)] had higher prevalence than those with less thorough descriptive statistics reporting [4,422/11,830; 37.7% (95% CI, 28.9&#x02013;46.5%); <italic>Q</italic> = 6.7, <italic>P</italic> = 0.01]. There were no statistically significant differences in prevalence estimates between studies stratified by sample representativeness, sample size, comparability between respondents and non-respondents, ascertainment of depression, or total NOS score (<italic>P</italic> &#x0003E; 0.05; <xref ref-type="table" rid="T8">Table 8</xref>; details of the NOS appear in <xref ref-type="supplementary-material" rid="SM1">Supplementary Table 1</xref>).</p>
<table-wrap position="float" id="T7">
<label>Table 7</label>
<caption><p>Meta-analysis of the prevalence of insomnia, stress, anxiety, and depression among frontline HCWs during the COVID-19 pandemic stratified by study-level characteristics.</p></caption>
<graphic xlink:href="fpsyg-13-1096857-t0007.tif"/>
<table-wrap-foot>
<p>A, insomnia or insomnia symptoms; B, stress or stress symptoms; C, anxiety or anxiety symptoms; D, depression or depressive symptoms.</p>
<p><sup>&#x0002A;</sup>P &#x0003C; 0.05, <sup>&#x0002A;&#x0002A;</sup>P &#x0003C; 0.01. The area of each diamond is proportional to the inverse variance of the estimate. Horizontal extremes of the diamonds indicate 95% CIs of the estimate.</p>
</table-wrap-foot>
</table-wrap>
<table-wrap position="float" id="T8">
<label>Table 8</label>
<caption><p>Meta-analysis of the prevalence of insomnia, stress, anxiety, and depression among frontline HCWs during the COVID-19 pandemic stratified by NOS components and total score.</p></caption>
<graphic xlink:href="fpsyg-13-1096857-t0008.tif"/>
<table-wrap-foot>
<p>A, insomnia or insomnia symptoms; B, stress or stress symptoms; C, anxiety or anxiety symptoms; D, depression or depressive symptoms.</p>
<p><sup>&#x0002A;</sup>P &#x0003C; 0.05, <sup>&#x0002A;&#x0002A;</sup>P &#x0003C; 0.01. The area of each diamond is proportional to the inverse variance of the estimate. Horizontal extremes of the diamonds indicate 95% CIs of the estimate.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Assessment of publication bias</title>
<p>Visual examination of the funnel plot reporting on insomnia, stress, anxiety, and depression revealed minimal asymmetry (<xref ref-type="supplementary-material" rid="SM1">Supplementary Figures 1</xref>&#x02013;<xref ref-type="supplementary-material" rid="SM1">4</xref>), suggesting that there was no significant publication bias (<italic>P</italic> = 0.75; <italic>P</italic> = 0.69; <italic>P</italic> = 0.16; <italic>P</italic> = 0.51 using the Egger test).</p></sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>The systematic review and meta-analysis of 19 studies involving 17,013 frontline HCWs in 12 countries during the COVID-19 pandemic demonstrated that 42.9% (range, 33.8&#x02013;52.3%) and 53.0% (range, 41.1&#x02013;64.9%) of workers reported insomnia and stress, and 43.0% (range, 33.8&#x02013;52.3%) and 44.6% (range, 36.1&#x02013;53.1%) screened positive for anxiety and depression, respectively. This data is significantly higher than the prevalence of anxiety (31.9%), depression (33.7%), and stress (29.6%) among general population population during the COVID-19 pandemic (Salari et al., <xref ref-type="bibr" rid="B42">2020</xref>), and is similar to the prevalence of depression (45.0%), anxiety (47%), and insomnia (34%) among patients with COVID-19 (Deng et al., <xref ref-type="bibr" rid="B11">2021</xref>). Compared with the small pandemic of SARS in 2002 and MARS in 2012, COVID-19 has a greater psychological impact on HCWs (Boden et al., <xref ref-type="bibr" rid="B4">2021</xref>; Magnavita et al., <xref ref-type="bibr" rid="B34">2021</xref>). This is closely related to the unknown characteristics of COVID-19, the high risk of exposure to infection, and multiple work pressures. However, Magnavita et al. (<xref ref-type="bibr" rid="B36">2020b</xref>) pointed out that the frequency of anxiety and depression among HCWs during the early stage of the COVID-19 pandemic was not higher than the commonly recorded during periodic checks in the years preceding the epidemic, which may be related to the severity of the epidemic in the region or the type of work involving front-line or non-front-line workers. These findings are concerning given that the development of mental health among HCWs has been linked to an increased long-term risk of future mental health diseases.</p>
<p>It is important to note that all participants were assessed through online self-report inventories rather than the gold-standard diagnostic clinical interviews. The sensitivity and specificity of these instruments for estimating symptoms of insomnia, stress, anxiety, and depression vary substantially (<xref ref-type="supplementary-material" rid="SM1">Supplementary Table 7</xref>). In the evaluation of insomnia and stress, the sensitivity of the ISI (Morin et al., <xref ref-type="bibr" rid="B39">2011</xref>; 99%, 95% CI, 97&#x02013;100%) and IES-R (Lee, <xref ref-type="bibr" rid="B28">2012</xref>; 86%, 95% CI, 67&#x02013;94%) was higher than that of the others. However, that of ESS (Siegrist et al., <xref ref-type="bibr" rid="B47">2014</xref>; 76%, 95% CI, 63&#x02013;86%, 20%) and PC-PTSD (Li et al., <xref ref-type="bibr" rid="B30">2019</xref>; 57%, 95% CI, 45&#x02013;68%) are the least. When estimating anxiety symptoms, the specificity of the HADS-A (Hitchon et al., <xref ref-type="bibr" rid="B24">2020</xref>) was 78% (95% CI, 69&#x02013;85%), which was lower than that of the others. In contrast, the PHQ-9 (Williams et al., <xref ref-type="bibr" rid="B59">2002</xref>) has high sensitivity (88%, 95% CI, 74&#x02013;96%) and specificity (88%, 95% CI, 85&#x02013;90%) for diagnosing major depression and has been proven to be comparable with the administered assessments by clinicians, whereas the GHQ (Williams et al., <xref ref-type="bibr" rid="B59">2002</xref>) has low specificity (66%, 95% CI, 57&#x02013;74%). In addition, all self-report measures were conducted online because of the COVID-19 pandemic which may affect the accurate evaluation of symptoms.</p>
<p>The sub-analysis revealed potentially important differences, such as study period, specialty and region. The prevalence of stress and depression is higher in 2020 and that of insomnia and anxiety is higher in 2021. This probably reflects the already established psychological problems of the population that have changed with the evolution of COVID-19 (Simon et al., <xref ref-type="bibr" rid="B48">2020</xref>; Kola et al., <xref ref-type="bibr" rid="B26">2021</xref>). HCWs changed from stress and depression during the outbreak of the COVID-19 pandemic to mild psychological problems of sleep and anxiety with the normalization of COVID-19 prevention and control. In the HCWs specialty, the prevalence of psychological problems of physicians is higher than that of other HCWs. This is related to the working hours and strength of the physicians at the frontline of COVID-19 (Elbay et al., <xref ref-type="bibr" rid="B13">2020</xref>). By region, the prevalence of HCWs in South America is higher, while the prevalence of anxiety and depression in North America is lower, which is related to local economic level, contact tracing, isolation and management, and other measures (Fitzpatrick et al., <xref ref-type="bibr" rid="B17">2020</xref>; Goularte et al., <xref ref-type="bibr" rid="B20">2021</xref>).</p>
<p>Furthermore, according to NOS criteria analysis, variation in sample size contributed significantly to the observed heterogeneity in the study. Studies with fewer participants usually produced more extreme prevalence estimates of stress, indicating publication bias. However, for insomnia, anxiety, and depression, studies with more participants usually produced more extreme prevalence estimates. These differences were partly captured by the NOS score, which assessed the risk of bias in each study. Studies with a higher risk of bias produced higher prevalence estimates of insomnia and stress, while studies with a lower risk of bias produced higher prevalence estimates of anxiety and depression. These findings may be related to the heterogeneity between studies on study design (i.e., multicenter vs. non multicenter), online surveys, study period of COVID-19, positions of frontline HCWs, and severity of regional pandemic.</p>
<p>Most opinions show that psychological strategies are the mediating factor to change these outstanding problems, although the stressors (COVID-19 pandemic) cannot be changed (Mediavilla et al., <xref ref-type="bibr" rid="B37">2022</xref>). Importantly, increasing the so-called social support barriers (i.e., factors that increase the use of social support, even when available) might also contribute to improving the mental health of HCWs (Thoresen et al., <xref ref-type="bibr" rid="B53">2014</xref>). With mounting evidence suggesting an association between reported discrimination against COVID-19 and poor mental health outcomes among HCWs, mental health strategies at the community level could take the form of anti-stigma campaigns (Taylor et al., <xref ref-type="bibr" rid="B51">2020</xref>). At the policy level, addressing various common problems reported by HCWs, including increased workload, shortage of protective equipment, or lack of standardized operating procedures, may also enable HCWs to help reduce the negative consequences of mental health problems (Erquicia et al., <xref ref-type="bibr" rid="B15">2020</xref>).</p></sec></sec>
<sec id="s5">
<title>Limitations</title>
<p>When interpreting the results of this study, several limitations should be considered. First, a substantial amount of the heterogeneity among frontline HCWs remained unexplained by the variables examined. We attempted to reduce these impacts by assessing and reporting the risk of bias. Second, most studies were observational and lacked enough cohort studies; thus, they were vulnerable to the effects of confounding factors. It is necessary to explore the psychological impacts on frontline HCWs during the COVID-19 pandemic over a longer and more prospective period (Shanafelt et al., <xref ref-type="bibr" rid="B45">2020</xref>; Pan et al., <xref ref-type="bibr" rid="B40">2021</xref>). It can be helpful in clarifying the mental state of this population in the future. Third, fewer studies can be included in this meta-analysis because of the special background of the COVID-19 pandemic, which is difficult to analyze through different dimensions of mental health problems. At present, most studies focus on how to control the pandemic, but the mental health of frontline HCWs is easy to be ignore (Greenberg et al., <xref ref-type="bibr" rid="B21">2020</xref>; The, <xref ref-type="bibr" rid="B52">2020</xref>; de Vroege and van den Broek, <xref ref-type="bibr" rid="B10">2021</xref>).</p></sec>
<sec sec-type="conclusions" id="s6">
<title>Conclusions</title>
<p>This systematic review and meta-analysis showed that the COVID-19 pandemic have significant effects on mental health among frontline HCWs. The overall prevalence of insomnia, stress, anxiety and depression among frontline HCWs is high. Therefore, the health policy-makers should pay attention to and respond to the mental health problems of frontline HCWs in the context of public health emergencies.</p></sec>
<sec sec-type="data-availability" id="s7">
<title>Data availability statement</title>
<p>The original contributions presented in the study are included in the article/<xref ref-type="supplementary-material" rid="SM1">Supplementary material</xref>, further inquiries can be directed to the corresponding authors.</p></sec>
<sec sec-type="author-contributions" id="s8">
<title>Author contributions</title>
<p>JT, XS, JZ, and CH conceived the study aims. JT and WL undertook screening for the review. JZ and WY extracted data and checked it. YP and NZ undertook risk of bias assessment. JT, XS, and JZ developed the analysis plan. CH oversaw data analysis. JT drafted the initial manuscript. JZ edited the initial draft. XS verified the data. JT, XS, and CH obtained funding for the study. All authors conceptualized and approved the research protocol, which outlined the aims and study methods used here, provided critical comments on the manuscript, had access to the data, and approved the final version of the manuscript.</p></sec>
</body>
<back>
<sec sec-type="funding-information" id="s9">
<title>Funding</title>
<p>This work was supported by the Key Discipline Construction Fund of the Shanghai Pudong New Area Municipal Commission of Health and Family Planning (Grant No. PWZxk2022-18), the Young Medical Talents Training Project of Health Commission in Pudong New Area (Grant No. PWRq2020-59), and the Key Discipline Construction Fund of the Outstanding Clinical Discipline Project of Shanghai Pudong Funding (Grant No. PWYgy2021-02).</p>
</sec>
<ack><p>We would like to thank the Shanghai Pudong New Area Municipal Commission of Health and Family Planning for funding support. We also thank Xudong Zhao, Binggen Zhu, and Qiang Wang for their comments on the review protocol and analysis. Finally, we thank Zhengwan Qu, Jie Yuan, Hua Jiang, and Xiwang Fan for clarification of data from our studies and review of early drafts of the manuscript.</p>
</ack>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec sec-type="supplementary-material" id="s11">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1096857/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1096857/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.PDF" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Almater</surname> <given-names>A. I.</given-names></name> <name><surname>Tobaigy</surname> <given-names>M. F.</given-names></name> <name><surname>Younis</surname> <given-names>A. S.</given-names></name> <name><surname>Alaqeel</surname> <given-names>M. K.</given-names></name> <name><surname>Abouammoh</surname> <given-names>M. A.</given-names></name></person-group> (<year>2020</year>). <article-title>Effect of 2019 coronavirus pandemic on ophthalmologists practicing in Saudi Arabia: A psychological health assessment</article-title>. <source>Middle East Afr. J. Ophthalmol.</source> <volume>27</volume>, <fpage>79</fpage>&#x02013;<lpage>85</lpage>. <pub-id pub-id-type="doi">10.4103/meajo.MEAJO_220_20</pub-id><pub-id pub-id-type="pmid">32874039</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alshekaili</surname> <given-names>M.</given-names></name> <name><surname>Hassan</surname> <given-names>W.</given-names></name> <name><surname>Al Said</surname> <given-names>N.</given-names></name> <name><surname>Al Sulaimani</surname> <given-names>F.</given-names></name> <name><surname>Jayapal</surname> <given-names>S. K.</given-names></name> <name><surname>Al-Mawali</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Factors associated with mental health outcomes across healthcare settings in Oman during COVID-19: frontline versus non-frontline healthcare workers</article-title>. <source>Br. Med. J. Open</source> <volume>10</volume>, <fpage>e042030</fpage>. <pub-id pub-id-type="doi">10.1136/bmjopen-2020-042030</pub-id><pub-id pub-id-type="pmid">33040019</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Azoulay</surname> <given-names>E.</given-names></name> <name><surname>Pochard</surname> <given-names>F.</given-names></name> <name><surname>Reignier</surname> <given-names>J.</given-names></name> <name><surname>Argaud</surname> <given-names>L.</given-names></name> <name><surname>Bruneel</surname> <given-names>F.</given-names></name> <name><surname>Courbon</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Symptoms of mental health disorders in critical care physicians facing the second COVID-19 wave: A cross-sectional study</article-title>. <source>Chest</source> <volume>160</volume>, <fpage>944</fpage>&#x02013;<lpage>955</lpage>. <pub-id pub-id-type="doi">10.1016/j.chest.2021.05.023</pub-id><pub-id pub-id-type="pmid">34023323</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boden</surname> <given-names>M.</given-names></name> <name><surname>Cohen</surname> <given-names>N.</given-names></name> <name><surname>Froelich</surname> <given-names>J. M.</given-names></name> <name><surname>Hoggatt</surname> <given-names>K. J.</given-names></name> <name><surname>Abdel Magid</surname> <given-names>H. S.</given-names></name> <name><surname>Mushiana</surname> <given-names>S. S.</given-names></name></person-group> (<year>2021</year>). <article-title>Mental disorder prevalence among populations impacted by coronavirus pandemics: A multilevel meta-analytic study of COVID-19, MERS &#x00026; SARS</article-title>. <source>Gen. Hosp. Psychiatr.</source> <volume>70</volume>, <fpage>124</fpage>&#x02013;<lpage>133</lpage>. <pub-id pub-id-type="doi">10.1016/j.genhosppsych.2021.03.006</pub-id><pub-id pub-id-type="pmid">34531031</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000F6;ger</surname> <given-names>B.</given-names></name> <name><surname>Fachi</surname> <given-names>M. M.</given-names></name> <name><surname>Vilhena</surname> <given-names>R. O.</given-names></name> <name><surname>Cobre</surname> <given-names>A. F.</given-names></name> <name><surname>Tonin</surname> <given-names>F. S.</given-names></name> <name><surname>Pontarolo</surname> <given-names>R.</given-names></name></person-group> (<year>2021</year>). <article-title>Systematic review with meta-analysis of the accuracy of diagnostic tests for COVID-19</article-title>. <source>Am. J. Infect. Control</source> <volume>49</volume>, <fpage>21</fpage>&#x02013;<lpage>29</lpage>. <pub-id pub-id-type="doi">10.1016/j.ajic.2020.07.011</pub-id><pub-id pub-id-type="pmid">32659413</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chu</surname> <given-names>D. K.</given-names></name> <name><surname>Akl</surname> <given-names>E. A.</given-names></name> <name><surname>Duda</surname> <given-names>S.</given-names></name> <name><surname>Solo</surname> <given-names>K.</given-names></name> <name><surname>Yaacoub</surname> <given-names>S.</given-names></name> <name><surname>Sch&#x000FC;nemann</surname> <given-names>H. J.</given-names></name></person-group> (<year>2020</year>). <article-title>Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: A systematic review and meta-analysis</article-title>. <source>Lancet</source> <volume>395</volume>, <fpage>1973</fpage>&#x02013;<lpage>1987</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(20)31142-9</pub-id><pub-id pub-id-type="pmid">32497510</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Computing</surname> <given-names>T.R.p.f.s.</given-names></name></person-group> (<year>2022</year>). <source>The R Project for Statistical Computing</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.R-project.org/">http://www.R-project.org/</ext-link></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cui</surname> <given-names>Q.</given-names></name> <name><surname>Cai</surname> <given-names>Z.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Liu</surname> <given-names>Z.</given-names></name> <name><surname>Sun</surname> <given-names>S.</given-names></name> <name><surname>Chen</surname> <given-names>C.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>The psychological pressures of breast cancer patients during the COVID-19 outbreak in China-A comparison with frontline female nurses</article-title>. <source>Front. Psychiatr.</source> <volume>11</volume>, <fpage>559701</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyt.2020.559701</pub-id><pub-id pub-id-type="pmid">33384620</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dai</surname> <given-names>H.</given-names></name> <name><surname>Saccardo</surname> <given-names>S.</given-names></name> <name><surname>Han</surname> <given-names>M. A.</given-names></name> <name><surname>Roh</surname> <given-names>L.</given-names></name> <name><surname>Raja</surname> <given-names>N.</given-names></name> <name><surname>Vangala</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Behavioural nudges increase COVID-19 vaccinations</article-title>. <source>Nature</source> <volume>597</volume>, <fpage>404</fpage>&#x02013;<lpage>409</lpage>. <pub-id pub-id-type="doi">10.1038/s41586-021-03843-2</pub-id><pub-id pub-id-type="pmid">34340242</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Vroege</surname> <given-names>L.</given-names></name> <name><surname>van den Broek</surname> <given-names>A.</given-names></name></person-group> (<year>2021</year>). <article-title>Results of mental support for health care professionals and mental care during the COVID-19 pandemic</article-title>. <source>J. Public Health</source><volume>43</volume>, <fpage>490</fpage>&#x02013;<lpage>492</lpage>. <pub-id pub-id-type="doi">10.1093/pubmed/fdaa278</pub-id><pub-id pub-id-type="pmid">33501979</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deng</surname> <given-names>J.</given-names></name> <name><surname>Zhou</surname> <given-names>F.</given-names></name> <name><surname>Hou</surname> <given-names>W.</given-names></name> <name><surname>Silver</surname> <given-names>Z.</given-names></name> <name><surname>Wong</surname> <given-names>C. Y.</given-names></name> <name><surname>Chang</surname> <given-names>O.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>The prevalence of depression, anxiety, and sleep disturbances in COVID-19 patients: A meta-analysis</article-title>. <source>Ann. N. Y. Acad. Sci.</source> <volume>1486</volume>, <fpage>90</fpage>&#x02013;<lpage>111</lpage>. <pub-id pub-id-type="doi">10.1111/nyas.14506</pub-id><pub-id pub-id-type="pmid">33009668</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Di Mattei</surname> <given-names>V. E.</given-names></name> <name><surname>Perego</surname> <given-names>G.</given-names></name> <name><surname>Milano</surname> <given-names>F.</given-names></name> <name><surname>Mazzetti</surname> <given-names>M.</given-names></name> <name><surname>Taranto</surname> <given-names>P.</given-names></name> <name><surname>Di Pierro</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>The &#x0201C;healthcare workers&#x00027; wellbeing (benessere operatori)&#x0201D; project: A picture of the mental health conditions of italian healthcare workers during the first wave of the COVID-19 pandemic</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>18</volume>, <fpage>105267</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph18105267</pub-id><pub-id pub-id-type="pmid">34063421</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Elbay</surname> <given-names>R. Y.</given-names></name> <name><surname>Kurtulmu&#x0015F;</surname> <given-names>A.</given-names></name> <name><surname>Arpacioglu</surname> <given-names>S.</given-names></name> <name><surname>Karadere</surname> <given-names>E.</given-names></name></person-group> (<year>2020</year>). <article-title>Depression, anxiety, stress levels of physicians and associated factors in Covid-19 pandemics</article-title>. <source>Psychiatry Res.</source> <volume>290</volume>, <fpage>113130</fpage>. <pub-id pub-id-type="doi">10.1016/j.psychres.2020.113130</pub-id><pub-id pub-id-type="pmid">32497969</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Elkholy</surname> <given-names>H.</given-names></name> <name><surname>Tawfik</surname> <given-names>F.</given-names></name> <name><surname>Ibrahim</surname> <given-names>I.</given-names></name> <name><surname>Salah El-Din</surname> <given-names>W.</given-names></name> <name><surname>Sabry</surname> <given-names>M.</given-names></name> <name><surname>Mohammed</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Mental health of frontline healthcare workers exposed to COVID-19 in Egypt: A call for action</article-title>. <source>Int. J. Soc. Psychiatr.</source> <volume>67</volume>, <fpage>522</fpage>&#x02013;<lpage>531</lpage>. <pub-id pub-id-type="doi">10.1177/0020764020960192</pub-id><pub-id pub-id-type="pmid">32972298</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Erquicia</surname> <given-names>J.</given-names></name> <name><surname>Valls</surname> <given-names>L.</given-names></name> <name><surname>Barja</surname> <given-names>A.</given-names></name> <name><surname>Gil</surname> <given-names>S.</given-names></name> <name><surname>Miquel</surname> <given-names>J.</given-names></name> <name><surname>Leal-Blanquet</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Emotional impact of the Covid-19 pandemic on healthcare workers in one of the most important infection outbreaks in Europe</article-title>. <source>Med. Clin.</source> <volume>155</volume>, <fpage>434</fpage>&#x02013;<lpage>440</lpage>. <pub-id pub-id-type="doi">10.1016/j.medcli.2020.07.006</pub-id><pub-id pub-id-type="pmid">33163628</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fiol-DeRoque</surname> <given-names>M. A.</given-names></name> <name><surname>Serrano-Ripoll</surname> <given-names>M. J.</given-names></name> <name><surname>Jim&#x000E9;nez</surname> <given-names>R.</given-names></name> <name><surname>Zamanillo-Campos</surname> <given-names>R.</given-names></name> <name><surname>Y&#x000E1;&#x000F1;ez-Juan</surname> <given-names>A. M.</given-names></name> <name><surname>Bennasar-Veny</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>A mobile phone-based intervention to reduce mental health problems in health care workers during the COVID-19 pandemic (PsyCovidApp): Randomized controlled trial</article-title>. <source>JMIR Mhealth Uhealth</source> <volume>9</volume>, <fpage>e27039</fpage>. <pub-id pub-id-type="doi">10.2196/27039</pub-id><pub-id pub-id-type="pmid">33909587</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fitzpatrick</surname> <given-names>K. M.</given-names></name> <name><surname>Drawve</surname> <given-names>G.</given-names></name> <name><surname>Harris</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>Facing new fears during the COVID-19 pandemic: The State of America&#x00027;s mental health</article-title>. <source>J. Anxiety Disord.</source> <volume>75</volume>, <fpage>102291</fpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2020.102291</pub-id><pub-id pub-id-type="pmid">32827869</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Giardino</surname> <given-names>D. L.</given-names></name> <name><surname>Huck-Iriart</surname> <given-names>C.</given-names></name> <name><surname>Riddick</surname> <given-names>M.</given-names></name> <name><surname>Garay</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>The endless quarantine: the impact of the COVID-19 outbreak on healthcare workers after three months of mandatory social isolation in Argentina</article-title>. <source>Sleep Med.</source> <volume>76</volume>, <fpage>16</fpage>&#x02013;<lpage>25</lpage>. <pub-id pub-id-type="doi">10.1016/j.sleep.2020.09.022</pub-id><pub-id pub-id-type="pmid">33059247</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gottlieb</surname> <given-names>R. L.</given-names></name> <name><surname>Nirula</surname> <given-names>A.</given-names></name> <name><surname>Chen</surname> <given-names>P.</given-names></name> <name><surname>Boscia</surname> <given-names>J.</given-names></name> <name><surname>Heller</surname> <given-names>B.</given-names></name> <name><surname>Morris</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Effect of bamlanivimab as monotherapy or in combination with etesevimab on viral load in patients with mild to moderate COVID-19: A randomized clinical trial</article-title>. <source>J. Am. Med. Assoc</source> <volume>325</volume>, <fpage>632</fpage>&#x02013;<lpage>644</lpage>. <pub-id pub-id-type="doi">10.1001/jama.2021.0202</pub-id><pub-id pub-id-type="pmid">33475701</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goularte</surname> <given-names>J. F.</given-names></name> <name><surname>Serafim</surname> <given-names>S. D.</given-names></name> <name><surname>Colombo</surname> <given-names>R.</given-names></name> <name><surname>Hogg</surname> <given-names>B.</given-names></name> <name><surname>Caldieraro</surname> <given-names>M. A.</given-names></name> <name><surname>Rosa</surname> <given-names>A. R.</given-names></name></person-group> (<year>2021</year>). <article-title>COVID-19 and mental health in Brazil: Psychiatric symptoms in the general population</article-title>. <source>J. Psychiatr. Res.</source> <volume>132</volume>, <fpage>32</fpage>&#x02013;<lpage>37</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychires.2020.09.021</pub-id><pub-id pub-id-type="pmid">33038563</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Greenberg</surname> <given-names>N.</given-names></name> <name><surname>Docherty</surname> <given-names>M.</given-names></name> <name><surname>Gnanapragasam</surname> <given-names>S.</given-names></name> <name><surname>Wessely</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>Managing mental health challenges faced by healthcare workers during covid-19 pandemic</article-title>. <source>Br. Med. J.</source> <volume>368</volume>, <fpage>m1211</fpage>. <pub-id pub-id-type="doi">10.1136/bmj.m1211</pub-id><pub-id pub-id-type="pmid">32217624</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guo</surname> <given-names>W. P.</given-names></name> <name><surname>Min</surname> <given-names>Q.</given-names></name> <name><surname>Gu</surname> <given-names>W. W.</given-names></name> <name><surname>Yu</surname> <given-names>L.</given-names></name> <name><surname>Xiao</surname> <given-names>X.</given-names></name> <name><surname>Yi</surname> <given-names>W. B.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Prevalence of mental health problems in frontline healthcare workers after the first outbreak of COVID-19 in China: A cross-sectional study</article-title>. <source>Health Qual. Life Outcomes</source> <volume>19</volume>, <fpage>103</fpage>. <pub-id pub-id-type="doi">10.1186/s12955-021-01743-7</pub-id><pub-id pub-id-type="pmid">33752686</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haravuori</surname> <given-names>H.</given-names></name> <name><surname>Junttila</surname> <given-names>K.</given-names></name> <name><surname>Haapa</surname> <given-names>T.</given-names></name> <name><surname>Tuisku</surname> <given-names>K.</given-names></name> <name><surname>Kujala</surname> <given-names>A.</given-names></name> <name><surname>Rosenstr&#x000F6;m</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Personnel well-being in the Helsinki University Hospital during the COVID-19 pandemic-A prospective cohort study</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>17</volume>, <fpage>905</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph17217905</pub-id><pub-id pub-id-type="pmid">33126583</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hitchon</surname> <given-names>C. A.</given-names></name> <name><surname>Zhang</surname> <given-names>L.</given-names></name> <name><surname>Peschken</surname> <given-names>C. A.</given-names></name> <name><surname>Lix</surname> <given-names>L. M.</given-names></name> <name><surname>Graff</surname> <given-names>L. A.</given-names></name> <name><surname>Fisk</surname> <given-names>J. D.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Validity and reliability of screening measures for depression and anxiety disorders in rheumatoid arthritis</article-title>. <source>Arthritis Care Res.</source> <volume>72</volume>, <fpage>1130</fpage>&#x02013;<lpage>1139</lpage>. <pub-id pub-id-type="doi">10.1002/acr.24011</pub-id><pub-id pub-id-type="pmid">31199570</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kinder</surname> <given-names>F.</given-names></name> <name><surname>Harvey</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Covid-19: The medical students responding to the pandemic</article-title>. <source>Br. Med. J.</source> <volume>369</volume>, <fpage>m2160</fpage>. <pub-id pub-id-type="doi">10.1136/bmj.m2160</pub-id><pub-id pub-id-type="pmid">32540952</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kola</surname> <given-names>L.</given-names></name> <name><surname>Kohrt</surname> <given-names>B. A.</given-names></name> <name><surname>Acharya</surname> <given-names>B.</given-names></name> <name><surname>Mutamba</surname> <given-names>B. B.</given-names></name> <name><surname>Kieling</surname> <given-names>C.</given-names></name> <name><surname>Kumar</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>The path to global equity in mental health care in the context of COVID-19</article-title>. <source>Lancet</source> <volume>398</volume>, <fpage>1670</fpage>&#x02013;<lpage>1672</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(21)02233-9</pub-id><pub-id pub-id-type="pmid">34627492</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lai</surname> <given-names>J.</given-names></name> <name><surname>Ma</surname> <given-names>S.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name> <name><surname>Cai</surname> <given-names>Z.</given-names></name> <name><surname>Hu</surname> <given-names>J.</given-names></name> <name><surname>Wei</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019</article-title>. <source>J. Am. Med. Assoc. Netw. Open</source> <volume>3</volume>, <fpage>e203976</fpage>. <pub-id pub-id-type="doi">10.1001/jamanetworkopen.2020.3976</pub-id><pub-id pub-id-type="pmid">32202646</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>E. H.</given-names></name></person-group> (<year>2012</year>). <article-title>Review of the psychometric evidence of the perceived stress scale</article-title>. <source>Asian Nurs. Res.</source> <volume>6</volume>, <fpage>121</fpage>&#x02013;<lpage>127</lpage>. <pub-id pub-id-type="doi">10.1016/j.anr.2012.08.004</pub-id><pub-id pub-id-type="pmid">25030254</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>J.</given-names></name> <name><surname>Lee</surname> <given-names>H. J.</given-names></name> <name><surname>Hong</surname> <given-names>Y.</given-names></name> <name><surname>Shin</surname> <given-names>Y. W.</given-names></name> <name><surname>Chung</surname> <given-names>S.</given-names></name> <name><surname>Park</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>Risk perception, unhealthy behavior, and anxiety due to viral epidemic among healthcare workers: The relationships with depressive and insomnia symptoms during COVID-19</article-title>. <source>Front. Psychiatry</source>. <volume>12</volume>, <fpage>615387</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyt.2021.615387</pub-id><pub-id pub-id-type="pmid">33815164</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>W.</given-names></name> <name><surname>Chen</surname> <given-names>W.</given-names></name> <name><surname>Yuan</surname> <given-names>H.</given-names></name> <name><surname>Zhang</surname> <given-names>S.</given-names></name> <name><surname>Tian</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Applications of the Chinese version of the primary care PTSD screen for DSM-5 (PC-PTSD-5) for children</article-title>. <source>J. Affect Disord.</source> <volume>254</volume>, <fpage>109</fpage>&#x02013;<lpage>114</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2019.05.021</pub-id><pub-id pub-id-type="pmid">31158781</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>T.</given-names></name> <name><surname>Zheng</surname> <given-names>Z.</given-names></name> <name><surname>Sha</surname> <given-names>X.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name> <name><surname>Zheng</surname> <given-names>W.</given-names></name> <name><surname>Su</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Psychological impact in non-infectious disease specialists who had direct contact with patients with COVID-19</article-title>. <source>BJPsych Open</source>. <volume>7</volume>, <fpage>e8</fpage>. <pub-id pub-id-type="doi">10.1192/bjo.2020.147</pub-id><pub-id pub-id-type="pmid">33283699</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lotta</surname> <given-names>G.</given-names></name> <name><surname>Fernandez</surname> <given-names>M.</given-names></name> <name><surname>Pimenta</surname> <given-names>D.</given-names></name> <name><surname>Wenham</surname> <given-names>C.</given-names></name></person-group> (<year>2021</year>). <article-title>Gender, race, and health workers in the COVID-19 pandemic</article-title>. <source>Lancet.</source> <volume>397</volume>, <fpage>1264</fpage>. <pub-id pub-id-type="doi">10.1016/s0140-6736(21)00530-4</pub-id><pub-id pub-id-type="pmid">36259834</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lumley</surname> <given-names>S.</given-names></name> <name><surname>O&#x00027;Donnell</surname> <given-names>D.</given-names></name> <name><surname>Stoesser</surname> <given-names>N.</given-names></name> <name><surname>Matthews</surname> <given-names>P.</given-names></name> <name><surname>Howarth</surname> <given-names>A.</given-names></name> <name><surname>Hatch</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Antibody status and incidence of SARS-CoV-2 infection in health care workers</article-title>. <source>N England J Med.</source> <volume>384</volume>, <fpage>533</fpage>&#x02013;<lpage>540</lpage>. <pub-id pub-id-type="doi">10.1056/NEJMoa2034545</pub-id><pub-id pub-id-type="pmid">34242763</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Magnavita</surname> <given-names>N.</given-names></name> <name><surname>Chirico</surname> <given-names>F.</given-names></name> <name><surname>Garbarino</surname> <given-names>S.</given-names></name> <name><surname>Bragazzi</surname> <given-names>N. L.</given-names></name> <name><surname>Santacroce</surname> <given-names>E.</given-names></name> <name><surname>Zaffina</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). <article-title>SARS/MERS/SARS-CoV-2 outbreaks and burnout syndrome among healthcare workers. An umbrella systematic review</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>18</volume>, <fpage>84361</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph18084361</pub-id><pub-id pub-id-type="pmid">33924026</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Magnavita</surname> <given-names>N.</given-names></name> <name><surname>Soave</surname> <given-names>P. M.</given-names></name> <name><surname>Ricciardi</surname> <given-names>W.</given-names></name> <name><surname>Antonelli</surname> <given-names>M.</given-names></name></person-group> (<year>2020a</year>). <article-title>Occupational stress and mental health among anesthetists during the COVID-19 pandemic</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>17</volume>, <fpage>218245</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph17218245</pub-id><pub-id pub-id-type="pmid">33171618</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Magnavita</surname> <given-names>N.</given-names></name> <name><surname>Tripepi</surname> <given-names>G.</given-names></name> <name><surname>Di Prinzio</surname> <given-names>R. R.</given-names></name></person-group> (<year>2020b</year>). <article-title>Symptoms in health care workers during the COVID-19 epidemic. A cross-sectional survey</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>17</volume>:<fpage>145218</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph17145218</pub-id><pub-id pub-id-type="pmid">32698320</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mediavilla</surname> <given-names>R.</given-names></name> <name><surname>Monistrol-Mula</surname> <given-names>A.</given-names></name> <name><surname>McGreevy</surname> <given-names>K. R.</given-names></name> <name><surname>Felez-Nobrega</surname> <given-names>M.</given-names></name> <name><surname>Delaire</surname> <given-names>A.</given-names></name> <name><surname>Nicaise</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Mental health problems and needs of frontline healthcare workers during the COVID-19 pandemic in Spain: A qualitative analysis</article-title>. <source>Front. Public Health</source> <volume>10</volume>, <fpage>956403</fpage>. <pub-id pub-id-type="doi">10.3389/fpubh.2022.956403</pub-id><pub-id pub-id-type="pmid">35968478</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moher</surname> <given-names>D.</given-names></name> <name><surname>Liberati</surname> <given-names>A.</given-names></name> <name><surname>Tetzlaff</surname> <given-names>J.</given-names></name> <name><surname>Altman</surname> <given-names>D. G.</given-names></name></person-group> (<year>2009</year>). <article-title>Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement</article-title>. <source>Open Med.</source> <volume>3</volume>, <fpage>e123</fpage>&#x02013;<lpage>130</lpage>. <pub-id pub-id-type="doi">10.1371/journal.pmed.1000097</pub-id><pub-id pub-id-type="pmid">20171303</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morin</surname> <given-names>C. M.</given-names></name> <name><surname>Belleville</surname> <given-names>G.</given-names></name> <name><surname>B&#x000E9;langer</surname> <given-names>L.</given-names></name> <name><surname>Ivers</surname> <given-names>H.</given-names></name></person-group> (<year>2011</year>). <article-title>The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response</article-title>. <source>Sleep</source> <volume>34</volume>, <fpage>601</fpage>&#x02013;<lpage>608</lpage>. <pub-id pub-id-type="doi">10.1093/sleep/34.5.601</pub-id><pub-id pub-id-type="pmid">21532953</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pan</surname> <given-names>K. Y.</given-names></name> <name><surname>Kok</surname> <given-names>A. A. L.</given-names></name> <name><surname>Eikelenboom</surname> <given-names>M.</given-names></name> <name><surname>Horsfall</surname> <given-names>M.</given-names></name> <name><surname>J&#x000F6;rg</surname> <given-names>F.</given-names></name> <name><surname>Luteijn</surname> <given-names>R. A.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>The mental health impact of the COVID-19 pandemic on people with and without depressive, anxiety, or obsessive-compulsive disorders: A longitudinal study of three Dutch case-control cohorts</article-title>. <source>Lancet Psychiatr.</source> <volume>8</volume>, <fpage>121</fpage>&#x02013;<lpage>129</lpage>. <pub-id pub-id-type="doi">10.1016/S2215-0366(20)30491-0</pub-id><pub-id pub-id-type="pmid">33306975</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pappa</surname> <given-names>S.</given-names></name> <name><surname>Ntella</surname> <given-names>V.</given-names></name> <name><surname>Giannakas</surname> <given-names>T.</given-names></name> <name><surname>Giannakoulis</surname> <given-names>V. G.</given-names></name> <name><surname>Papoutsi</surname> <given-names>E.</given-names></name> <name><surname>Katsaounou</surname> <given-names>P.</given-names></name></person-group> (<year>2020</year>). <article-title>Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis</article-title>. <source>Brain Behav. Immun.</source> <volume>88</volume>, <fpage>901</fpage>&#x02013;<lpage>907</lpage>. <pub-id pub-id-type="doi">10.1016/j.bbi.2020.05.026</pub-id><pub-id pub-id-type="pmid">33309228</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salari</surname> <given-names>N.</given-names></name> <name><surname>Hosseinian-Far</surname> <given-names>A.</given-names></name> <name><surname>Jalali</surname> <given-names>R.</given-names></name> <name><surname>Vaisi-Raygani</surname> <given-names>A.</given-names></name> <name><surname>Rasoulpoor</surname> <given-names>S.</given-names></name> <name><surname>Mohammadi</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: A systematic review and meta-analysis</article-title>. <source>Glob. Health</source> <volume>16</volume>, <fpage>57</fpage>. <pub-id pub-id-type="doi">10.1186/s12992-020-00589-w</pub-id><pub-id pub-id-type="pmid">32631403</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salehi</surname> <given-names>S.</given-names></name> <name><surname>Abedi</surname> <given-names>A.</given-names></name> <name><surname>Balakrishnan</surname> <given-names>S.</given-names></name> <name><surname>Gholamrezanezhad</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Coronavirus disease 2019 (COVID-19): A systematic review of imaging findings in 919 patients</article-title>. <source>Am. J. Roentgenol.</source> <volume>215</volume>, <fpage>87</fpage>&#x02013;<lpage>93</lpage>. <pub-id pub-id-type="doi">10.2214/AJR.20.23034</pub-id><pub-id pub-id-type="pmid">32174129</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schneider</surname> <given-names>J.</given-names></name> <name><surname>Talamonti</surname> <given-names>D.</given-names></name> <name><surname>Gibson</surname> <given-names>B.</given-names></name> <name><surname>Forshaw</surname> <given-names>M.</given-names></name></person-group> (<year>2022</year>). <article-title>Factors mediating the psychological wellbeing of healthcare workers responding to global pandemics: A systematic review</article-title>. <source>J. Health Psychol.</source> <volume>27</volume>, <fpage>1875</fpage>&#x02013;<lpage>1896</lpage>. <pub-id pub-id-type="doi">10.1177/13591053211012759</pub-id><pub-id pub-id-type="pmid">33913356</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shanafelt</surname> <given-names>T.</given-names></name> <name><surname>Ripp</surname> <given-names>J.</given-names></name> <name><surname>Trockel</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>Understanding and addressing sources of anxiety among health care professionals during the COVID-19 pandemic</article-title>. <source>J. Am. Med. Assoc.</source> <volume>323</volume>, <fpage>2133</fpage>&#x02013;<lpage>2134</lpage>. <pub-id pub-id-type="doi">10.1001/jama.2020.5893</pub-id><pub-id pub-id-type="pmid">32259193</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shechter</surname> <given-names>A.</given-names></name> <name><surname>Diaz</surname> <given-names>F.</given-names></name> <name><surname>Moise</surname> <given-names>N.</given-names></name> <name><surname>Anstey</surname> <given-names>D. E.</given-names></name> <name><surname>Ye</surname> <given-names>S.</given-names></name> <name><surname>Agarwal</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Psychological distress, coping behaviors, and preferences for support among New York healthcare workers during the COVID-19 pandemic</article-title>. <source>Gen. Hosp. Psychiatr.</source> <volume>66</volume>, <fpage>1</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.genhosppsych.2020.06.007</pub-id><pub-id pub-id-type="pmid">32590254</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Siegrist</surname> <given-names>J.</given-names></name> <name><surname>Dragano</surname> <given-names>N.</given-names></name> <name><surname>Nyberg</surname> <given-names>S. T.</given-names></name> <name><surname>Lunau</surname> <given-names>T.</given-names></name> <name><surname>Alfredsson</surname> <given-names>L.</given-names></name> <name><surname>Erbel</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Validating abbreviated measures of effort-reward imbalance at work in European cohort studies: The IPD-Work consortium</article-title>. <source>Int. Arch. Occup. Environ. Health</source> <volume>87</volume>, <fpage>249</fpage>&#x02013;<lpage>256</lpage>. <pub-id pub-id-type="doi">10.1007/s00420-013-0855-z</pub-id><pub-id pub-id-type="pmid">24097076</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Simon</surname> <given-names>N. M.</given-names></name> <name><surname>Saxe</surname> <given-names>G. N.</given-names></name> <name><surname>Marmar</surname> <given-names>C. R.</given-names></name></person-group> (<year>2020</year>). <article-title>Mental health disorders related to COVID-19-related deaths</article-title>. <source>J. Am. Med. Assoc.</source> <volume>324</volume>, <fpage>1493</fpage>&#x02013;<lpage>1494</lpage>. <pub-id pub-id-type="doi">10.1001/jama.2020.19632</pub-id><pub-id pub-id-type="pmid">33044510</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Skowronski</surname> <given-names>D. M.</given-names></name> <name><surname>De Serres</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). <article-title>Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine</article-title>. <source>N. Engl. J. Med.</source> <volume>384</volume>, <fpage>1576</fpage>&#x02013;<lpage>1577</lpage>. <pub-id pub-id-type="doi">10.1056/NEJMc2036242</pub-id><pub-id pub-id-type="pmid">33596351</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stang</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses</article-title>. <source>Eur. J. Epidemiol.</source> <volume>25</volume>, <fpage>603</fpage>&#x02013;<lpage>605</lpage>. <pub-id pub-id-type="doi">10.1007/s10654-010-9491-z</pub-id><pub-id pub-id-type="pmid">20652370</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taylor</surname> <given-names>S.</given-names></name> <name><surname>Landry</surname> <given-names>C. A.</given-names></name> <name><surname>Rachor</surname> <given-names>G. S.</given-names></name> <name><surname>Paluszek</surname> <given-names>M. M.</given-names></name> <name><surname>Asmundson</surname> <given-names>G. J. G.</given-names></name></person-group> (<year>2020</year>). <article-title>Fear and avoidance of healthcare workers: An important, under-recognized form of stigmatization during the COVID-19 pandemic</article-title>. <source>J. Anxiety Disord.</source> <volume>75</volume>, <fpage>102289</fpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2020.102289</pub-id><pub-id pub-id-type="pmid">32853884</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><collab>The L.</collab></person-group> (<year>2020</year>). <article-title>COVID-19: Protecting health-care workers</article-title>. <source>Lancet</source> <volume>395</volume>, <fpage>922</fpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(20)30644-9</pub-id><pub-id pub-id-type="pmid">32199474</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thoresen</surname> <given-names>S.</given-names></name> <name><surname>Jensen</surname> <given-names>T. K.</given-names></name> <name><surname>Wentzel-Larsen</surname> <given-names>T.</given-names></name> <name><surname>Dyb</surname> <given-names>G.</given-names></name></person-group> (<year>2014</year>). <article-title>Social support barriers and mental health in terrorist attack survivors</article-title>. <source>J. Affect Disord.</source> <volume>156</volume>, <fpage>187</fpage>&#x02013;<lpage>193</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2013.12.014</pub-id><pub-id pub-id-type="pmid">24398044</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tiete</surname> <given-names>J.</given-names></name> <name><surname>Guatteri</surname> <given-names>M.</given-names></name> <name><surname>Lachaux</surname> <given-names>A.</given-names></name> <name><surname>Matossian</surname> <given-names>A.</given-names></name> <name><surname>Hougardy</surname> <given-names>J. M.</given-names></name> <name><surname>Loas</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Mental health outcomes in healthcare workers in COVID-19 and non-COVID-19 care units: A cross-sectional survey in Belgium</article-title>. <source>Front. Psychol.</source> <volume>11</volume>, <fpage>612241</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2020.612241</pub-id><pub-id pub-id-type="pmid">33469439</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Houwelingen</surname> <given-names>H. C.</given-names></name> <name><surname>Arends</surname> <given-names>L. R.</given-names></name> <name><surname>Stijnen</surname> <given-names>T.</given-names></name></person-group> (<year>2002</year>). <article-title>Advanced methods in meta-analysis: Multivariate approach and meta-regression</article-title>. <source>Stat. Med.</source> <volume>21</volume>, <fpage>589</fpage>&#x02013;<lpage>624</lpage>. <pub-id pub-id-type="doi">10.1002/sim.1040</pub-id><pub-id pub-id-type="pmid">11836738</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>L. Q.</given-names></name> <name><surname>Zhang</surname> <given-names>M.</given-names></name> <name><surname>Liu</surname> <given-names>G. M.</given-names></name> <name><surname>Nan</surname> <given-names>S. Y.</given-names></name> <name><surname>Li</surname> <given-names>T.</given-names></name> <name><surname>Xu</surname> <given-names>L.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Psychological impact of coronavirus disease (2019) (COVID-19) epidemic on medical staff in different posts in China: A multicenter study</article-title>. <source>J. Psychiatr. Res.</source> <volume>129</volume>, <fpage>198</fpage>&#x02013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychires.2020.07.008</pub-id><pub-id pub-id-type="pmid">32763586</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Xu</surname> <given-names>Y.</given-names></name> <name><surname>Gao</surname> <given-names>R.</given-names></name> <name><surname>Lu</surname> <given-names>R.</given-names></name> <name><surname>Han</surname> <given-names>K.</given-names></name> <name><surname>Wu</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Detection of SARS-CoV-2 in different types of clinical specimens</article-title>. <source>J. Am. Med. Assoc</source> <volume>323</volume>, <fpage>1843</fpage>&#x02013;<lpage>1844</lpage>. <pub-id pub-id-type="doi">10.1001/jama.2020.3786</pub-id><pub-id pub-id-type="pmid">32706393</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wasserman</surname> <given-names>D.</given-names></name> <name><surname>Iosue</surname> <given-names>M.</given-names></name> <name><surname>Wuestefeld</surname> <given-names>A.</given-names></name> <name><surname>Carli</surname> <given-names>V.</given-names></name></person-group> (<year>2020</year>). <article-title>Adaptation of evidence-based suicide prevention strategies during and after the COVID-19 pandemic</article-title>. <source>J World Psychiatr.</source> <volume>19</volume>, <fpage>294</fpage>&#x02013;<lpage>306</lpage>. <pub-id pub-id-type="doi">10.1002/wps.20801</pub-id><pub-id pub-id-type="pmid">32931107</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname> <given-names>J. W.</given-names> <suffix>Jr.</suffix></name> <name><surname>Pignone</surname> <given-names>M.</given-names></name> <name><surname>Ramirez</surname> <given-names>G.</given-names></name> <name><surname>Perez Stellato</surname> <given-names>C.</given-names></name></person-group> (<year>2002</year>). <article-title>Identifying depression in primary care: A literature synthesis of case-finding instruments</article-title>. <source>Gen. Hosp. Psychiatr.</source> <volume>24</volume>, <fpage>225</fpage>&#x02013;<lpage>237</lpage>. <pub-id pub-id-type="doi">10.1016/S0163-8343(02)00195-0</pub-id><pub-id pub-id-type="pmid">12100833</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wright</surname> <given-names>H. M.</given-names></name> <name><surname>Griffin</surname> <given-names>B. J.</given-names></name> <name><surname>Shoji</surname> <given-names>K.</given-names></name> <name><surname>Love</surname> <given-names>T. M.</given-names></name> <name><surname>Langenecker</surname> <given-names>S. A.</given-names></name> <name><surname>Benight</surname> <given-names>C. C.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Pandemic-related mental health risk among front line personnel</article-title>. <source>J. Psychiatr. Res.</source> <volume>137</volume>, <fpage>673</fpage>&#x02013;<lpage>680</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychires.2020.10.045</pub-id><pub-id pub-id-type="pmid">33189356</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>F.</given-names></name> <name><surname>Zhao</surname> <given-names>S.</given-names></name> <name><surname>Yu</surname> <given-names>B.</given-names></name> <name><surname>Chen</surname> <given-names>Y. M.</given-names></name> <name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Song</surname> <given-names>Z. G.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>A new coronavirus associated with human respiratory disease in China</article-title>. <source>Nature</source> <volume>579</volume>, <fpage>265</fpage>&#x02013;<lpage>269</lpage>. <pub-id pub-id-type="doi">10.1038/s41586-020-2008-3</pub-id><pub-id pub-id-type="pmid">32296181</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Youssef</surname> <given-names>N.</given-names></name> <name><surname>Mostafa</surname> <given-names>A.</given-names></name> <name><surname>Ezzat</surname> <given-names>R.</given-names></name> <name><surname>Yosef</surname> <given-names>M.</given-names></name> <name><surname>El Kassas</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>Mental health status of health-care professionals working in quarantine and non-quarantine Egyptian hospitals during the COVID-19 pandemic</article-title>. <source>East Mediterr. Health J.</source> <volume>26</volume>, <fpage>1155</fpage>&#x02013;<lpage>1164</lpage>. <pub-id pub-id-type="doi">10.26719/emhj.20.116</pub-id><pub-id pub-id-type="pmid">33103742</pub-id></citation></ref>
</ref-list> 
</back>
</article> 