<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2022.1108835</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Development and psychometric properties of health care workers&#x2019; concerns in infectious outbreaks scale</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Yarahmadi</surname>
<given-names>Sajad</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Khademi</surname>
<given-names>Mojgan</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ebrahimzadeh</surname>
<given-names>Farzad</given-names>
</name>
<xref rid="aff3" ref-type="aff"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Cheraghian</surname>
<given-names>Tayebeh</given-names>
</name>
<xref rid="aff4" ref-type="aff"><sup>4</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Shahidi Delshad</surname>
<given-names>Elham</given-names>
</name>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2115633/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Social Determinants of Health Research Center, School of Nursing and Midwifery, Lorestan University of Medical Sciences</institution>, <addr-line>Khorramabad</addr-line>, <country>Iran</country></aff>
<aff id="aff2"><sup>2</sup><institution>Student Research Committee, Semnan University of Medical Sciences</institution>, <addr-line>Semnan</addr-line>, <country>Iran</country></aff>
<aff id="aff3"><sup>3</sup><institution>Nutritional Health Research Center, School of Health and Nutrition, Lorestan University of Medical Sciences</institution>, <addr-line>Khorramabad</addr-line>, <country>Iran</country></aff>
<aff id="aff4"><sup>4</sup><institution>Cardiovascular Research Center, Shahid Rahimi Hospital, Lorestan University of Medical Sciences</institution>, <addr-line>Khorramabad</addr-line>, <country>Iran</country></aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by"><p>Edited by: Mateusz Krystian Grajek, Medical University of Silesia in Katowice, Poland</p></fn>
<fn id="fn0002" fn-type="edited-by"><p>Reviewed by: Hojjat Farahmandnia, Kerman University of Medical Sciences, Iran; Ah Yusuf, Airlangga University, Indonesia</p></fn>
<corresp id="c001">&#x002A;Correspondence: Elham Shahidi Delshad, &#x02709; <email>delshad1364@gmail.com</email></corresp>
<fn id="fn0003" fn-type="other"><p>This article was submitted to Personality and Social Psychology, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>17</day>
<month>01</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>1108835</elocation-id>
<history>
<date date-type="received">
<day>26</day>
<month>11</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>26</day>
<month>12</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Yarahmadi, Khademi, Ebrahimzadeh, Cheraghian and Shahidi Delshad.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Yarahmadi, Khademi, Ebrahimzadeh, Cheraghian and Shahidi Delshad</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec>
<title>Introduction</title>
<p>Healthcare workers are a crucial workforce; from a moral perspective, understanding their concerns and how to support them is crucial and makes it possible for health services to keep functioning. This study aimed to develop and validate Health Care Workers&#x2019; Concerns in Infectious Outbreaks Scale (HCWCIOS).</p>
</sec>
<sec>
<title>Methods</title>
<p>This exploratory sequential mix-method study was employed to design and validate the HCWCIOS. The initial tool was designed after searching similar studies and performing a qualitative phase under the semi-structured approach. Both qualitative and quantitative methods were used to evaluate the face and content validity. The content validity ratio, content validity index, and item-level content validity index were also calculated. Exploratory factor analysis was employed to evaluate the construct validity. Using a convenient sampling method, 354 Iranian healthcare workers participated in the study. Computing Cronbach&#x2019;s alpha coefficient estimated the internal consistency for HCWCIOS and its subscales. Furthermore assessed was test&#x2013;retest reliability.</p>
</sec>
<sec>
<title>Results</title>
<p>The preliminary scale was designed with 57 items. By eliminating nine items in the content validity phase and 12 items during factor analysis, the final 36-item scale was developed on six factors: inadequate preparedness, lack of knowledge, risk perception, affected social relations, work pressure, and absenteeism. These six factors accounted for 46.507% of the total variance. The whole scale&#x2019;s Cronbach&#x2019;s alpha coefficient was 0.912, and the intra-class correlation coefficient was 0.88.</p>
</sec>
<sec>
<title>Conclusion</title>
<p>A 36-item HCWCIOS has good psychometric properties and is suitable for measuring healthcare workers&#x2019; concerns during a pandemic.</p>
</sec>
</abstract>
<kwd-group>
<kwd>concern</kwd>
<kwd>exploratory factor analysis</kwd>
<kwd>infectious disease outbreaks</kwd>
<kwd>psychometry</kwd>
<kwd>reliability</kwd>
<kwd>validity</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="53"/>
<page-count count="10"/>
<word-count count="7122"/>
</counts>
</article-meta>
</front>
<body>
<sec id="sec5" sec-type="intro">
<label>1.</label>
<title>Introduction</title>
<p>Increased outbreaks of infectious diseases in recent years, including Severe Acute Respiratory Syndrome (SARS) in 2003, Novel Influenza A/H1N1 in 2009, and Middle East Respiratory Syndrome (MERS) in 2012, have raised concerns about the potential of a global pandemic. The emergence of Corona Virus Disease-2019 (COVID-19) brought this potential to realization (<xref ref-type="bibr" rid="ref21">Fernandez et al., 2020</xref>) and caused a tremendous public health crisis (<xref ref-type="bibr" rid="ref41">Que et al., 2020</xref>; <xref ref-type="bibr" rid="ref49">Sperling, 2021</xref>).</p>
<p>Healthcare workers (HCWs) are on the front lines of the fight against the crisis of such infectious outbreaks (<xref ref-type="bibr" rid="ref1">Abolfotouh et al., 2017</xref>). They often risk contracting pathogens (<xref ref-type="bibr" rid="ref51">Temsah et al., 2020</xref>). Therefore, during the past and current infectious outbreaks, frontline HCWs became infected, and many have lost their lives (<xref ref-type="bibr" rid="ref12">Chakravorty et al., 2020</xref>; <xref ref-type="bibr" rid="ref26">Jalili et al., 2021</xref>). COVID-19 infections and deaths among HCWs follow that of the general population worldwide, and over 150,000 infections and 1,400 deaths were reported until 2020 (<xref ref-type="bibr" rid="ref6">Bandyopadhyay et al., 2020</xref>). According to a recent Iranian study, COVID-19 has killed about 10,000 HCWs (<xref ref-type="bibr" rid="ref26">Jalili et al., 2021</xref>).</p>
<p>Participating in frontline work and receiving such negative information appears to be significant risk factors for psychological distress and problems (<xref ref-type="bibr" rid="ref22">Goulia et al., 2010</xref>). High levels of concern have been reported in many studies (<xref ref-type="bibr" rid="ref2">Alsubaie et al., 2019</xref>) in both frontline and non-frontline HCWs (<xref ref-type="bibr" rid="ref45">Sahashi et al., 2021</xref>). It has significantly impacted them professionally and personally (<xref ref-type="bibr" rid="ref36">Moseley et al., 2020</xref>). Understanding HCWs&#x2019; concerns and how to support them is crucial, not only from a moral perspective but also to ensure that health services remain on track (<xref ref-type="bibr" rid="ref10">Borek et al., 2022</xref>). The HCWs&#x2019; concerns mean facing challenges, fears, and anxieties (<xref ref-type="bibr" rid="ref25">Heidarijamebozorgi et al., 2021</xref>).</p>
<p>Many frontline HCWs&#x2019; are concerned about well-reported deaths, according to media reports in the United Kingdom (<xref ref-type="bibr" rid="ref12">Chakravorty et al., 2020</xref>). They are frequently concerned about their health and the health of their families, concerned about how they function, and fear being stigmatized (<xref ref-type="bibr" rid="ref22">Goulia et al., 2010</xref>). A survey of over 10,000 HCWs during the SARS outbreak (2003) reported that many respondents experienced social stigmatization. Nearly half (49%) and 31%, respectively, believed that &#x201C;people avoid me because of my employment&#x201D; and &#x201C;people avoid my family members because of my job.&#x201D; For instance, some parents of school-aged children prohibited their kids from playing with or being close to HCWs&#x2019; kids. A significant portion of HCWs (69%) also thought that &#x201C;those close to me are concerned they might contract the virus from me&#x201D; (<xref ref-type="bibr" rid="ref31">Koh et al., 2005</xref>).</p>
<p>These are only part of the concerns of HCWs during pandemics. Various studies reported that during the outbreak of pandemics, widespread concerns are created among health workers, which becomes a big challenge for health systems in crisis periods (<xref ref-type="bibr" rid="ref1">Abolfotouh et al., 2017</xref>; <xref ref-type="bibr" rid="ref29">Khademipour et al., 2017</xref>; <xref ref-type="bibr" rid="ref8">Berkhout et al., 2021</xref>).</p>
<p>The novelty of the diseases, the lack of prior experience, and the potential that HCWs were not fully informed about the management difficulties by the pertinent authorities during their teaching campaign all could be attributed to a high level of concern (<xref ref-type="bibr" rid="ref2">Alsubaie et al., 2019</xref>).</p>
<p>Higher job stress, social isolation, and health fears have all been related to HCWs&#x2019; concerns and psychological distress around the outbreaks (<xref ref-type="bibr" rid="ref22">Goulia et al., 2010</xref>; <xref ref-type="bibr" rid="ref47">Sheikhbardsiri et al., 2022</xref>). Unrecognizing emotions and concerns may prevent patient-centered care, neglect patients&#x2019; psychological issues, avoid bonding with patients, and inhibit the quality of care. It also could affect the HCWs&#x2019; sense of well-being and may lead to distress, disengagement, job conflict, and burnout (<xref ref-type="bibr" rid="ref7">Barello et al., 2020</xref>). In an extended crisis such as the pandemic, the sustainability of the healthcare response entirely depends on its capability to protect the health of responders and the HCWs (<xref ref-type="bibr" rid="ref37">Muller et al., 2020</xref>). However, even when supplied for free or at a low cost, the support uptake by HCWs has remained limited (<xref ref-type="bibr" rid="ref8">Berkhout et al., 2021</xref>). For an appropriate epidemic response, it is vital to understand the concerns, behaviors, and knowledge of HCWs. The concerns may affect HCWs&#x2019; overall effectiveness and must be addressed by including organization policies in outbreak planning (<xref ref-type="bibr" rid="ref2">Alsubaie et al., 2019</xref>).</p>
<p>Limited studies focus on HCW&#x2019;S perception of concerns and worries in the past (<xref ref-type="bibr" rid="ref52">Wong et al., 2008</xref>; <xref ref-type="bibr" rid="ref22">Goulia et al., 2010</xref>; <xref ref-type="bibr" rid="ref1">Abolfotouh et al., 2017</xref>) and current pandemics (<xref ref-type="bibr" rid="ref31">Koh et al., 2005</xref>; <xref ref-type="bibr" rid="ref13">Chaudhary et al., 2020</xref>; <xref ref-type="bibr" rid="ref30">Kinariwala et al., 2020</xref>; <xref ref-type="bibr" rid="ref49">Sperling, 2021</xref>) among different groups of HCWs. In these studies, questionnaires have been used as a data collection tool. However, there is some ambiguity regarding their creditability.</p>
<p>In Singapore, a study evaluated how HCWs perceived the risk and its effects on their work and personal life. A three-part questionnaire has applied, including individual characteristics, 88 questions about the perceived risk of infection, the perceived impact of the SARS pandemic on personal and professional life, and the impact of events scale (<xref ref-type="bibr" rid="ref31">Koh et al., 2005</xref>). After 3&#x2009;years of an avian influenza pandemic, <xref ref-type="bibr" rid="ref52">Wong et al. (2008)</xref> from the same country used a modified version of that questionnaire to study concerns, perceived impact, and preparedness in HCWs (<xref ref-type="bibr" rid="ref52">Wong et al., 2008</xref>). In MERS outbreaks in Saudi Arabia, the level of concern among HCWs was assessed with <xref ref-type="bibr" rid="ref52">Wong&#x2019;s et al. (2008)</xref> instrument (<xref ref-type="bibr" rid="ref1">Abolfotouh et al., 2017</xref>). Based on retrieved studies, research in Greek is the only article on past outbreaks that report Cronbach&#x2019;s &#x03B1; score. In this study, <xref ref-type="bibr" rid="ref22">Goulia et al. (2010)</xref> designed the questionnaire based on the information in the literature about the perspectives and opinions of experts on infectious disease outbreaks (<xref ref-type="bibr" rid="ref22">Goulia et al., 2010</xref>).</p>
<p>With the emergence of COVID-19, HCWs&#x2019; concerns and worries have become the focus of some researchers again. A modified version of <xref ref-type="bibr" rid="ref22">Goulia et al.&#x2019;s (2010)</xref> instrument without validity assessment has been used to survey worries and concerns among HCWs in COVID-19 in Japan (<xref ref-type="bibr" rid="ref45">Sahashi et al., 2021</xref>). Researchers have applied a modified version of <xref ref-type="bibr" rid="ref52">Wong&#x2019;s et al. (2008)</xref> scale to study concerns, perceived impact, and preparedness of oral HCWs. In this study, Cronbach&#x2019;s &#x03B1; score has been reported (<xref ref-type="bibr" rid="ref13">Chaudhary et al., 2020</xref>). An instrument with no psychometric report was applied to study the concerns and fears of Indian dentists regarding professional practice (<xref ref-type="bibr" rid="ref30">Kinariwala et al., 2020</xref>).</p>
<p>This brief review of applied questionnaires to study concerns of HCW shows no clear, sufficient, and substantial evidence on the rigorous process of designing and psychometric evaluating of used questionnaires. There is no valid and reliable tool to evaluate HCWs&#x2019; concerns in an infectious disease outbreak. More objectively, among those already built instruments, no one validated for the Iranian context can evaluate the healthcare workers&#x2019; concerns. Thus, we seek to contribute by filling this gap and offering an instrument to healthcare workers&#x2019; concerns in infectious outbreaks, given the relevance and urgency of the matter. Hence, this study aimed to develop and psychometrically evaluate a scale to measure HCWs&#x2019; concerns in infectious outbreaks.</p>
</sec>
<sec id="sec6" sec-type="materials|methods">
<label>2.</label>
<title>Materials and methods</title>
<sec id="sec7">
<label>2.1.</label>
<title>Study design</title>
<p>This exploratory sequential mix-method study (qualitative-quantitative) was employed to develop and validate the HCWCIOS in Iran during the COVID-19 pandemic in 2020. This study was carried out in two stages: (1) item generation based on literature review and qualitative study findings and (2) psychometric analysis of the developed scale. The data in the first stage were collected by reviewing related literature and performing semi-structured interviews with HCWs.</p>
</sec>
<sec id="sec8">
<label>2.2.</label>
<title>Item generation</title>
<p>The item generation phase consisted of three steps: (1) a Literature review to find out the concept dimensions; (2) Carrying out a qualitative study to discover other dimensions of HCWs&#x2019; concerns in infectious outbreaks that were not fully obtained in the previous step in order to generate the item pool; and (3) Designing the initial tool.</p>
<sec id="sec9">
<label>2.2.1.</label>
<title>Literature review</title>
<p>In this step, a literature review was applied to identify prior researches that discussed the HCWs&#x2019; concerns about infectious outbreaks. The search was conducted in Web of Science, Scopus, and PubMed databases, as well as Iranian ones and Google Scholar search engine, without any time limitation. There were no restrictions regarding the study design. Studies were included if they addressed the concerns of healthcare workers during epidemics and contagious diseases. The statements were extracted to be used as the initial items.</p>
</sec>
<sec id="sec10">
<label>2.2.2.</label>
<title>Qualitative phase</title>
<p>Nine HCWs (six female and three male) with strong communication skills and willingness to participate in a study were recruited for the qualitative phase. In this phase, individual interviews under the semi-structured approach were conducted regarding the participants&#x2019; preferences. Due to the importance of having different points of view, it was tried to choose participants with maximum diversity in terms of parameters such as gender, job categories, and work experience. Purposive sampling was used to select HCWs. First, the participants received a written consent form, which they must read and sign. The researcher had a pre-prepared interview guide with key questions to better manage the interview time. The interviews were started by asking general questions such as &#x201C;Tell us about your experiences working during the pandemic?&#x201D; Through which the participant was allowed to talk openly about the topic. Following the main questions generated from our literature review, exploratory questions were asked. At this point, content analysis was utilized. After transcription, researchers read the written interviews several times to get immersed in the data. They examined the data to identify their preconceptions to build self-reflexivity. To make sense, the researchers frequently asked Wh-questions while performing the analysis. The data analysis and coding were performed. The codes, subcategories, and categories were derived from the transcript data. The researchers also conferred with team members regarding the themes and codes they had retrieved, followed by a thorough explanation of the data analysis procedure and precise citations. The inclusion criteria were: hospital staff who had direct or indirect contact with COVID-19 patients had at least 1&#x2009;month of work experience during the pandemic and were willing to participate in the study. The interviews continued until the data were saturated because the sample size for qualitative studies could not be determined (<xref ref-type="bibr" rid="ref40">Polit and Yang, 2016</xref>).</p>
</sec>
<sec id="sec11">
<label>2.2.3.</label>
<title>Synthesis stage and designing the initial scale</title>
<p>With the information obtained from the previous two steps and by putting them together (literature review and qualitative interviews), an item pool was created, which was used to build the primary scale in this step.</p>
</sec>
</sec>
<sec id="sec12">
<label>2.3.</label>
<title>Psychometric evaluation</title>
<p>In this study stage, face validity and content validity were assessed. Then, the tool&#x2019;s psychometric properties were then examined in a descriptive cross-sectional study.</p>
<sec id="sec13">
<label>2.3.1.</label>
<title>Face validity</title>
<p>Face validity is the extent to which a test appears to assess what it is intended to measure (<xref ref-type="bibr" rid="ref28">Johnson, 2021</xref>). At this stage, the newly designed scale was completed by 10 HCWs. The item impact score was evaluated to determine the quantitative face validity. The item will be retained and considered suitable for further analysis if the impact score exceeds 1.5 (<xref ref-type="bibr" rid="ref40">Polit and Yang, 2016</xref>). A 5-point Likert scale was used for calculating the item impact score by 10 HCWs that were requested through convenience sampling to study the items. The categories of unimportant (1), slightly important (2), relatively important (3), important (4), and very important (5) were taken into consideration (<xref ref-type="bibr" rid="ref17">Cresswell and Plano Clark, 2011</xref>). In the qualitative phase of face validity, regarding the items that scored 1.5 or less, the same 10 participants of the quantitative stage were interviewed face-to-face about the items&#x2019; difficulty, relevancy, and ambiguity (<xref ref-type="bibr" rid="ref19">Ebadi et al., 2017</xref>).</p>
</sec>
<sec id="sec14">
<label>2.3.2.</label>
<title>Content validity</title>
<p>Both qualitative and quantitative methods were used to evaluate content validity. In the qualitative phase, 20 faculty members with experience in instrument development, patient care, and psychology were requested to evaluate and provide feedback on the items&#x2019; wording, item allocation, and scaling. Then, the Content Validity Ratio (CVR) and Content Validity Index (CVI) were computed. Twenty experts were asked to score each item on a three-point scale for reporting CVR as &#x201C;necessary,&#x201D; &#x201C;useful but not necessary,&#x201D; and &#x201C;unnecessary.&#x201D; The items with a CVR of 0.62 and higher were conserved according to Lawshe&#x2019;s table (<xref ref-type="bibr" rid="ref34">Lawshe, 1975</xref>). The CVI for each item (I-CVI) and modified kappa coefficient were calculated based on the scoring of the same expert panel. A CVI value of 0.79 or higher was considered optimal without any need to be re-reviewed in the final version. Items with a kappa index less than 0.74 also were deleted. Furthermore, the scale-level CVI (S-CVI) was estimated. If S-CVI/Ave is 0.9 and higher, the scale&#x2019;s content validity is reported as favorable (<xref ref-type="bibr" rid="ref39">Polit et al., 2007</xref>).</p>
</sec>
<sec id="sec15">
<label>2.3.3.</label>
<title>Construct validity</title>
<p>The final scale was distributed to HCWs to construct validity. Sampling was done by convenience method. The inclusion criteria were: hospital staff directly or indirectly in contact with COVID-19 patients had at least 1&#x2009;month of work experience during the pandemic and were willing to participate in the study. An incomplete questionnaire was considered as an exclusion criterion. Maximum Likelihood Exploratory Factor Analysis (MLEFA) with varimax rotation was used to assess the scale&#x2019;s construct validity. The univariate and multivariate normal distributions of data were examined by Skewness (&#x00B1;3) and Kurtosis (&#x00B1;7). Sample adequacy was determined through the Kaiser&#x2013;Meyer&#x2013;Olkin (KMO) and Bartlett&#x2019;s tests. KMO values above 0.7 were considered acceptable (<xref ref-type="bibr" rid="ref38">Pahlevan Sharif and Sharif Nia, 2020</xref>). The minimum sample size needed for factor analysis is 300, according to <xref ref-type="bibr" rid="ref50">Tabachnick et al. (2007)</xref>. Due to the spread of COVID-19 and the lack of in-person access to the respondents, the questionnaires were provided electronically. From May to November 2020, 304 questionnaires were gathered. The number of factors was calculated using the &#x201C;Eigenvalue&#x201D; and &#x201C;Scree Plot&#x201D; techniques. Each factor that was extracted from the factor analysis required to be loaded at least 40% to remain constant. More than one eigenvalue was considered (<xref ref-type="bibr" rid="ref44">Saggino and Kline, 1996</xref>).</p>
</sec>
<sec id="sec16">
<label>2.3.4.</label>
<title>Reliability</title>
<p>Cronbach&#x2019;s alpha (&#x2265;0.7) was determined to assess the scale&#x2019;s internal consistency and that of its subscales (<xref ref-type="bibr" rid="ref24">Grove et al., 2012</xref>). Fifty HCWs participated in this stage. The test&#x2013;retest method was used to assess the scale&#x2019;s stability, and the Intra-Class Correlation (ICC) coefficient &#x003E;0.8 was an acceptable, two-way mixed model with an absolute agreement in the second round (<xref ref-type="bibr" rid="ref40">Polit and Yang, 2016</xref>). In this way, the test&#x2013;retest method was used. A validated scale was given to 30 HCWs, and they were asked to answer the items on a 6-point Likert scale (1&#x2009;=&#x2009;completely disagree, 6&#x2009;=&#x2009;completely agree). After 7&#x2009;days, the same questionnaire was again provided to the HCWs, and they were asked to answer, then the ICC coefficient was calculated. IBM SPSS Amos 25 was used to perform all statistical analyses.</p>
</sec>
</sec>
</sec>
<sec id="sec17" sec-type="results">
<label>3.</label>
<title>Results</title>
<sec id="sec18">
<label>3.1.</label>
<title>Item generation</title>
<p>After reviewing related studies, 49 items were obtained by combining and changing the items of similar instruments (<xref ref-type="bibr" rid="ref31">Koh et al., 2005</xref>; <xref ref-type="bibr" rid="ref52">Wong et al., 2008</xref>; <xref ref-type="bibr" rid="ref1">Abolfotouh et al., 2017</xref>). Interviews with nine participants led to the formation of 520 codes, 32 sub-themes, and six themes. Based on the obtained codes, eight items were extracted. The HCWCIOS preliminary item pool was created using the extracted themes, primary categories, and existing literature. The initial scale, 57 items, was then ready for the psychometric procedure.</p>
</sec>
<sec id="sec19">
<label>3.2.</label>
<title>Psychometric evaluation</title>
<p>Eight items had an impact factor of 1.5 or below, according to the evaluation of face validity. These items were revised in the qualitative stage, and after the reforms, they were returned to the item pool. All the modifications suggested by experts were used in the qualitative review of content validity. The items with a numerical value of less than 0.62 were eliminated following the CVR results. Based on the overall content validity results, nine items were removed, and 48 items reached the item analysis stage. Noteworthily, the S-CVI/Ave scale was obtained as 0.93. At the stage of item analysis, estimates put Cronbach&#x2019;s alpha at 0.947, and no items were deleted.</p>
<p>Based on the inclusion criteria, 304 HCWs completed the electronic questionnaires. The participants&#x2019; average age was 32.25 (SD&#x2009;=&#x2009;7.34) years. The majority of participants were women (67.10%) with a bachelor&#x2019;s degree (70.40%) and married (60.20%). The participants had a mean work experience of 10.18 (SD&#x2009;=&#x2009;6.42) years. We observed that 88.10% of the participants contracted with patients directly, and 55.30% were nurses.</p>
<p>Exploratory Factor Analysis (EFA) was done to assess the factor structure of the HCWCIOS items. According to the results presented in <xref rid="tab1" ref-type="table">Table 1</xref>, the Kaiser&#x2013;Meyer&#x2013;Olkin (KMO) test value was 0.872, and Bartlett&#x2019;s test value was 7468.038 (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001). Six factors were extracted and categorized as &#x201C;Inadequate Preparedness&#x201D; (eight items); &#x201C;Lack of Knowledge&#x201D; (seven items); &#x201C;Risk Perception&#x201D; (six items); &#x201C;Affected Social Relations&#x201D; (six items); &#x201C;Work Pressure&#x201D; (six items); and &#x201C;Absenteeism&#x201D; (three items). These six factors had eigenvalues of 9.800, 4.262, 3.051, 2.209, 1.985, and 1.797, respectively, and 46.507% of the total variance of variables of the HCWs&#x2019; concerns in the scale of the infectious outbreaks explained (<xref rid="tab2" ref-type="table">Table 2</xref>). The Varimax rotation was done based on the scree plot (<xref rid="fig1" ref-type="fig">Figure 1</xref>) and the total variance table. Due to commonalities below 0.4, seven items were excluded from the EFA.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption><p>Kaiser&#x2013;Meyer&#x2013;Olkin (KMO) and Bartlett&#x2019;s tests for sample adequacy of HCWCIOS.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top" colspan="2">Kaiser-Meyer-Olkin measure of sampling adequacy</th>
<th align="center" valign="top">0.872</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" rowspan="3">Bartlett&#x2019;s test of sphericity</td>
<td align="left" valign="top">Approx. Chi-Square</td>
<td align="center" valign="top">7468.038</td>
</tr>
<tr>
<td align="left" valign="top">df</td>
<td align="center" valign="top">1,081</td>
</tr>
<tr>
<td align="left" valign="top">Sig.</td>
<td align="center" valign="top">0.000</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption><p>Exploratory factor analysis of HCWCIOS.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Factors</th>
<th align="left" valign="top">Items</th>
<th align="center" valign="top">Factor loading</th>
<th align="center" valign="top">Eigen value</th>
<th align="center" valign="top">Variance (%)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top" rowspan="8">1. Inadequate preparedness</td>
<td align="left" valign="top">Q40: I feel that my organization cannot manage these patients.</td>
<td align="center" valign="top">0.853</td>
<td align="center" valign="top" rowspan="8">9.800</td>
<td align="center" valign="top" rowspan="8">10.792</td>
</tr>
<tr>
<td align="left" valign="top">Q38: Protocols and guidelines are not fully implemented.</td>
<td align="center" valign="top">0.694</td>
</tr>
<tr>
<td align="left" valign="top">Q32: My workplace does not have a detailed plan to face the crisis caused by this pandemic.</td>
<td align="center" valign="top">0.664</td>
</tr>
<tr>
<td align="left" valign="top">Q37: The protective and preventive measures implemented in my work environment are ineffective in preventing the spread of this disease.</td>
<td align="center" valign="top">0.639</td>
</tr>
<tr>
<td align="left" valign="top">Q41: I feel that there is not enough program in our region to deal with this disease.</td>
<td align="center" valign="top">0.626</td>
</tr>
<tr>
<td align="left" valign="top">Q39: My colleagues have not taken the recommended prevention and control of infection seriously.</td>
<td align="center" valign="top">0.569</td>
</tr>
<tr>
<td align="left" valign="top">Q35: I have not received enough training on infection control and how to use personal protective equipment.</td>
<td align="center" valign="top">0.532</td>
</tr>
<tr>
<td align="left" valign="top">Q24: The rules regarding the epidemic of this disease have confused me.</td>
<td align="center" valign="top">0.481</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="7">2. Lack of knowledge</td>
<td align="left" valign="top">Q46: I do not have enough knowledge about patient care.</td>
<td align="center" valign="top">0.804</td>
<td align="center" valign="top" rowspan="7">4.262</td>
<td align="center" valign="top" rowspan="7">9.712</td>
</tr>
<tr>
<td align="left" valign="top">Q44: I do not have enough knowledge about the prognosis and mortality rate of this disease.</td>
<td align="center" valign="top">0.705</td>
</tr>
<tr>
<td align="left" valign="top">Q43: I do not know the signs and symptoms of this disease well enough.</td>
<td align="center" valign="top">0.700</td>
</tr>
<tr>
<td align="left" valign="top">Q47: I do not know enough to prevent and care for myself against this disease.</td>
<td align="center" valign="top">0.661</td>
</tr>
<tr>
<td align="left" valign="top">Q42: I do not know enough about this disease&#x2019;s causative agent, such as its nature and ways of transmission.</td>
<td align="center" valign="top">0.643</td>
</tr>
<tr>
<td align="left" valign="top">Q45: I do not know enough about the drug treatment of this disease.</td>
<td align="center" valign="top">0.574</td>
</tr>
<tr>
<td align="left" valign="top">Q36: Most of the time, there is no one to answer my questions about this disease.</td>
<td align="center" valign="top">0.486</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="6">3. Risk perception</td>
<td align="left" valign="top">Q3: I feel anxious while interacting with infected people.</td>
<td align="center" valign="top">0.853</td>
<td align="center" valign="top" rowspan="6">3.051</td>
<td align="center" valign="top" rowspan="6">8.220</td>
</tr>
<tr>
<td align="left" valign="top">Q4: When communicating with infected people, the fear of transmitting the disease worries me.</td>
<td align="center" valign="top">0.853</td>
</tr>
<tr>
<td align="left" valign="top">Q6: If one of my colleagues gets this disease, I feel threatened.</td>
<td align="center" valign="top">0.709</td>
</tr>
<tr>
<td align="left" valign="top">Q14: It worries me that I do not know when the diseasewill subside.</td>
<td align="center" valign="top">0.525</td>
</tr>
<tr>
<td align="left" valign="top">Q7: I feel that I have to reduce my social activities due to the spread of this disease.</td>
<td align="center" valign="top">0.467</td>
</tr>
<tr>
<td align="left" valign="top">Q12: I am worried about the unintentional transmission of the disease to my family, friends, and colleagues.</td>
<td align="center" valign="top">0.415</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="6">4. Affected social relations</td>
<td align="left" valign="top">Q17: I think others may stay away from my family because of my job and the possibility of getting sick.</td>
<td align="center" valign="top">0.733</td>
<td align="center" valign="top" rowspan="6">2.209</td>
<td align="center" valign="top" rowspan="6">6.622</td>
</tr>
<tr>
<td align="left" valign="top">Q15: I think others avoid me because of my job.</td>
<td align="center" valign="top">0.685</td>
</tr>
<tr>
<td align="left" valign="top">Q19: The fear of being a disease carrier has made me stay away from my family and friends.</td>
<td align="center" valign="top">0.580</td>
</tr>
<tr>
<td align="left" valign="top">Q16: I feel that my family avoids me because I work in the hospital.</td>
<td align="center" valign="top">0.569</td>
</tr>
<tr>
<td align="left" valign="top">Q18: I am afraid to inform my family about the level of risk I am facing of being infected.</td>
<td align="center" valign="top">0.461</td>
</tr>
<tr>
<td align="left" valign="top">Q30: It is challenging for me to meet physiological needs (eating, drinking, hygiene, rest, etc.) while working.</td>
<td align="center" valign="top">0.402</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="6">5. Work pressure</td>
<td align="left" valign="top">Q25: There are not enough human resources to carry out the affairs and demands in this situation.</td>
<td align="center" valign="top">0.648</td>
<td align="center" valign="top" rowspan="6">1.985</td>
<td align="center" valign="top" rowspan="6">6.131</td>
</tr>
<tr>
<td align="left" valign="top">Q27: My workload has increased.</td>
<td align="center" valign="top">0.508</td>
</tr>
<tr>
<td align="left" valign="top">Q26: There are more conflicts between my colleagues and me in the work environment.</td>
<td align="center" valign="top">0.502</td>
</tr>
<tr>
<td align="left" valign="top">Q23: I feel that the organization I work for will not pay attention to my needs if I get sick.</td>
<td align="center" valign="top">0.499</td>
</tr>
<tr>
<td align="left" valign="top">Q28: Against my will, I have to work overtime.</td>
<td align="center" valign="top">0.498</td>
</tr>
<tr>
<td align="left" valign="top">Q21: I am worried that my manager and colleagues will not treat me properly if I get infected.</td>
<td align="center" valign="top">0.402</td>
</tr>
<tr>
<td align="left" valign="top" rowspan="3">6. Absenteeism</td>
<td align="left" valign="top">Q8: I think it is better for me to be absent from work in order not to get sick.</td>
<td align="center" valign="top">0.604</td>
<td align="center" valign="top" rowspan="3">1.797</td>
<td align="center" valign="top" rowspan="3">5.031</td>
</tr>
<tr>
<td align="left" valign="top">Q31: I have not accepted that facing all kinds of diseases is part of the nature of my profession.</td>
<td align="center" valign="top">0.586</td>
</tr>
<tr>
<td align="left" valign="top">Q9: I feel I have to change my job because of the spread of this disease.</td>
<td align="center" valign="top">0.585</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption><p>Scree plot. Based on the scree plot, six factors were proposed for extraction in the EFA of the HCWCIOS.</p></caption>
<graphic xlink:href="fpsyg-13-1108835-g001.tif"/>
</fig>
<p>The internal consistency based on Cronbach&#x2019;s alpha coefficient for the inadequate preparedness factor was <italic>&#x03B1;</italic>&#x2009;=&#x2009;0.854; for the lack of knowledge factor was <italic>&#x03B1;</italic>&#x2009;=&#x2009;0.858; for the risk perception factor was <italic>&#x03B1;</italic>&#x2009;=&#x2009;0.864; for affected social relations factor was <italic>&#x03B1;</italic>&#x2009;=&#x2009;0.817; for work pressure factor was <italic>&#x03B1;</italic>&#x2009;=&#x2009;0.754; for absenteeism was &#x03B1;&#x2009;=&#x2009;0.735, and for the whole scale was <italic>&#x03B1;</italic>&#x2009;=&#x2009;0.912. On the other hand, ICC was found as 0.880 (95% confidence interval: 0.854&#x2013;0.901) by the test&#x2013;retest method (<xref rid="tab3" ref-type="table">Table 3</xref>).</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption><p>Reliability coefficient and internal consistency of HCWCIOS.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top" rowspan="2">Factor</th>
<th align="center" valign="top" rowspan="2">No. of item</th>
<th align="center" valign="top" rowspan="2">Cronbach&#x2019;s alpha coefficient</th>
<th align="center" valign="top" rowspan="2">ICC</th>
<th align="center" valign="top">CI, 95%</th>
</tr>
<tr>
<th align="center" valign="top">Lower &#x2013; Upper</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">1</td>
<td align="center" valign="top">8</td>
<td align="center" valign="top">0.854</td>
<td align="center" valign="top">0.851</td>
<td align="center" valign="top">0.878&#x2013;0.881</td>
</tr>
<tr>
<td align="left" valign="top">2</td>
<td align="center" valign="top">7</td>
<td align="center" valign="top">0.858</td>
<td align="center" valign="top">0.860</td>
<td align="center" valign="top">0.830&#x2013;0.885</td>
</tr>
<tr>
<td align="left" valign="top">3</td>
<td align="center" valign="top">6</td>
<td align="center" valign="top">0.864</td>
<td align="center" valign="top">0.828</td>
<td align="center" valign="top">0.795&#x2013;0.857</td>
</tr>
<tr>
<td align="left" valign="top">4</td>
<td align="center" valign="top">6</td>
<td align="center" valign="top">0.817</td>
<td align="center" valign="top">0.723</td>
<td align="center" valign="top">0.624&#x2013;0.804</td>
</tr>
<tr>
<td align="left" valign="top">5</td>
<td align="center" valign="top">6</td>
<td align="center" valign="top">0.754</td>
<td align="center" valign="top">0.705</td>
<td align="center" valign="top">0.618&#x2013;0.771</td>
</tr>
<tr>
<td align="left" valign="top">6</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">0.735</td>
<td align="center" valign="top">0.709</td>
<td align="center" valign="top">0.625&#x2013;0.773</td>
</tr>
<tr>
<td align="left" valign="top">Total</td>
<td align="center" valign="top">36</td>
<td align="center" valign="top">0.912</td>
<td align="center" valign="top">0.880</td>
<td align="center" valign="top">0.854&#x2013;0.901</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec id="sec20" sec-type="discussions">
<label>4.</label>
<title>Discussion</title>
<p>This study aimed to design and psychometrically evaluate a scale to measure HCWs&#x2019; concerns in infectious outbreaks. The initial scale was developed based on data obtained from extensive reviews of existing literature on HCWs&#x2019; concerns in infectious outbreaks and a qualitative study. The findings of this study confirmed that the validity and reliability of the final HCWCIOS were as expected. HCWCIOS featured 36 items and six factors: inadequate preparedness, lack of knowledge, risk perception, affected social relations, work pressure, and absenteeism.</p>
<p>The first factor of HCWCIOS was inadequate preparedness. Emergency preparedness involves a broad range of skills, abilities, and knowledge to prepare for and respond to catastrophes, threats, and pandemics. Understanding the readiness and preparation of HCWs to handle emergencies like the COVID-19 pandemic and deliver safe and effective treatment during these times is lacking (<xref ref-type="bibr" rid="ref15">Chua et al., 2021</xref>). In a qualitative study, <xref ref-type="bibr" rid="ref10">Borek et al. (2022)</xref> with the issue of HCWs&#x2019; concerns in the COVID-19 pandemic, stated that HCWs experienced substantial stress and anxiety due to the pandemic&#x2019;s inadequate preparation, which was followed by requests for reflection and learning from the experience.</p>
<p>The second factor of this scale was the lack of knowledge. HCWs might need more knowledge regarding pandemics. As a result, individuals could not fully comprehend the risk or danger involved, which could affect their ability to stop the virus&#x2019;s spread. Related studies conclude that less experienced HCWs are less knowledgeable, have lower levels of self-control and resilience, and experience greater levels of stress than more experienced HCWs who also have greater expertise (<xref ref-type="bibr" rid="ref14">Chigwedere et al., 2021</xref>; <xref ref-type="bibr" rid="ref27">Jamebozorgi et al., 2021</xref>). According to <xref ref-type="bibr" rid="ref20">Malekshahi Beiranvand and Hatami Varzaneh (2018)</xref> the HCWs faced difficulties during COVID-19, including a lack of specialized expertise, inadequate readiness, and access to practical skills for managing and controlling the disease. One of the stressors identified among HCWs during the COVID-19 pandemic was a lack of knowledge and experience (<xref ref-type="bibr" rid="ref53">Yusefi et al., 2022</xref>).</p>
<p>Risk perception was the third factor on the scale, with six items. Risk perception is essential in making the proper decisions during a pandemic crisis and can be viewed as the driving force behind preventive behaviors (<xref ref-type="bibr" rid="ref16">Cori et al., 2020</xref>). According to the findings of the research done in the United States, because it was recognized that COVID-19 could result in severe effects other than death, such as serious infections and self-quarantine, the association between risk perception of COVID-19 and death due to COVID-19 has a stronger relationship with protective activities (<xref ref-type="bibr" rid="ref11">Bruine De Bruin and Bennett, 2020</xref>). However, a cross-sectional study in Asian and European regions found no connection between awareness of the influenza pandemic risk and taking protective behaviors during the outbreak (<xref ref-type="bibr" rid="ref43">Sadique et al., 2007</xref>). Studies showed that considering a pandemic&#x2019;s perceived risk and setting standards for assessing performance can be beneficial for preventive planning, and appropriate educational interventions could be implemented (<xref ref-type="bibr" rid="ref35">Molavi-Taleghani et al., 2020</xref>; <xref ref-type="bibr" rid="ref4">Arefi et al., 2022</xref>).</p>
<p>Another factor of the designed tool was affected social relations. Several incidents of stigmatization of HCWs have emerged throughout this pandemic worldwide. In Mexico, for example, it was discovered that doctors and nurses utilize bicycles because they were allegedly denied access to public transportation and were the targets of physical assaults (<xref ref-type="bibr" rid="ref5">Bagcchi, 2020</xref>). Healthcare professionals&#x2019; social relations studies demonstrated that HCWs&#x2019; families are psychologically impacted due to the pandemic (<xref ref-type="bibr" rid="ref33">Lau et al., 2005</xref>; <xref ref-type="bibr" rid="ref3">Amakiri et al., 2020</xref>). HCWs endure social stigmatization despite being praised by the media as heroes and suffer extreme anxiety and concern for their safety and the well-being of their family, friends, and coworkers. Although HCWs are more prone to seek peer psychological assistance, they also gain from being aware of the availability of official psychological support (<xref ref-type="bibr" rid="ref18">Duffy et al., 2022</xref>). To tackle the COVID-19-related social stigma, the World Health Organization (WHO) emphasizes fostering a culture that encourages honest communication between individuals and HCWs (<xref ref-type="bibr" rid="ref5">Bagcchi, 2020</xref>).</p>
<p>Work pressure was another factor. Pandemics placed extreme demands on HCWs. When pressure is high, they have had to manage a more significant number of patients with high mortality rates. They have had difficulties providing care while adhering to strict infection control procedures and not always wearing enough personal protective equipment. As a result of their redeployment into new positions, teams, or wards, many have been operating in unfamiliar settings without the established social support of their peers (<xref ref-type="bibr" rid="ref9">Billings et al., 2021</xref>). Some studies have depicted that the unique demands of world crises and high-stress levels placed HCWs at additional risk for mental health problems (<xref ref-type="bibr" rid="ref32">Lai et al., 2020</xref>; <xref ref-type="bibr" rid="ref23">Greene et al., 2021</xref>).</p>
<p>The last but not most minor factor of HCWCIOS was absenteeism. During the SARs outbreak, several reports revealed HCWs in Toronto and Hong Kong either shied away from physical examinations of ill patients or refused to work with them because the risk they posed was too significant. At the height of China&#x2019;s SARS outbreak, at least one hospital struggled to sustain services due to absenteeism, among which some were driven by concerns about getting sick (<xref ref-type="bibr" rid="ref48">Shiao et al., 2007</xref>). More than 80% of HCWs in New York City were willing and/or able to report to work during a mass casualty or environmental disaster. However, only 57&#x2013;68% would be willing to do so during a SARS or smallpox outbreak, according to a recent survey assessing their readiness for duty during a catastrophic disaster (<xref ref-type="bibr" rid="ref42">Qureshi et al., 2005</xref>). Fears for one&#x2019;s safety and the responsibilities of the family are frequently the leading causes of potential absenteeism during a pandemic, and the absenteeism rate doubles when a family member is infected (<xref ref-type="bibr" rid="ref46">Seale et al., 2009</xref>).</p>
<p>The present research used a robust methodological and statistical approach to provide a valid tool for HCWs&#x2019; concerns in infectious outbreaks.</p>
<sec id="sec21">
<label>4.1.</label>
<title>Limitations and strengths</title>
<p>The specific design to assess the HCWs&#x2019; concerns in infectious outbreaks was one of the strengths of this study. Moreover, an acceptable population diversity was recruited from different cities in Iran for the psychometric evaluation of the tool.</p>
<p>The most significant limitation of the current study was that access to participants was limited due to the spread of COVID-19. Furthermore, the present study was only conducted in Iran, and it is preferable to include other countries and cultures to demonstrate its trustworthiness because cultural factors can influence HCWs&#x2019; concerns. More studies are recommended to investigate this scale&#x2019;s conceptual structure and to gather more evidence regarding the tool study&#x2019;s psychometric properties.</p>
</sec>
</sec>
<sec id="sec22" sec-type="conclusions">
<label>5.</label>
<title>Conclusion</title>
<p>A 36-item HCWCIOS has good psychometric properties and is suitable for measuring HCWs&#x2019; concerns during a pandemic.</p>
</sec>
<sec id="sec23" sec-type="data-availability">
<title>Data availability statement</title>
<p>The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/<xref rid="sec27" ref-type="sec">Supplementary material</xref>.</p>
</sec>
<sec id="sec24">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by the Ethics Committee of Lorestan University of Medical Sciences, Khorramabad, Iran (IR.LUMS.REC.1399.007). The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="sec25">
<title>Author contributions</title>
<p>SY: conceptualization, methodology, data curation, writing &#x2013; original draft preparation, review and editing, supervision, and project administration. MK: conceptualization, methodology, writing &#x2013; original draft preparation, and review and editing. FE: formal analysis and methodology. TC: data curation and methodology. ES: formal analysis, writing &#x2013; original draft preparation, review and editing. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ack>
<p>We thank all participants and all faculty members who made this study possible.</p>
</ack>
<sec id="sec27" sec-type="supplementary-material">
<title>Supplementary material</title>
<p>The Supplementary material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1108835/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1108835/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.DOCX" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abolfotouh</surname> <given-names>M. A.</given-names></name> <name><surname>AlQarni</surname> <given-names>A. A.</given-names></name> <name><surname>Al-Ghamdi</surname> <given-names>S. M.</given-names></name> <name><surname>Salam</surname> <given-names>M.</given-names></name> <name><surname>Al-Assiri</surname> <given-names>M. H.</given-names></name> <name><surname>Balkhy</surname> <given-names>H. H.</given-names></name></person-group> (<year>2017</year>). <article-title>An assessment of the level of concern among hospital-based health-care workers regarding MERS outbreaks in Saudi Arabia</article-title>. <source>BMC Infect. Dis.</source> <volume>17</volume>:<fpage>4</fpage>. doi: <pub-id pub-id-type="doi">10.1186/s12879-016-2096-8</pub-id>, PMID: <pub-id pub-id-type="pmid">28049440</pub-id></citation></ref>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alsubaie</surname> <given-names>S.</given-names></name> <name><surname>Temsah</surname> <given-names>M. H.</given-names></name> <name><surname>Al-Eyadhy</surname> <given-names>A. A.</given-names></name> <name><surname>Gossady</surname> <given-names>I.</given-names></name> <name><surname>Hasan</surname> <given-names>G. M.</given-names></name> <name><surname>Al-Rabiaah</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Middle East respiratory syndrome coronavirus epidemic impact on healthcare workers&#x2019; risk perceptions, work and personal lives</article-title>. <source>J. Infect. Dev. Ctries.</source> <volume>13</volume>, <fpage>920</fpage>&#x2013;<lpage>926</lpage>. doi: <pub-id pub-id-type="doi">10.3855/jidc.11753</pub-id>, PMID: <pub-id pub-id-type="pmid">32084023</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amakiri</surname> <given-names>P. C.</given-names></name> <name><surname>Chude</surname> <given-names>C. F.</given-names></name> <name><surname>Oradiegwu</surname> <given-names>S.</given-names></name> <name><surname>Primanik</surname> <given-names>I.</given-names></name> <name><surname>Anoka</surname> <given-names>K. C.</given-names></name> <name><surname>Ezeoke</surname> <given-names>Q.</given-names></name></person-group> (<year>2020</year>). <article-title>Psychological effect of pandemic COVID-19 on families of health care professionals</article-title>. <source>Br. J. Psychol. Res.</source> <volume>8</volume>, <fpage>1</fpage>&#x2013;<lpage>7</lpage>. Available at: doi: <ext-link xlink:href="https://www.eajournals.org/wp-content/uploads/Psychological-effect-of-Pandemic-Covid-19-on-families-of-health-care-professionals.pdf" ext-link-type="uri">https://www.eajournals.org/wp-content/uploads/Psychological-effect-of-Pandemic-Covid-19-on-families-of-health-care-professionals.pdf</ext-link></citation></ref>
<ref id="ref4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arefi</surname> <given-names>M. F.</given-names></name> <name><surname>Babaei</surname> <given-names>A. P.</given-names></name> <name><surname>Barzanouni</surname> <given-names>S.</given-names></name> <name><surname>Ebrahimi</surname> <given-names>S.</given-names></name> <name><surname>Salehi</surname> <given-names>A. R.</given-names></name> <name><surname>Khajehnasiri</surname> <given-names>F.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Risk perception in the COVID-19 pandemic; a health promotion approach</article-title>. <source>J. Educ. Health Promot.</source> <volume>11</volume>:<fpage>118</fpage>. doi: <pub-id pub-id-type="doi">10.4103/jehp.jehp_1162_21</pub-id></citation></ref>
<ref id="ref5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bagcchi</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>Stigma during the COVID-19 pandemic</article-title>. <source>Lancet Infect. Dis.</source> <volume>20</volume>:<fpage>782</fpage>. doi: <pub-id pub-id-type="doi">10.1016/S1473-3099(20)30498-9</pub-id>, PMID: <pub-id pub-id-type="pmid">32592670</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandyopadhyay</surname> <given-names>S.</given-names></name> <name><surname>Baticulon</surname> <given-names>R. E.</given-names></name> <name><surname>Kadhum</surname> <given-names>M.</given-names></name> <name><surname>Alser</surname> <given-names>M.</given-names></name> <name><surname>Ojuka</surname> <given-names>D. K.</given-names></name> <name><surname>Badereddin</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Infection and mortality of healthcare workers worldwide from COVID-19: a systematic review</article-title>. <source>BMJ Glob. Health</source> <volume>5</volume>:<fpage>e003097</fpage>. doi: <pub-id pub-id-type="doi">10.1136/bmjgh-2020-003097</pub-id>, PMID: <pub-id pub-id-type="pmid">33277297</pub-id></citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barello</surname> <given-names>S.</given-names></name> <name><surname>Palamenghi</surname> <given-names>L.</given-names></name> <name><surname>Graffigna</surname> <given-names>G.</given-names></name></person-group> (<year>2020</year>). <article-title>Burnout and somatic symptoms among frontline healthcare professionals at the peak of the Italian COVID-19 pandemic</article-title>. <source>Psychiatry Res.</source> <volume>290</volume>:<fpage>113129</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.psychres.2020.113129</pub-id>, PMID: <pub-id pub-id-type="pmid">32485487</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berkhout</surname> <given-names>S. G.</given-names></name> <name><surname>Sheehan</surname> <given-names>K. A.</given-names></name> <name><surname>Abbey</surname> <given-names>S. E.</given-names></name></person-group> (<year>2021</year>). <article-title>Individual- and institutional-level concerns of health care workers in Canada during the COVID-19 pandemic: a qualitative analysis</article-title>. <source>JAMA Netw. Open</source> <volume>4</volume>:<fpage>e2118425</fpage>. doi: <pub-id pub-id-type="doi">10.1001/jamanetworkopen.2021.18425</pub-id>, PMID: <pub-id pub-id-type="pmid">34313739</pub-id></citation></ref>
<ref id="ref9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Billings</surname> <given-names>J.</given-names></name> <name><surname>Ching</surname> <given-names>B. C. F.</given-names></name> <name><surname>Gkofa</surname> <given-names>V.</given-names></name> <name><surname>Greene</surname> <given-names>T.</given-names></name> <name><surname>Bloomfield</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Experiences of frontline healthcare workers and their views about support during COVID-19 and previous pandemics: a systematic review and qualitative meta-synthesis</article-title>. <source>BMC Health Serv. Res.</source> <volume>21</volume>, <fpage>1</fpage>&#x2013;<lpage>17</lpage>. doi: <pub-id pub-id-type="doi">10.1186/s12913-021-06917-z</pub-id>, PMID: <pub-id pub-id-type="pmid">34488733</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Borek</surname> <given-names>A. J.</given-names></name> <name><surname>Pilbeam</surname> <given-names>C.</given-names></name> <name><surname>Mableson</surname> <given-names>H.</given-names></name> <name><surname>Wanat</surname> <given-names>M.</given-names></name> <name><surname>Atkinson</surname> <given-names>P.</given-names></name> <name><surname>Sheard</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Experiences and concerns of health workers throughout the first year of the COVID-19 pandemic in the UK: a longitudinal qualitative interview study</article-title>. <source>PLoS One</source> <volume>17</volume>:<fpage>e0264906</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0264906</pub-id>, PMID: <pub-id pub-id-type="pmid">35294450</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bruine De Bruin</surname> <given-names>W.</given-names></name> <name><surname>Bennett</surname> <given-names>D.</given-names></name></person-group> (<year>2020</year>). <article-title>Relationships between initial COVID-19 risk perceptions and protective health behaviors: a national survey</article-title>. <source>Am. J. Prev. Med.</source> <volume>59</volume>, <fpage>157</fpage>&#x2013;<lpage>167</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.amepre.2020.05.001</pub-id>, PMID: <pub-id pub-id-type="pmid">32576418</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chakravorty</surname> <given-names>I.</given-names></name> <name><surname>Daga</surname> <given-names>S.</given-names></name> <name><surname>Dave</surname> <given-names>S.</given-names></name> <name><surname>Chakravorty</surname> <given-names>S.</given-names></name> <name><surname>Menon</surname> <given-names>G.</given-names></name> <name><surname>Bhala</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>An online survey of healthcare professionals in the COVID-19 pandemic in the UK</article-title>. <source>Sushruta J. Health Policy Opin.</source> <volume>13</volume>. doi: <pub-id pub-id-type="doi">10.38192/13.2.9</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chaudhary</surname> <given-names>F. A.</given-names></name> <name><surname>Ahmad</surname> <given-names>B.</given-names></name> <name><surname>Ahmad</surname> <given-names>P.</given-names></name> <name><surname>Khalid</surname> <given-names>M. D.</given-names></name> <name><surname>Butt</surname> <given-names>D. Q.</given-names></name> <name><surname>Khan</surname> <given-names>S. Q.</given-names></name></person-group> (<year>2020</year>). <article-title>Concerns, perceived impact, and preparedness of oral healthcare workers in their working environment during COVID-19 pandemic</article-title>. <source>J. Occup. Health</source> <volume>62</volume>:<fpage>e12168</fpage>. doi: <pub-id pub-id-type="doi">10.1002/1348-9585.12168</pub-id>, PMID: <pub-id pub-id-type="pmid">32951286</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chigwedere</surname> <given-names>O. C.</given-names></name> <name><surname>Sadath</surname> <given-names>A.</given-names></name> <name><surname>Kabir</surname> <given-names>Z.</given-names></name> <name><surname>Arensman</surname> <given-names>E.</given-names></name></person-group> (<year>2021</year>). <article-title>The impact of epidemics and pandemics on the mental health of healthcare workers: a systematic review</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>18</volume>:<fpage>6695</fpage>. doi: <pub-id pub-id-type="doi">10.3390/ijerph18136695</pub-id>, PMID: <pub-id pub-id-type="pmid">34206264</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chua</surname> <given-names>B. S.</given-names></name> <name><surname>Cosmas</surname> <given-names>G.</given-names></name> <name><surname>Arsat</surname> <given-names>N.</given-names></name></person-group> (<year>2021</year>). <article-title>Nurses&#x2019; preparedness, readiness, and anxiety in managing COVID-19 pandemic</article-title>. <source>Asia Pac. J. Public Health</source> <volume>33</volume>, <fpage>564</fpage>&#x2013;<lpage>570</lpage>. doi: <pub-id pub-id-type="doi">10.1177/10105395211012170</pub-id>, PMID: <pub-id pub-id-type="pmid">33938289</pub-id></citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cori</surname> <given-names>L.</given-names></name> <name><surname>Bianchi</surname> <given-names>F.</given-names></name> <name><surname>Cadum</surname> <given-names>E.</given-names></name> <name><surname>Anthonj</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>Risk perception and COVID-19</article-title>. <volume>17</volume>, <fpage>3114</fpage>. doi: <pub-id pub-id-type="doi">10.3390/ijerph17093114</pub-id>, PMID: <pub-id pub-id-type="pmid">32365710</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Cresswell</surname> <given-names>John W.</given-names></name> <name><surname>Plano Clark</surname> <given-names>Vicki L.</given-names></name></person-group> (<year>2011</year>). <source>Designing and Conducting Mixed Methods Research</source>.&#x201D; <publisher-loc>Los Angeles</publisher-loc>: <publisher-name>SAGE Publications</publisher-name></citation></ref>
<ref id="ref18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duffy</surname> <given-names>C. C.</given-names></name> <name><surname>Bass</surname> <given-names>G. A.</given-names></name> <name><surname>Fitzpatrick</surname> <given-names>G.</given-names></name> <name><surname>Doherty</surname> <given-names>E. M.</given-names></name></person-group> (<year>2022</year>). <article-title>What can we learn from the past? Pandemic health care workers&#x2019; fears, concerns, and needs: a review</article-title>. <source>J. Patient Saf.</source> <volume>18</volume>, <fpage>52</fpage>&#x2013;<lpage>57</lpage>. doi: <pub-id pub-id-type="doi">10.1097/PTS.0000000000000803</pub-id>, PMID: <pub-id pub-id-type="pmid">33337596</pub-id></citation></ref>
<ref id="ref19"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Ebadi</surname> <given-names>A.</given-names></name> <name><surname>Ladan Zarshenas</surname> <given-names>M.</given-names></name> <name><surname>Rakhshan</surname> <given-names>A. Zareiyan</given-names></name> <name><surname>Sharifnia</surname> <given-names>S.</given-names></name> <name><surname>Mojahedi</surname> <given-names>M. J. T. J.</given-names></name></person-group> (<year>2017</year>). &#x201C;<source>Principles of Scale Development in Health Science</source>.&#x201D; <publisher-loc>Tehran</publisher-loc>: <publisher-name>Jame-e-negar</publisher-name>.</citation></ref>
<ref id="ref21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fernandez</surname> <given-names>R.</given-names></name> <name><surname>Lord</surname> <given-names>H.</given-names></name> <name><surname>Halcomb</surname> <given-names>E.</given-names></name> <name><surname>Moxham</surname> <given-names>L.</given-names></name> <name><surname>Middleton</surname> <given-names>R.</given-names></name> <name><surname>Alananzeh</surname> <given-names>I.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Implications for COVID-19: a systematic review of nurses&#x2019; experiences of working in acute care hospital settings during a respiratory pandemic</article-title>. <source>Int. J. Nurs. Stud.</source> <volume>111</volume>:<fpage>103637</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ijnurstu.2020.103637</pub-id></citation></ref>
<ref id="ref22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goulia</surname> <given-names>P.</given-names></name> <name><surname>Mantas</surname> <given-names>C.</given-names></name> <name><surname>Dimitroula</surname> <given-names>D.</given-names></name> <name><surname>Mantis</surname> <given-names>D.</given-names></name> <name><surname>Hyphantis</surname> <given-names>T.</given-names></name></person-group> (<year>2010</year>). <article-title>General hospital staff worries, perceived sufficiency of information and associated psychological distress during the a/H1N1 influenza pandemic</article-title>. <source>BMC Infect. Dis.</source> <volume>10</volume>, <fpage>1</fpage>&#x2013;<lpage>11</lpage>. doi: <pub-id pub-id-type="doi">10.1186/1471-2334-10-322</pub-id></citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Greene</surname> <given-names>T.</given-names></name> <name><surname>Harju-Sepp&#x00E4;nen</surname> <given-names>J.</given-names></name> <name><surname>Adeniji</surname> <given-names>M.</given-names></name> <name><surname>Steel</surname> <given-names>C.</given-names></name> <name><surname>Grey</surname> <given-names>N.</given-names></name> <name><surname>Brewin</surname> <given-names>C. R.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Predictors and rates of PTSD, depression and anxiety in UK frontline health and social care workers during COVID-19</article-title>. <source>Eur. J. Psychotraumatol.</source> <volume>12</volume>:<fpage>1882781</fpage>. doi: <pub-id pub-id-type="doi">10.1080/20008198.2021.1882781</pub-id>, PMID: <pub-id pub-id-type="pmid">33968317</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Grove</surname> <given-names>Susan K.</given-names></name> <name><surname>Burns</surname> <given-names>Nancy</given-names></name> <name><surname>Gray</surname> <given-names>Jennifer</given-names></name></person-group>. (<year>2012</year>). <source>The Practice of Nursing Research: Appraisal, Synthesis, and Generation of Evidence</source>. <publisher-loc>St. Louis, MO</publisher-loc>: <publisher-name>Elsevier Health Sciences</publisher-name>.</citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heidarijamebozorgi</surname> <given-names>M.</given-names></name> <name><surname>Jafari</surname> <given-names>H.</given-names></name> <name><surname>Sadeghi</surname> <given-names>R.</given-names></name> <name><surname>Sheikhbardsiri</surname> <given-names>H.</given-names></name> <name><surname>Kargar</surname> <given-names>M.</given-names></name> <name><surname>Gharaghani</surname> <given-names>M. A.</given-names></name></person-group> (<year>2021</year>). <article-title>The prevalence of depression, anxiety, and stress among nurses during the coronavirus disease 2019: a comparison between nurses in the frontline and the second line of care delivery</article-title>. <source>Nurs. Midwifery Stud.</source> <volume>10</volume>:<fpage>188</fpage>.</citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jalili</surname> <given-names>M.</given-names></name> <name><surname>Niroomand</surname> <given-names>M.</given-names></name> <name><surname>Hadavand</surname> <given-names>F.</given-names></name> <name><surname>Zeinali</surname> <given-names>K.</given-names></name> <name><surname>Fotouhi</surname> <given-names>A.</given-names></name></person-group> (<year>2021</year>). <article-title>Burnout among healthcare professionals during COVID-19 pandemic: a cross-sectional study</article-title>. <source>Int. Arch. Occup. Environ. Health</source> <volume>94</volume>, <fpage>1345</fpage>&#x2013;<lpage>1352</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s00420-021-01695-x</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jamebozorgi</surname> <given-names>M. H.</given-names></name> <name><surname>Karamoozian</surname> <given-names>A.</given-names></name> <name><surname>Bardsiri</surname> <given-names>T. I.</given-names></name> <name><surname>Sheikhbardsiri</surname> <given-names>H.</given-names></name></person-group> (<year>2021</year>). <article-title>Nurses burnout, resilience, and its association with socio-demographic factors during COVID-19 pandemic</article-title>. <source>Front. Psych.</source> <volume>12</volume>:<fpage>803506</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyt.2021.803506</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>E.</given-names></name></person-group> (<year>2021</year>). &#x201C;<article-title>Face validity</article-title>&#x201D; in <source>Encyclopedia of Autism Spectrum Disorders.</source> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>1957</fpage>.</citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Khademipour</surname> <given-names>G.</given-names></name> <name><surname>Nakhaee</surname> <given-names>N.</given-names></name> <name><surname>Anari</surname> <given-names>S. M. S.</given-names></name> <name><surname>Sadeghi</surname> <given-names>M.</given-names></name> <name><surname>Ebrahimnejad</surname> <given-names>H.</given-names></name> <name><surname>Sheikhbardsiri</surname> <given-names>H.</given-names></name></person-group> (<year>2017</year>). <article-title>Crowd simulations and determining the critical density point of emergency situations</article-title>. <source>Disaster Med. Public Health Prep.</source> <volume>11</volume>, <fpage>674</fpage>&#x2013;<lpage>680</lpage>. doi: <pub-id pub-id-type="doi">10.1017/dmp.2017.7</pub-id>, PMID: <pub-id pub-id-type="pmid">28554341</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kinariwala</surname> <given-names>N.</given-names></name> <name><surname>Samaranayake</surname> <given-names>L. P.</given-names></name> <name><surname>Perera</surname> <given-names>I.</given-names></name> <name><surname>Patel</surname> <given-names>Z.</given-names></name></person-group> (<year>2020</year>). <article-title>Concerns and fears of Indian dentists on professional practice during the coronavirus disease 2019 (COVID-19) pandemic</article-title>. <source>Oral Dis.</source> <volume>27</volume>, <fpage>730</fpage>&#x2013;<lpage>732</lpage>. doi: <pub-id pub-id-type="doi">10.1111/odi.13459</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koh</surname> <given-names>D.</given-names></name> <name><surname>Lim</surname> <given-names>M. K.</given-names></name> <name><surname>Chia</surname> <given-names>S. E.</given-names></name> <name><surname>Ko</surname> <given-names>S. M.</given-names></name> <name><surname>Qian</surname> <given-names>F.</given-names></name> <name><surname>Ng</surname> <given-names>V.</given-names></name> <etal/></person-group>. (<year>2005</year>). <article-title>Risk perception and impact of severe acute respiratory syndrome (SARS) on work and personal lives of healthcare workers in Singapore What can we learn?</article-title> <source>Med. Care</source> <volume>43</volume>, <fpage>676</fpage>&#x2013;<lpage>682</lpage>. doi: <pub-id pub-id-type="doi">10.1097/01.mlr.0000167181.36730.cc</pub-id>, PMID: <pub-id pub-id-type="pmid">15970782</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lai</surname> <given-names>J.</given-names></name> <name><surname>Ma</surname> <given-names>S.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name> <name><surname>Cai</surname> <given-names>Z.</given-names></name> <name><surname>Jianbo</surname> <given-names>H.</given-names></name> <name><surname>Wei</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019</article-title>. <source>JAMA Netw. Open</source> <volume>3</volume>:<fpage>e203976</fpage>. doi: <pub-id pub-id-type="doi">10.1001/jamanetworkopen.2020.3976</pub-id>, PMID: <pub-id pub-id-type="pmid">32202646</pub-id></citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lau</surname> <given-names>J. T. F.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name> <name><surname>Ellie Pang</surname> <given-names>H. Y.</given-names></name> <name><surname>Tsui</surname> <given-names>E. W.</given-names></name> <name><surname>Wing</surname> <given-names>Y. K.</given-names></name></person-group> (<year>2005</year>). <article-title>SARS-related perceptions in Hong Kong</article-title>. <source>Emerg. Infect. Dis.</source> <volume>11</volume>, <fpage>417</fpage>&#x2013;<lpage>424</lpage>. doi: <pub-id pub-id-type="doi">10.3201/eid1103.040675</pub-id>, PMID: <pub-id pub-id-type="pmid">15757557</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lawshe</surname> <given-names>C. H.</given-names></name></person-group> (<year>1975</year>). <article-title>A quantitative approach to content validity</article-title>. <source>Pers. Psychol.</source> <volume>28</volume>, <fpage>563</fpage>&#x2013;<lpage>575</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1744-6570.1975.tb01393.x</pub-id></citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Malekshahi Beiranvand</surname> <given-names>F.</given-names></name> <name><surname>Hatami Varzaneh</surname> <given-names>A.</given-names></name></person-group> (<year>2018</year>). <article-title>Health care workers challenges during coronavirus outbreak: The qualitative study</article-title>. <source>RBS</source> <volume>18</volume>, <fpage>180</fpage>&#x2013;<lpage>190</lpage>.</citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Molavi-Taleghani</surname> <given-names>Y.</given-names></name> <name><surname>Ebrahimpour</surname> <given-names>H.</given-names></name> <name><surname>Sheikhbardsiri</surname> <given-names>H.</given-names></name></person-group> (<year>2020</year>). <article-title>A proactive risk assessment through healthcare failure mode and effect analysis in pediatric surgery department</article-title>. <source>J. Compr. Pediatr.</source> <volume>11</volume>:<fpage>e56008</fpage>. doi: <pub-id pub-id-type="doi">10.5812/compreped.56008</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moseley</surname> <given-names>J. M.</given-names></name> <name><surname>Burns</surname> <given-names>D.</given-names></name> <name><surname>Heil</surname> <given-names>J.</given-names></name> <name><surname>He</surname> <given-names>K.</given-names></name> <name><surname>Stolarski</surname> <given-names>A.</given-names></name> <name><surname>Whang</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Nursing perspectives on their COVID-19 pandemic preparedness</article-title>. <source>Nurse Pract.</source> <volume>7</volume>:<fpage>7</fpage>. doi: <pub-id pub-id-type="doi">10.7243/2056-9157-7-3</pub-id></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Muller</surname> <given-names>A. E.</given-names></name> <name><surname>Stensland</surname> <given-names>S. &#x00D8;.</given-names></name> <name><surname>van de Velde</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>The mental health impact of the COVID-19 pandemic on healthcare workers, and interventions to help them: a rapid systematic review</article-title>. <source>Psychiatry Res.</source> <volume>293</volume>:<fpage>113441</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.psychres.2020.113441</pub-id></citation></ref>
<ref id="ref38"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Pahlevan Sharif</surname> <given-names>S.</given-names></name> <name><surname>Sharif Nia</surname> <given-names>H.</given-names></name></person-group>. (<year>2020</year>). &#x201C;<source>Factor Analysis and Structural Equation Modeling With SPSS and AMOS</source>.&#x201D; <publisher-loc>Tehran</publisher-loc>: <publisher-name>Jame-e-Negar</publisher-name>.</citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Polit</surname> <given-names>D. F.</given-names></name> <name><surname>Beck</surname> <given-names>C. T.</given-names></name> <name><surname>Owen</surname> <given-names>S. V.</given-names></name></person-group> (<year>2007</year>). <article-title>Is the CVI an acceptable indicator of content validity? Appraisal and recommendations</article-title>. <source>Res. Nurs. Health</source> <volume>30</volume>, <fpage>459</fpage>&#x2013;<lpage>467</lpage>. doi: <pub-id pub-id-type="doi">10.1002/nur.20199</pub-id>, PMID: <pub-id pub-id-type="pmid">17654487</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Polit</surname> <given-names>Denise F.</given-names></name> <name><surname>Yang</surname> <given-names>Frances</given-names></name></person-group>. (<year>2016</year>). <source>Measurement and the Measurement of Change: A Primer for the Health Professions</source>. <publisher-loc>Philadelphia</publisher-loc>: <publisher-name>Wolters Kluwer</publisher-name>.</citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Que</surname> <given-names>J.</given-names></name> <name><surname>Le Shi</surname> <given-names>J. D.</given-names></name> <name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>L.</given-names></name> <name><surname>Suying</surname> <given-names>W.</given-names></name> <name><surname>Gong</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Psychological impact of the COVID-19 pandemic on healthcare workers: a cross-sectional study in China</article-title>. <source>Gen. Psychiatr.</source> <volume>33</volume>:<fpage>e100259</fpage>. doi: <pub-id pub-id-type="doi">10.1136/gpsych-2020-100259</pub-id>, PMID: <pub-id pub-id-type="pmid">32596640</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Qureshi</surname> <given-names>K.</given-names></name> <name><surname>Gershon</surname> <given-names>R. R. M.</given-names></name> <name><surname>Sherman</surname> <given-names>M. F.</given-names></name> <name><surname>Straub</surname> <given-names>T.</given-names></name> <name><surname>Gebbie</surname> <given-names>E.</given-names></name> <name><surname>McCollum</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2005</year>). <article-title>Health care workers&#x2019; ability and willingness to report to duty during catastrophic disasters</article-title>. <source>J. Urban Health</source> <volume>82</volume>, <fpage>378</fpage>&#x2013;<lpage>388</lpage>. doi: <pub-id pub-id-type="doi">10.1093/jurban/jti086</pub-id>, PMID: <pub-id pub-id-type="pmid">16000654</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sadique</surname> <given-names>M. Z.</given-names></name> <name><surname>John Edmunds</surname> <given-names>W.</given-names></name> <name><surname>Smith</surname> <given-names>R. D.</given-names></name> <name><surname>Meerding</surname> <given-names>W. J.</given-names></name> <name><surname>De Zwart</surname> <given-names>O.</given-names></name> <name><surname>Brug</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2007</year>). <article-title>Precautionary behavior in response to perceived threat of pandemic influenza</article-title>. <source>Emerg. Infect. Dis.</source> <volume>13</volume>, <fpage>1307</fpage>&#x2013;<lpage>1313</lpage>. doi: <pub-id pub-id-type="doi">10.3201/eid1309.070372</pub-id>, PMID: <pub-id pub-id-type="pmid">18252100</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saggino</surname> <given-names>A.</given-names></name> <name><surname>Kline</surname> <given-names>P.</given-names></name></person-group> (<year>1996</year>). <article-title>Item factor analysis of the Italian version of the death anxiety scale</article-title>. <source>J. Clin. Psychol.</source> <volume>52</volume>, <fpage>329</fpage>&#x2013;<lpage>333</lpage>. doi: <pub-id pub-id-type="doi">10.1002/(SICI)1097-4679(199605)52:3&#x003C;329::AID-JCLP11&#x003E;3.0.CO;2-K</pub-id>, PMID: <pub-id pub-id-type="pmid">8835696</pub-id></citation></ref>
<ref id="ref45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sahashi</surname> <given-names>Y.</given-names></name> <name><surname>Endo</surname> <given-names>H.</given-names></name> <name><surname>Sugimoto</surname> <given-names>T.</given-names></name> <name><surname>Nabeta</surname> <given-names>T.</given-names></name> <name><surname>Nishizaki</surname> <given-names>K.</given-names></name> <name><surname>Kikuchi</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Worries and concerns among healthcare workers during the coronavirus 2019 pandemic: a web-based cross-sectional survey</article-title>. <source>Humanit. Soc. Sci. Commun.</source> <volume>8</volume>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1057/s41599-021-00716-x</pub-id></citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seale</surname> <given-names>H.</given-names></name> <name><surname>Leask</surname> <given-names>J.</given-names></name> <name><surname>Po</surname> <given-names>K.</given-names></name> <name><surname>Raina Mac Intyre</surname> <given-names>C.</given-names></name></person-group> (<year>2009</year>). <article-title>&#x201C;Will they just pack up and leave?&#x201D;&#x2013;attitudes and intended behaviour of hospital health care workers during an influenza pandemic</article-title>. <source>BMC Health Serv. Res.</source> <volume>9</volume>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>. doi: <pub-id pub-id-type="doi">10.1186/1472-6963-9-30</pub-id></citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sheikhbardsiri</surname> <given-names>H.</given-names></name> <name><surname>Afshar</surname> <given-names>P. J.</given-names></name> <name><surname>Baniasadi</surname> <given-names>H.</given-names></name> <name><surname>Farokhzadian</surname> <given-names>J.</given-names></name></person-group> (<year>2022</year>). <article-title>Workplace violence against prehospital paramedic personnel (city and road) and factors related to this type of violence in Iran</article-title>. <source>J. Interpers. Violence</source> <volume>37</volume>, <fpage>NP11683</fpage>&#x2013;<lpage>NP11698</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0886260520967127</pub-id>, PMID: <pub-id pub-id-type="pmid">33107378</pub-id></citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shiao</surname> <given-names>J. S.-C.</given-names></name> <name><surname>Koh</surname> <given-names>D.</given-names></name> <name><surname>Lo</surname> <given-names>L.-H.</given-names></name> <name><surname>Lim</surname> <given-names>M.-K.</given-names></name> <name><surname>Guo</surname> <given-names>Y. L.</given-names></name></person-group> (<year>2007</year>). <article-title>Factors predicting nurses&#x2019; consideration of leaving their job during the SARS outbreak</article-title>. <source>Nurs. Ethics</source> <volume>14</volume>, <fpage>5</fpage>&#x2013;<lpage>17</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0969733007071350</pub-id>, PMID: <pub-id pub-id-type="pmid">17334166</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sperling</surname> <given-names>D.</given-names></name></person-group> (<year>2021</year>). <article-title>Nurses&#x2019; challenges, concerns and unfair requirements during the COVID-19 outbreak</article-title>. <source>Nurs. Ethics</source> <volume>28</volume>, <fpage>1096</fpage>&#x2013;<lpage>1110</lpage>. doi: <pub-id pub-id-type="doi">10.1177/09697330211005175</pub-id>, PMID: <pub-id pub-id-type="pmid">33942658</pub-id></citation></ref>
<ref id="ref50"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tabachnick</surname> <given-names>Barbara G.</given-names></name> <name><surname>Fidell</surname> <given-names>Linda S.</given-names></name> <name><surname>Ullman</surname> <given-names>Jodie B.</given-names></name></person-group> (<year>2007</year>). <source>Using Multivariate Statistics</source>. Vol. <volume>5</volume> <publisher-name>Pearson</publisher-name> <publisher-loc>Boston, MA</publisher-loc>.</citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Temsah</surname> <given-names>M.-H.</given-names></name> <name><surname>Al-Sohime</surname> <given-names>F.</given-names></name> <name><surname>Alamro</surname> <given-names>N.</given-names></name> <name><surname>Al-Eyadhy</surname> <given-names>A.</given-names></name> <name><surname>Al-Hasan</surname> <given-names>K.</given-names></name> <name><surname>Jamal</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>The psychological impact of COVID-19 pandemic on health care workers in a MERS-CoV endemic country</article-title>. <source>J. Infect. Public Health</source> <volume>13</volume>, <fpage>877</fpage>&#x2013;<lpage>882</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jiph.2020.05.021</pub-id>, PMID: <pub-id pub-id-type="pmid">32505461</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wong</surname> <given-names>T. Y.</given-names></name> <name><surname>Koh</surname> <given-names>G. C.</given-names></name> <name><surname>Cheong</surname> <given-names>S. K.</given-names></name> <name><surname>Lee</surname> <given-names>H. Y.</given-names></name> <name><surname>Fong</surname> <given-names>Y. T.</given-names></name> <name><surname>Sundram</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2008</year>). <article-title>Concerns, perceived impact and preparedness in an avian influenza pandemic--a comparative study between healthcare workers in primary and tertiary care</article-title>. <source>Ann. Acad. Med. Singap.</source> <volume>37</volume>:<fpage>96</fpage>.</citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yusefi</surname> <given-names>A. R.</given-names></name> <name><surname>Sharifi</surname> <given-names>M.</given-names></name> <name><surname>Nasabi</surname> <given-names>N. S.</given-names></name> <name><surname>Davarani</surname> <given-names>E. R.</given-names></name> <name><surname>Bastani</surname> <given-names>P.</given-names></name></person-group> (<year>2022</year>). <article-title>Health human resources challenges during COVID-19 pandemic; evidence of a qualitative study in a developing country</article-title>. <source>PLos One</source> <volume>17</volume>:<fpage>e0262887</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0262887</pub-id></citation></ref>
</ref-list>
</back>
</article>
