<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2018.00959</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Spanish Validation of the Shorter Version of the Workplace Incivility Scale: An Employment Status Invariant Measure</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Di Marco</surname> <given-names>Donatella</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/334318/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Mart&#x00ED;nez-Corts</surname> <given-names>In&#x00E9;s</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/320962/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Arenas</surname> <given-names>Alicia</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/187472/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Gamero</surname> <given-names>Nuria</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/547853/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Business Research Unit (BRU-IUL), Instituto Universit&#x00E1;rio de Lisboa (ISCTE-IUL)</institution>, <addr-line>Lisbon</addr-line>, <country>Portugal</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Social Psychology, University of Seville</institution>, <addr-line>Seville</addr-line>, <country>Spain</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Darren C. Treadway, University at Buffalo, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Laurent Sovet, Universit&#x00E9; Paris Descartes, France; Juan Jose Fernandez Mu&#x00F1;oz, Universidad Rey Juan Carlos, Spain</p></fn>
<corresp id="c001">&#x002A;Correspondence: Donatella Di Marco, <email>ddmoi@iscte-iul.pt</email></corresp>
<fn fn-type="other" id="fn002"><p>This article was submitted to Organizational Psychology, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>13</day>
<month>06</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>09</volume>
<elocation-id>959</elocation-id>
<history>
<date date-type="received">
<day>24</day>
<month>10</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>24</day>
<month>05</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2018 Di Marco, Mart&#x00ED;nez-Corts, Arenas and Gamero.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Di Marco, Mart&#x00ED;nez-Corts, Arenas and Gamero</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Workplace Incivility (WI) occurs worldwide and has negative consequences on individuals and organizations. Valid and comprehensive instruments have been used, specifically in English speaking countries, to measure such adverse process at work, but it is not available a validated instrument for research carried out in Spanish speaking countries. In this study we aim to test the psychometric properties of the Matthews and Ritter&#x2019;s four-item Workplace Incivility Scale (2016) with Spanish workers (<italic>N</italic> = 407) from different sectors. Participants&#x2019; mean age was 38.73 (<italic>SD</italic> = 10.45) years old and the percentage of female employees was 59.2%. Confirmatory factor analysis using AMOS 19.0 was carried out, presenting a good fit. The internal consistency, convergent and concurrent validity of the scale were examined. Results show good scale reliability and expected high correlations with social undermining. Moreover, the scale related to propensity to leave a job, job satisfaction, and psychological well-being in the expected way. After configural invariance across groups was established, testing for metric invariance and scalar invariance was performed. Considering &#x0394;&#x03C7;<sup>2</sup> and &#x0394;CFI tests for two nested models, the 4-item scale was invariant when the employment status is considered (permanent vs. temporal, full-time vs. part-time, and supervisor vs. non-supervisors). Overall, our findings showed good psychometric properties of the shorter version of the WIS in Spain. Theoretical and practical implications of this study are discussed.</p>
</abstract>
<kwd-group>
<kwd>workplace incivility scale</kwd>
<kwd>Spanish validation</kwd>
<kwd>invariant measure</kwd>
<kwd>shorter version</kwd>
<kwd>employment status</kwd>
<kwd>employees&#x2019; well-being</kwd>
</kwd-group>
<contract-num rid="cn001">PSI2015-64894-P</contract-num>
<contract-num rid="cn002">SFRH/BPD/121748/2016</contract-num>
<contract-sponsor id="cn001">Ministerio de Econom&#x00ED;a y Competitividad<named-content content-type="fundref-id">10.13039/501100003329</named-content></contract-sponsor>
<contract-sponsor id="cn002">Funda&#x00E7;&#x00E3;o para a Ci&#x00EA;ncia e a Tecnologia<named-content content-type="fundref-id">10.13039/501100003329</named-content></contract-sponsor>
<counts>
<fig-count count="1"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="65"/>
<page-count count="9"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<sec><title>Workplace Incivility</title>
<p>Workplaces are spaces characterized by rules defined as appropriate in a specific society. Sometimes such rules might be broken and people might carry out behaviors considered as deviant at that moment and in that context (<xref ref-type="bibr" rid="B48">Pawar, 2013</xref>), affecting negatively employees&#x2019; well-being and satisfaction. In the last few years, several researchers have focused their attention on deviant behaviors at work and many of them have been identified (e.g., <xref ref-type="bibr" rid="B30">Hershcovis, 2011</xref>): social undermining (<xref ref-type="bibr" rid="B15">Duffy et al., 2002</xref>), bullying (<xref ref-type="bibr" rid="B31">Hoel et al., 1999</xref>; <xref ref-type="bibr" rid="B16">Einarsen, 2000</xref>), ostracism (<xref ref-type="bibr" rid="B64">Williams, 2007</xref>), or abusive supervision (<xref ref-type="bibr" rid="B58">Tepper, 2000</xref>) are only some of them. Quite recently, workplace incivility (WI), defined as &#x201C;low-intensity deviant behavior with ambiguous intent to harm the target, in violation of workplace norms for mutual respect&#x201D; (<xref ref-type="bibr" rid="B1">Andersson and Pearson, 1999</xref>, p. 457), has captured the attention of many researchers. WI is characterized by the ambiguity about the real intention of the perpetrator. In fact, uncivil acts might be the result of an intentional mistreatment; but it might also be the consequence of a lack of nicety (<xref ref-type="bibr" rid="B49">Pearson et al., 2000</xref>) without any goal of harming the other part. Moreover, following the original definition, WI might pass as unseen, given the low-intensity of acts that enter in its domain. In the original works of (<xref ref-type="bibr" rid="B1">Andersson and Pearson, 1999</xref>; <xref ref-type="bibr" rid="B50">Pearson et al., 2001</xref>) and in the following research on this issue (e.g., <xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>, <xref ref-type="bibr" rid="B9">2013</xref>) behaviors of different nature where identified as WI. Shouting against a coworker, isolating him or her, devaluating a colleague&#x2019;s job, making jokes at others&#x2019; expense: all these behaviors enter into the realm of what is defined as WI. The subtlety of such acts makes difficult to define them as mistreatments and can be attributed to a rude environment (<xref ref-type="bibr" rid="B38">Leiter, 2013</xref>). Various researchers (e.g., <xref ref-type="bibr" rid="B30">Hershcovis, 2011</xref>) have pointed out the growth and, often, the overlapping between constructs related to negative acts at work. One of them is social undermining (<xref ref-type="bibr" rid="B15">Duffy et al., 2002</xref>) which refers to those behaviors whose intent is undermining victims&#x2019; work relational ties and reputation. Although related concepts, they can be differentiated by the intent to harm which is clearer in social undermining and ambiguous in case of incivility.</p>
<p>Although uncivil acts are not blatantly aggressive and victims often are not aware of the perpetrator&#x2019;s intent to harm, they might be the cause of several prejudicial consequences for people&#x2019;s well-being and organizations (<xref ref-type="bibr" rid="B12">Di Marco et al., 2015</xref>; <xref ref-type="bibr" rid="B22">Garrosa et al., 2015</xref>; <xref ref-type="bibr" rid="B35">Kabat-Farr et al., 2016</xref>; <xref ref-type="bibr" rid="B56">Schilpzand et al., 2016</xref>). Such consequences depend on the intensity of the act and its frequency (<xref ref-type="bibr" rid="B30">Hershcovis, 2011</xref>; <xref ref-type="bibr" rid="B38">Leiter, 2013</xref>). Incivility is an organizational stressor (<xref ref-type="bibr" rid="B28">Griffin, 2010</xref>) and being victim of uncivil behaviors produces negative outcomes. Previous studies demonstrated that WI affects physical and psychological well-being, diminishes job satisfaction and increases the desire of revenge (<xref ref-type="bibr" rid="B1">Andersson and Pearson, 1999</xref>; <xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>; <xref ref-type="bibr" rid="B50">Pearson et al., 2001</xref>; <xref ref-type="bibr" rid="B13">Diaz et al., 2011</xref>; <xref ref-type="bibr" rid="B44">Moreno-Jim&#x00E9;nez et al., 2012</xref>; <xref ref-type="bibr" rid="B35">Kabat-Farr et al., 2016</xref>); it also reduces job performance, increases the intention to leave and organizational costs (<xref ref-type="bibr" rid="B28">Griffin, 2010</xref>; <xref ref-type="bibr" rid="B53">Porath and Pearson, 2010</xref>; <xref ref-type="bibr" rid="B57">Taylor et al., 2012</xref>; <xref ref-type="bibr" rid="B56">Schilpzand et al., 2016</xref>; <xref ref-type="bibr" rid="B39">Mao et al., 2017</xref>). Moreover, recent research has demonstrated that being victim of WI can lead to counterproductive work behaviors (voluntary actions which are prejudicial for the organization or their members) (<xref ref-type="bibr" rid="B54">Sakurai and Jex, 2012</xref>; <xref ref-type="bibr" rid="B62">Welbourne and Sariol, 2017</xref>), increasing the cost of incivility for the organization. People who perceive WI spend more time thinking on uncivil acts experienced, are less satisfied and the probability to quit the organization is higher (<xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>).</p>
<p>The cost of WI is paid by victims and organizations, but also by bystanders and all those people who enter into the uncivil spiral (<xref ref-type="bibr" rid="B43">Montgomery et al., 2004</xref>; <xref ref-type="bibr" rid="B52">Porath and Erez, 2009</xref>). In fact, not paying attention to WI might involve the escalation of conflict. Workers who are victims of uncivil acts might ignore such treatment or might desire to retaliate with the original perpetrator or with another person. Indeed WI might be contagious (<xref ref-type="bibr" rid="B1">Andersson and Pearson, 1999</xref>) and a spiral of incivility might rise, involving many people within the organization. All the organizational actors might be implicated. Past studies found that supervisors, coworkers and clients might perpetrate incivility (<xref ref-type="bibr" rid="B56">Schilpzand et al., 2016</xref>). Specially, people at the top of the hierarchy might use more often incivility as a mean to exercise power or to push productivity (<xref ref-type="bibr" rid="B53">Porath and Pearson, 2010</xref>; <xref ref-type="bibr" rid="B36">Kabat-Farr et al., 2017</xref>).</p>
</sec>
<sec><title>Workplace Incivility Measure</title>
<p>Rudeness and uncivil behaviors are largely widespread at the workplace and many workers confirmed they have been victims of them at least once in their working life (<xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>; <xref ref-type="bibr" rid="B51">Pearson and Porath, 2013</xref>). In order to measure the impact of this phenomenon, numerous qualitative (<xref ref-type="bibr" rid="B1">Andersson and Pearson, 1999</xref>; <xref ref-type="bibr" rid="B50">Pearson et al., 2001</xref>; <xref ref-type="bibr" rid="B12">Di Marco et al., 2015</xref>) and quantitative (<xref ref-type="bibr" rid="B61">Welbourne et al., 2015</xref>) studies have been carried out. Several scales have been developed with the goal of creating a comprehensive instrument in order to measure quantitatively and objectively uncivil acts at the workplace (e.g., <xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>, <xref ref-type="bibr" rid="B9">2013</xref>; <xref ref-type="bibr" rid="B40">Martin and Hine, 2005</xref>). However, &#x201C;WI is not an objective phenomenon; it reflects people&#x2019;s interpretation of how actions make them feel&#x201D; (<xref ref-type="bibr" rid="B53">Porath and Pearson, 2010</xref>, p. 64) and several factors might play a role in the process of interpretation of behaviors considered uncivil (e.g., hierarchical status) (<xref ref-type="bibr" rid="B56">Schilpzand et al., 2016</xref>).</p>
<p>Although different measures have been developed (e.g., <xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>, <xref ref-type="bibr" rid="B9">2013</xref>; <xref ref-type="bibr" rid="B40">Martin and Hine, 2005</xref>; <xref ref-type="bibr" rid="B65">Wilson and Holmvall, 2013</xref>), Cortina and colleagues&#x2019; Workplace Incivility Scale (WIS), in the original (<xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>) and revised version (<xref ref-type="bibr" rid="B9">Cortina et al., 2013</xref>) is the most known and applied instrument to date. The WIS is a unidimensional scale that brings together 7 (<xref ref-type="bibr" rid="B10">Cortina et al., 2001</xref>) or 12 items (<xref ref-type="bibr" rid="B9">Cortina et al., 2013</xref>) which refer to several uncivil behaviors experienced in a variable recall window: &#x201C;the past 5 years&#x201D; in the former version, and &#x201C;the last year&#x201D; in the latter. In fact, researchers were conscious that results can be affected significantly by the length of the recall window (<xref ref-type="bibr" rid="B3">Blau and Andersson, 2005</xref>; <xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>), due to distractions that a longer recall window might create (<xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>).</p>
<p>There have been several attempts to reduce or adapt the WIS to different research goals (e.g., <xref ref-type="bibr" rid="B3">Blau and Andersson, 2005</xref>; <xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>). Recently, <xref ref-type="bibr" rid="B41">Matthews and Ritter (2016)</xref> elaborated a shorter (four-item scale) WIS based on the second version of <xref ref-type="bibr" rid="B9">Cortina et al.&#x2019;s (2013)</xref> WIS. Applying a shorter instrument is important in order to improve the clarity of the construct that researcher would measure; it enhances the probability that respondents complete the questionnaire, even more when several scales are applied at the same time (<xref ref-type="bibr" rid="B20">Fisher et al., 2015</xref>; <xref ref-type="bibr" rid="B2">Balducci et al., 2017</xref>). Reduced scales are necessary when researchers carry out longitudinal studies and, also, when responses are given by computer, due to the largely use of electronic surveys (<xref ref-type="bibr" rid="B2">Balducci et al., 2017</xref>).</p>
<p>The four item-reduced version of the WIS (<xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>) was the result of a complex analysis which first had the goal to explore the judgmental qualities of the scale, understanding which items of the 12-items WIS version (<xref ref-type="bibr" rid="B9">Cortina et al., 2013</xref>) respected the initial conceptualization that <xref ref-type="bibr" rid="B1">Andersson and Pearson (1999)</xref> gave to the construct. In other terms, researchers explored if both the distinguishing features of the original construct -the ambiguous intent to harm and the low intensity of acts- were reflected by the WIS. Then convergent and divergent validity were analyzed and the four items of the reduced version were identified. The reduced WIS showed good psychometric properties with a Cronbach&#x2019;s &#x03B1; = 0.79 and factor loadings ranged from 0.57 to 0.77. The reduced scale correlated 0.93 with the 12-items scale and both explained similar levels of variance in the dependent variables analyzed (e.g., civility norms, interpersonal deviance, organizational deviance, etc.).</p>
<p>The goal of this research is to validate a Spanish version of the WI reduced scale elaborated by <xref ref-type="bibr" rid="B41">Matthews and Ritter (2016)</xref>. The recent increment of workers&#x2019; demands and the escalation of work insecurity due to the financial crises have involved several countries. For instance, in Spain, only 59% of workers perceive job security (<xref ref-type="bibr" rid="B17">Eurofound, 2017</xref>). According the 6th Eurofound Working Conditions Survey, 16% of European workers perceived adverse social behavior at work and 16% have not been treated fairly in their workplace. In Spain the prevalence of these issues is 10 and 21%, respectively (<xref ref-type="bibr" rid="B17">Eurofound, 2017</xref>). Thus, this trend might have reinforced negative acts such as WI which might be instigated by a demanding workplace (<xref ref-type="bibr" rid="B56">Schilpzand et al., 2016</xref>). The few studies on WI in Spain showed that uncivil behaviors generate workers less satisfied, who carried out more counterproductive behaviors (<xref ref-type="bibr" rid="B13">Diaz et al., 2011</xref>); the emotional exhaustion increases (<xref ref-type="bibr" rid="B22">Garrosa et al., 2015</xref>) as well as the intention to leave the organization (<xref ref-type="bibr" rid="B44">Moreno-Jim&#x00E9;nez et al., 2012</xref>). Although research carried out in Spain to date does not show high levels of incivility, they highlight its prejudicial effects at individual and organizational level. In order to recognize and evaluate the impact of WI, it is necessary to analyze the psychometric properties of the WIS, making available a valid and reduced measure of such construct for those studies carried out in Spain. In the present study we analyze, firstly, the items reliability and factor loading of the Spanish reduced WIS; secondly, we analyze the convergent validity of the reduced WIS with another related concept, such as social undermining; and the concurrent validity with several outcomes propensity to leave, job satisfaction, and psychological well-being. Finally, as <xref ref-type="bibr" rid="B41">Matthews and Ritter (2016)</xref> highlighted in their work, it is necessary to obtain an invariant scale based on the characteristics of the employment type. While their measure results to be invariant when applied to full-time versus part-time workers and to men and women, they did not consider other features of the employment, such as the type of contract (permanent vs. temporal contract) and the position occupied in the hierarchical scale (supervisors vs. non-supervisors). In fact, people who are in a temporary contract might be more likely victims of WI, because their transit within the organization is perceived as limited and perpetrators might care less about consequences derived from negative behaviors against this group of workers (<xref ref-type="bibr" rid="B55">Salminen and Saloniemi, 2010</xref>). The same process might arise when we are in front of people with different level of formal power. As research has underlined previously (e.g., <xref ref-type="bibr" rid="B56">Schilpzand et al., 2016</xref>), subordinates experience WI more than superiors do. Consequently, the goal to validate an invariant measure will be to find out those behaviors that are uncivil beyond the employment status.</p>
</sec>
</sec>
<sec id="s1" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec><title>Participants</title>
<p>Participants were 407 employees from a broad range of professional backgrounds, including trade (28%), education (25.3%), insurance (10.8%), health and welfare (8.8%), catering (6.4%), industry (4.7%), culture and leisure (4.2%), construction (3.2%), transport (1.7%), business service (1.7%), agricultural sector (1.2%), government (1.2%), communication (1%), and others (2.8%). The percentage of female employees was 59.2%. Regarding their highest education, 58.5% had a university degree, 30% had completed high school or vocational education, 10.1% had completed elementary studies, and 1.5% had not completed any formal education. Respondents&#x2019; mean age was 38.73 (<italic>SD</italic> = 10.45) years old. Most respondent held a fulltime employed (70.3%) and no managerial position (57.5%). About 72% held permanent contract, 18.9% held temporal contract and 2.2% were freelance. Participants worked an average of 26.54 (<italic>SD</italic> = 14.37) hours per week. Their average seniority at the current company was about 12 years (<italic>SD</italic> = 9.87).</p>
</sec>
<sec><title>Measures</title>
<sec><title>Workplace Incivility Scale</title>
<p>Participants answered the short version of WI by <xref ref-type="bibr" rid="B41">Matthews and Ritter (2016)</xref>, which comprises 4 items (see <bold>Appendix A</bold>). Respondents had to think about if in the last year they have been victims of uncivil behaviors perpetrated by a coworker or supervisor (e.g., &#x201C;Made jokes at your expense&#x201D;). Respondents were scored on a 5-point Likert scale ranging from 1 (never) to 5 (many times). Cronbach&#x2019;s alpha was 0.75.</p>
</sec>
<sec><title>Social Undermining Scale</title>
<p><xref ref-type="bibr" rid="B15">Duffy et al. (2002)</xref> 26-item measure was used. Using a 6-point Likert scale ranging from 1 (never) to 6 (everyday) participants were asked to think about the frequency their supervisors and coworkers show the listed behaviors (e.g., &#x201C;Hurt your feelings&#x201D;). Cronbach&#x2019;s alpha was 0.96.</p>
</sec>
<sec><title>Propensity to Leave a Job Scale</title>
<p><xref ref-type="bibr" rid="B25">Gonz&#x00E1;lez-Rom&#x00E1; et al. (1992)</xref> 3-item measure was used. Using a 5-point Likert scale ranging from 1 (absolutely disagree) to 5 (absolutely agree) participants were asked to think about their workplace and reflect on whether they would change to another job in the same organization (e.g., &#x201C;I would feel better if I occupied the same position (with the same work conditions) in another department or section at my organization&#x201D;). Cronbach&#x2019;s alpha was 0.89.</p>
</sec>
<sec><title>Job Satisfaction Scale</title>
<p>The Minnesota Satisfaction Scale (<xref ref-type="bibr" rid="B60">Weiss et al., 1967</xref>) 5-item measure of extrinsically and general satisfaction was used. Using a 5-point Likert scale ranging from 1 (unsatisfied) to 5 (very satisfied) participants were asked to think how satisfied they are with different aspect of their job (e.g., paid, security, coworkers, supervisors) and with the job in general (e.g., &#x201C;In general, how satisfied are you with your actual job?&#x201D;). Cronbach&#x2019;s alpha was 0.74.</p>
</sec>
<sec><title>Psychological Well-Being Scale</title>
<p>The 12-item General Health Questionnaire <xref ref-type="bibr" rid="B24">Goldberg&#x2019;s (1972)</xref>, adapted by <xref ref-type="bibr" rid="B26">Gonz&#x00E1;lez-Rom&#x00E1; et al. (1991)</xref> was used. The scale is measured in a 4-point response format ranging from 1 (rarely) to 4 (frequently). Participants were asked to describe how they feel actually (e.g., &#x201C;Have you recently felt constantly under strain?&#x201D;). Cronbach&#x2019;s alpha was 0.76.</p>
</sec>
</sec>
<sec><title>Translation and Adaptation Procedures</title>
<p>According to the International Test Commission guidelines (<xref ref-type="bibr" rid="B29">Hambleton et al., 2005</xref>; <xref ref-type="bibr" rid="B33">International Test Commission [ITC], 2005</xref>), four expert researchers first translated the WIS into Spanish trying to preserve the original meaning of items. Second, the translated items were discussed and the four experts got a consensus about the content of the items. In general, item translation did not generate debate and consensus was reached easily. Third, a back-translation was conducted by an English speaking translator and the equivalence between the two versions was assured. The final Spanish version of the scale is shown in &#x201C;<bold>Appendix A</bold>&#x201D;.</p>
</sec>
<sec><title>Data Collection Procedure</title>
<p>Employees from various organizations in Spain were recruited using an incidental sampling scheme. They voluntary fulfilled a cross-sectional survey in approximately 15 min. Participants were informed about the anonymity and confidentiality of the survey.</p>
</sec>
<sec><title>Analyses</title>
<p>Confirmatory factor analysis (CFA) was conducted using AMOS 19.0 and all other statistical procedures were computed with SPSS 24.0. Since there was evidence of data&#x2019;s deviation of normal distribution and the sample is moderated we computed analysis with Asymptotic Distribution-Free (ADF) method (<xref ref-type="bibr" rid="B34">Jones and Waller, 2015</xref>). Model evaluation included an examination of the model fit indices and squared multiple correlations. As widely recommended (<xref ref-type="bibr" rid="B6">Byrne, 2010</xref>; <xref ref-type="bibr" rid="B45">Mueller and Hancock, 2010</xref>; <xref ref-type="bibr" rid="B23">Garson, 2012</xref>; <xref ref-type="bibr" rid="B63">West et al., 2012</xref>) the goodness-of-fit of the factor structure was evaluated from three different perspectives (incremental, parsimonious, and absolute) using the normed chi-square value, the comparative fit index (CFI), the non-normed fit index (NNFI), the root mean square error of approximation (RMSEA), and the standardized root mean square residual (SRMR). Moreover, the measurement invariance across gender and work characteristics groups was analyzed through a multi-group CFA. After configural invariance across groups was established, testing for metric invariance and scalar invariance was performed using &#x0394;&#x03C7;<sup>2</sup> and &#x0394;CFI tests for two nested models (<xref ref-type="bibr" rid="B4">Brown, 2006</xref>; <xref ref-type="bibr" rid="B6">Byrne, 2010</xref>; <xref ref-type="bibr" rid="B14">Dimitrov, 2010</xref>). A change of equal to or &#x003C; 0.01 for CFI indicates that invariance holds (<xref ref-type="bibr" rid="B7">Cheung and Rensvold, 2002</xref>).</p>
<p>The internal consistency, concurrent and convergent validity of the scale were examined by Cronbach&#x2019;s alpha coefficients and Spearman correlation coefficients, respectively. Moreover, correlational analyses and analysis of variance were used to perform group comparison.</p>
</sec>
</sec>
<sec><title>Results</title>
<sec><title>Item Analysis</title>
<p>Regarding the distributional properties of the 4 items, means ranged from 1.96 to 1.43 (see <bold>Table <xref ref-type="table" rid="T1">1</xref></bold>). When studying negative acts at work, such as WI, low means are common (e.g., <xref ref-type="bibr" rid="B35">Kabat-Farr et al., 2016</xref>). Standard deviations ranged from 0.99 to 0.78, skewness ranged from 0.90 to 2.45 and kurtosis ranged from 0.35 to 6.35. Some items are below indices for acceptable limits of 2 (<xref ref-type="bibr" rid="B18">Field, 2000</xref>, <xref ref-type="bibr" rid="B19">2009</xref>; <xref ref-type="bibr" rid="B59">Trochim and Donnelly, 2006</xref>; <xref ref-type="bibr" rid="B27">Gravetter and Wallnau, 2014</xref>). Hence, as shown in <bold>Table <xref ref-type="table" rid="T1">1</xref></bold>, there is evidence of deviation of normal distribution.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Means, standard deviation, item-adjusted total correlation, alpha if item deleted, and inter-item correlation of the workplace incivility scale.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Item</th>
<th valign="top" align="center">Mean</th>
<th valign="top" align="center"><italic>SD</italic></th>
<th valign="top" align="center">Skewness <italic>SE</italic> = 0.121</th>
<th valign="top" align="center">Kurtosis <italic>SE</italic> = 0.241</th>
<th valign="top" align="center"><italic>rit</italic></th>
<th valign="top" align="center"><italic>&#x03B1;id</italic></th>
<th valign="top" align="center" colspan="3">Inter-item correlations<hr/></th>
</tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<th valign="top" align="center">Item 1</th>
<th valign="top" align="center">Item 2</th>
<th valign="top" align="center">Item 3</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Item 1</td>
<td valign="top" align="center">1.91</td>
<td valign="top" align="center">0.95</td>
<td valign="top" align="center">0.903</td>
<td valign="top" align="center">0.355</td>
<td valign="top" align="center">0.75</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td></tr>
<tr>
<td valign="top" align="left">Item 2</td>
<td valign="top" align="center">1.96</td>
<td valign="top" align="center">0.99</td>
<td valign="top" align="center">1.032</td>
<td valign="top" align="center">0.858</td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center">0.66</td>
<td valign="top" align="center">0.48</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">Item 3</td>
<td valign="top" align="center">1.39</td>
<td valign="top" align="center">0.79</td>
<td valign="top" align="center">2.450</td>
<td valign="top" align="center">6.354</td>
<td valign="top" align="center">0.76</td>
<td valign="top" align="center">0.69</td>
<td valign="top" align="center">0.42</td>
<td valign="top" align="center">0.51</td>
<td valign="top" align="center"></td></tr>
<tr>
<td valign="top" align="left">Item 4</td>
<td valign="top" align="center">1.43</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">2.062</td>
<td valign="top" align="center">4.488</td>
<td valign="top" align="center">0.71</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">0.34</td>
<td valign="top" align="center">0.46</td>
<td valign="top" align="center">0.45</td>
</tr>
<tr>
<td valign="top" align="left">PL</td>
<td valign="top" align="center">2.45</td>
<td valign="top" align="center">1.2</td>
<td valign="top" align="center">0.456</td>
<td valign="top" align="center">-0.817</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">JS</td>
<td valign="top" align="center">3.47</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">-0.463</td>
<td valign="top" align="center">-0.032</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">PWB</td>
<td valign="top" align="center">2.99</td>
<td valign="top" align="center">0.49</td>
<td valign="top" align="center">-0.192</td>
<td valign="top" align="center">0.018</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">SU</td>
<td valign="top" align="center">1.21</td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="center">3.97</td>
<td valign="top" align="center">19.85</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td></tr>
</tbody></table>
<table-wrap-foot>
<attrib><italic>PL = Propension to leave; JS = Job Satisfaction; PWB = Psychological Well-being; SU = Social Undermining; <italic>SD</italic> standard deviation, <italic>rit</italic> item homogeneity<italic>, &#x03B1;id</italic> Alpha if-item-deleted. All correlations were statistically significant <italic>p</italic> &#x003C; 0.01</italic>.</attrib>
</table-wrap-foot>
</table-wrap>
</sec>
<sec><title>Confirmatory Factor Analysis</title>
<p>Confirmatory factor analysis model with the unconstrained factor loadings are shown in <bold>Figure <xref ref-type="fig" rid="F1">1</xref></bold>. The factor loadings ranged from 0.48 to 0.77 and parameters show a good fit (see <bold>Figure <xref ref-type="fig" rid="F1">1</xref></bold>). Two CFAs were conducted for each pair of work characteristics &#x2013;men vs. women; permanent vs. temporal contract; full-time vs. part-time and supervisor vs. non-supervisors- separately. Taken together, values suggest a good fit. A non-significant chi-square indicates a perfect fit, and a good fit is indicated when the ratio between the chi-square statistic and the degree of freedom is less than 5 (<xref ref-type="bibr" rid="B63">West et al., 2012</xref>). All CFI and NNFI values are > 0.95 indicating a good fit (<xref ref-type="bibr" rid="B6">Byrne, 2010</xref>). The RMSEA for the scale with all participants indicates a well-fitting model (<xref ref-type="bibr" rid="B5">Browne and Cudeck, 1993</xref>). With only one exception (for part-time employees), RMSEA values are lower 0.08, indicating an acceptable fitting (<xref ref-type="bibr" rid="B32">Hu and Bentler, 1999</xref>). All SRMR values are under 0.08 indicating a good fit (<xref ref-type="bibr" rid="B32">Hu and Bentler, 1999</xref>). Standardized residuals revealed that all values fell well below the 0.15, which is consistent with the notion of an acceptable fit (<xref ref-type="bibr" rid="B6">Byrne, 2010</xref>) (see <bold>Figure <xref ref-type="fig" rid="F1">1</xref></bold>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Standardized path loadings for 4-item scale. WI, Workplace Incivility.</p></caption>
<graphic xlink:href="fpsyg-09-00959-g001.tif"/>
</fig>
<p>Based on selective discrimination&#x2019;s assumptions, different ANOVA was conducted with all demographic variables: sex, age, studies, civil status, type of contract, employment status, responsibility position, and sector. There were no differences in WI perceptions.</p>
<p>Using the criterion by <xref ref-type="bibr" rid="B46">Nunnally (1978)</xref>, the alpha coefficient of the reduced measure showed a good internal consistency (Cronbach&#x2019;s &#x03B1; = 0.75). The mean and standard deviation of each item and the inter-item correlations are presented in <bold>Table <xref ref-type="table" rid="T1">1</xref></bold>. Sequential deletion of items generated alphas ranging from 0.66 to 0.72.</p>
<p>To test the convergent validity, Spearman&#x2019;s correlation coefficients were computed between the reduced WIS and social undermining, the propensity to leave a job, job satisfaction and psychological well-being measures. In addition, guidelines <xref ref-type="bibr" rid="B8">Cohen&#x2019;s (1988)</xref> were used to determine the strengths of the correlation coefficients between the reduced WIS and other measures, with <italic>r</italic> around 0.1 indicating small effect sizes, around 0.3 indicating medium effect sizes, and <italic>r</italic> > 0.5 indicating large effect sizes. Assessing for convergent validity, as expected, the reduced WIS had a large positive effect with social undermining. Regarding the concurrent validity, results showed that the scale was significantly, although moderately, associated with propensity to leave a job (<italic>r</italic> = 0.21, <italic>p</italic> &#x003C; 0.01), job satisfaction (<italic>r</italic> = -0.44, <italic>p</italic> &#x003C; 0.01) and psychological well-being (<italic>r</italic> = -0.20, <italic>p</italic> &#x003C; 0.01) (see <bold>Table <xref ref-type="table" rid="T2">2</xref></bold>).</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Means, Standard Deviations, and Spearman Inter-correlations among variables (<italic>N</italic> = 407 participants).</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Variable</th>
<th valign="top" align="center">alpha</th>
<th valign="top" align="center">Items</th>
<th valign="top" align="center">1</th>
<th valign="top" align="center">2</th>
<th valign="top" align="center">3</th>
<th valign="top" align="center">4</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">(1) Workplace Incivility</td>
<td valign="top" align="center">0.75</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">(2) Social Undermining</td>
<td valign="top" align="center">0.96</td>
<td valign="top" align="center">26</td>
<td valign="top" align="center">0.50<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">(3) Propensity to Leave a job</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">0.21<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">0.21<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">(4) Job Satisfaction</td>
<td valign="top" align="center">0.77</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">-0.44<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">-0.30<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">-0.26<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center"></td>
</tr>
<tr>
<td valign="top" align="left">(5) Psychological Well-Being</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">-0.20<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">-0.18<sup>&#x2217;&#x2217;</sup></td>
<td valign="top" align="center">-0.05</td>
<td valign="top" align="center">0.37<sup>&#x2217;&#x2217;</sup></td>
</tr>
</tbody></table>
<table-wrap-foot>
<attrib><sup>&#x2217;&#x2217;</sup><italic>p &#x003C; 0.01</italic>.</attrib>
</table-wrap-foot>
</table-wrap>
<p>To test measurement invariance across groups, configural, metric and scalar models were compared (see <bold>Table <xref ref-type="table" rid="T3">3</xref></bold>). The results showed that these four types of invariant models had a good fit in three out of four pair of groups analyzed (permanent vs. temporal, full-time vs. part-time and supervisor vs. non-supervisors groups). Multigroup analysis showed no invariance between men vs. women groups (see <bold>Table <xref ref-type="table" rid="T3">3</xref></bold>).</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Fit statistics for different work conditions employees.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Model</th>
<th valign="top" align="left"><italic>N</italic></th>
<th valign="top" align="center">&#x03C7;<sup>2</sup></th>
<th valign="top" align="left"><italic>df</italic></th>
<th valign="top" align="left"><italic>p</italic></th>
<th valign="top" align="left">CFI</th>
<th valign="top" align="left">NFI</th>
<th valign="top" align="left">RMSEA</th>
<th valign="top" align="left">SRMR</th>
<th valign="top" align="left">COMPARISON</th>
<th valign="top" align="left">&#x0394;CFI</th>
<th valign="top" align="left">&#x0394;&#x03C7;<sup>2</sup></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Original model</td>
<td valign="top" align="left">407</td>
<td valign="top" align="left">1.420</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.492</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.980</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.012</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Permanent Contract</td>
<td valign="top" align="left">294</td>
<td valign="top" align="left">2.470</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.291</td>
<td valign="top" align="left">0.990</td>
<td valign="top" align="left">0.953</td>
<td valign="top" align="left">0.028</td>
<td valign="top" align="left">0.022</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td></tr>
<tr>
<td valign="top" align="left">Temporal Contract</td>
<td valign="top" align="left">77</td>
<td valign="top" align="left">1.843</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.398</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.910</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.034</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Full-time</td>
<td valign="top" align="left">286</td>
<td valign="top" align="left">2.210</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.330</td>
<td valign="top" align="left">0.996</td>
<td valign="top" align="left">0.960</td>
<td valign="top" align="left">0.020</td>
<td valign="top" align="left">0.021</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td></tr>
<tr>
<td valign="top" align="left">Part-time</td>
<td valign="top" align="left">121</td>
<td valign="top" align="left">3.730</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.154</td>
<td valign="top" align="left">0.928</td>
<td valign="top" align="left">0.877</td>
<td valign="top" align="left">0.085</td>
<td valign="top" align="left">0.072</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Supervisors</td>
<td valign="top" align="left">171</td>
<td valign="top" align="left">0.775</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.685</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.969</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.017</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Non-supervisors</td>
<td valign="top" align="left">234</td>
<td valign="top" align="left">2.005</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.367</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.962</td>
<td valign="top" align="left">0.020</td>
<td valign="top" align="left">0.003</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Women</td>
<td valign="top" align="left">241</td>
<td valign="top" align="left">7.643</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.220</td>
<td valign="top" align="left">0.876</td>
<td valign="top" align="left">0.851</td>
<td valign="top" align="left">0.108</td>
<td valign="top" align="left">0.033</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td></tr>
<tr>
<td valign="top" align="left">Men</td>
<td valign="top" align="left">166</td>
<td valign="top" align="left">3.294</td>
<td valign="top" align="left">2</td>
<td valign="top" align="left">0.193</td>
<td valign="top" align="left">0.966</td>
<td valign="top" align="left">0.925</td>
<td valign="top" align="left">0.063</td>
<td valign="top" align="left">0.037</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">Invariance model</td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 1a</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">3.829</td>
<td valign="top" align="left">4</td>
<td valign="top" align="left">0.147</td>
<td valign="top" align="left">0.970</td>
<td valign="top" align="left">0.948</td>
<td valign="top" align="left">0.050</td>
<td valign="top" align="left">0.029</td>
<td valign="top" align="left">2 versus 1</td>
<td valign="top" align="left">0.030</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup> (4) = 1.778, <italic>p</italic> > 0.05</td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 2a</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">5.607</td>
<td valign="top" align="left">8</td>
<td valign="top" align="left">0.469</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">924</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.055</td>
<td valign="top" align="left">3 versus 1</td>
<td valign="top" align="left">-0.065</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup> (8) = 13.019, <italic>p</italic> > 0.05</td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 3a</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">16.848</td>
<td valign="top" align="left">12</td>
<td valign="top" align="left">0.112</td>
<td valign="top" align="left">0.905</td>
<td valign="top" align="left">0.770</td>
<td valign="top" align="left">0.038</td>
<td valign="top" align="left">0.077</td>
<td valign="top" align="left">3 versus 2</td>
<td valign="top" align="left">-0.095</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup> (4) = 11.241, <italic>p</italic> > 0.05</td></tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 1b</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">4.06</td>
<td valign="top" align="left">4</td>
<td valign="top" align="left">0.397</td>
<td valign="top" align="left">0.999</td>
<td valign="top" align="left">0.946</td>
<td valign="top" align="left">0.007</td>
<td valign="top" align="left">0.028</td>
<td valign="top" align="left">2 versus 1</td>
<td valign="top" align="left">0.001</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup>(4) = 1.85, <italic>p</italic> > 0.05</td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 2b</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">5.919</td>
<td valign="top" align="left">8</td>
<td valign="top" align="left">0.656</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.921</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.050</td>
<td valign="top" align="left">3 versus 1</td>
<td valign="top" align="left">0.001</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup>(8) = 7.36, <italic>p</italic> > 0.05</td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 3b</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">11.429</td>
<td valign="top" align="left">12</td>
<td valign="top" align="left">0.487</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.847</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.054</td>
<td valign="top" align="left">3 versus 2</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup> (4) = 5.51, <italic>p</italic> > 0.05</td></tr>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
<td valign="top" align="left"></td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 1c</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">2.760</td>
<td valign="top" align="left">4</td>
<td valign="top" align="left">0.599</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.964</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.018</td>
<td valign="top" align="left">2 versus 1</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup>(4) = 4.70, <italic>p</italic> > 0.05</td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 2c</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">7.460</td>
<td valign="top" align="left">8</td>
<td valign="top" align="left">0.488</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.904</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.060</td>
<td valign="top" align="left">3 versus 1</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup>(8) = 6.99, <italic>p</italic> > 0.05</td>
</tr>
<tr>
<td valign="top" align="left">&#x00A0;&#x00A0;&#x00A0;Model 3c</td>
<td valign="top" align="left"></td>
<td valign="top" align="left">9.759</td>
<td valign="top" align="left">12</td>
<td valign="top" align="left">0.637</td>
<td valign="top" align="left">1.000</td>
<td valign="top" align="left">0.874</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">0.065</td>
<td valign="top" align="left">3 versus 2</td>
<td valign="top" align="left">0.000</td>
<td valign="top" align="left">&#x03C7;<sup>2</sup>(4) = 2.29, <italic>p</italic> > 0.05</td></tr>
</tbody></table>
<table-wrap-foot>
<attrib><italic>a = Permanent contract versus temporal contract; b = full-time versus part-time employees; c = supervisors versus non-supervisors. Model 1 = Configural model; Model 2 = Metric model; Model 3 = Scalar model</italic>.</attrib>
</table-wrap-foot>
</table-wrap>
<p>In the original model, CFA for men showed a good fit (see <bold>Table <xref ref-type="table" rid="T3">3</xref></bold> for the fit indices). However, the CFA for the original model did not fit for women (see <bold>Table <xref ref-type="table" rid="T3">3</xref></bold>). Therefore, no invariance models between men and women are analyzed. According with <xref ref-type="bibr" rid="B6">Byrne (2010)</xref>, we can conclude about metric invariance for permanent vs. temporal contract groups. Although the value of the &#x0394;CFI was below the cut-off value (&#x0394;CFI = 0.030), &#x0394;&#x03C7;<sup>2</sup> is not significant (1.77, <italic>p</italic> > 0.005), showing invariance. For full-time vs. part-time and supervisor vs. non-supervisors groups, when configural and metric invariant models were compared, no significant changes occurred in fit indices. Both &#x0394;CFI and &#x0394;&#x03C7;<sup>2</sup> were smaller than the cut-off values (&#x0394;CFI = 0.001 and &#x0394;&#x03C7;<sup>2</sup> = 1.85, <italic>p</italic> > 0.05, for full-time vs. part-time groups; and &#x0394;CFI = 0.000 and &#x0394;&#x03C7;<sup>2</sup> = 4.70, <italic>p</italic> > 0.05, for supervisor vs. non-supervisors groups). These results suggest that factor loadings were invariant across the each pair of groups.</p>
<p>When metric and scalar invariant models were compared, neither significant changes occurred in fit indices (&#x0394;CFI = 0.000 and &#x0394;&#x03C7;<sup>2</sup> = 5.51, <italic>p</italic> > 0.05, for full-time vs. part-time groups; and &#x0394;CFI = 0.000 and &#x0394;&#x03C7;<sup>2</sup> = 2.29, <italic>p</italic> > 0.05, for supervisor vs. non-supervisors groups). These results suggest that factor loadings and intercepts were invariant across the each pair of groups. However, for permanent vs. temporal contract, again, although &#x0394;&#x03C7;<sup>2</sup> = 11.241, <italic>p</italic> > 0.05, &#x0394;CFI = -0.095, so invariance could not be concluded.</p>
</sec>
</sec>
<sec><title>Discussion</title>
<p>The goal of this article was to validate the reduced version of the WIS from English to Spanish. After a rigorous process of translation, the validity of the scale was statistically demonstrated. Similarly to the English version (<xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>), the scale shows a good reliability. The convergent and the concurrent validity of the scale was explored by analyzing its relation with other constructs such as social undermining, the propensity to leave a job, the job satisfaction and the psychological well-being. As expected, the reduced WIS was positively associated with the first variable and negatively associated with the last two ones. Thus, although the participants&#x2019; mean scores on WI are not high (<italic>M</italic> = 1.67), WI produces negative consequences for people and organizations. Low participants&#x2019; mean scores are in line with previous research (<xref ref-type="bibr" rid="B13">Diaz et al., 2011</xref>; <xref ref-type="bibr" rid="B22">Garrosa et al., 2015</xref>; <xref ref-type="bibr" rid="B35">Kabat-Farr et al., 2016</xref>) and might be due to the low intensity and ambiguity that characterize uncivil behaviors and which make incivility less recognizable.</p>
<p>The unidimensional model tested showed a minimum factor loading higher than the one of the original scale (0.61 vs. 0.57). The goodness-of-fit of the factor structure was good.</p>
<p>The contribution of this work goes beyond testing the validity of WIS in Spain. In fact, our results also show the invariance of the Spanish reduced scale throughout workers with different employment status. Specifically, two CFAs were carried out for each work characteristics respectively, demonstrating the invariance of the scale between permanent versus temporal, full-time versus part-time, and supervisor versus non-supervisor workers. Subordinates, people with a part-time or temporal contract might be victims of negative and uncivil acts more frequently; moreover, the types of uncivil behaviors that they can experience might be different than those ones experiences by colleagues in other contract/hierarchical position. This scale overcomes limitations derived by the employment status, offering a valid invariant tool for people at any level of the hierarchical position and with different contract type or working hours per week. The scale was not gender invariant demonstrating that men and women experience WI differently. Future research should increase the sample size in order to test again gender invariance.</p>
<p>Another advantage of this scale is its length. This short version increases the probability to obtain a high response rate when several variables are measured at the same time (<xref ref-type="bibr" rid="B21">Galiana et al., 2015</xref>), or a longitudinal study is carried out. Moreover, the low number of items makes it easy to answer by computer. Furthermore, its psychometric properties have been tested with workers of different sectors, which guarantee its functionality and validity beyond the context where the scale is used.</p>
<p>This research has several theoretical and practical implications. At a theoretical level, it allows advancing in the field of WI, offering a scale for studies carried out with Spanish speaking workers and providing an invariant measure across the employment status.</p>
<p>Although the Spanish reduced version of the WIS is a starting point for researchers who are interested on uncivil acts, we have to acknowledge that this instrument does not allow exploring other aspects of this phenomenon, accordingly with the new nature of the work. In fact, recent research (<xref ref-type="bibr" rid="B47">Park et al., 2015</xref>; <xref ref-type="bibr" rid="B37">Krishnan, 2016</xref>) has underlined modern forms of incivility, connected with new technologies. Cyber incivility (such as sending rude email or using all caps in order to transmit a reproach) is widespread and its consequences are still largely unknown. The next step in this direction should be the study of psychometric properties of cyber incivility instruments that already exist.</p>
<p>At a practical level, this research provides to Human Resources Managers an easy tool for the evaluation of uncivil behaviors at the workplace, in order to take measures when a climate of incivility is perceived. In fact, perceiving uncivil behaviors at work reduces employees&#x2019; well-being and job satisfaction (<xref ref-type="bibr" rid="B42">Miner and Cortina, 2016</xref>) which, in turn, affect employees&#x2019; quality of life. Moreover, the outcomes of negative work dynamics might spill onto the personal domain, deteriorating people quality of life (<xref ref-type="bibr" rid="B11">De Simone et al., 2014</xref>).</p>
<p>A limitation of this study might be the unique recall window that has been analyzed. While previous research (<xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>), tested the factor structure of the reduced scale using three different recall windows (2 weeks, 1 month, and 1 year), in this study participants were asked about their experience of incivility in the &#x2018;last year&#x2019;. However, <xref ref-type="bibr" rid="B41">Matthews and Ritter (2016)</xref> showed that there exist no differences in the factor structure of the reduced scale with those three different recall windows. Notwithstanding, it is necessary to take into account that &#x201C;one month&#x201D; recall window might be the best time frame to provide a realistic experience of uncivil acts (<xref ref-type="bibr" rid="B41">Matthews and Ritter, 2016</xref>).</p>
<p>To sum up, this study validates the reduced version of WIS in a sample of workers from several sectors in Spain. The measure embraces four different behaviors that are considered uncivil invariably by people in different employment status. As expected the reduced Spanish measure correlates negatively with job satisfaction and well-being and positively with propensity to leave.</p>
</sec>
<sec><title>Ethics Statement</title>
<p>The Ethics Committee of the Faculty of Psychology (University of Seville, Spain) approved the study.</p>
</sec>
<sec><title>Author Contributions</title>
<p>All the authors contributed to the conception and design of the work and the acquisition, analysis, and interpretation of data for the work. They drafted the work and revised it critically. The authors gave the final approval of the manuscript before the submission. They participated at any step of the research.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<app-group>
<app id="A1">
<title>Appendix</title>
<p>Spanish and English items of the reduced version of the workplace incivility scale.</p>
<list list-type="simple" prefix-word="simple">
<list-item><label>(1)</label><p> &#x00BF;Ha/n prestado poca atenci&#x00F3;n a sus ideas o ha/n mostrado poco inter&#x00E9;s en sus opiniones?</p></list-item>
<list-item><p> &#x00A0;&#x00A0;&#x00A0;&#x00A0;&#x00A0;<italic>Paid little attention to your statements or showed little interest in your opinions.</italic></p></list-item>
<list-item><label>(2)</label><p> &#x00BF;Le ha/n interrumpido o ha/n comenzado a hablar mientras usted hablaba?</p></list-item>
<list-item><p> &#x00A0;&#x00A0;&#x00A0;&#x00A0;&#x00A0;<italic>Interrupted or &#x201C;spoke over&#x201D; you.</italic></p></list-item>
<list-item><label>(3)</label><p> &#x00BF;Le ha/n ignorado o ha/n dejado de hablarle (por ejemplo: le ha/n hecho el vac&#x00ED;o)?</p></list-item>
<list-item><p> &#x00A0;&#x00A0;&#x00A0;&#x00A0;&#x00A0;<italic>Ignored you or failed to speak to you (e.g., gave you &#x201C;the silent treatment&#x201D;).</italic></p></list-item>
<list-item><label>(4)</label><p> &#x00BF;Han/n hecho bromas a su costa?</p></list-item>
<list-item><p> &#x00A0;&#x00A0;&#x00A0;&#x00A0;&#x00A0;<italic>Make jokes at your expense.</italic></p></list-item></list>
</app>
</app-group>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> This work was funded by the Spanish Ministry of Economy and Competitiveness (MINECO/FEDER), grant reference no. PSI2015-64894-P and by the Foundation for Science and Technology of Portugal, grant reference no. SFRH/BPD/121748/2016.</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andersson</surname> <given-names>L. M.</given-names></name> <name><surname>Pearson</surname> <given-names>C. M.</given-names></name></person-group> (<year>1999</year>). <article-title>Tit for tat? The spiraling effect of incivility in the workplace.</article-title> <source><italic>Acad. Manag. Rev.</italic></source> <volume>24</volume> <fpage>452</fpage>&#x2013;<lpage>471</lpage>. <pub-id pub-id-type="doi">10.5465/amr.1999.2202131</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Balducci</surname> <given-names>C.</given-names></name> <name><surname>Romeo</surname> <given-names>L.</given-names></name> <name><surname>Brondino</surname> <given-names>M.</given-names></name> <name><surname>Lazzarini</surname> <given-names>G.</given-names></name> <name><surname>Benedetti</surname> <given-names>F.</given-names></name> <name><surname>Toderi</surname> <given-names>S.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>The validity of the short UK health and safety executive stress indicator tool for the assessment of the psychosocial work environment in Italy.</article-title> <source><italic>Eur. J. Psychol. Assess.</italic></source> <volume>33</volume> <fpage>149</fpage>&#x2013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1027/1015-5759/a000280</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blau</surname> <given-names>G.</given-names></name> <name><surname>Andersson</surname> <given-names>L.</given-names></name></person-group> (<year>2005</year>). <article-title>Testing a measure of instigated workplace incivility.</article-title> <source><italic>J. Occup. Organ. Psychol.</italic></source> <volume>78</volume> <fpage>595</fpage>&#x2013;<lpage>614</lpage>. <pub-id pub-id-type="doi">10.1348/096317905X26822</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>T. A.</given-names></name></person-group> (<year>2006</year>). <article-title>&#x201C;Confirmatory factor analysis for applied research,&#x201D; in</article-title> <source><italic>Methodology in the Social Science</italic></source>, <role>ed.</role> <person-group person-group-type="editor"><name><surname>Kenny</surname> <given-names>D. A.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>The Guilford Press</publisher-name>).</citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Browne</surname> <given-names>M. W.</given-names></name> <name><surname>Cudeck</surname> <given-names>R.</given-names></name></person-group> (<year>1993</year>). <article-title>&#x201C;Alternative ways of assessing model fit,&#x201D; in</article-title> <source><italic>Structural Equation Models</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Bollen</surname> <given-names>K. A.</given-names></name> <name><surname>Long</surname> <given-names>J. S.</given-names></name></person-group> (<publisher-loc>Beverly Hills, CA</publisher-loc>: <publisher-name>Sage</publisher-name>), <fpage>136</fpage>&#x2013;<lpage>162</lpage>.</citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Byrne</surname> <given-names>B. M.</given-names></name></person-group> (<year>2010</year>). <source><italic>Structural Equation Modeling with AMOS: Basic Concepts, Applications and Programming</italic></source>, 2nd Edn. New York, NY: Taylor and Francis.</citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheung</surname> <given-names>G. W.</given-names></name> <name><surname>Rensvold</surname> <given-names>R. B.</given-names></name></person-group> (<year>2002</year>). <article-title>Evaluating goodness-of-fit indexes for testing measurement invariance.</article-title> <source><italic>Struct. Equ. Modeling</italic></source> <volume>9</volume> <fpage>233</fpage>&#x2013;<lpage>255</lpage>. <pub-id pub-id-type="doi">10.1207/S15328007SEM0902_5</pub-id> <pub-id pub-id-type="pmid">22551991</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>J.</given-names></name></person-group> (<year>1988</year>). <source><italic>Statistical Power Analysis for the Behavioral Sciences</italic></source>, 2nd Edn. Hillsdale, NJ: Lawrence Erlbaum Associates.</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cortina</surname> <given-names>L. M.</given-names></name> <name><surname>Kabat-Farr</surname> <given-names>D.</given-names></name> <name><surname>Leskinen</surname> <given-names>E. A.</given-names></name> <name><surname>Huerta</surname> <given-names>M.</given-names></name> <name><surname>Magley</surname> <given-names>V. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Selective incivility as modern discrimination in organizations: evidence and impact.</article-title> <source><italic>J. Manag.</italic></source> <volume>39</volume> <fpage>1579</fpage>&#x2013;<lpage>1605</lpage>. <pub-id pub-id-type="doi">10.1177/0149206311418835</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cortina</surname> <given-names>L. M.</given-names></name> <name><surname>Magley</surname> <given-names>V. J.</given-names></name> <name><surname>Williams</surname> <given-names>J. H.</given-names></name> <name><surname>Langhout</surname> <given-names>R. D.</given-names></name></person-group> (<year>2001</year>). <article-title>Incivility in the workplace: incidence and impact.</article-title> <source><italic>J. Occup. Organ. Psychol.</italic></source> <volume>6</volume> <fpage>64</fpage>&#x2013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1037/1076-8998.6.1.64</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>De Simone</surname> <given-names>S.</given-names></name> <name><surname>Lampis</surname> <given-names>J.</given-names></name> <name><surname>Lasio</surname> <given-names>D.</given-names></name> <name><surname>Serri</surname> <given-names>F.</given-names></name> <name><surname>Cicotto</surname> <given-names>G.</given-names></name> <name><surname>Putzu</surname> <given-names>D.</given-names></name></person-group> (<year>2014</year>). <article-title>Influences of work-family interface on job and life satisfaction.</article-title> <source><italic>Appl. Res. Qual. Life</italic></source> <volume>9</volume> <fpage>831</fpage>&#x2013;<lpage>861</lpage>. <pub-id pub-id-type="doi">10.1007/s11482-013-9272-4</pub-id> <pub-id pub-id-type="pmid">27423429</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Di Marco</surname> <given-names>D.</given-names></name> <name><surname>Hoel</surname> <given-names>H.</given-names></name> <name><surname>Arenas</surname> <given-names>A.</given-names></name> <name><surname>Munduate</surname> <given-names>L.</given-names></name></person-group> (<year>2015</year>). <article-title>Workplace incivility as modern sexual prejudice.</article-title> <source><italic>J. Interpers. Violence</italic></source> <volume>33</volume> <fpage>1978</fpage>&#x2013;<lpage>2004</lpage>. <pub-id pub-id-type="doi">10.1177/0886260515621083</pub-id> <pub-id pub-id-type="pmid">26704986</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Diaz</surname> <given-names>L.</given-names></name> <name><surname>Moreno</surname> <given-names>B.</given-names></name> <name><surname>Garrosa</surname> <given-names>E.</given-names></name> <name><surname>Sebasti&#x00E1;n</surname> <given-names>J.</given-names></name></person-group> (<year>2011</year>). <article-title>El incivismo y el acoso sexual en el trabajo: impacto en la salud ocupacional.</article-title> <source><italic>Rev. Fac. Nac. Salud P&#x00FA;blica</italic></source> <volume>29</volume> <fpage>474</fpage>&#x2013;<lpage>483</lpage>.</citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dimitrov</surname> <given-names>D.</given-names></name></person-group> (<year>2010</year>). <article-title>Testing for factorial invariance in the context of construct validation.</article-title> <source><italic>Meas. Eval. Couns. Dev.</italic></source> <volume>43</volume> <fpage>121</fpage>&#x2013;<lpage>149</lpage>. <pub-id pub-id-type="doi">10.1177/0748175610373459</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duffy</surname> <given-names>M. K.</given-names></name> <name><surname>Gaster</surname> <given-names>D. C.</given-names></name> <name><surname>Pagon</surname> <given-names>M.</given-names></name></person-group> (<year>2002</year>). <article-title>Social undermining in the workplace.</article-title> <source><italic>Acad. Manage. J.</italic></source> <volume>45</volume> <fpage>331</fpage>&#x2013;<lpage>351</lpage>.</citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Einarsen</surname> <given-names>S.</given-names></name></person-group> (<year>2000</year>). <article-title>Harassment and bullying at work: a review of the Scandinavian approach.</article-title> <source><italic>Aggress. Violent Behav.</italic></source> <volume>5</volume> <fpage>379</fpage>&#x2013;<lpage>401</lpage>. <pub-id pub-id-type="doi">10.1016/S1359-1789(98)00043-3</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><collab>Eurofound</collab> (<year>2017</year>). <source><italic>Sixth European Working Conditions Survey &#x2013; Overview Report (2017 Update).</italic></source> <publisher-loc>Luxembourg City</publisher-loc>: <publisher-name>Publications Office of the European Union</publisher-name>.</citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Field</surname> <given-names>A.</given-names></name></person-group> (<year>2000</year>). <source><italic>Discovering Statistics Using SPSS for Windows.</italic></source> <publisher-loc>London</publisher-loc>: <publisher-name>Sage Publications</publisher-name>.</citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Field</surname> <given-names>A.</given-names></name></person-group> (<year>2009</year>). <source><italic>Discovering Statistics Using SPSS.</italic></source> <publisher-loc>London</publisher-loc>: <publisher-name>SAGE</publisher-name>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fisher</surname> <given-names>G. G.</given-names></name> <name><surname>Matthews</surname> <given-names>R. A.</given-names></name> <name><surname>Gibbons</surname> <given-names>A. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Developing and investigating the use of single-item measures in organizational research.</article-title> <source><italic>J. Occup. Organ. Psychol.</italic></source> <volume>21</volume> <fpage>3</fpage>&#x2013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1037/a0039139</pub-id> <pub-id pub-id-type="pmid">25894198</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Galiana</surname> <given-names>L.</given-names></name> <name><surname>Oliver</surname> <given-names>A.</given-names></name> <name><surname>Sancho</surname> <given-names>P.</given-names></name> <name><surname>Tom&#x00E1;s</surname> <given-names>J. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Dimensionality and validation of the dispositional hope scale in a Spanish sample.</article-title> <source><italic>Soc. Indic. Res.</italic></source> <volume>120</volume> <fpage>297</fpage>&#x2013;<lpage>308</lpage>. <pub-id pub-id-type="doi">10.1007/s11205-014-0582-1</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garrosa</surname> <given-names>E.</given-names></name> <name><surname>Carmona-Cobo</surname> <given-names>I.</given-names></name> <name><surname>Moreno-Jim&#x00E9;nez</surname> <given-names>B.</given-names></name> <name><surname>Sanz-Vergel</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>El impacto emocional del incivismo laboral y el abuso verbal en el trabajo: el papel protector de la recuperaci&#x00F3;n diaria.</article-title> <source><italic>An. Psicol.</italic></source> <volume>31</volume> <fpage>190</fpage>&#x2013;<lpage>198</lpage>. <pub-id pub-id-type="doi">10.6018/analesps.31.1.161491</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garson</surname> <given-names>G. D.</given-names></name></person-group> (<year>2012</year>). <source><italic>Structural Equation Modeling.</italic></source> <publisher-loc>Asheboro, NC</publisher-loc>: <publisher-name>Statistical Publishing Associates</publisher-name>.</citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goldberg</surname> <given-names>P.</given-names></name></person-group> (<year>1972</year>). <source><italic>The Detection of Psychiatric Illness by Questionnaire.</italic></source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gonz&#x00E1;lez-Rom&#x00E1;</surname> <given-names>V.</given-names></name> <name><surname>Mer&#x00ED;</surname> <given-names>R.</given-names></name> <name><surname>Lloret</surname> <given-names>S.</given-names></name></person-group> (<year>1992</year>). <article-title>Propiedades psicom&#x00E9;tricas de un cuestionario para medir la propensi&#x00F3;n al abandono del puesto de trabajo y de la organizaci&#x00F3;n.</article-title> <source><italic>Rev. Psicol. Soc.</italic></source> <volume>2</volume> <fpage>25</fpage>&#x2013;<lpage>42</lpage>.</citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gonz&#x00E1;lez-Rom&#x00E1;</surname> <given-names>V.</given-names></name> <name><surname>Peir&#x00F3;</surname> <given-names>J. M.</given-names></name> <name><surname>Luna</surname> <given-names>R.</given-names></name> <name><surname>Baeza</surname> <given-names>J. A.</given-names></name> <name><surname>Espejo</surname> <given-names>B.</given-names></name> <name><surname>Mu&#x00F1;oz</surname> <given-names>P.</given-names></name></person-group> (<year>1991</year>). <article-title>Un estudio de la estructura factorial del cuestionario de salud general (GHQ-12): comparaci&#x00F3;n de los modelos factoriales.</article-title> <source><italic>Psicol&#x00F3;gica</italic></source> <volume>12</volume> <fpage>119</fpage>&#x2013;<lpage>129</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gravetter</surname> <given-names>F.</given-names></name> <name><surname>Wallnau</surname> <given-names>L.</given-names></name></person-group> (<year>2014</year>). <source><italic>Essentials of Statistics for the Behavioral Sciences</italic></source>, 8th Edn. Belmont, CA: Wadsworth.</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Griffin</surname> <given-names>B.</given-names></name></person-group> (<year>2010</year>). <article-title>Multilevel relationships between organizational-level incivility, justice and intention to stay.</article-title> <source><italic>Work Stress</italic></source> <volume>24</volume> <fpage>309</fpage>&#x2013;<lpage>323</lpage>. <pub-id pub-id-type="doi">10.1080/02678373.2010.531186</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hambleton</surname> <given-names>R. K.</given-names></name> <name><surname>Merenda</surname> <given-names>P.</given-names></name> <name><surname>Spielberger</surname> <given-names>C.</given-names></name></person-group> <role>(eds)</role>. (<year>2005</year>). <source><italic>Adapting Educational and Psychological Tests for Cross-Cultural Assessment.</italic></source> <publisher-loc>Hillsdale, NJ</publisher-loc>: <publisher-name>Lawrence Erlbaum Publishers</publisher-name>.</citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hershcovis</surname> <given-names>M. S.</given-names></name></person-group> (<year>2011</year>). <article-title>&#x201C;Incivility, social undermining, bullying&#x2026;oh my!&#x201D;: a call to reconcile constructs within workplace aggression research.</article-title> <source><italic>J. Organ. Behav.</italic></source> <volume>32</volume> <fpage>499</fpage>&#x2013;<lpage>519</lpage>. <pub-id pub-id-type="doi">10.1002/job.689</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hoel</surname> <given-names>H.</given-names></name> <name><surname>Rayner</surname> <given-names>C.</given-names></name> <name><surname>Cooper</surname> <given-names>C. L.</given-names></name></person-group> (<year>1999</year>). <article-title>&#x201C;Workplace bullying,&#x201D; in</article-title> <source><italic>International Review of Industrial and Organizational Psychology</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Cooper</surname> <given-names>C. L.</given-names></name> <name><surname>Robertson</surname> <given-names>I. T.</given-names></name></person-group> (<publisher-loc>Chichester</publisher-loc>: <publisher-name>Wiley</publisher-name>), <fpage>195</fpage>&#x2013;<lpage>230</lpage>.</citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hu</surname> <given-names>L. T.</given-names></name> <name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>1999</year>). <article-title>Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives.</article-title> <source><italic>Struct. Equ. Modeling</italic></source> <volume>6</volume> <fpage>1</fpage>&#x2013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1080/10705519909540118</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><collab>International Test Commission [ITC]</collab> (<year>2005</year>). <source><italic>International Guidelines on Test Adaptation.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.intestcom.org">www.intestcom.org</ext-link></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>J. A.</given-names></name> <name><surname>Waller</surname> <given-names>N. G.</given-names></name></person-group> (<year>2015</year>). <article-title>The normal-theory and asymptotic distribution-free (ADF) covariance matrix of standardized regression coefficients: theoretical extensions and finite sample behavior.</article-title> <source><italic>Psychometrika</italic></source> <volume>80</volume> <fpage>365</fpage>&#x2013;<lpage>378</lpage>. <pub-id pub-id-type="doi">10.1007/s11336-013-9380-y</pub-id> <pub-id pub-id-type="pmid">28290108</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kabat-Farr</surname> <given-names>D.</given-names></name> <name><surname>Cortina</surname> <given-names>L. M.</given-names></name> <name><surname>Marchiondo</surname> <given-names>L. A.</given-names></name></person-group> (<year>2016</year>). <article-title>The emotional aftermath of incivility: anger, guilt, and the role of organizational commitment.</article-title> <source><italic>Int. J. Stress Manag.</italic></source> <volume>25</volume> <fpage>109</fpage>&#x2013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1037/str0000045</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kabat-Farr</surname> <given-names>D.</given-names></name> <name><surname>Walsh</surname> <given-names>B. M.</given-names></name> <name><surname>McGonagle</surname> <given-names>A. K.</given-names></name></person-group> (<year>2017</year>). <article-title>Uncivil supervisors and perceived work ability: the joint moderating roles of job involvement and grit.</article-title> <source><italic>J. Bus. Ethics</italic></source> <pub-id pub-id-type="doi">10.1007/s10551-017-3604-5</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krishnan</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Electronic warfare: a personality model of cyber incivility.</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>64</volume> <fpage>537</fpage>&#x2013;<lpage>546</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2016.07.031</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leiter</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <source><italic>Analyzing and Theorizing the Dynamics of the Workplace Incivility Crisis.</italic></source> <publisher-loc>Dordrecht</publisher-loc>: <publisher-name>Springer</publisher-name>. <pub-id pub-id-type="doi">10.1007/978-94-007-5571-0</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mao</surname> <given-names>C.</given-names></name> <name><surname>Chang</surname> <given-names>C.-H.</given-names></name> <name><surname>Johnson</surname> <given-names>R. E.</given-names></name> <name><surname>Sun</surname> <given-names>J.</given-names></name></person-group> (<year>2017</year>). <article-title>Incivility and employee performance, citizenship, and counterproductive behaviors: implications of the social context.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <pub-id pub-id-type="doi">10.1037/ocp0000108</pub-id> <comment>[Epub ahead of print]</comment>. <pub-id pub-id-type="pmid">29283603</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Martin</surname> <given-names>R.</given-names></name> <name><surname>Hine</surname> <given-names>D.</given-names></name></person-group> (<year>2005</year>). <article-title>Development and validation of the uncivil workplace behavior questionnaire.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <volume>10</volume> <fpage>477</fpage>&#x2013;<lpage>490</lpage>. <pub-id pub-id-type="doi">10.1037/1076-8998.10.4.477</pub-id> <pub-id pub-id-type="pmid">16248694</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Matthews</surname> <given-names>R. A.</given-names></name> <name><surname>Ritter</surname> <given-names>K. J.</given-names></name></person-group> (<year>2016</year>). <article-title>A concise, content valid, gender invariant measure of workplace incivility.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <volume>21</volume> <fpage>352</fpage>&#x2013;<lpage>365</lpage>. <pub-id pub-id-type="doi">10.1037/ocp0000017</pub-id> <pub-id pub-id-type="pmid">26569134</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miner</surname> <given-names>K. N.</given-names></name> <name><surname>Cortina</surname> <given-names>L. M.</given-names></name></person-group> (<year>2016</year>). <article-title>Observed workplace incivility toward women, perceptions of interpersonal injustice, and observer occupational well-being: differential effects for gender of the observer.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>7</volume>:<issue>482</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.00482</pub-id> <pub-id pub-id-type="pmid">27242558</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Montgomery</surname> <given-names>K.</given-names></name> <name><surname>Kane</surname> <given-names>K.</given-names></name> <name><surname>Vance</surname> <given-names>C.</given-names></name></person-group> (<year>2004</year>). <article-title>Accounting for differences in norms of respect: a study of assessments of incivility through the lenses of race and gender.</article-title> <source><italic>Group Organ. Manage.</italic></source> <volume>29</volume> <fpage>248</fpage>&#x2013;<lpage>268</lpage>. <pub-id pub-id-type="doi">10.1177/1059601103252105</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno-Jim&#x00E9;nez</surname> <given-names>B.</given-names></name> <name><surname>D&#x00ED;az-Gracia</surname> <given-names>L.</given-names></name> <name><surname>Garrosa</surname> <given-names>E.</given-names></name></person-group> (<year>2012</year>). <article-title>La agresi&#x00F3;n laboral y la intenci&#x00F3;n de abandono: evaluaci&#x00F3;n del papel mediador de la satisfacci&#x00F3;n laboral.</article-title> <source><italic>Rev. Mex. Psicol.</italic></source> <volume>29</volume> <fpage>125</fpage>&#x2013;<lpage>135</lpage>.</citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mueller</surname> <given-names>R. O.</given-names></name> <name><surname>Hancock</surname> <given-names>G. R.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x201C;Structural equation modeling,&#x201D; in</article-title> <source><italic>The Reviewer&#x2019;s Guide to Quantitative Methods</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Hancock</surname> <given-names>G. R.</given-names></name> <name><surname>Mueller</surname> <given-names>R. O.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Taylor and Francis</publisher-name>), <fpage>371</fpage>&#x2013;<lpage>383</lpage>.</citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nunnally</surname> <given-names>J.</given-names></name></person-group> (<year>1978</year>). <source><italic>Psychometric Theory</italic></source>, 2nd Edn. New York, NY: McGraw-Hill.</citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Park</surname> <given-names>J. A.</given-names></name> <name><surname>Fritz</surname> <given-names>C.</given-names></name> <name><surname>Jex</surname> <given-names>S. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Daily cyber incivility and distress: the moderating roles of resources at work and home.</article-title> <source><italic>J. Manag.</italic></source> <pub-id pub-id-type="doi">10.1177/0149206315576796</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pawar</surname> <given-names>B. S.</given-names></name></person-group> (<year>2013</year>). <article-title>A proposed model of organizational behavior aspects for employee performance and well-being.</article-title> <source><italic>Appl. Res. Qual. Life</italic></source> <volume>8</volume> <fpage>339</fpage>&#x2013;<lpage>359</lpage>. <pub-id pub-id-type="doi">10.1007/s11482-012-9193-7</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pearson</surname> <given-names>C. L.</given-names></name> <name><surname>Andersson</surname> <given-names>L. M.</given-names></name> <name><surname>Porath</surname> <given-names>C. L.</given-names></name></person-group> (<year>2000</year>). <article-title>Assessing and attacking workplace incivility.</article-title> <source><italic>Organ. Dyn.</italic></source> <volume>29</volume> <fpage>123</fpage>&#x2013;<lpage>137</lpage>. <pub-id pub-id-type="doi">10.1016/S0090-2616(00)00019-X</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pearson</surname> <given-names>C. L.</given-names></name> <name><surname>Andersson</surname> <given-names>L. M.</given-names></name> <name><surname>Wegner</surname> <given-names>J. W.</given-names></name></person-group> (<year>2001</year>). <article-title>When workers flout convention: a study of workplace incivility.</article-title> <source><italic>Hum. Relat.</italic></source> <volume>54</volume> <fpage>1387</fpage>&#x2013;<lpage>1419</lpage>. <pub-id pub-id-type="doi">10.1177/00187267015411001</pub-id></citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pearson</surname> <given-names>C. L.</given-names></name> <name><surname>Porath</surname> <given-names>C. L.</given-names></name></person-group> (<year>2013</year>). <article-title>The price of incivility.</article-title> <source><italic>Harv. Bus. Rev.</italic></source> <volume>91</volume> <fpage>114</fpage>&#x2013;<lpage>121</lpage>.</citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Porath</surname> <given-names>C. L.</given-names></name> <name><surname>Erez</surname> <given-names>A.</given-names></name></person-group> (<year>2009</year>). <article-title>Overlooked but not untouched: how incivility reduces onlookers&#x2019; performance on routine and creative tasks.</article-title> <source><italic>Organ. Behav. Hum. Decis. Process.</italic></source> <volume>109</volume> <fpage>29</fpage>&#x2013;<lpage>44</lpage>. <pub-id pub-id-type="doi">10.1016/j.obhdp.2009.01.003</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Porath</surname> <given-names>C. L.</given-names></name> <name><surname>Pearson</surname> <given-names>C. M.</given-names></name></person-group> (<year>2010</year>). <article-title>The cost of bad behavior.</article-title> <source><italic>Organ. Dyn.</italic></source> <volume>39</volume> <fpage>64</fpage>&#x2013;<lpage>71</lpage>. <pub-id pub-id-type="doi">10.1016/j.orgdyn.2009.10.006</pub-id></citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sakurai</surname> <given-names>K.</given-names></name> <name><surname>Jex</surname> <given-names>S. M.</given-names></name></person-group> (<year>2012</year>). <article-title>Coworker incivility and incivility targets&#x2019; work effort and counterproductive work behaviors: the moderating role of supervisor social support.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <volume>17</volume> <fpage>150</fpage>&#x2013;<lpage>161</lpage>. <pub-id pub-id-type="doi">10.1037/a0027350</pub-id> <pub-id pub-id-type="pmid">22352293</pub-id></citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salminen</surname> <given-names>S.</given-names></name> <name><surname>Saloniemi</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>Fixed-term work and violence at work.</article-title> <source><italic>Int. J. Occup. Saf. Ergon.</italic></source> <volume>16</volume> <fpage>323</fpage>&#x2013;<lpage>328</lpage>. <pub-id pub-id-type="doi">10.1080/10803548.2010.11076846</pub-id> <pub-id pub-id-type="pmid">20831854</pub-id></citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schilpzand</surname> <given-names>P.</given-names></name> <name><surname>De Pater</surname> <given-names>I. E.</given-names></name> <name><surname>Erez</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). <article-title>Workplace incivility: a review of the literature and agenda for future research.</article-title> <source><italic>J. Organ. Behav.</italic></source> <volume>37</volume> <fpage>57</fpage>&#x2013;<lpage>88</lpage>. <pub-id pub-id-type="doi">10.1002/job.1976</pub-id></citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taylor</surname> <given-names>S. G.</given-names></name> <name><surname>Bedeian</surname> <given-names>A. G.</given-names></name> <name><surname>Kluemper</surname> <given-names>D. H.</given-names></name></person-group> (<year>2012</year>). <article-title>Linking workplace incivility to citizenship performance: the combined effects of affective commitment and conscientiousness.</article-title> <source><italic>J. Organ. Behav.</italic></source> <volume>33</volume> <fpage>878</fpage>&#x2013;<lpage>893</lpage>. <pub-id pub-id-type="doi">10.1002/job.773</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tepper</surname> <given-names>B. J.</given-names></name></person-group> (<year>2000</year>). <article-title>Consequences of abusive supervision.</article-title> <source><italic>Acad. Manag. J.</italic></source> <volume>43</volume> <fpage>178</fpage>&#x2013;<lpage>190</lpage>.</citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Trochim</surname> <given-names>W. M.</given-names></name> <name><surname>Donnelly</surname> <given-names>J. P.</given-names></name></person-group> (<year>2006</year>). <source><italic>The Research Methods Knowledge Base</italic></source>, 3rd Edn. Cincinnati, OH: Atomic Dog.</citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weiss</surname> <given-names>D. J.</given-names></name> <name><surname>Dawis</surname> <given-names>R. V.</given-names></name> <name><surname>England</surname> <given-names>G. W.</given-names></name> <name><surname>Lofquist</surname> <given-names>L. H.</given-names></name></person-group> (<year>1967</year>). <source><italic>Manual for the Minnesota Satisfaction Questionnaire.</italic></source> <publisher-loc>Minneapolis, MN</publisher-loc>: <publisher-name>University of Minnesota</publisher-name>.</citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Welbourne</surname> <given-names>J. L.</given-names></name> <name><surname>Gangadharan</surname> <given-names>A.</given-names></name> <name><surname>Sariol</surname> <given-names>A. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Ethnicity and cultural values as predictors of the occurrence and impact of experienced workplace incivility.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <volume>20</volume> <fpage>205</fpage>&#x2013;<lpage>217</lpage>. <pub-id pub-id-type="doi">10.1037/a0038277</pub-id> <pub-id pub-id-type="pmid">25365631</pub-id></citation></ref>
<ref id="B62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Welbourne</surname> <given-names>J. L.</given-names></name> <name><surname>Sariol</surname> <given-names>A. M.</given-names></name></person-group> (<year>2017</year>). <article-title>When does incivility lead to counterproductive work behavior? Roles of job involvement, task interdependence, and gender.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <volume>22</volume> <fpage>194</fpage>&#x2013;<lpage>206</lpage>. <pub-id pub-id-type="doi">10.1037/ocp0000029</pub-id> <pub-id pub-id-type="pmid">27101343</pub-id></citation></ref>
<ref id="B63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>West</surname> <given-names>S. G.</given-names></name> <name><surname>Taylor</surname> <given-names>A. B.</given-names></name> <name><surname>Wu</surname> <given-names>W.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x201C;Model fit and model selection in structural equation modeling,&#x201D; in</article-title> <source><italic>Handbook of Structural Equation Modeling</italic></source>, <role>ed.</role> <person-group person-group-type="editor"><name><surname>Hoyle</surname> <given-names>R. H.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name>), <fpage>209</fpage>&#x2013;<lpage>231</lpage>.</citation></ref>
<ref id="B64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname> <given-names>K. D.</given-names></name></person-group> (<year>2007</year>). <article-title>Ostracism.</article-title> <source><italic>Annu. Rev. Psychol.</italic></source> <volume>58</volume> <fpage>425</fpage>&#x2013;<lpage>452</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.psych.58.110405.085641</pub-id></citation></ref>
<ref id="B65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wilson</surname> <given-names>N. L.</given-names></name> <name><surname>Holmvall</surname> <given-names>C. M.</given-names></name></person-group> (<year>2013</year>). <article-title>The development and validation of the incivility from customers scale.</article-title> <source><italic>J. Occup. Health Psychol.</italic></source> <volume>18</volume> <fpage>310</fpage>&#x2013;<lpage>326</lpage>. <pub-id pub-id-type="doi">10.1037/a0032753</pub-id> <pub-id pub-id-type="pmid">23834446</pub-id></citation></ref>
</ref-list>
</back>
</article>