<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2023.1061482</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Measuring empathy online and moral disengagement in cyberbullying</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Francisco</surname>
<given-names>Sofia Mateus</given-names>
</name>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/1950219/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>da Costa Ferreira</surname>
<given-names>Paula</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1017465/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Veiga Sim&#x00E3;o</surname>
<given-names>Ana Margarida</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1375430/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Pereira</surname>
<given-names>N&#x00E1;dia Salgado</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1374786/overview"/>
</contrib>
</contrib-group>
<aff><institution>CICPSI, Faculdade de Psicologia, Universidade de Lisboa, Alameda da Universidade</institution>, <addr-line>Lisbon</addr-line>, <country>Portugal</country></aff>
<author-notes>
<fn id="fn0001" fn-type="edited-by"><p>Edited by: Carla Canestrari, University of Macerata, Italy</p></fn>
<fn id="fn0002" fn-type="edited-by"><p>Reviewed by: Christine Linda Cook, National Chengchi University, Taiwan; Maria Grazia Lo Cricchio, University of Basilicata, Italy; Lijun Zhao, Liaocheng University, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Sofia Mateus Francisco, <email>sofifrancisco@gmail.com</email></corresp>
<fn id="fn0003" fn-type="other"><p>This article was submitted to Personality and Social Psychology, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>04</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>14</volume>
<elocation-id>1061482</elocation-id>
<history>
<date date-type="received">
<day>04</day>
<month>10</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>29</day>
<month>03</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Francisco, da Costa Ferreira, Veiga Sim&#x00E3;o and Pereira.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Francisco, da Costa Ferreira, Veiga Sim&#x00E3;o and Pereira</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>This investigation intends to explore how adolescents report empathy in online contexts and moral disengagement in cyberbullying incidents, and how these two constructs are related. To accomplish this goal, three studies were conducted considering the need to develop new instruments to uncover this new approach of measuring empathy and moral disengagement. In the first study, we adapted the Portuguese version of the Empathy Quotient-short form to online contexts, which resulted in the Empathy Quotient in Virtual Contexts (EQVC). We also developed the Process Moral Disengagement in Cyberbullying Inventory (PMDCI), in order to assess moral disengagement in these specific situations. In the second study we conducted exploratory factor analyses (<italic>N</italic> =&#x2009;234) of these instruments. Finally, in the third study, we conducted confirmatory factor analyses (<italic>N</italic> =&#x2009;345) of both instruments. These results showed how adolescents reported empathy in online contexts and moral disengagement in cyberbullying incidents. Specifically, empathy revealed a bi-dimensional structure including difficulty and self-efficacy in empathizing (Cronbach&#x2019;s <italic>&#x03B1;</italic> =&#x2009;0.44, 0.83, respectively), whereas process moral disengagement revealed four unidimensional questionnaires including locus of behavior, agency, outcome, and recipient (Cronbach&#x2019;s <italic>&#x03B1;</italic> =&#x2009;0.76, 0.65, 0.77, 0.69, respectively). Furthermore, a correlational analysis was also performed of both constructs, and we also considered the variable sex. Results showed that difficulty in empathizing was negatively associated with sex (with girls revealing more difficulty than boys) and all moral disengagement mechanisms except for behavior. Moral disengagement was positively correlated with sex, suggesting boys morally disengaged more from cyberbullying. The instruments provided new insights on how empathy and moral disengagement can be specific to online contexts and cyberbullying situations, and how they can be used in educational programs to promote empathy and gain insight on moral disengagement within this phenomenon.</p>
</abstract>
<kwd-group>
<kwd>assessing empathy online</kwd>
<kwd>measuring moral disengagement in cyberbullying</kwd>
<kwd>instruments</kwd>
<kwd>cyberbullying</kwd>
<kwd>adolescents</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="118"/>
<page-count count="15"/>
<word-count count="13305"/>
</counts>
</article-meta>
</front>
<body>
<sec id="sec1" sec-type="intro">
<label>1.</label>
<title>Introduction</title>
<p>People are not only autonomous agents, but also function as the product of a reciprocal interplay of intrapersonal, behavioral, and environmental events (<xref ref-type="bibr" rid="ref7">Bandura, 1986</xref>). Therefore, this investigation is based on the Social Cognitive Theory, which adopts an agentic perspective. Specifically, in this investigation we explore the relation between two intrapersonal factors that are proven to play an important role in cyberbullying involvement, which are empathy and moral disengagement.</p>
<p>Cyberbullying is a pervasive problem in our society, as it increases and causes harmful consequences in the lives of children and adolescents (<xref ref-type="bibr" rid="ref64">Kowalski et al., 2014</xref>). Considering this, it is of utmost importance to be familiar with factors that play a role in preventing or reinforcing this type of behavior (<xref ref-type="bibr" rid="ref65">Lo Cricchio et al., 2020</xref>). Many factors have been studied in relation to cyberbullying, such as empathy and Moral Disengagement (MD) (<xref ref-type="bibr" rid="ref71">Mar&#x00ED;n-L&#x00F3;pez et al., 2020</xref>; <xref ref-type="bibr" rid="ref1100">Ferreira et al., 2021</xref>).</p>
<p>When someone is involved in conflicts, empathy allows us to empathize with and understand others, but also helps us to predict the type of response of others (i.e., aggressive). Thus, it is assumed that empathy can serve as a control mechanism in conflict dynamics (<xref ref-type="bibr" rid="ref63">Klimecki, 2019</xref>), which may include aggressive behavior (<xref ref-type="bibr" rid="ref91">Tampke et al., 2020</xref>), such as in bullying and cyberbullying.</p>
<p>Therefore, empathy plays an important role in cyberbullying, however, it does not explain or predict it (<xref ref-type="bibr" rid="ref81">Pfetsch, 2017</xref>). In fact, empathy has been found to be negatively related to cyberbullying perpetration (<xref ref-type="bibr" rid="ref43">Garaigordobil, 2015</xref>). With respect to bystander behavior, empathy has been found to be an important factor for increasing prosocial behavior (<xref ref-type="bibr" rid="ref800">Barli&#x0144;ska et al., 2018</xref>), therefore it can be considered a protective factor (<xref ref-type="bibr" rid="ref1800">Zhu et al., 2021</xref>).</p>
<p>Considering that cyberbullying may be seen as intentional and repeated acts of aggression toward peers (<xref ref-type="bibr" rid="ref55">Hinduja and Patchin, 2009</xref>), involving moral aspects (<xref ref-type="bibr" rid="ref86">Romera et al., 2021</xref>), it is also crucial to understand moral (dis) engagement within this phenomenon, which is an important risk factor in the cyberbullying cycle (<xref ref-type="bibr" rid="ref700">Gao et al., 2020</xref>; <xref ref-type="bibr" rid="ref86">Romera et al., 2021</xref>). With respect to bullying, <xref ref-type="bibr" rid="ref1600">Wang and Goldberg (2017)</xref> suggested that MD predicted and increased bullying perpetration in adolescence, and <xref ref-type="bibr" rid="ref1400">Thornberg et al. (2019)</xref> also found that bullying perpetration could also lead to MD. That is, MD impacted aggressive conduct, and aggressive conduct also impacted MD progressively over time (<xref ref-type="bibr" rid="ref400">Bandura, 1999</xref>). For example, <xref ref-type="bibr" rid="ref1000">Falla et al. (2020)</xref> found that moral disengagement also had an impact on bullying victims, since cognitive restructuring (i.e., moral justification, euphemistic language and advantageous comparison) influenced the association between victimization and later, bullying behavior. Moreover, that same set of MD mechanisms were the single strongest predictor of both offline and online bullying (<xref ref-type="bibr" rid="ref86">Romera et al., 2021</xref>). Thus, mechanisms of MD prevent individuals from feeling unpleasant emotions when perpetrating transgressions (<xref ref-type="bibr" rid="ref74">Mazzone et al., 2019</xref>). <xref ref-type="bibr" rid="ref35">Falla et al. (2021)</xref> argued that MD mechanisms may lead to a decrease in empathy, considering that the first seem to promote aggressive behavior, and the latter is related to prosocial behavior. Thus, considering that empathy seems to play an important role in moral development (<xref ref-type="bibr" rid="ref28">Cameron et al., 2019</xref>), assessing both constructs with regards to online contexts and understanding the possible relation between them, may provide an important contribution to the field. For example, <xref ref-type="bibr" rid="ref500">Francisco (2022)</xref> discussed that empathy can be viewed as a shield for the impulsive use of MD mechanisms, since they found that when adolescents did not spontaneously use MD mechanisms to justify aggressors&#x2019; and/or bystanders&#x2019; cyberbullying behavior, they tended to show empathic responses instead. Moreover, <xref ref-type="bibr" rid="ref48">Haddock and Jimerson (2017)</xref> studied the correlation between MD and empathy and found that this correlation was statistically significant and negative. Specifically, these authors found that affective empathy and cognitive empathy both significantly predicted MD. Accordingly, as MD increased, affective and cognitive empathy decreased. In general, students who had higher scores in MD, tended to have lower scores in empathy. Despite the differences that can occur in feeling empathy online and the activation of MD mechanisms with respect to cyberbullying incidents, we believe that a similar relationship might occur between these constructs, since it occurs within bullying (<xref ref-type="bibr" rid="ref48">Haddock and Jimerson, 2017</xref>). Therefore, this study aims to assess adolescents&#x2019; perceived empathy with regards to online contexts and their MD in cyberbullying situations with two new instruments. We also proposed to understand the relationship between the two constructs, considering adolescents&#x2019; perspectives, because the MD instrument was developed according to adolescents&#x2019; point of view regarding cyberbullying scenarios.</p>
<sec id="sec2">
<label>1.1.</label>
<title>Measuring adolescents&#x2019; perceived empathy regarding online contexts</title>
<sec id="sec3">
<label>1.1.1.</label>
<title>The importance of the online context</title>
<p>This study is positioned within the perspective of empathy online, namely that it is possible to express &#x201C;traditional empathic characteristics such as concern and caring for others &#x2026; through computer-mediated communications&#x201D; (<xref ref-type="bibr" rid="ref92">Terry and Cain, 2016</xref>, p. 1). In fact, this study focuses specifically on empathy in virtual contexts, because empathy itself is not online, but rather, occurs within individuals as they establish interpersonal relations in virtual contexts. To date, few studies have considered this specificity and have assessed empathy with adapted instruments. That is, few studies have considered the online characteristics of empathy, when studying cyberbullying. Nonetheless, some studies have already taken empathy in virtual contexts into account. For example, <xref ref-type="bibr" rid="ref29">Carrier et al. (2015)</xref> and <xref ref-type="bibr" rid="ref69">Manasia and Chicioreanu (2017)</xref> found that virtual empathy was positively related with empathy in face-to-face interactions, however, virtual empathy was lower for both sexes. Complementarily, <xref ref-type="bibr" rid="ref71">Mar&#x00ED;n-L&#x00F3;pez et al. (2020)</xref> found no differences between the different cyberbullying roles with respect to online empathy. Considering the scarce literature with respect to empathy in virtual contexts and cyberbullying (<xref ref-type="bibr" rid="ref70">Mar&#x00ED;n-L&#x00F3;pez et al., 2019</xref>, <xref ref-type="bibr" rid="ref71">2020</xref>), it is crucial to develop further research in this area of knowledge.</p>
<p>Assessing empathy is important to explain bystanders&#x2019; role in cyberbullying situations. For instance, <xref ref-type="bibr" rid="ref68">Macaula and Boulton (2017)</xref> found that when comparing positive bystanders&#x2019; responses in bullying and cyberbullying, the rate of responses tended to be higher in cyberbullying. Moreover, this type of responses in both bullying and cyberbullying was positively and moderately correlated with empathy. Also, positive bystander responses tended to increase, as a result of cyberbullying severity. Another study (<xref ref-type="bibr" rid="ref89">Schultze-Krumbholz et al., 2018</xref>) found that higher levels of both cognitive and affective empathy were associated with prosocial defending, when compared to passive bystander behavior. Notwithstanding, the research presented above considered measures of empathy without accounting for the online context.</p>
<p>From a phenomenological perspective, <xref ref-type="bibr" rid="ref41">Fuchs (2014)</xref> proposed that it is not possible for empathy to occur in online contexts, since we lose our perceptual access to other individuals&#x2019; physical presence, and thus, we lose our direct empathic access to others. Accordingly, for empathy to occur, we need to perceive other individuals&#x2019; &#x201C;lived body&#x201D; (see <xref ref-type="bibr" rid="ref79">Osler, 2021</xref>), and this is not possible in online &#x201C;disembodied communication&#x201D; (<xref ref-type="bibr" rid="ref41">Fuchs, 2014</xref>, p. 167). Moreover, the temporal delay and the loss of perceptual queues (i.e., the perception we have is not apprehended by all our sensory capabilities) that occurs in technological mediated communication prevents us from perceiving someone&#x2019;s physical and emotional experience. This was not a concern in face-to-face interactions, but do come into play in online interactions (<xref ref-type="bibr" rid="ref79">Osler, 2021</xref>). Despite these perspectives, we believe it is possible to feel empathy in online contexts, even if individuals do not see others in person. We consider this to be true because empathic skills can be developed through the use of virtual reality (e.g., <xref ref-type="bibr" rid="ref19">Bertrand et al., 2018</xref>), which is also different from face-to-face interactions. Moreover, although there are differences between online and offline communication, individuals tend to use other cue systems at their disposal, with the objective of promoting and detecting these cues, as well as developing relationships (<xref ref-type="bibr" rid="ref98">Walther, 1995</xref>). Therefore, if relationships can be developed, empathy can also be possible in online interactions. In fact, through interpersonal communication online, individuals are able to infer what others might be thinking/feeling in a certain situation (<xref ref-type="bibr" rid="ref29">Carrier et al., 2015</xref>). Nonetheless, the specificities of online contexts, may make it difficult for empathic reactions (<xref ref-type="bibr" rid="ref92">Terry and Cain, 2016</xref>). Despite the fact that few studies have investigated empathy in virtual contexts and its specificities, it has been already proven that empathy can be experienced online. For example, <xref ref-type="bibr" rid="ref1700">Preece (1999)</xref> found that empathy online was quite common in support groups, which corroborates our position. This author discussed that the difference between synchronous and asynchronous systems impacts communication. Firstly, the pace of interaction is very different between these systems, that is, in one it is almost immediate, whereas in the other, it can take much more time (i.e., hours, days, or weeks differing from the platform). Moreover, another important difference is regarding the mode of expression, and other features that allowed nonverbal expression, whereas in the asynchronous system the primary mode is written text. It is important to highlight that this investigation is from the 1990&#x2019;s, and several features of online communication have changed. However, more recent studies have found that text-type emoticons and graphic emojis are processed in a similar way to in-person facial expressions (<xref ref-type="bibr" rid="ref42">Gantiva et al., 2019</xref>), and participants who viewed text-type emoticons exhibited face imitation mirroring (<xref ref-type="bibr" rid="ref78">O&#x2019;Neil, 2013</xref>). Therefore, we can argue that it is possible to feel empathy when interacting in virtual contexts.</p>
</sec>
<sec id="sec4">
<label>1.1.2.</label>
<title>Gaps in existing scale development</title>
<p>Considering the importance of accounting for online features in measuring empathy, we sought new instruments on empathy that were developed according to the online context. To date, we found three instruments directly adapted from the Basic Empathy Scale (<xref ref-type="bibr" rid="ref59">Jolliffe and Farrington, 2006</xref>), that is, the Virtual Empathy Scale (<xref ref-type="bibr" rid="ref29">Carrier et al., 2015</xref>), the Online Empathy Questionnaire (<xref ref-type="bibr" rid="ref70">Mar&#x00ED;n-L&#x00F3;pez et al., 2019</xref>) and the Virtual Basic Empathy Scale (<xref ref-type="bibr" rid="ref69">Manasia and Chicioreanu, 2017</xref>). Also, another instrument was adapted by <xref ref-type="bibr" rid="ref44">Garc&#x00ED;a-P&#x00E9;rez et al. (2016)</xref> based on the Basque version (<xref ref-type="bibr" rid="ref47">Gorostiaga et al., 2014</xref>) of the <italic>Test de Empat&#x00ED;a Cognitiva y Afectiva</italic> (TECA) from <xref ref-type="bibr" rid="ref66">L&#x00F3;pez-P&#x00E9;rez et al. (2008)</xref>. Additionally, <xref ref-type="bibr" rid="ref51">Happ and Pfetsch (2015)</xref> developed the Media-Based Empathy (MBE) Scale (original name <italic>Skalazumedienbasierter Empathie</italic>) based on a pool of items according to the Interpersonal Reactivity Index (<xref ref-type="bibr" rid="ref32">Davis, 1980</xref>) and an instrument to assess media empathy by <xref ref-type="bibr" rid="ref40">Fr&#x00FC;h and W&#x00FC;nsch (2009)</xref>, which included media concern, affective media empathy, cognitive media empathy, and immersion in video games, with items related to different types of media, as well as fictional and real people. Of all these instruments, only the Online Empathy Questionnaire (<xref ref-type="bibr" rid="ref70">Mar&#x00ED;n-L&#x00F3;pez et al., 2019</xref>) was used in relation to cyberbullying behavior.</p>
<p>Despite the valuable contributions in terms of the aforementioned instrument development and validity studies, and after a detailed analysis of the respective items, we found that the Empathy Quotient (EQ) by <xref ref-type="bibr" rid="ref16">Baron-Cohen and Wheelwright (2004)</xref> would be appropriate to reach our objectives. Specifically, these authors defined empathy as &#x201C;The drive or ability to attribute mental states to another person/animal and entails an appropriate affective response in the observer to the other person&#x2019;s mental state&#x201D; (<xref ref-type="bibr" rid="ref16">Baron-Cohen and Wheelwright, 2004</xref>, p. 168). The term &#x201C;quocient&#x201D; derives from the Latin word &#x201C;quotiens&#x201D; which means &#x201C;how much&#x201D; or &#x201C;how many&#x201D; (<xref ref-type="bibr" rid="ref16">Baron-Cohen and Wheelwright, 2004</xref>, p. 166). According to this perspective (<xref ref-type="bibr" rid="ref15">Baron-Cohen, 2011</xref>), that if individuals only focus on their own problems or interests, they are likely to feel less empathy. In fact, when individuals feel empathy, they are able to identify what others are thinking or feeling and are able to provide an adaptive emotional response. Thus, this view of empathy entails two fundamental stages: recognition and response. Accordingly, empathy occurs when there is recognition and an adaptive response, which helps avoid hurting others and fosters prosociality.</p>
<p>Some studies have provided evidence that the Empathy Quotient was the third most used instrument (e.g., <xref ref-type="bibr" rid="ref58">Ilgunaite et al., 2017</xref>) and a recent a meta-analysis by <xref ref-type="bibr" rid="ref50">Hall and Schwartz (2019)</xref> determined that it was the second most used instrument in research. For this investigation the aim was to choose an instrument that had been widely used and already validated for several countries (e.g., <xref ref-type="bibr" rid="ref84">Redondo and Herrero-Fern&#x00E1;ndez, 2018</xref>), but that also included items assessing accurate interpersonal perception (<xref ref-type="bibr" rid="ref50">Hall and Schwartz, 2019</xref>), since it is an important feature when assessing empathy, specifically in the virtual contexts, as is the case with this study. Moreover, we preferred to adapt the short form of this questionnaire, which had already been developed by <xref ref-type="bibr" rid="ref96">Wakabayashi et al. (2006)</xref>, and adapted for the Portuguese population (<xref ref-type="bibr" rid="ref85">Rodrigues et al., 2011</xref>). Our study provides an important contribution, since it proposes to adapt this last version of the instrument to a younger population and for online contexts.</p>
</sec>
<sec id="sec5">
<label>1.1.3.</label>
<title>Goals of the present work</title>
<p>Considering the literature reviewed, one of the main purposes of this study is to present and evaluate a new version of the Portuguese short form of the EQ for adolescents communicating online, entitled Empathy Quotient in Virtual Contexts (EQVC).</p>
<p>According to some of the literature, empathy can be developed over time (<xref ref-type="bibr" rid="ref46">Gerdes et al., 2010</xref>) and may be considered a capacity (or ability), suggesting that individuals have the potential to empathize or not (<xref ref-type="bibr" rid="ref50">Hall and Schwartz, 2019</xref>). In fact, in some circumstances, feeling empathy requires effort and cognitive costs, and therefore, individuals may avoid feeling empathy (<xref ref-type="bibr" rid="ref28">Cameron et al., 2019</xref>). Thus, considering the specificities of the online environment and its consequences in interpersonal relationships, we felt the need to assess empathy that occurs specifically in virtual contexts. Moreover, empathy can be situation and context specific (<xref ref-type="bibr" rid="ref28">Cameron et al., 2019</xref>) such as in cyberbullying situations. Nonetheless, despite the widespread consensus that empathy is predetermined by circumstances (<xref ref-type="bibr" rid="ref14">Barli&#x0144;ska et al., 2013</xref>), none of the empathy definitions clearly state that empathy can decrease in some situations. That is, for example, in a bullying situation, an individual might feel empathy, however, if a similar situation occurs online, the same individual might not feel the same degree of empathy. This is one of the reasons we opted to adapt an empathy instrument for online contexts, as it may be more difficult for individuals to feel empathy toward others in these digital environments (<xref ref-type="bibr" rid="ref81">Pfetsch, 2017</xref>).</p>
</sec>
</sec>
<sec id="sec6">
<label>1.2.</label>
<title>Assessing moral disengagement in cyberbullying situations</title>
<p>According to the Social Information Processing theory (<xref ref-type="bibr" rid="ref99">Walther, 2015</xref>), the lack of nonverbal cues in many forms of computer-mediated communication (CMC) causes relational information to be exchanged more slowly. As a result, relationships develop more slowly <italic>via</italic> CMC than in face-to-face interactions, but eventually reaches equivalent levels of development (<xref ref-type="bibr" rid="ref97">Walther, 1992</xref>). Moreover, the scarcity of social&#x2013;emotional cues and the easiness of sharing media content may facilitate the use of certain MD mechanisms (<xref ref-type="bibr" rid="ref88">Runions and Bak, 2015</xref>).</p>
<p>Before cyberbullying had been linked to MD (for a meta-analytic review see <xref ref-type="bibr" rid="ref102">Zhao and Yu, 2021</xref>), <xref ref-type="bibr" rid="ref1">Suler (2004)</xref> had already investigated some characteristics of the online world that impacted individuals&#x2019; online actions. For instance, <xref ref-type="bibr" rid="ref1">Suler (2004)</xref> argued that in cyberspace, people tended to say and do things that normally they would not in face-to-face interactions. Suler explained how dissociative anonymity, invisibility and asynchronicity facilitated online disinhibition. He also discussed other factors, however considering cyberbullying situations, those three seemed more important. Specifically, Suler defended that dissociative anonymity allowed people to distance themselves from their online behavior, which is one of the main principles that helps explain online disinhibition. Furthermore, the fact that it was possible to be invisible in online interactions also amplified the disinhibition effect because people did not worry about how they looked when they communicated online (<xref ref-type="bibr" rid="ref1">Suler, 2004</xref>). Thus, considering that the virtual online world seems to be characterized by a degree of disinhibition (<xref ref-type="bibr" rid="ref1">Suler, 2004</xref>), which is a crucial social environment for MD (<xref ref-type="bibr" rid="ref12">Bandura et al., 1996</xref>), cyberbullying behavior will be more frequent for individuals with higher MD (<xref ref-type="bibr" rid="ref102">Zhao and Yu, 2021</xref>). That is, the lack of emotional cues in online settings may result in dehumanization (i.e., depriving another person from human qualities; <xref ref-type="bibr" rid="ref11">Bandura, 2002</xref>), whereas the ease with which young people share information online, may facilitate the diffusion and displacement of responsibility (distributing the responsibility for several individuals or attributing the responsibility to an authority; <xref ref-type="bibr" rid="ref11">Bandura, 2002</xref>). Accordingly, ambiguous communication, which is common online, may provoke cyber aggression which is justified by the perceived blame of the other (<xref ref-type="bibr" rid="ref88">Runions and Bak, 2015</xref>). Moreover, the same authors argued that young people are technologically more immersed, and media attention is increasing regarding extreme cases of cyberbullying. Hence, the relationship between online contexts and the use of MD mechanisms stresses the importance of assessing the construct in terms of specific behavior that occurs online, which in the case of this study, is cyberbullying behavior.</p>
<p>To our knowledge, few studies have accounted for MD in online settings. For instance, <xref ref-type="bibr" rid="ref80">Paciello et al. (2020)</xref> found that online MD and offline MD were correlated, even though they were distinct constructs. Moreover, they found that depending on the degree of externalizing behavior, the importance of online and offline MD was different. Specifically, cyberbullying was only significantly related to online MD for low externalizing adolescents, whereas for medium externalizing behaviors, both online and offline MD were significant. For high externalizing participants, only offline MD was significant. Complementarily, <xref ref-type="bibr" rid="ref71">Mar&#x00ED;n-L&#x00F3;pez et al. (2020)</xref> found that online MD was generally higher for children who were involved in cyberbullying (specifically cyberbullies and cybervictims), when compared to those who were not.</p>
<p>Some instruments have already been developed to assess MD in cyberbullying context. One of the first measures of MD in cyberbullying situations was from <xref ref-type="bibr" rid="ref26">Bussey et al. (2015)</xref>, in which they reworded 8 items from the MD scale by <xref ref-type="bibr" rid="ref12">Bandura et al. (1996)</xref>. Later, <xref ref-type="bibr" rid="ref33">Day and Lazuras (2016)</xref> developed the Cyberbullying-specific Moral Disengagement Questionnaire (CBMDQ-15) which is a 15-item scale based on thematic analysis of focus group interviews with undergraduate students, from where eight themes reflecting the MD mechanisms (<xref ref-type="bibr" rid="ref8">Bandura, 1991</xref>) emerged. In recent years, two more questionnaires were developed. <xref ref-type="bibr" rid="ref70">Mar&#x00ED;n-L&#x00F3;pez et al. (2019)</xref> developed the Moral Disengagement through Technology Questionnaire, also based on <xref ref-type="bibr" rid="ref12">Bandura et al. (1996)</xref> and adapted to online interactions. Additionally, <xref ref-type="bibr" rid="ref31">Cuadrado-Gordillo and Fern&#x00E1;ndez-Antelo (2019)</xref> combined two different questionnaires (<xref ref-type="bibr" rid="ref33">Day and Lazuras, 2016</xref>; <xref ref-type="bibr" rid="ref1200">Meter and Bauman, 2018</xref>) and transform the different types of aggression to online contexts. More recently, <xref ref-type="bibr" rid="ref80">Paciello et al. (2020)</xref> developed the Online Moral Disengagement scale referring to &#x201C;online social settings and misbehavior&#x201D; (<xref ref-type="bibr" rid="ref80">Paciello et al., 2020</xref>, p. 191).</p>
<p>Despite the aforementioned instruments to assess MD in online interactions (e.g., <xref ref-type="bibr" rid="ref80">Paciello et al., 2020</xref>) and cyberbullying situations (e.g., <xref ref-type="bibr" rid="ref26">Bussey et al., 2015</xref>), we consider that the development of a new instrument would be beneficial to assess the construct as a process for the Portuguese population, rather than just an adaptation to the Portuguese language. The main objective was to develop an instrument that could capture adolescents&#x2019; view regarding cyberbullying phenomenon, and MD as a process. That is, we intended to follow <xref ref-type="bibr" rid="ref11">Bandura&#x2019;s (2002)</xref> Social Cognitive Theory, but we also aimed to complement this perspective with new information that participants may report regarding MD in cyberbullying situations. We consider this important because most instruments presented were only adaptations to online contexts, without considering adolescents&#x2019; view of the phenomenon. Thus, this study also aims to present the new developed instrument to assess MD regarding cyberbullying situations (Process Moral Disengagement in Cyberbullying Inventory [PMDCI]), as well as to evaluate its psychometric properties.</p>
</sec>
<sec id="sec7">
<label>1.3.</label>
<title>Adolescents&#x2019; perceived empathy online and moral disengagement in cyberbullying</title>
<p>Empathy is central for moral development (<xref ref-type="bibr" rid="ref28">Cameron et al., 2019</xref>), as it can be an antecedent of moral attitudes (<xref ref-type="bibr" rid="ref56">Hyde et al., 2010</xref>). Additionally, as empathy can be considered the base for more abstract moral concepts, as well as attitudes toward society, it is probably an antecedent of subsequent moral attitudes, such as MD. For example, <xref ref-type="bibr" rid="ref56">Hyde et al. (2010)</xref> postulated that both MD and empathy share an element of disengagement, that is, MD is directed at society and its values, whereas empathy can be considered more person-specific. For instance, moral self-censure derives from how aggressors regard the individuals they harm, therefore, if they perceive another person as human this can activate empathic reactions through perceived similarity (<xref ref-type="bibr" rid="ref300">Bandura, 1992</xref>). Moreover, <xref ref-type="bibr" rid="ref500">Francisco (2022)</xref> found that when spontaneously talking about fictitious cyberbullying scenarios, participants who tended to use less MD mechanisms to justify aggressors&#x2019; and bystanders&#x2019; cyberbullying behavior, showed more empathic responses. Thus, empathy and MD seem to be related, as they can be seen as opposite sides of the same coin, and therefore, highlighting the importance of a concerted work including empathy and MD, with the aim of increasing prosocial behavior online (<xref ref-type="bibr" rid="ref500">Francisco, 2022</xref>). Moreover, MD and empathy are two relevant personal factors in cyberbullying bystanders&#x2019; behavior. However, the relationship between the two constructs is not fully understood (<xref ref-type="bibr" rid="ref71">Mar&#x00ED;n-L&#x00F3;pez et al., 2020</xref>). Thus, taking this into account, and considering the virtual world and cyberbullying involvement, we propose that adolescents&#x2019; perceived empathy regarding online contexts may be related to MD with cyberbullying situations.</p>
<p>It is known that gender can have an impact on several individual factors, such as empathy and MD. For example, <xref ref-type="bibr" rid="ref35">Falla et al. (2021)</xref> found gender differences with respect to empathy and MD in relation to bullying. Specifically, the authors found that girls had higher scores on both cognitive and affective empathy, and that boys had higher scores on several MD mechanisms, such as cognitive restructuring, minimizing responsibility, distorting consequences and dehumanizing. Thus, considering these gender differences we argue whether gender can have an impact on the variables of this study. Therefore, we question: (1) Is there a relationship between Empathy in virtual contexts and MD related to cyberbullying situations? If so, how are these constructs related?; and (2) What is the role of gender in empathy in virtual contexts and MD in cyberbullying situations?</p>
<p>In order to reach our objectives and answer our research questions, we present three distinct studies. A first study explores the initial adaptation of the EQVC and the preliminary development of the PMDCI. A second study presents the exploratory psychometric evidence of the EQVC and the PMDCI, whereas a third study shows the confirmatory analyses of the instruments and a correlational study of the two constructs.</p>
</sec>
</sec>
<sec id="sec8">
<label>2.</label>
<title>Study 1- Adaptation of the EQVC and preliminary development of the PMDCI</title>
<sec id="sec9">
<label>2.1.</label>
<title>Method</title>
<sec id="sec10">
<label>2.1.1.</label>
<title>Ethical aspects</title>
<p>For all the studies presented, authorization to complete the questionnaires in the online context was granted by the Ministry of Education of Portugal, the Portuguese National Commission of Data Protection, the Deontology Committee of the researchers&#x2019; institution, the schools&#x2019; boards of directors, the teachers, the parents and the adolescents themselves. Before the completion of the questionnaires, students were informed that psychological assistance was available if needed, considering the sensitivity of the subject in study. Additionally, students were informed that all information collected was anonymous and confidential and that they could quit at any time if they were not comfortable. This study was not preregistered. Further information regarding the initial adaptation and construction of the instruments, all items (Portuguese version), and additional information are available in the <xref rid="SM1" ref-type="supplementary-material">Supplementary material</xref>.</p>
</sec>
</sec>
<sec id="sec11">
<label>2.2.</label>
<title>Initial adaptation of the EQVC</title>
<p>All the 22 items from the Portuguese version of the EQ short form were converted to the online context considering its specificities. Later, these items were compared to the original version in English, by a bilingual Portuguese-English teacher. Considering the different populations from the original version (i.e., adults) and ours, some modifications were made to simplify the items and make them more comprehensible for the adolescent population. Lastly, small changes were made considering students&#x2019; feedback in the face validity session (see <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.1</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.1</xref>).</p>
</sec>
<sec id="sec12">
<label>2.3.</label>
<title>Initial construction of the PMDCI</title>
<sec id="sec13">
<label>2.3.1.</label>
<title>Participants</title>
<p>Thirty-four 9th grade students (Mage&#x2009;=&#x2009;14.29, SD&#x2009;=&#x2009;0.72, 53% female) participated in an in-depth semi-structured interview with fictitious scenarios.</p>
</sec>
<sec id="sec14">
<label>2.3.2.</label>
<title>Procedure</title>
<p>A qualitative study was conducted to explore adolescents&#x2019; MD in cyberbullying situations. In-depth semi-structured interviews with scenarios were conducted and <italic>verbatim</italic> transcribed. Later, we performed a content analysis with a mixed approach (deductive/inductive), based on the Social Cognitive Theory (<xref ref-type="bibr" rid="ref11">Bandura, 2002</xref>). The coding units we established were adolescents&#x2019; written verbalizations with meaning (<xref ref-type="bibr" rid="ref200">Amado et al., 2014</xref>), summing a total of 396 verbalizations, which were analyzed. We performed an initial phase, where categories were created, and a re-checking phase, where a set of verbalizations were analyzed by two other researchers and adjustments were made to the operational definition of the categories. Finally, two independent coders rated the data. Inter-rater reliability was excellent, as mentioned in the literature (<xref ref-type="bibr" rid="ref1200">McGraw and Wong, 1996</xref>), with an ICC&#x2009;=&#x2009;0.99, with a 95% confident interval&#x2009;=&#x2009;0.99&#x2013;0.99. From this analysis, the categorization process went beyond the Social Cognitive Theory. That is, several categories of MD mechanisms emerged from the analysis, as well as other attributions (<xref rid="fig1" ref-type="fig">Figure 1</xref>), both regarding aggressors&#x2019; and bystanders&#x2019; behavior from the scenarios (see <xref ref-type="bibr" rid="ref600">Francisco et al., 2022</xref> for a detailed description).</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Procedural model of cyberbullying in the perspective of participants, as bystanders of the scenarios. Ag., aggressors&#x2019; behavior; Bys., bystanders&#x2019; behavior; Part., participants&#x2019; bystanders behavior in the scenarios. From <xref ref-type="bibr" rid="ref600">Francisco et al. (2022)</xref>.</p>
</caption>
<graphic xlink:href="fpsyg-14-1061482-g001.tif"/>
</fig>
<p>It is important to highlight that we considered MD as a process, since several mechanisms tend to be used before the aggression, during the behavior and after as consequents of the behavior, as presented in <xref rid="fig1" ref-type="fig">Figure 1</xref>. Thus, considering this novel approach, the qualitative data was the starting point of the development of the PMDCI because we sought to develop an instrument that could capture adolescents&#x2019; beliefs and perspective of this phenomenon as accurately as possible. Hence, from the categories that emerged from the content analysis, we created the items for the PMDCI. All the procedures regarding scale development can be found in the <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.2</xref>.</p>
</sec>
</sec>
<sec id="sec15">
<label>2.4.</label>
<title>Results</title>
<p>Study 1 allowed us to develop the EQVC and the PMDCI. The EQVC is composed of 22 items in Portuguese, for the adolescent population. The final items were translated into English, for the purpose of presenting this investigation (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.8</xref>). As for the PMDCI, it was an instrument about the psychological mechanisms adolescents use to justify their cyberbullying-related actions, in the perspective of possible aggressors and bystanders (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Tables A.2&#x2013;A.6</xref>). The inventory begins with a brief introduction about adolescents&#x2019; daily use of ICT. The PMDCI (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.3</xref>) is also composed of two scales (the aggressor&#x2019;s and bystander&#x2019;s perspective), because when speaking freely about the cyberbullying scenarios, adolescents tended to use MD mechanisms to not only legitimize cyberbullies&#x2019; actions, but also to approve cyber bystanders&#x2019; aggressive behavior. The PMDCI also includes a Non-Intervention scale. However, for the purpose of this work, only the bystander scale was used, since it is part of a larger investigation that aims to improve bystanders&#x2019; prosocial behavior online. The Bystander Scale of the PMDCI is composed of 36 items (24 regarding MD mechanisms, 3 regarding the devaluation of behavioral intention, and 9 items in the attribution category). All items were presented with a Likert scale from 1 (<italic>totally disagree</italic>) to 4 (<italic>totally agree</italic>).</p>
</sec>
</sec>
<sec id="sec16">
<label>3.</label>
<title>Study 2 &#x2013; Preliminary testing and exploratory psychometric evidence of the EQVC and 363 the PMDCI</title>
<sec id="sec17">
<label>3.1.</label>
<title>Method</title>
<sec id="sec18">
<label>3.1.1.</label>
<title>Participants</title>
<p>A total of 234 students participated in the exploratory factor analysis (EFA) study (<italic>M<sub>age</sub></italic>&#x2009;=&#x2009;13.24; <italic>SD</italic>&#x2009;=&#x2009;1.18; 51.7% girls), 35.9% of whom were in the 7th grade, 25.6% were in the 8th grade and 38.5% were in the 9th grade (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.4</xref>). All 234 participated in the EFA of the EQVC and 230 participated in the EFA of the PMDCI.</p>
</sec>
<sec id="sec19">
<label>3.1.2.</label>
<title>Procedures</title>
<p>The new created version of EQ (EQVC) and the new developed instrument (PMDCI) were administered on-line in a classroom context, individually with the guidance of an educational psychologist. Students took approximately 40&#x2009;minutes to complete both questionnaires. After the data gathering, EFA was conducted with FACTOR 10.10.02 (<xref ref-type="bibr" rid="ref36">Ferrando and Lorenzo-Seva, 2017</xref>) to understand the factorial structure of both instruments. Specifically, we intended to explore if the EQVC yielded the same structure of the EQ-short form (Portuguese version), or if considering the new context and different population, the structure of the instrument would change. Regarding the PMDCI, since it was developed considering the four loci (i.e., Behavior, Agency, Outcome and Recipient) and the respective MD mechanisms, we intended to evaluate the best way to validate the instrument. That is, we were interested in understanding if the instrument should be considered as a single scale, or if it should be regarded as a questionnaire with different scales (i.e., one scale for each locus) involving the distinct locus of the MD.</p>
</sec>
</sec>
<sec id="sec20">
<label>3.2.</label>
<title>Results</title>
<sec id="sec21">
<label>3.2.1.</label>
<title>Exploratory evidence of the EQVC</title>
<p>In order to uncover the underlying structure of the EQVC, we performed an EFA (see <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.5</xref> for more details). We present the correlations and descriptive statistics of all items, including skewness and kurtosis (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.7</xref>). Regarding univariate normality, all variables were approximately normally distributed according to the literature, with skewness absolute values less than 2 and kurtosis absolute values less than 2 (<xref ref-type="bibr" rid="ref45">George and Mallery, 2016</xref>). We also analyzed multivariate normality accordingly to <xref ref-type="bibr" rid="ref22">Bollen and Long (1993)</xref>, where multivariate normality is accepted if Mardia&#x2019;s coefficient is lower than P (P&#x2009;+&#x2009;2), considering P the number of observed variables. Considering that the EQVC presented 22 observed variables, Mardia&#x2019;s coefficient for skewness of 78.41&#x2009;&#x003C;&#x2009;22(22&#x2009;+&#x2009;2)&#x2009;=&#x2009;528 and for kurtosis is 605.06&#x2009;&#x003E;&#x2009;22(22&#x2009;+&#x2009;2)&#x2009;=&#x2009;528. Moreover, as for the correlation matrix, we used polychoric correlations (<xref ref-type="bibr" rid="ref77">Muth&#x00E9;n and Kaplan, 1985</xref>; <xref ref-type="bibr" rid="ref24">Brown, 2006</xref>) (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.7</xref>). Furthermore, before proceeding to the EFA results, Kaiser&#x2013;Meyer&#x2013;Olkin (KMO) and Bartlett Sphericity were assessed. As for KMO it was 0.89 revealing sampling adequacy, and Bartlett Sphericity test was &#x03C7;<sup>2</sup>(<sub>231</sub>)&#x2009;=&#x2009;2543.4 (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001), which indicated that we could proceed with factor analysis. In order to retain the appropriate number of factors we used Horn Parallel analyses (<xref ref-type="bibr" rid="ref1500">O&#x2019;Connor, 2000</xref>). In the FACTOR program (<xref ref-type="bibr" rid="ref36">Ferrando and Lorenzo-Seva, 2017</xref>) the Optimal Implementation of Parallel Analysis (<xref ref-type="bibr" rid="ref95">Timmerman and Lorenzo-Seva, 2011</xref>) suggested that two factors should be extracted. We used the Unweighted Least Squares (ULS) method for factor extraction. Specifically, Robust Factor Analysis based on the Robust Unweighted Least Squares (RULS) was used to fit the factor solution. Robust Promin Rotation was used to achieve factor simplicity (<xref ref-type="bibr" rid="ref67">Lorenzo-Seva and Ferrando, 2019</xref>). As according to the literature (<xref ref-type="bibr" rid="ref6">Bandalos and Finney, 2010</xref>), we took into account all items with structure coefficients superior to 0.30, and no items revealed loadings greater than 0.40 on the two factors (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.2</xref>). According to the literature (<xref ref-type="bibr" rid="ref75">McDonald, 1999</xref>), goodness-of-fit values (<italic>GFI</italic>&#x2009;=&#x2009;0.98) and (<italic>AGFI</italic>&#x2009;=&#x2009;0.98), residuals statistics (<italic>RMSR</italic>&#x2009;=&#x2009;0.06) were good. The EQVC presented 48% of the explained variance. We then compared the bi-factorial model to the unifactorial model (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.6</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.9</xref>). Considering the results, we decided to keep the bi-factorial model since the percentage of explained variance was higher. Regarding reliability, McDonald&#x2019;s Omega (<xref ref-type="bibr" rid="ref52">Hayes and Coutts, 2020</xref>) was also assessed for both factors: factor 1 presented &#x03C9;&#x2009;=&#x2009;0.68, 95% CI [0.58, 0.74], showing acceptable reliability, and factor 2 presented &#x03C9;&#x2009;=&#x2009;0.91, 95% CI [0.88, 0.93], with excellent reliability (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.6</xref>).</p>
<p>Later, we conducted a Multidimensional Normal-ogive Graded Response Model (<xref ref-type="bibr" rid="ref83">Reckase, 1985</xref>), whose parameters can be seen in <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.8</xref>, as well as the item loadings. This model presents a discrimination parameter (<italic>a</italic>), which is important in the preliminary adjustment of questionnaires and item selection (<xref ref-type="bibr" rid="ref73">Matteucci and Stracqualursi, 2006</xref>). Most items revealed moderate item discrimination, however, items 1, 4, and 5 revealed low item discrimination, presenting values between 0.424 and 0.586, as indicated in the literature (<xref ref-type="bibr" rid="ref5">Baker, 2001</xref>). Item discrimination reveals how well an item differentiates individuals scoring high and low on the latent ability being measured (<xref ref-type="bibr" rid="ref34">Depaoli et al., 2018</xref>). Then, we performed the analysis again without items 1, 4, and 5 to see how the model change. Lastly, we had some participants with Weighted Mean-Squared Index larger than 2.0 (<xref ref-type="bibr" rid="ref37">Ferrando et al., 2016</xref>), thus, these participants were removed and the analysis was performed again. <xref rid="tab1" ref-type="table">Table 1</xref> shows a comparison between 4 proposed EFA models: (1) with all participants and all items, (2) with all participants and without items 1, 4 and 5, (3) without infit/outfit participants and all items and (4) without infit/outfit participants and without items 1, 4, and 5.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Proposed bi-factorial model parameters of the EQVC.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th/>
<th align="center" valign="top" colspan="2">Model 1</th>
<th align="center" valign="top" colspan="2">Model 2</th>
<th align="center" valign="top" colspan="2">Model 3</th>
<th align="center" valign="top" colspan="2">Model 4</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Mardia&#x2019;s coefficient skewness</td>
<td align="center" valign="middle" colspan="2">78.41&#x2009;&#x003C;&#x2009;22(22&#x2009;+&#x2009;2)&#x2009;=&#x2009;528</td>
<td align="center" valign="middle" colspan="2">54.56&#x2009;&#x003C;&#x2009;19(19&#x2009;+&#x2009;2)&#x2009;=&#x2009;329</td>
<td align="center" valign="middle" colspan="2">78.81&#x2009;&#x003C;&#x2009;22(22&#x2009;+&#x2009;2)&#x2009;=&#x2009;528</td>
<td align="center" valign="middle" colspan="2">52.78&#x2009;&#x003C;&#x2009;19(19&#x2009;+&#x2009;2)&#x2009;=&#x2009;329</td>
</tr>
<tr>
<td align="left" valign="top">Mardia&#x2019;s coefficient kurtosis</td>
<td align="center" valign="middle" colspan="2">605.06&#x2009;&#x003E;&#x2009;22(22&#x2009;+&#x2009;2)&#x2009;=&#x2009;528</td>
<td align="center" valign="middle" colspan="2">465.91&#x2009;&#x003E;&#x2009;19(19&#x2009;+&#x2009;2)&#x2009;=&#x2009;440</td>
<td align="center" valign="middle" colspan="2">588.02&#x2009;&#x003E;&#x2009;22(22&#x2009;+&#x2009;2)&#x2009;=&#x2009;528</td>
<td align="center" valign="middle" colspan="2">449.76&#x2009;&#x003E;&#x2009;19(19&#x2009;+&#x2009;2)&#x2009;=&#x2009;440</td>
</tr>
<tr>
<td align="left" valign="top">Kaiser&#x2013;Meyer&#x2013;Olkin</td>
<td align="center" valign="middle" colspan="2">0.89</td>
<td align="center" valign="middle" colspan="2">0.90</td>
<td align="center" valign="middle" colspan="2">0.91</td>
<td align="center" valign="middle" colspan="2">0.92</td>
</tr>
<tr>
<td align="left" valign="top">Bartlett sphericity</td>
<td align="center" valign="middle" colspan="2">&#x03C7;<sup>2</sup><sub>231</sub> =&#x2009;2543.4 (<italic>p</italic> &#x003C;&#x2009;0.001)</td>
<td align="center" valign="top" colspan="2">&#x03C7;<sup>2</sup><sub>171</sub> =&#x2009;2292.2 (<italic>p</italic> &#x003C;&#x2009;0.001)</td>
<td align="center" valign="middle" colspan="2">&#x03C7;<sup>2</sup><sub>231</sub> =&#x2009;2415.8 (<italic>p</italic> &#x003C;&#x2009;0.001)</td>
<td align="center" valign="top" colspan="2">&#x03C7;<sup>2</sup><sub>171</sub> =&#x2009;2356.1 (<italic>p</italic> &#x003C;&#x2009;0.001)</td>
</tr>
<tr>
<td align="left" valign="top">% Explained variance</td>
<td align="center" valign="middle" colspan="2">48%</td>
<td align="center" valign="middle" colspan="2">52%</td>
<td align="center" valign="middle" colspan="2">51%</td>
<td align="center" valign="middle" colspan="2">55%</td>
</tr>
<tr>
<td align="left" valign="top">GFI</td>
<td align="center" valign="middle" colspan="2">0.98</td>
<td align="center" valign="top" colspan="2">0.99</td>
<td align="center" valign="top" colspan="2">0.99</td>
<td align="center" valign="top" colspan="2">0.99</td>
</tr>
<tr>
<td align="left" valign="top">CFI</td>
<td align="center" valign="middle" colspan="2">1.00</td>
<td align="center" valign="top" colspan="2">1.00</td>
<td align="center" valign="top" colspan="2">1.00</td>
<td align="center" valign="top" colspan="2">1.00</td>
</tr>
<tr>
<td align="left" valign="middle">RMSR</td>
<td align="center" valign="middle" colspan="2">0.057</td>
<td align="center" valign="top" colspan="2">0.055</td>
<td align="center" valign="top" colspan="2">0.051</td>
<td align="center" valign="top" colspan="2">0.049</td>
</tr>
<tr>
<td align="left" valign="top">RMSEA</td>
<td align="center" valign="middle" colspan="2">0.028</td>
<td align="center" valign="top" colspan="2">0.032</td>
<td align="center" valign="top" colspan="2">0.015</td>
<td align="center" valign="top" colspan="2">0.018</td>
</tr>
<tr>
<td align="left" valign="top">&#x03B1;</td>
<td align="center" valign="middle">0.68</td>
<td align="center" valign="middle">0.91</td>
<td align="center" valign="middle">0.64</td>
<td align="center" valign="middle">0.91</td>
<td align="center" valign="middle">0.68</td>
<td align="center" valign="middle">0.92</td>
<td align="center" valign="middle">0.64</td>
<td align="center" valign="middle">0.92</td>
</tr>
<tr>
<td align="left" valign="top">&#x03C9; (95%)</td>
<td align="center" valign="middle">0.68 [0.58, 0.74]</td>
<td align="center" valign="middle">0.91 [0.88, 0.93]</td>
<td align="center" valign="middle">0.64 [0.54, 0.72]</td>
<td align="center" valign="middle">0.91 [0.88, 0.93]</td>
<td align="center" valign="middle">0.68 [0.57, 0.74]</td>
<td align="center" valign="middle">0.92 [0.90, 0.94]</td>
<td align="center" valign="middle">0.63 [0.53, 0.72]</td>
<td align="center" valign="middle">0.92 [0.90, 0.94]</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>&#x03B1; and &#x03C9; were calculated for difficulty in empathizing and self-efficacy regarding empathy, in all models. &#x03C9; is assessed with 95% confidence interval.</p>
</table-wrap-foot>
</table-wrap>
<p>The elimination of participants improved the % of explained variance (from 48 to 51%); the RMSEA and the RMSR were the fit indices that had better improvement. Moreover, the elimination of the 3 items improved the model essentially in terms of % explained variance (from 48 to 55%), and also the same indices as described above. Considering these improvements, we conducted Confirmatory Factor Analysis (CFA) with this structure.</p>
</sec>
<sec id="sec22">
<label>3.2.2.</label>
<title>Exploratory factor analysis of the PMDCI</title>
<p>With the aim of assessing the structure of the PMDCI, we performed an EFA with data from 230 participants to the 5 scales included in the questionnaire (4 scales regarding Loci of MD and 1 scale regarding Attributions for the cyberbullying behavior), considering the Bystanders&#x2019; perspective (i.e., Bystander scale). We present the correlations and descriptive statistics of all items, including skewness and kurtosis (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.10</xref>).</p>
<p>Regarding univariate normality, most of the variables were normally distributed, with skewness absolute values less than 2 (<xref ref-type="bibr" rid="ref22">Bollen and Long, 1993</xref>), with the exception of the items from the Attribution Scale. Regarding kurtosis, all variables had less than 5 in absolute value. With respect to multivariate normality, according to <xref ref-type="bibr" rid="ref22">Bollen and Long (1993)</xref>, it is accepted if Mardia&#x2019;s coefficient is lower than P(P&#x2009;+&#x2009;2), considering P the number of observed variables. Moreover, as for the correlation matrix, we used polychoric correlations (<xref ref-type="bibr" rid="ref77">Muth&#x00E9;n and Kaplan, 1985</xref>; <xref ref-type="bibr" rid="ref24">Brown, 2006</xref>). Furthermore, before proceeding to the EFA, Kaiser&#x2013;Meyer&#x2013;Olkin (KMO) and Bartlett Sphericity were assessed (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.11</xref>). All scales had high KMO which revealed sampling adequacy, as well as a significant Bartlett Sphericity test, which indicates that we could proceed with factor analysis.</p>
<p>In order to retain the appropriate number of factors, we followed the same procedures used for the EQVC. Our EFA suggested that a single factor should be extracted of each scale of the PMDCI. As for the factor structure (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.12</xref>), we took into account all items with structure coefficients superior than 0.30 (<xref ref-type="bibr" rid="ref6">Bandalos and Finney, 2010</xref>). Regarding reliability, all scales reveal good internal consistency values (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.11</xref>).</p>
<p>Regarding Explained Variance, all scales were above the minimum range, as according to the literature (<xref ref-type="bibr" rid="ref49">Hair et al., 2014</xref>). As for the model fit indices, all scales presented satisfactory values of goodness-of-fit values and residuals statistics (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.11</xref>), according to the literature (<xref ref-type="bibr" rid="ref75">McDonald, 1999</xref>).</p>
<p>Later, we conducted a Multidimensional Normal-ogive Graded Response Model for unifactorial models (<xref ref-type="bibr" rid="ref11000">Samejima, 1969</xref>), whose parameters can be seen in <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.12</xref>, as well as the item loadings, for all the 5 scales. Considering the discrimination parameter values, it was concluded that all items from all scales revealed good discrimination (<xref ref-type="bibr" rid="ref5">Baker, 2001</xref>), indicating that there was no need to remove items. Thus, we conducted CFA with the original structure of all 5 scales.</p>
</sec>
</sec>
</sec>
<sec id="sec23">
<label>4.</label>
<title>Study 3 &#x2013; The confirmatory analyses of the instruments and a correlational study of the studied constructs</title>
<sec id="sec24">
<label>4.1.</label>
<title>Method</title>
<sec id="sec25">
<label>4.1.1.</label>
<title>Participants</title>
<p>For the CFA, our sample consisted of 345 students (<italic>M</italic>age&#x2009;=&#x2009;13.13; <italic>SD</italic>&#x2009;=&#x2009;1.27; 51% boys), 40.5% of whom were in the 7th grade, 27.1% in the 8th grade and 32.4% in the 9th grade. Most students were Portuguese (85.8%). All 345 participated in the CFA of the EQVC and 342 participated in the CFA of the PMDCI, as well as in the correlational study.</p>
</sec>
<sec id="sec26">
<label>4.1.2.</label>
<title>Procedures</title>
<p>Before proceeding to the CFA, univariate and multivariate normality of all scales were evaluated and the distributions were considered non-normal. This is consistent with the literature (<xref ref-type="bibr" rid="ref101">Yuan and Bentler, 1998</xref>), since non-normality is prevalent in real data (<xref ref-type="bibr" rid="ref19">Blanca et al., 2013</xref>) and it would dictate the possibilities in the data analysis, because structural equation modeling assumes the normality of latent variables (<xref ref-type="bibr" rid="ref21">Bollen, 1989</xref>). Thus, several estimation methods were investigated and analyzed considering the nature of our data (for a detailed description see <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.7</xref>).</p>
<p>With this in mind, we attempted to analyze several estimation methods that could be applied to our data. As a way of summarizing our results, we only mentioned the ULS parameters in the text, as advised by <xref ref-type="bibr" rid="ref21">Bollen (1989)</xref> because it does not make distributional assumptions regarding the observed variables. Moreover, the other estimation procedures are presented in the <xref rid="SM1" ref-type="supplementary-material">Supplementary Material</xref> and referred to when they are considered relevant.</p>
<p>For the CFA of the EQVC and PMDCI we used IBM, SPSS AMOS 24.0 (<xref ref-type="bibr" rid="ref2">Arbuckle, 2019</xref>) and the <italic>lavaan</italic> package (<xref ref-type="bibr" rid="ref87">Rosseel, 2012</xref>) in R Project (<xref ref-type="bibr" rid="ref82">R Core Team, 2020</xref>). ULS and ML with Bollen-Stine Bootstrapping were conducted in AMOS, and ML with Satorra-Bentler correction and WLSMV were conducted using the <italic>lavaan</italic> package in R software. Several Fit Indices will be presented according to the different estimation methods (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.7</xref>), and organized by their main classification. Considering that the covariance matrix might not be as asymptotically distributed as chi-square with the ULS method (<xref ref-type="bibr" rid="ref21">Bollen, 1989</xref>), several statistics are not reported, such as the chi-square test and other fit indexes based on this statistic. Instead, we used the following fit indexes to ascertain the tested models: GFI, AGFI and PGFI (more information regarding Fit Indices are in the <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.9</xref>).</p>
<p>As for the correlational study, Spearman correlation coefficients were used to examine the relationship between the variables.</p>
</sec>
</sec>
<sec id="sec27">
<label>4.2.</label>
<title>Results</title>
<sec id="sec28">
<label>4.2.1.</label>
<title>Confirmatory factor analysis of the EQVC</title>
<p>We examined the multivariate normality and considering that the critical ratio for both skewness and kurtosis was outside the interval of [&#x2212;1.96, +1.96] (<xref ref-type="bibr" rid="ref27">Byrne, 2010</xref>), some procedures were made to account for the non-normal distribution of the data. Thus, first several multivariate outliers were removed, and multivariate normality was assessed again. However, the distribution was still non-normal.</p>
<p>We tested various possible models so as to confirm the initial structure of the EQVC suggested by the EFA with confirmatory factor analysis. We attempted to test a model with all participants and no covariances (model 1), a model without outliers and no covariances (model 2) and a model without outliers and with covariances (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.13</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.1</xref>) between the error terms (model 3). From the results presented, we chose model 3, which according to the literature (<xref ref-type="bibr" rid="ref61">J&#x00F6;reskog and S&#x00F6;rbom, 1984</xref>; <xref ref-type="bibr" rid="ref30">Cole, 1987</xref>; <xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>) presented good reference values [&#x03C7;<sup>2</sup>(149)&#x2009;=&#x2009;151.626, &#x03C7;<sup>2</sup>/<italic>df</italic>&#x2009;=&#x2009;0.793, GFI&#x2009;=&#x2009;0.969, AGFI&#x2009;=&#x2009;0.961, SRMR&#x2009;=&#x2009;0.054, NFI&#x2009;=&#x2009;0.930, PGFI&#x2009;=&#x2009;0.759, PNFI&#x2009;=&#x2009;0.810].</p>
<p>Despite the good fit of the model, several relationships between each factor and corresponding items were lower than the cut-off value of 0.5, as suggested in the literature (e.g., <xref ref-type="bibr" rid="ref6">Bandalos and Finney, 2010</xref>). All unstandardized path coefficients<xref rid="fn0004" ref-type="fn"><sup>1</sup></xref> were significant at <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05, with the exception of item 3, which was equal to 0.05 (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.1</xref>). Moreover, the construct reliability scores were low for the Difficulties in Empathizing and higher than 0.80 (<xref ref-type="bibr" rid="ref49">Hair et al., 2014</xref>) for the Self-efficacy regarding Empathy (<xref rid="tab2" ref-type="table">Table 2</xref>). Thus, the second factor presented good construct reliability; however, the first, which only has 4 items, revealed low reliability. Convergent validity was low for both factors since the Average Variance Extracted (AVE) scores were lower than 0.50 (<xref ref-type="bibr" rid="ref54">Henseler et al., 2009</xref>). Nonetheless, the Average Shared Variance scores below the AVE scores (<xref ref-type="bibr" rid="ref49">Hair et al., 2014</xref>) indicated good discriminant validity of both factors. Additionally, the simplified model also presented lower Modified Expected Cross-Validation Index (MECVI), indicating that it has better validity in the population we are studying (<xref ref-type="bibr" rid="ref72">Mar&#x00F4;co, 2014</xref>).</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Validity measures of Model 3 from the EQVC.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Factors</th>
<th align="center" valign="top">Cronbach&#x2019;s alpha</th>
<th align="center" valign="top">McDonald&#x2019;s omega</th>
<th align="center" valign="top">CR</th>
<th align="center" valign="top">AVE</th>
<th align="center" valign="top">ASV</th>
<th align="center" valign="top">MSV</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">Difficulties in empathizing</td>
<td align="center" valign="middle">0.44</td>
<td align="center" valign="middle">0.45 [0.30&#x2013;0.54]</td>
<td align="center" valign="middle">0.39</td>
<td align="center" valign="middle">0.18</td>
<td align="center" valign="middle">0.12</td>
<td align="center" valign="middle">0.12</td>
</tr>
<tr>
<td align="left" valign="middle">Self-efficacy beliefs regarding empathy</td>
<td align="center" valign="middle">0.83</td>
<td align="center" valign="middle">0.83 [0.79,0.86]</td>
<td align="center" valign="middle">0.83</td>
<td align="center" valign="middle">0.26</td>
<td align="center" valign="middle">0.12</td>
<td align="center" valign="middle">0.12</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>CR, construct reliability; AVE, average variance extracted; ASV, average shared variance; MSV, mean shared variance.</p>
</table-wrap-foot>
</table-wrap>
<p>The bi-factorial structure that we found could be the result of reverse coding (<xref ref-type="bibr" rid="ref100">Woods, 2006</xref>). Even though the factor Difficulties in Empathizing revealed low construct reliability, we decided to keep the bi-factorial structure, since this is a pilot study of an adapted instrument to online contexts, which is quite different from the offline environment. Nonetheless, further studies are required to better assess the EQVC, and to better understand if the bi-factorial structure results from reverse coding, or from the characteristics of online contexts.</p>
</sec>
<sec id="sec29">
<label>4.2.2.</label>
<title>Confirmatory factor analysis of the PMDCI</title>
<p>In order to confirm the initial structure suggested by the EFA of the scales from the PMDCI, various possible models were tested for the 5 scales (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Tables A.14&#x2013;A.18</xref>). Hence, we attempted to test a model with all participants and no covariances (model 1), a model without outliers and no covariances (model 2) and a model without outliers and with covariances between the error terms (model 3).</p>
<p>Considering the <italic>Locus Behavior</italic> scale, the best model (model 3) presents several covariances between items (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.14</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.2</xref>). According to the literature (<xref ref-type="bibr" rid="ref61">J&#x00F6;reskog and S&#x00F6;rbom, 1984</xref>; <xref ref-type="bibr" rid="ref30">Cole, 1987</xref>; <xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>), the factor model we opted for presented good reference values [&#x03C7;<sup>2</sup>(25)&#x2009;=&#x2009;9.638, &#x03C7;<sup>2</sup>/<italic>df</italic>&#x2009;=&#x2009;0.386, GFI&#x2009;=&#x2009;0.991, AGFI =0.983, SRMR&#x2009;=&#x2009;0.051, NFI&#x2009;=&#x2009;0.975, PGFI =0.550, PNFI&#x2009;=&#x2009;0.677].</p>
<p>As for the <italic>Locus Agency</italic> scale, model 3 which presents the covariances between two error terms of items (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.15</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.3</xref>) presented good reference values [&#x03C7;<sup>2</sup>(8)&#x2009;=&#x2009;1.233, &#x03C7;<sup>2</sup>/<italic>df</italic>&#x2009;=&#x2009;0.154, GFI&#x2009;=&#x2009;0.997, AGFI =0.992, SRMR&#x2009;=&#x2009;0.032, NFI&#x2009;=&#x2009;0.987, PGFI =0.380, PNFI&#x2009;=&#x2009;0.526], as according to the literature (<xref ref-type="bibr" rid="ref61">J&#x00F6;reskog and S&#x00F6;rbom, 1984</xref>; <xref ref-type="bibr" rid="ref30">Cole, 1987</xref>; <xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>).</p>
<p>As for the <italic>Locus Outcome</italic> scale, we only assessed 2 models, since the Modification Indices did not indicate the need to covariate error terms of items (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.16</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.4</xref>), thus we only had model 1 with all participants, and model 2 without outliers. Model 2 presented good values [&#x03C7;<sup>2</sup>(9)&#x2009;=&#x2009;0.904, &#x03C7;<sup>2</sup>/<italic>df</italic>&#x2009;=&#x2009;0.100, GFI&#x2009;=&#x2009;0.997, AGFI =0.993, SRMR&#x2009;=&#x2009;0.028, NFI&#x2009;=&#x2009;0.993, PGFI =0.427, PNFI&#x2009;=&#x2009;0.596], as according to the literature (<xref ref-type="bibr" rid="ref61">J&#x00F6;reskog and S&#x00F6;rbom, 1984</xref>; <xref ref-type="bibr" rid="ref30">Cole, 1987</xref>; <xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>). Nonetheless, Model 1 presented better validity in the population of study, since it has lower MECVI (<xref ref-type="bibr" rid="ref72">Mar&#x00F4;co, 2014</xref>).</p>
<p>Considering the <italic>Locus Recipient</italic> scale, model 3 presented the covariances between four error terms (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.17</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.5</xref>). According to the literature (<xref ref-type="bibr" rid="ref61">J&#x00F6;reskog and S&#x00F6;rbom, 1984</xref>; <xref ref-type="bibr" rid="ref30">Cole, 1987</xref>; <xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>), the factor model we opted for presented good reference values [&#x03C7;<sup>2</sup>(7)&#x2009;=&#x2009;6.366, &#x03C7;<sup>2</sup>/<italic>df</italic>&#x2009;=&#x2009;0.909, GFI&#x2009;=&#x2009;0.993, AGFI =0.979, SRMR&#x2009;=&#x2009;0.042, NFI&#x2009;=&#x2009;0.979, PGFI =0.331, PNFI&#x2009;=&#x2009;0.457].</p>
<p>Finally, for the <italic>Attribution scale</italic>, model 3 presented the covariances between two error terms (<xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Table A.18</xref> and <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figure A.6</xref>) revealed good reference values [&#x03C7;<sup>2</sup>(26)&#x2009;=&#x2009;1.198, &#x03C7;<sup>2</sup>/<italic>df</italic>&#x2009;=&#x2009;0.046, GFI&#x2009;=&#x2009;0.992, AGFI =0.987, SRMR&#x2009;=&#x2009;0.05, NFI =0.987, PGFI =0.573, PNFI&#x2009;=&#x2009;0.713], according to the literature (<xref ref-type="bibr" rid="ref61">J&#x00F6;reskog and S&#x00F6;rbom, 1984</xref>; <xref ref-type="bibr" rid="ref30">Cole, 1987</xref>; <xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>).</p>
<p>Despite the good fit of the selected models, PGFI did not present good values for all scales. It was below the cutoff of 0.6 (<xref ref-type="bibr" rid="ref20">Blunch, 2008</xref>) in the Locus Agency, Outcome and Recipient and near the cutoff in the Locus Behavior and Attribution scale. Nonetheless, the other estimation procedures revealed good fit indices, supporting our model choice, as can be seen by comparing RMSEA and AIC. Also, all models chosen presented lower MECVI (<xref ref-type="bibr" rid="ref72">Mar&#x00F4;co, 2014</xref>), indicating better validity in the population of study, except for the Locus Outcome scale.</p>
<p>As can be seen in <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix Figures A.2&#x2013;A.6</xref>, several relationships between each factor and corresponding items were lower than the cut-off value of 0.5 (<xref ref-type="bibr" rid="ref6">Bandalos and Finney, 2010</xref>). Nevertheless, all unstandardized path coefficients were significant at <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05. Moreover, the composite reliability scores ranged from 0.62 to 0.88, revealing medium to high construct reliability (<xref ref-type="bibr" rid="ref49">Hair et al., 2014</xref>), as can be seen in <xref rid="tab3" ref-type="table">Table 3</xref>. However, the AVE was low for Locus Behavior, Agency and Recipient and approximate of the 0.50 as indicated in the literature (<xref ref-type="bibr" rid="ref54">Henseler et al., 2009</xref>) for Locus Outcome and Attributions. Thus, for the former scales, convergent validity was low, and for the later, convergent validity was almost adequate. Nonetheless, the Average Shared Variance (ASV) scores below the AVE scores (<xref ref-type="bibr" rid="ref49">Hair et al., 2014</xref>) indicated good discriminant validity for all scales, except for Locus Outcome, of which the ASV could not be calculated, since this scale did not have correlation between error terms.</p>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption>
<p>Validity measures of Model 3 for all scales from the PMDCI.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Factors</th>
<th align="center" valign="top">Cronbach&#x2019;s alpha</th>
<th align="center" valign="top">McDonald&#x2019;s omega</th>
<th align="center" valign="top">CR</th>
<th align="center" valign="top">AVE</th>
<th align="center" valign="top">ASV</th>
<th align="center" valign="top">MSV</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">Locus behavior</td>
<td align="center" valign="middle">0.76</td>
<td align="center" valign="middle">0.76 [0.71, 0.79]</td>
<td align="center" valign="middle">0.75</td>
<td align="center" valign="middle">0.26</td>
<td align="center" valign="middle">0.12</td>
<td align="center" valign="middle">0.16</td>
</tr>
<tr>
<td align="left" valign="middle">Locus agency</td>
<td align="center" valign="middle">0.65</td>
<td align="center" valign="middle">0.66 [0.57, 0.71]</td>
<td align="center" valign="middle">0.62</td>
<td align="center" valign="middle">0.24</td>
<td align="center" valign="middle">0.07</td>
<td align="center" valign="middle">0.07</td>
</tr>
<tr>
<td align="left" valign="middle">Locus outcome</td>
<td align="center" valign="middle">0.77</td>
<td align="center" valign="middle">0.78 [0.72, 0.82]</td>
<td align="center" valign="middle">0.80</td>
<td align="center" valign="middle">0.42</td>
<td align="center" valign="middle">N/A</td>
<td align="center" valign="middle">0.00</td>
</tr>
<tr>
<td align="left" valign="middle">Locus recipient</td>
<td align="center" valign="middle">0.69</td>
<td align="center" valign="middle">0.65 [0.54, 0.73]</td>
<td align="center" valign="middle">0.68</td>
<td align="center" valign="middle">0.30</td>
<td align="center" valign="middle">0.18</td>
<td align="center" valign="middle">0.22</td>
</tr>
<tr>
<td align="left" valign="middle">Attributions</td>
<td align="center" valign="middle">0.88</td>
<td align="center" valign="middle">0.89 [0.80, 0.93]</td>
<td align="center" valign="middle">0.88</td>
<td align="center" valign="middle">0.45</td>
<td align="center" valign="middle">0.10</td>
<td align="center" valign="middle">0.10</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>CR, construct reliability; AVE, average variance extracted; ASV, average shared variance; MSV, mean shared variance. N/A, not available.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="sec30">
<label>4.2.3.</label>
<title>Correlational study</title>
<p>In this investigation, we found that empathy in online contexts appeared to be divided in two factors (i.e., Difficulties in Empathizing and Self-efficacy regarding Empathy), and that Moral Disengagement with respect to cyberbullying situations was composed of 4 different <italic>loci</italic> (i.e., Behavior, Agency, Outcome and Recipient) and Attributions (for the definition of each scale/variable see <xref rid="SM1" ref-type="supplementary-material">Supplementary Appendix A.10</xref>). Thus, regarding the first research question, Difficulties in Empathizing was negatively and significantly correlated with Attributions (<italic>r</italic>&#x2009;=&#x2009;&#x2212;0.135, <italic>p</italic> &#x003C;&#x2009;0.05) and 3 Locus of MD [Agent (<italic>r</italic>&#x2009;=&#x2009;&#x2212;0.169, <italic>p</italic> &#x003C;&#x2009;0.01), Outcome (<italic>r</italic>&#x2009;=&#x2009;&#x2212;0.218, <italic>p</italic> &#x003C;&#x2009;0.01), and Recipient (<italic>r</italic>&#x2009;=&#x2009;&#x2212;0.142, <italic>p</italic> &#x003C;&#x2009;0.01)]. That is, the more difficulty participants had in empathizing, the less attributions and the three different Loci were used. However, with respect to self-efficacy in empathizing, it was not statistically significantly correlated with any variable. Considering the second research question, difficulties in empathizing was negatively and significantly correlated with gender (<italic>r</italic>&#x2009;=&#x2009;&#x2212;0.114, <italic>p</italic> &#x003C;&#x2009;0.05), meaning that girls tended to have more difficulties in empathizing, and boys tended to have less. Additionally, gender was positively and significantly correlated with Attributions (<italic>r</italic>&#x2009;=&#x2009;0.223, <italic>p</italic> &#x003C;&#x2009;0.01), Locus of Behavior (<italic>r</italic>&#x2009;=&#x2009;0.174, <italic>p</italic> &#x003C;&#x2009;0.01), Locus of Agency (<italic>r</italic>&#x2009;=&#x2009;0.226, <italic>p</italic> &#x003C;&#x2009;0.01), Locus of Outcome (<italic>r</italic>&#x2009;=&#x2009;0.136, <italic>p</italic> &#x003C;&#x2009;0.05) and Locus of Recipient (<italic>r</italic>&#x2009;=&#x2009;0.196, <italic>p</italic> &#x003C;&#x2009;0.01). This means that boys tended to use more attributions and MD Loci with regards to cyberbullying. Correlations can be found in <xref rid="tab4" ref-type="table">Table 4</xref>.</p>
<table-wrap position="float" id="tab4">
<label>Table 4</label>
<caption>
<p>Correlations between EQVC and PMDCI.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="middle">Variable</th>
<th align="center" valign="middle">Gender</th>
<th align="center" valign="middle">Difficulties empathizing</th>
<th align="center" valign="middle">Self-efficacy empathy</th>
<th align="center" valign="middle">Attributions</th>
<th align="center" valign="middle">Locus behavior</th>
<th align="center" valign="middle">Locus agent</th>
<th align="center" valign="middle">Locus outcome</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">Gender</td>
<td align="center" valign="middle"><bold>&#x2013;</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td align="left" valign="middle">Difficulties empathizing</td>
<td align="center" valign="middle">&#x2212;0.114<sup>&#x002A;</sup></td>
<td align="center" valign="middle"><bold>&#x2013;</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td align="left" valign="middle">Self-efficacy empathy</td>
<td align="center" valign="middle">&#x2212;0.041</td>
<td align="center" valign="middle">&#x2212;0.124<sup>&#x002A;</sup></td>
<td align="center" valign="middle">&#x2013;</td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td align="left" valign="middle">Attributions</td>
<td align="center" valign="middle">0.223<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.135<sup>&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.072</td>
<td align="center" valign="middle">&#x2013;</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td align="left" valign="middle">Locus behavior</td>
<td align="center" valign="middle">0.174<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.072</td>
<td align="center" valign="middle">0.000</td>
<td align="center" valign="middle">0.410<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2013;</td>
<td/>
<td/>
</tr>
<tr>
<td align="left" valign="middle">Locus agent</td>
<td align="center" valign="middle">0.226<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.169<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.075</td>
<td align="center" valign="middle">0.234<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.294<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2013;</td>
<td/>
</tr>
<tr>
<td align="left" valign="middle">Locus outcome</td>
<td align="center" valign="middle">0.136<sup>&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.218<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.033</td>
<td align="center" valign="middle">0.363<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.580<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.277<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2013;</td>
</tr>
<tr>
<td align="left" valign="middle">Locus recipient</td>
<td align="center" valign="middle">0.196<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">&#x2212;0.142<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.026</td>
<td align="center" valign="middle">0.404<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.632<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.393<sup>&#x002A;&#x002A;</sup></td>
<td align="center" valign="middle">0.529<sup>&#x002A;&#x002A;</sup></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>&#x002A;<italic>p</italic>&#x2009;&#x003C;&#x2009;0.05, &#x002A;&#x002A;<italic>p</italic>&#x2009;&#x003C;&#x2009;0.01.</p>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
</sec>
<sec id="sec31" sec-type="discussions">
<label>5.</label>
<title>Discussion</title>
<p>Although investigating cyberbullying is crucial, it is difficult to assess adolescents&#x2019; view of this phenomenon since students tend to underrate their involvement (<xref ref-type="bibr" rid="ref39">Francisco et al., 2015</xref>), which further demonstrates the importance of studying other related constructs, such as empathy and MD. That is, by understanding how these types of variables operate within the cyberbullying cycle, the more we are able to understand cyberbullying and its relationship with these variables. Thus, this investigation proposed a different perspective of these constructs, considering the specificities of the online world. Thus, we presented a preliminary study of two new instruments with respect to empathy and MD, considering that the characteristics of cyberspace can make right from wrong more difficult to distinguish (<xref ref-type="bibr" rid="ref70">Mar&#x00ED;n-L&#x00F3;pez et al., 2019</xref>), and have an impact on online interactions (<xref ref-type="bibr" rid="ref71">Mar&#x00ED;n-L&#x00F3;pez et al., 2020</xref>).</p>
<sec id="sec32">
<label>5.1.</label>
<title>Empathy quotient in virtual contexts</title>
<p>Our proposed model of empathy in virtual contexts was highly distinct from the one initially proposed by <xref ref-type="bibr" rid="ref16">Baron-Cohen and Wheelwright (2004)</xref> for face-to-face interactions. This was expected; since online contexts have some features that make feeling empathy difficult (<xref ref-type="bibr" rid="ref92">Terry and Cain, 2016</xref>). Thus, instead of having three factors (i.e., cognitive empathy, emotional reactivity, and social skills) (<xref ref-type="bibr" rid="ref1">Suler, 2004</xref>), EFA and CFA showed a bi-factorial structure. Therefore, the first factor refers to the difficulties in empathizing specifically in online contexts (by referring the term &#x201C;difficulty&#x201D; in most of the items) or not being able to understand something online. The second factor refers to self-efficacy beliefs regarding empathy, which according to <xref ref-type="bibr" rid="ref9">Bandura (1997)</xref>, refers to individuals&#x2019; beliefs regarding their capacity to control their own behavior and the environment that surrounds them, and specifically in this case, with respect to empathy.</p>
<p>This structure shares some similarities with the Portuguese short form of the EQ, since the factor Difficulties in Empathizing has the same 6 items as the Empathic Difficulties. Even though, two items had to be eliminated because of low discrimination, the fact that other study (<xref ref-type="bibr" rid="ref85">Rodrigues et al., 2011</xref>) found a factor with the same structure gave us some support for our two-dimensional structure. Despite the bi-factorial structure of the EQVC, which could be a direct consequence of the reverse worded items, as well as careless respondents (<xref ref-type="bibr" rid="ref100">Woods, 2006</xref>), if all the items of the first factor had already been aggregated together in other study (<xref ref-type="bibr" rid="ref85">Rodrigues et al., 2011</xref>), we may suppose that they in fact, form a factor. Nonetheless, further investigation should be conducted, adding more (positively worded) items to this factor to reassess the bi-factorial structure and understand if it is specific to the online context.</p>
<p>As for the second factor, all items of Self-efficacy beliefs regarding Empathy refer to a capacity which is perceived by the participant (e.g., &#x201C;I find it easy to put myself in someone else&#x2019;s shoes online&#x201D;). According to <xref ref-type="bibr" rid="ref10">Bandura (2001</xref>, p.10) efficacy beliefs are the foundation of human agency, therefore the perceived self-efficacy to accomplish goals is more important than the actual capacity. These beliefs are the driving force to act, despite the difficulties that may arise in the course of action (<xref ref-type="bibr" rid="ref10">Bandura, 2001</xref>). Thus, in the context of online empathy, it is of major importance that adolescents feel that they can deal with those situations, specifically considering online features that hamper empathy. Moreover, this structure informed us that in online contexts the different components of empathy (i.e., cognitive empathy), are not as relevant as the easiness/difficulty in feeling empathy, as well as the self-efficacy beliefs related to it.</p>
<p>Considering the results from this investigation, with respect to the factorial structure and reliability values, it seems important to continue this work of improving this instrument on empathy in virtual contexts, in order to understand whether the structure holds if more items are included, or if the instrument is analyzed with a different population, for example. Moreover, it would be interesting to test model invariance, in order to understand if the instrument behaves differently regarding boys and girls, separately. This would be important to test, since empathy is usually higher for girls (<xref ref-type="bibr" rid="ref59">Jolliffe and Farrington, 2006</xref>). Moreover, it would also be interesting to evaluate the convergent validity, with other measures of MD in online interaction, as well as to assess discriminant validity with measures of empathy in virtual contexts.</p>
</sec>
<sec id="sec33">
<label>5.2.</label>
<title>Process moral disengagement in cyberbullying situations questionnaire</title>
<p>As for MD, instruments to address it related to cyberbullying situations have begun to appear (e.g., <xref ref-type="bibr" rid="ref26">Bussey et al., 2015</xref>), but research on this topic remains a current concern (e.g., <xref ref-type="bibr" rid="ref80">Paciello et al., 2020</xref>). For example, <xref ref-type="bibr" rid="ref26">Bussey et al. (2015)</xref> addressed this issue in a general sense (i.e., &#x201C;Cyberbullying annoying classmates is just teaching them a lesson&#x201D;) or without specifying who the aggressor is (i.e., &#x201C;If people give out their passwords to others, they deserve to be cyberbullied&#x201D;). Items with this mixed approach made us question if the level of MD would be the same if participants put themselves in the place of aggressors or bystanders. Also, the qualitative research that led to the development of the instrument supported this idea, since adolescents did not use MD mechanisms only to legitimize cyberbullies&#x2019; actions, but also to approve cyber bystanders&#x2019; aggressive behavior (<xref ref-type="bibr" rid="ref600">Francisco et al., 2022</xref>). Therefore, we decided to develop an instrument that could assess MD from the aggressors&#x2019; and bystanders&#x2019; perspectives. This distinctive feature allows us to understand the role of MD with respect to the aggressors&#x2019; and bystanders&#x2019; cyberbullying behavior, however, for the purpose of this study, only the bystander scale was analyzed.</p>
<p>With a different perspective, <xref ref-type="bibr" rid="ref70">Mar&#x00ED;n-L&#x00F3;pez et al. (2019)</xref> focused on Moral Justification, Diffusion of responsibility, Distortion of consequences and Attribution of blame. However, we wanted to capture the impact of MD mechanisms as a process. Thus, we chose to develop a measure that included all mechanisms, separated by locus, since the qualitative study showed that not all mechanisms have the same impact in explaining cyberbullying behavior (<xref ref-type="bibr" rid="ref600">Francisco et al., 2022</xref>), and not all of them were mentioned (<xref rid="fig1" ref-type="fig">Figure 1</xref>). Moreover, for investigation purposes, some scales may prove to be more useful than others. Furthermore, we consider MD as a process; since this view provides a better understanding of how cyberbullying starts and how adolescents perpetuate this type of behavior, considering that some mechanisms may occur in specific timings of the cyberbullying cycle (<xref ref-type="bibr" rid="ref94">Tillman et al., 2018</xref>).</p>
<p>Confirmatory Factor Analysis verified the unidimensionality of the five scales (i.e., 4 Locus and Attributions) of the Bystander perspective of the PMDCI. Future studies should evaluate the psychometric properties of the Aggressor&#x2019;s perspective and compare it to the Bystander&#x2019;s perspective. It would also be important to evaluate the convergent validity, with other measures of MD in online interaction, as well as to assess discriminant validity with measures of empathy in virtual contexts. Furthermore, it would also be very important, especially in terms of intervention, to understand if the role of the distinct loci differ according to different grade levels and participants&#x2019; age, because it is known that MD increases over the years in high school (<xref ref-type="bibr" rid="ref90">Smith and Slonje, 2010</xref>) and severe cyberbullying incidents peak during middle adolescence (<xref ref-type="bibr" rid="ref38">Festl et al., 2017</xref>).</p>
</sec>
<sec id="sec34">
<label>5.3.</label>
<title>Empathy online and moral disengagement in cyberbullying</title>
<p>With respect to the relationship between both constructs, we believe that when students felt more difficulties in empathizing, the need to resort to MD mechanisms to decrease moral self-sanctions lessened (<xref ref-type="bibr" rid="ref11">Bandura, 2002</xref>). However, this does not mean that they would not get involved in cyberbullying situations. That is, if they did enter the cyberbullying cycle, since they had difficulties in empathizing, they would not use MD mechanisms, because they did not feel that the situation could transgress their moral standards. Considering gender issues, girls felt more difficulties in empathizing probably because they needed more social cues to do so (<xref ref-type="bibr" rid="ref1">Suler, 2004</xref>; <xref ref-type="bibr" rid="ref88">Runions and Bak, 2015</xref>). Even though they generally scored higher on empathy (<xref ref-type="bibr" rid="ref16">Baron-Cohen and Wheelwright, 2004</xref>; <xref ref-type="bibr" rid="ref29">Carrier et al., 2015</xref>), ICT may have brought them more challenges, especially considering that empathy can be effortful (<xref ref-type="bibr" rid="ref28">Cameron et al., 2019</xref>), they may perceive more difficulties in empathizing. With respect to MD, we were expecting positive significant correlations regarding gender, since boys tended to express significantly higher levels of moral justification, euphemistic labeling, diffusion of responsibility, distortion of consequences and blaming the victim than girls (<xref ref-type="bibr" rid="ref93">Thornberg and Jungert, 2014</xref>).</p>
</sec>
<sec id="sec35">
<label>5.4.</label>
<title>Limitations and future directions</title>
<p>This study has some limitations, among them the convenience sample (<xref ref-type="bibr" rid="ref71">Mar&#x00ED;n-L&#x00F3;pez et al., 2020</xref>), sample size (<xref ref-type="bibr" rid="ref46">Gerdes et al., 2010</xref>), and age of participants (<xref ref-type="bibr" rid="ref13">Barlett et al., 2016</xref>), therefore we cannot generalize findings. Additionally, self-report instruments can lead to false reporting and social desirability (<xref ref-type="bibr" rid="ref93">Thornberg and Jungert, 2014</xref>), thus it would be interesting to compare adolescents&#x2019; results to peer reports (<xref ref-type="bibr" rid="ref43">Garaigordobil, 2015</xref>). Also, procedures of data collection may not establish validity of the data (<xref ref-type="bibr" rid="ref46">Gerdes et al., 2010</xref>), thus, comparison with objective data collected from ecologically valid contexts, would be important. Moreover, test&#x2013;retest reliability would be important to better assess the instruments (<xref ref-type="bibr" rid="ref84">Redondo and Herrero-Fern&#x00E1;ndez, 2018</xref>).</p>
</sec>
<sec id="sec36">
<label>5.5.</label>
<title>Implications for practice</title>
<p>In terms of implications for practice, we believe the EQVC may provide some clues for intervention regarding the promotion of empathy in online contexts. Specifically, it can help identify which areas may be more prone to evoke some difficulties in feeling empathy when interacting virtually. Moreover, considering the importance of self-efficacy in goals and expectations (<xref ref-type="bibr" rid="ref10">Bandura, 2001</xref>), it seems of extreme importance to stimulate and develop self-efficacy specific to online interactions, as well as to empower children and adolescents, so they can be able to persevere when deciding to act against cyberbullying events. Regarding MD, as <xref ref-type="bibr" rid="ref12">Bandura et al. (1996)</xref> argued, the different mechanisms seem to differ in their contribution to detrimental conduct, hence the PMDCI allowed us to understand which MD mechanisms could interfere more with justifying cyberbullying behavior, and therefore, be an in-depth resource for interventions. That is, by providing information about the most common mechanisms used, this inventory can inform researchers and practitioners about what type of intervention can be developed within a specific population. Consequently, future interventions could be more accurate in terms of psychological needs, as well as more focused and shorter. These features may be important considering the difficulties that are often encountered with respect to the time available to work with children and adolescents beyond the school schedule. We believe that these versions of the EQVC and the PMDCI are promising instruments that can be further improved, and can also be used with other Portuguese-speakers (i.e., from Brazil and Angola, for example), however cultural differences may emerge. Moreover, we believe that these instruments can also be translated and adapted to other countries. Finally, the two instruments that resulted from this investigation can make an important contribution to understand the complex nature of cyberbullying to improve prosocial behavior online.</p>
</sec>
</sec>
<sec id="sec37" sec-type="data-availability">
<title>Data availability statement</title>
<p>The datasets presented in this article are not readily available because the Portuguese National Commission of Data Protection and the Deontology Committee of the researchers&#x2019; institution do not allow the availability of the datasets. The data that supports the findings of this study are available in the <xref rid="SM1" ref-type="supplementary-material">Supplementary material</xref> of this article. Requests to access the datasets should be directed to <email>sofifrancisco@gmail.com</email>.</p>
</sec>
<sec id="sec38">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Deontology Committee of the Faculty of Psychology University of Lisbon. Written informed consent to participate in this study was provided by the participants&#x2019; legal guardian/next of kin.</p>
</sec>
<sec id="sec39">
<title>Author contributions</title>
<p>SF designed and executed the study, analyzed the data, and wrote the manuscript. PC assisted with the design, collaborated with the data analyses, and the writing of the study. AV assisted with the design, execution and writing of the study, collaborated with the editing of the final manuscript. NP assisted with writing and the editing of the final manuscript. All authors approved the final version of the manuscript for submission.</p>
</sec>
<sec id="sec40" sec-type="funding-information">
<title>Funding</title>
<p>This work was supported by the Foundation for Science and Technology of the Science and Education Ministry of Portugal through a PhD grant (SFRH/BD/130982/2017), a Project grant (PTDC/PSI-GER/1918/2020) and through the Research Center for Psychological Science of the Faculty of Psychology, University of Lisbon (CICPSI; UIDB/04527/2020 and UIDP/04527/2020).</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="sec42" sec-type="supplementary-material">
<title>Supplementary material</title>
<p>The Supplementary material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1061482/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1061482/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref200"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Amado</surname> <given-names>J.</given-names></name> <name><surname>Costa</surname> <given-names>A. P.</given-names></name> <name><surname>Cruso&#x00E9;</surname> <given-names>N.</given-names></name></person-group> (<year>2014</year>). &#x201C;<article-title>A T&#x00E9;cnica de An&#x00E1;lise de Conte&#x00FA;do [The Content Analysis Technique]</article-title>&#x201D; in <source>Manual de investiga&#x00E7;&#x00E3;o qualitativa em educa&#x00E7;&#x00E3;o. 2nd edn.</source> ed. <person-group person-group-type="editor"><name><surname>Amado</surname> <given-names>J.</given-names></name></person-group>. (<publisher-loc>Coimbra</publisher-loc>: <publisher-name>Coimbra University Press</publisher-name>), <fpage>301</fpage>&#x2013;<lpage>348</lpage>.</citation></ref>
<ref id="ref2"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Arbuckle</surname> <given-names>J. L.</given-names></name></person-group> (<year>2019</year>). <source>Amos (version 24.0) [computer program]</source>. <publisher-loc>Chicago</publisher-loc>: <publisher-name>IBM SPSS</publisher-name>.</citation></ref>
<ref id="ref5"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Baker</surname> <given-names>F.</given-names></name></person-group> (<year>2001</year>). The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation, University of Maryland, College Park, MD. Available at: <ext-link xlink:href="http://echo.edres.org:8080/irt/baker/" ext-link-type="uri">http://echo.edres.org:8080/irt/baker/</ext-link></citation></ref>
<ref id="ref6"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Bandalos</surname> <given-names>D. L.</given-names></name> <name><surname>Finney</surname> <given-names>S. J.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x201C;Factor analysis: Exploratory and confirmatory&#x201D;</article-title> in <italic>The Reviewer&#x2019;s Guide to Quantitative Methods in the Social Sciences</italic>. eds. G. R. Hancock and R. O. Mueller (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>), <fpage>93</fpage>&#x2013;<lpage>114</lpage>.</citation></ref>
<ref id="ref7"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>1986</year>). <source>Social foundations of thought and action: A social cognitive theory</source>. <publisher-loc>Englewood Cliffs, NJ</publisher-loc>: <publisher-name>Prentice-Hall</publisher-name>.</citation></ref>
<ref id="ref8"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>1991</year>). &#x201C;<article-title>Social cognitive theory of moral thought and action</article-title>&#x201D; in <source>Handbook of moral behavior and development . Vol. 1.</source> eds. M. K. William and L. G. Jacob (<publisher-loc>Mahwah</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates, Inc.</publisher-name>), <fpage>45</fpage>&#x2013;<lpage>103</lpage>.</citation></ref>
<ref id="ref300"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>1992</year>). &#x201C;<article-title>Social cognitive theory of social referencing</article-title>&#x201D; in <source>Social Referencing and the Social Construction of Reality in Infancy</source>. ed. <person-group person-group-type="editor"><name><surname>Feinman</surname> <given-names>S.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Plenum</publisher-name>), <fpage>175</fpage>&#x2013;<lpage>208</lpage>.</citation></ref>
<ref id="ref9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>1997</year>). <article-title>Self-efficacy: the exercise of control</article-title>. <source>Freeman.</source></citation></ref>
<ref id="ref400"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>1999</year>). <article-title>Moral disengagement in the perpetration of inhumanities</article-title>. <source>Personal Soci Psychol Rev.</source> <volume>3</volume>, <fpage>193</fpage>&#x2013;<lpage>209</lpage>. doi: <pub-id pub-id-type="doi">10.1207/s15327957pspr0303_3</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>2001</year>). <article-title>Social cognitive theory: an agentic perspective</article-title>. <source>Annu. Rev. Psychol.</source> <volume>52</volume>, <fpage>1</fpage>&#x2013;<lpage>26</lpage>. doi: <pub-id pub-id-type="doi">10.1146/annurev.psych.52.1.1</pub-id>, PMID: <pub-id pub-id-type="pmid">11148297</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>2002</year>). <article-title>Selective moral disengagement in the exercise of moral agency</article-title>. <source>J. Moral Educ.</source> <volume>31</volume>, <fpage>101</fpage>&#x2013;<lpage>119</lpage>. doi: <pub-id pub-id-type="doi">10.1080/0305724022014322</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name> <name><surname>Barbaranelli</surname> <given-names>C.</given-names></name> <name><surname>Caprara</surname> <given-names>G. V.</given-names></name> <name><surname>Pastorelli</surname> <given-names>C.</given-names></name></person-group> (<year>1996</year>). <article-title>Mechanisms of moral disengagement in the exercise of moral agency</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>71</volume>, <fpage>364</fpage>&#x2013;<lpage>374</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-3514.71.2.364</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barlett</surname> <given-names>C. P.</given-names></name> <name><surname>Helmstetter</surname> <given-names>K.</given-names></name> <name><surname>Gentile</surname> <given-names>D. A.</given-names></name></person-group> (<year>2016</year>). <article-title>The development of a new cyberbullying attitude measure</article-title>. <source>Comput. Hum. Behav.</source> <volume>64</volume>, <fpage>906</fpage>&#x2013;<lpage>913</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.chb.2016.08.013</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barli&#x0144;ska</surname> <given-names>J.</given-names></name> <name><surname>Szuster</surname> <given-names>A.</given-names></name> <name><surname>Winiewski</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>Cyberbullying among adolescent bystanders: role of the communication medium, form of violence, and empathy</article-title>. <source>J. Community Appl. Soc. Psychol.</source> <volume>23</volume>, <fpage>37</fpage>&#x2013;<lpage>51</lpage>. doi: <pub-id pub-id-type="doi">10.1002/casp.2137</pub-id></citation></ref>
<ref id="ref800"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barli&#x0144;ska</surname> <given-names>J.</given-names></name> <name><surname>Szuster</surname> <given-names>A.</given-names></name> <name><surname>Winiewski</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Cyberbullying among adolescent bystanders: Role of affective versus cognitive empathy in increasing prosocial cyberbystander behavior</article-title>. <source>Front. Psychol.</source> <volume>9</volume>:<fpage>799</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2018.00799</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Baron-Cohen</surname> <given-names>S.</given-names></name></person-group> (<year>2011</year>). <source>The science of evil: On empathy and the origins of cruelty</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Basic Books</publisher-name>.</citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baron-Cohen</surname> <given-names>S.</given-names></name> <name><surname>Wheelwright</surname> <given-names>S.</given-names></name></person-group> (<year>2004</year>). <article-title>The empathy quotient: an investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences</article-title>. <source>J. Autism Dev. Disord.</source> <volume>34</volume>, <fpage>163</fpage>&#x2013;<lpage>175</lpage>. doi: <pub-id pub-id-type="doi">10.1023/B:JADD.0000022607.19833.00</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>1990</year>). <article-title>Comparative fit indexes in structural models</article-title>. <source>Psychol. Bull.</source> <volume>107</volume>, <fpage>238</fpage>&#x2013;<lpage>246</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0033-2909.107.2.238</pub-id></citation></ref>
<ref id="ref18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bentler</surname> <given-names>P. M.</given-names></name> <name><surname>Bonett</surname> <given-names>D. G.</given-names></name></person-group> (<year>1980</year>). <article-title>Significance tests and goodness of fit in the analysis of covariance structures</article-title>. <source>Psychol. Bull.</source> <volume>88</volume>, <fpage>588</fpage>&#x2013;<lpage>606</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0033-2909.88.3.588</pub-id></citation></ref>
<ref id="ref19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bertrand</surname> <given-names>P.</given-names></name> <name><surname>Guegan</surname> <given-names>J.</given-names></name> <name><surname>Robieux</surname> <given-names>L.</given-names></name> <name><surname>McCall</surname> <given-names>C. A.</given-names></name> <name><surname>Zenasni</surname> <given-names>F.</given-names></name></person-group> (<year>2018</year>). <article-title>Learning empathy through virtual reality: multiple strategies for training empathy-related abilities using body ownership illusions in embodied virtual reality</article-title>. <source>Front. Robot AI</source> <volume>5</volume>. doi: <pub-id pub-id-type="doi">10.3389/frobt.2018.00026</pub-id></citation></ref>
<ref id="ref900"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blanca</surname> <given-names>M. J.</given-names></name> <name><surname>Arnau</surname> <given-names>J.</given-names></name> <name><surname>L&#x00F3;pez-Montiel</surname> <given-names>D.</given-names></name> <name><surname>Bono</surname> <given-names>R.</given-names></name> <name><surname>Bendayan</surname> <given-names>R.</given-names></name></person-group> (<year>2013</year>). <article-title>Skewness and kurtosis in real data samples. Methodology: European</article-title>. <source>J. Res. Method. Behav. Soci. Sci.</source> <volume>9</volume>, <fpage>78</fpage>&#x2013;<lpage>84</lpage>. doi: <pub-id pub-id-type="doi">10.1027/1614-2241/a000057</pub-id></citation></ref>
<ref id="ref20"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Blunch</surname> <given-names>N. J.</given-names></name></person-group> (<year>2008</year>). <source>Introduction to structural equation modelling using SPSS and AMOS.</source> <publisher-name>California: SAGE Publications</publisher-name>.</citation></ref>
<ref id="ref21"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bollen</surname> <given-names>K. A.</given-names></name></person-group> (<year>1989</year>). <source>Structural equations with latent variables</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Wiley</publisher-name></citation></ref>
<ref id="ref22"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bollen</surname> <given-names>K. A.</given-names></name> <name><surname>Long</surname> <given-names>J. S.</given-names></name></person-group> (<year>1993</year>). <source>Testing structural equations models</source>. <publisher-loc>Newbury Park</publisher-loc>: <publisher-name>Sage</publisher-name>.</citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bollen</surname> <given-names>K. A.</given-names></name> <name><surname>Stine</surname> <given-names>R. A.</given-names></name></person-group> (<year>1992</year>). <article-title>Bootstrapping goodness-of-fit measures in structural equation models</article-title>. <source>Sociol. Methods Res.</source> <volume>21</volume>, <fpage>205</fpage>&#x2013;<lpage>229</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0049124192021002004</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>T. A.</given-names></name></person-group> (<year>2006</year>). <source>Confirmatory factor analysis for applied research</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>The Guilford Press</publisher-name>.</citation></ref>
<ref id="ref25"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Browne</surname> <given-names>M. W.</given-names></name> <name><surname>Cudeck</surname> <given-names>R.</given-names></name></person-group> (<year>1993</year>). &#x201C;<article-title>Alternative ways of assessing model fit</article-title>&#x201D; in <source>Testing structural equation models</source>. eds. <person-group person-group-type="editor"><name><surname>Bollen</surname> <given-names>K. A.</given-names></name> <name><surname>Long</surname> <given-names>J. S.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Sage</publisher-name>), <fpage>136</fpage>&#x2013;<lpage>162</lpage>.</citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bussey</surname> <given-names>K.</given-names></name> <name><surname>Fitzpatrick</surname> <given-names>S.</given-names></name> <name><surname>Raman</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>The role of moral disengagement and self-efficacy in cyberbullying</article-title>. <source>J. Sch. Violence</source> <volume>14</volume>, <fpage>30</fpage>&#x2013;<lpage>46</lpage>. doi: <pub-id pub-id-type="doi">10.1080/15388220.2014.954045</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Byrne</surname> <given-names>B. M.</given-names></name></person-group> (<year>2010</year>). <source>Structural equation modeling with AMOS: Basic concepts, applications, and programming</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation></ref>
<ref id="ref28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cameron</surname> <given-names>C. D.</given-names></name> <name><surname>Hutcherson</surname> <given-names>C. A.</given-names></name> <name><surname>Ferguson</surname> <given-names>A. M.</given-names></name> <name><surname>Scheffer</surname> <given-names>J. A.</given-names></name> <name><surname>Hadjiandreou</surname> <given-names>E.</given-names></name> <name><surname>Inzlicht</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Empathy is hard work: people choose to avoid empathy because of its cognitive costs</article-title>. <source>J. Exp. Psychol. Gen.</source> <volume>148</volume>, <fpage>962</fpage>&#x2013;<lpage>976</lpage>. doi: <pub-id pub-id-type="doi">10.1037/xge0000595</pub-id>, PMID: <pub-id pub-id-type="pmid">30998038</pub-id></citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carrier</surname> <given-names>L. M.</given-names></name> <name><surname>Spradlin</surname> <given-names>A.</given-names></name> <name><surname>Bunce</surname> <given-names>J. P.</given-names></name> <name><surname>Rosen</surname> <given-names>L. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Virtual empathy: positive and negative impacts of going online upon empathy in young adults</article-title>. <source>Comput. Hum. Behav.</source> <volume>52</volume>, <fpage>39</fpage>&#x2013;<lpage>48</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.chb.2015.05.026</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cole</surname> <given-names>D. A.</given-names></name></person-group> (<year>1987</year>). <article-title>Utility of confirmatory factor analysis in test validation research</article-title>. <source>J. Consult. Clin. Psychol.</source> <volume>55</volume>, <fpage>584</fpage>&#x2013;<lpage>594</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-006X.55.4.584</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cuadrado-Gordillo</surname> <given-names>I.</given-names></name> <name><surname>Fern&#x00E1;ndez-Antelo</surname> <given-names>I.</given-names></name></person-group> (<year>2019</year>). <article-title>Analysis of moral disengagement as a modulating factor in adolescents&#x2019; perception of cyberbullying</article-title>. <source>Front. Psychol.</source> <volume>10</volume>:<fpage>1222</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2019.01222</pub-id>, PMID: <pub-id pub-id-type="pmid">31191411</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Davis</surname> <given-names>M. H.</given-names></name></person-group> (<year>1980</year>). <article-title>A multidimensional approach to individual differences in empathy</article-title>. <source>JSAS Catal. Sel. Doc. Psychol.</source> <volume>10</volume>:<fpage>85</fpage>.</citation></ref>
<ref id="ref33"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Day</surname> <given-names>S.</given-names></name> <name><surname>Lazuras</surname> <given-names>L.</given-names></name></person-group> (<year>2016</year>). <source>The cyberbullying-specific moral disengagement questionnaire (CBMDQ-15)</source>. Available at: <ext-link xlink:href="https://shura.shu.ac.uk/12890" ext-link-type="uri">https://shura.shu.ac.uk/12890</ext-link></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Depaoli</surname> <given-names>S.</given-names></name> <name><surname>Tiemensma</surname> <given-names>J.</given-names></name> <name><surname>Felt</surname> <given-names>J. M.</given-names></name></person-group> (<year>2018</year>). <article-title>Assessment of health surveys: fitting a multidimensional graded response model</article-title>. <source>Psychol. Health Med.</source> <volume>23</volume>, <fpage>13</fpage>&#x2013;<lpage>31</lpage>. doi: <pub-id pub-id-type="doi">10.1080/13548506.2018.1447136</pub-id>, PMID: <pub-id pub-id-type="pmid">29544349</pub-id></citation></ref>
<ref id="ref1000"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Falla</surname> <given-names>D.</given-names></name> <name><surname>Ortega-Ruiz</surname> <given-names>R.</given-names></name> <name><surname>Runions</surname> <given-names>K.</given-names></name> <name><surname>Romera</surname> <given-names>E. M.</given-names></name></person-group> (<year>2020</year>). <article-title>Why do victims become perpetrators of peer bullying? Moral disengagement in the cycle of violence</article-title>. <source>Youth Society</source> <volume>54</volume>, <fpage>397</fpage>&#x2013;<lpage>418</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0044118X20973702</pub-id></citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Falla</surname> <given-names>D.</given-names></name> <name><surname>Romera</surname> <given-names>E.</given-names></name> <name><surname>Ortega-Ruiz</surname> <given-names>R.</given-names></name></person-group> (<year>2021</year>). <article-title>Aggression, moral disengagement and empathy: a longitudinal study within the interpersonal dynamics of bullying</article-title>. <source>Front. Psychol.</source> <volume>12</volume>:<fpage>703468</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2021.703468</pub-id>, PMID: <pub-id pub-id-type="pmid">34566782</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferrando</surname> <given-names>P. J.</given-names></name> <name><surname>Lorenzo-Seva</surname> <given-names>U.</given-names></name></person-group> (<year>2017</year>). <article-title>Program FACTOR at 10: origins, development and future directions</article-title>. <source>Psicothema</source> <volume>29</volume>, <fpage>236</fpage>&#x2013;<lpage>240</lpage>. doi: <pub-id pub-id-type="doi">10.7334/psicothema2016.304</pub-id>, PMID: <pub-id pub-id-type="pmid">28438248</pub-id></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferrando</surname> <given-names>P. J.</given-names></name> <name><surname>Vigil-Colet</surname> <given-names>A.</given-names></name> <name><surname>Lorenzo-Seva</surname> <given-names>U.</given-names></name></person-group> (<year>2016</year>). <article-title>Practical person-fit assessment with the linear FA model: new developments and a comparative study</article-title>. <source>Front. Psychol.</source> <volume>7</volume>:<lpage>1973</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2016.01973</pub-id>, PMID: <pub-id pub-id-type="pmid">28082929</pub-id></citation></ref>
<ref id="ref1100"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferreira</surname> <given-names>P. C.</given-names></name> <name><surname>Veiga Sim&#x00E3;o</surname> <given-names>A. M.</given-names></name> <name><surname>Paiva</surname> <given-names>A.</given-names></name> <name><surname>Martinho</surname> <given-names>C.</given-names></name> <name><surname>Prada</surname> <given-names>R.</given-names></name> <name><surname>Ferreira</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Exploring empathy in cyberbullying with serious games</article-title>. <source>Computers and Education</source> <volume>166</volume>:<fpage>104155</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.compedu.2021.104155</pub-id></citation></ref>
<ref id="ref38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Festl</surname> <given-names>R.</given-names></name> <name><surname>Vogelgesang</surname> <given-names>J.</given-names></name> <name><surname>Scharkow</surname> <given-names>M.</given-names></name> <name><surname>Quandt</surname> <given-names>T.</given-names></name></person-group> (<year>2017</year>). <article-title>Longitudinal patterns of involvement in cyberbullying: results from a latent transition analysis</article-title>. <source>Comput. Hum. Behav.</source> <volume>66</volume>, <fpage>7</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.chb.2016.09.027</pub-id></citation></ref>
<ref id="ref500"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Francisco</surname> <given-names>S. M.</given-names></name></person-group> (<year>2022</year>). <source>The Role of Moral Disengagement in Cyberbullying</source>. <comment>[Doctoral Dissertation].</comment> <publisher-name>Faculty of Psychology, University of Lisbon</publisher-name>.</citation></ref>
<ref id="ref600"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Francisco</surname> <given-names>S. M.</given-names></name> <name><surname>Ferreira</surname> <given-names>P. C.</given-names></name> <name><surname>Veiga Sim&#x00E3;o</surname> <given-names>A. M.</given-names></name></person-group> (<year>2022</year>). <article-title>Behind the scenes of cyberbullying: personal and normative beliefs across profiles and moral disengagement mechanisms</article-title>. <source>Int. J. Adolescence and Youth</source> <volume>27</volume>, <fpage>337</fpage>&#x2013;<lpage>361</lpage>. doi: <pub-id pub-id-type="doi">10.1080/02673843.2022.2095215</pub-id></citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Francisco</surname> <given-names>S. M.</given-names></name> <name><surname>Veiga Sim&#x00E3;o</surname> <given-names>A. M.</given-names></name> <name><surname>Ferreira</surname> <given-names>P. C.</given-names></name> <name><surname>Martins</surname> <given-names>M. J. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Cyberbullying: the hidden side of college students</article-title>. <source>Comput. Hum. Behav.</source> <volume>43</volume>, <fpage>167</fpage>&#x2013;<lpage>182</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.chb.2014.10.045</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fr&#x00FC;h</surname> <given-names>W.</given-names></name> <name><surname>W&#x00FC;nsch</surname> <given-names>C.</given-names></name></person-group> (<year>2009</year>). <article-title>Empathie und medienempathie</article-title>. <source>Publizistik</source> <volume>54</volume>, <fpage>191</fpage>&#x2013;<lpage>215</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11616-009-0038-9</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fuchs</surname> <given-names>T.</given-names></name></person-group> (<year>2014</year>). <article-title>The virtual other: empathy in the age of virtuality</article-title>. <source>J. Conscious. Stud.</source> <volume>21</volume>, <fpage>152</fpage>&#x2013;<lpage>173</lpage>.</citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gantiva</surname> <given-names>C.</given-names></name> <name><surname>Sotaquir&#x00E1;</surname> <given-names>M.</given-names></name> <name><surname>Araujo</surname> <given-names>A.</given-names></name> <name><surname>Cuervo</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). <article-title>Cortical processing of human and emoji faces: an ERP analysis</article-title>. <source>Behav Inform Technol</source> <volume>39</volume>, <fpage>935</fpage>&#x2013;<lpage>943</lpage>. doi: <pub-id pub-id-type="doi">10.1080/0144929X.2019.1632933</pub-id></citation></ref>
<ref id="ref700"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gao</surname> <given-names>L.</given-names></name> <name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Yang</surname> <given-names>J.</given-names></name> <name><surname>Wang</surname> <given-names>P.</given-names></name> <name><surname>Wang</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Moral disengagement and adolescents&#x2019; cyberbullying perpetration: Student relationship and gender as moderators</article-title>. <source>Children of Youth Services Rev.</source> <volume>116</volume>:<fpage>105119</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.childyouth.2020.105119</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garaigordobil</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Psychometric properties of the cyberbullying test: a screening instrument to measure cybervictimization, cyberaggression and cyberobservation</article-title>. <source>J. Interpers. Violence</source> <volume>32</volume>, <fpage>3556</fpage>&#x2013;<lpage>3576</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0886260515600165</pub-id>, PMID: <pub-id pub-id-type="pmid">26289455</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garc&#x00ED;a-P&#x00E9;rez</surname> <given-names>R.</given-names></name> <name><surname>Santos-Delgado</surname> <given-names>J. M.</given-names></name> <name><surname>Buz&#x00F3;n-Garc&#x00ED;a</surname> <given-names>O.</given-names></name></person-group> (<year>2016</year>). <article-title>Virtual empathy as digital competence in education 3.0. International journal of educational technology</article-title>. <source>High. Educ.</source> <volume>13</volume>, <fpage>1</fpage>&#x2013;<lpage>10</lpage>. doi: <pub-id pub-id-type="doi">10.1186/s41239-016-0029-7</pub-id></citation></ref>
<ref id="ref45"><citation citation-type="book"><person-group person-group-type="author"><name><surname>George</surname> <given-names>D.</given-names></name> <name><surname>Mallery</surname> <given-names>P.</given-names></name></person-group> (<year>2016</year>). <source>IBM SPSS statistics 23 step by step: A simple guide and reference (13th ed.)</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gerdes</surname> <given-names>K. E.</given-names></name> <name><surname>Segal</surname> <given-names>E. A.</given-names></name> <name><surname>Lietz</surname> <given-names>C. A.</given-names></name></person-group> (<year>2010</year>). <article-title>Conceptualising and measuring empathy</article-title>. <source>Br. J. Soc. Work.</source> <volume>40</volume>, <fpage>2326</fpage>&#x2013;<lpage>2343</lpage>. doi: <pub-id pub-id-type="doi">10.1093/bjsw/bcq048</pub-id></citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gorostiaga</surname> <given-names>A.</given-names></name> <name><surname>Balluerka</surname> <given-names>N.</given-names></name> <name><surname>Soroa</surname> <given-names>G.</given-names></name></person-group> (<year>2014</year>). <article-title>Assessment of empathy in educational field and its relationship with emotional intelligence</article-title>. <source>Revist. Educ.</source> <volume>364</volume>, <fpage>12</fpage>&#x2013;<lpage>38</lpage>.</citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haddock</surname> <given-names>A. D.</given-names></name> <name><surname>Jimerson</surname> <given-names>S. R.</given-names></name></person-group> (<year>2017</year>). <article-title>An examination of differences in moral disengagement and empathy among bullying participant groups</article-title>. <source>J. Relat. Res.</source> <volume>8</volume>, <fpage>1</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1017/jrr.2017.15</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hair</surname> <given-names>J. F.</given-names></name> <name><surname>Black</surname> <given-names>W. C.</given-names></name> <name><surname>Babin</surname> <given-names>B. J.</given-names></name> <name><surname>Anderson</surname> <given-names>R. E.</given-names></name></person-group> (<year>2014</year>). <source>Multivariate data analysis: Pearson new international edition</source>. <publisher-loc>Essex</publisher-loc>: <publisher-name>Pearson Education Limited</publisher-name>.</citation></ref>
<ref id="ref50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hall</surname> <given-names>J. A.</given-names></name> <name><surname>Schwartz</surname> <given-names>R.</given-names></name></person-group> (<year>2019</year>). <article-title>Empathy present and future</article-title>. <source>J. Soc. Psychol.</source> <volume>159</volume>, <fpage>225</fpage>&#x2013;<lpage>243</lpage>. doi: <pub-id pub-id-type="doi">10.1080/00224545.2018.1477442</pub-id></citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Happ</surname> <given-names>C.</given-names></name> <name><surname>Pfetsch</surname> <given-names>J.</given-names></name></person-group> (<year>2015</year>). <article-title>Medienbasierte Empathie (MBE)</article-title>. <source>Diagnostica</source> <volume>62</volume>, <fpage>1</fpage>&#x2013;<lpage>16</lpage>. doi: <pub-id pub-id-type="doi">10.1026/0012-1924/a000152</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hayes</surname> <given-names>A. F.</given-names></name> <name><surname>Coutts</surname> <given-names>J. J.</given-names></name></person-group> (<year>2020</year>). <article-title>Use omega rather than Cronbach's alpha for estimating reliability</article-title>. <source>But. Commun. Methods Measur.</source> <volume>14</volume>, <fpage>1</fpage>&#x2013;<lpage>24</lpage>. doi: <pub-id pub-id-type="doi">10.1080/19312458.2020.1718629</pub-id></citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hayton</surname> <given-names>J. C.</given-names></name> <name><surname>Allen</surname> <given-names>D. G.</given-names></name> <name><surname>Scarpello</surname> <given-names>V.</given-names></name></person-group> (<year>2004</year>). <article-title>Factor retention decisions in exploratory factor analysis: a tutorial on parallel analysis</article-title>. <source>Organ. Res. Methods</source> <volume>7</volume>, <fpage>191</fpage>&#x2013;<lpage>205</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1094428104263675</pub-id></citation></ref>
<ref id="ref54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Henseler</surname> <given-names>J.</given-names></name> <name><surname>Ringle</surname> <given-names>C. M.</given-names></name> <name><surname>Sinkovics</surname> <given-names>R. R.</given-names></name></person-group> (<year>2009</year>). <article-title>The use of partial least squares path modeling in international marketing</article-title>. <source>Adv. Int. Mark.</source> <volume>20</volume>, <fpage>277</fpage>&#x2013;<lpage>319</lpage>. doi: <pub-id pub-id-type="doi">10.1108/S1474-7979(2009)0000020014</pub-id></citation></ref>
<ref id="ref55"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hinduja</surname> <given-names>S.</given-names></name> <name><surname>Patchin</surname> <given-names>J. W.</given-names></name></person-group> (<year>2009</year>). <source>Bullying beyond the schoolyard: Preventing and responding to cyberbullying</source>. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage Publications</publisher-name>.</citation></ref>
<ref id="ref56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hyde</surname> <given-names>L. W.</given-names></name> <name><surname>Shaw</surname> <given-names>D. S.</given-names></name> <name><surname>Moilanen</surname> <given-names>K. L.</given-names></name></person-group> (<year>2010</year>). <article-title>Developmental precursors of moral disengagement and the role of moral disengagement in the development of antisocial behavior</article-title>. <source>J. Abnorm. Child Psychol.</source> <volume>38</volume>, <fpage>197</fpage>&#x2013;<lpage>209</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10802-009-9358-5</pub-id>, PMID: <pub-id pub-id-type="pmid">19777337</pub-id></citation></ref>
<ref id="ref58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ilgunaite</surname> <given-names>G.</given-names></name> <name><surname>Giromini</surname> <given-names>L.</given-names></name> <name><surname>Di Girolamo</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>Measuring empathy: a literature review of available tools</article-title>. <source>Appl. Psychol. Bull.</source> <volume>65</volume>, <fpage>2</fpage>&#x2013;<lpage>28</lpage>.</citation></ref>
<ref id="ref59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jolliffe</surname> <given-names>D.</given-names></name> <name><surname>Farrington</surname> <given-names>D. P.</given-names></name></person-group> (<year>2006</year>). <article-title>Development and validation of the basic empathy scale</article-title>. <source>J. Adolesc.</source> <volume>29</volume>, <fpage>589</fpage>&#x2013;<lpage>611</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.adolescence.2005.08.010</pub-id></citation></ref>
<ref id="ref60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>J&#x00F6;reskog</surname> <given-names>K. G.</given-names></name> <name><surname>S&#x00F6;rbom</surname> <given-names>D.</given-names></name></person-group> (<year>1982</year>). <article-title>Recent developments in structural equation modeling</article-title>. <source>J. Mark. Res.</source> <volume>19</volume>, <fpage>404</fpage>&#x2013;<lpage>416</lpage>. doi: <pub-id pub-id-type="doi">10.1177/002224378201900402</pub-id></citation></ref>
<ref id="ref61"><citation citation-type="book"><person-group person-group-type="author"><name><surname>J&#x00F6;reskog</surname> <given-names>K. G.</given-names></name> <name><surname>S&#x00F6;rbom</surname> <given-names>D.</given-names></name></person-group> (<year>1984</year>). <source>Advances in factor analysis and structural equation models</source>. <publisher-loc>Lanham</publisher-loc>: <publisher-name>Rowman &#x0026; Littlefield Publishers</publisher-name>.</citation></ref>
<ref id="ref62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kanyongo</surname> <given-names>G. Y.</given-names></name></person-group> (<year>2005</year>). <article-title>Determining the correct number of components to extract from a principal components analysis: a Monte Carlo study of the accuracy of the scree plot</article-title>. <source>J. Mod. Appl. Stat. Methods</source> <volume>4</volume>, <fpage>120</fpage>&#x2013;<lpage>133</lpage>. doi: <pub-id pub-id-type="doi">10.22237/jmasm/1114906380</pub-id></citation></ref>
<ref id="ref63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klimecki</surname> <given-names>O. M.</given-names></name></person-group> (<year>2019</year>). <article-title>The role of empathy and compassion in conflict resolution</article-title>. <source>Emot. Rev.</source> <volume>11</volume>, <fpage>310</fpage>&#x2013;<lpage>325</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1754073919838609</pub-id></citation></ref>
<ref id="ref64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kowalski</surname> <given-names>R. M.</given-names></name> <name><surname>Giumetti</surname> <given-names>G. W.</given-names></name> <name><surname>Schroeder</surname> <given-names>A. N.</given-names></name> <name><surname>Lattanner</surname> <given-names>M. R.</given-names></name></person-group> (<year>2014</year>). <article-title>Bullying in the digital age: a critical review and meta-analysis of cyberbullying research among youth</article-title>. <source>Psychol. Bull.</source> <volume>140</volume>, <fpage>1073</fpage>&#x2013;<lpage>1137</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0035618</pub-id>, PMID: <pub-id pub-id-type="pmid">24512111</pub-id></citation></ref>
<ref id="ref65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lo Cricchio</surname> <given-names>M. G.</given-names></name> <name><surname>Garc&#x00ED;a-Poole</surname> <given-names>C.</given-names></name> <name><surname>Te Brinke</surname> <given-names>L. W.</given-names></name> <name><surname>Bianchi</surname> <given-names>D.</given-names></name> <name><surname>Menesini</surname> <given-names>E.</given-names></name></person-group> (<year>2020</year>). <article-title>Moral disengagement and cyberbullying involvement: a systematic review</article-title>. <source>Eur. J. Dev. Psychol.</source> <volume>18</volume>, <fpage>271</fpage>&#x2013;<lpage>311</lpage>. doi: <pub-id pub-id-type="doi">10.1080/17405629.2020.1782186</pub-id></citation></ref>
<ref id="ref66"><citation citation-type="book"><person-group person-group-type="author"><name><surname>L&#x00F3;pez-P&#x00E9;rez</surname> <given-names>B.</given-names></name> <name><surname>Fern&#x00E1;ndez-Pinto</surname> <given-names>I.</given-names></name> <name><surname>Abad</surname> <given-names>F. J.</given-names></name></person-group> (<year>2008</year>). <source>TECA. Test de Empat&#x00ED;a Cognitiva y Afectiva</source>. <publisher-loc>Madrid</publisher-loc>: <publisher-name>Tea Ediciones, S.A.</publisher-name></citation></ref>
<ref id="ref67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lorenzo-Seva</surname> <given-names>U.</given-names></name> <name><surname>Ferrando</surname> <given-names>P. J.</given-names></name></person-group> (<year>2019</year>). <article-title>Robust promin: a method for diagonally weighted factor rotation</article-title>. <source>Rev. Peruana Psicol.</source> <volume>25</volume>, <fpage>99</fpage>&#x2013;<lpage>106</lpage>. doi: <pub-id pub-id-type="doi">10.24265/liberabit.2019.v25n1.08</pub-id></citation></ref>
<ref id="ref68"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Macaula</surname> <given-names>P.</given-names></name> <name><surname>Boulton</surname> <given-names>M. J.</given-names></name></person-group> (<year>2017</year>). <article-title>Adolescent bystander responses to offline and online bullying: The role of bullying severity and empathy</article-title>, <conf-name>In proceedings of the 22nd annual CyberPsychology, Cyber Therapy &#x0026; Social Networking Conference</conf-name>, <conf-loc>University of Wolverhampton, Wolverhampton</conf-loc>.</citation></ref>
<ref id="ref69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manasia</surname> <given-names>L.</given-names></name> <name><surname>Chicioreanu</surname> <given-names>T. D.</given-names></name></person-group> (<year>2017</year>). <article-title>Does the internet shape our mind? The case of virtual empathy in future teachers</article-title>. <source>eLearn. Softw. Educ.</source> <volume>2</volume>, <fpage>397</fpage>&#x2013;<lpage>404</lpage>. doi: <pub-id pub-id-type="doi">10.12753/2066-026X-17-141</pub-id></citation></ref>
<ref id="ref70"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Mar&#x00ED;n-L&#x00F3;pez</surname> <given-names>I.</given-names></name> <name><surname>Zych</surname> <given-names>I.</given-names></name> <name><surname>Ortega-Ruiz</surname> <given-names>R.</given-names></name> <name><surname>Monks</surname> <given-names>C.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Validaci&#x00F3;n y propiedades psicom&#x00E9;tricas del Cuestionario de Empat&#x00ED;a Online y el Cuestionario de Desconexi&#x00F3;n Moral a trav&#x00E9;s de las Tecnolog&#x00ED;as</article-title>&#x201D; in <source>Creando Redes Doctorales Vol. VII &#x201C;Investiga y Comunica&#x201D;</source>. eds. <person-group person-group-type="editor"><name><surname>Chica P&#x00E9;rez</surname> <given-names>A. F.</given-names></name> <name><surname>M&#x00E9;rida Garc&#x00ED;a</surname> <given-names>J.</given-names></name></person-group> (<publisher-loc>C&#x00F3;rdoba, Spain</publisher-loc>: <publisher-name>UCOPress</publisher-name>), <fpage>525</fpage>&#x2013;<lpage>528</lpage>.</citation></ref>
<ref id="ref71"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mar&#x00ED;n-L&#x00F3;pez</surname> <given-names>I.</given-names></name> <name><surname>Zych</surname> <given-names>I.</given-names></name> <name><surname>Ortega-Ruiz</surname> <given-names>R.</given-names></name> <name><surname>Monks</surname> <given-names>C. P.</given-names></name> <name><surname>Llorent</surname> <given-names>V. J.</given-names></name></person-group> (<year>2020</year>). <article-title>Empathy online and moral disengagement through technology as longitudinal predictors of cyberbullying victimization and perpetration</article-title>. <source>Child Youth Serv. Rev.</source> <volume>116</volume>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>.</citation></ref>
<ref id="ref72"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Mar&#x00F4;co</surname> <given-names>J.</given-names></name></person-group> (<year>2014</year>). <source>An&#x00E1;lise de equa&#x00E7;&#x00F5;es estruturais: Fundamentos te&#x00F3;ricos, software e aplica&#x00E7;&#x00F5;es</source> <edition>(2nd)</edition>. <publisher-loc>Pero Pinheiro</publisher-loc>: <publisher-name>Structural Equation Analysis: Theoretical Foundations, Software and Applications</publisher-name>.</citation></ref>
<ref id="ref73"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Matteucci</surname> <given-names>M.</given-names></name> <name><surname>Stracqualursi</surname> <given-names>L.</given-names></name></person-group> (<year>2006</year>). <article-title>Student assessment via graded response model</article-title>. <source>Statistica</source> <volume>66</volume>, <fpage>435</fpage>&#x2013;<lpage>447</lpage>.</citation></ref>
<ref id="ref74"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mazzone</surname> <given-names>A.</given-names></name> <name><surname>Yanagida</surname> <given-names>T.</given-names></name> <name><surname>Caravita</surname> <given-names>S. C. S.</given-names></name> <name><surname>Strohmeier</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Moral emotions and moral disengagement: concurrent and longitudinal associations with aggressive behavior among early adolescents</article-title>. <source>J. Early Adolesc.</source> <volume>39</volume>, <fpage>839</fpage>&#x2013;<lpage>863</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0272431618791276</pub-id></citation></ref>
<ref id="ref75"><citation citation-type="book"><person-group person-group-type="author"><name><surname>McDonald</surname> <given-names>R. P.</given-names></name></person-group> (<year>1999</year>). <source>Test theory: A unified treatment</source>. <publisher-loc>Mahwah, NJ</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates</publisher-name>.</citation></ref>
<ref id="ref1200"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McGraw</surname> <given-names>K. O.</given-names></name> <name><surname>Wong</surname> <given-names>S. P.</given-names></name></person-group> (<year>1996</year>). <article-title>Forming inferences about some intraclass correlation coefficients</article-title>. <source>Psychol. Meth.</source> <volume>1</volume>, <fpage>30</fpage>&#x2013;<lpage>46</lpage>. doi: <pub-id pub-id-type="doi">10.1037/1082-989X.1.1.30</pub-id></citation></ref>
<ref id="ref1300"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meter</surname> <given-names>D. J.</given-names></name> <name><surname>Bauman</surname> <given-names>S.</given-names></name></person-group> (<year>2018</year>). <article-title>Moral disengagement about cyberbullying and parental monitoring: effects on traditional bullying and victimization via cyberbullying involvement</article-title>. <source>J. Early Adoles.</source> <volume>38</volume>, <fpage>303</fpage>&#x2013;<lpage>326</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0272431616670752</pub-id></citation></ref>
<ref id="ref76"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Muth&#x00E9;n</surname> <given-names>B.</given-names></name> <name><surname>du Toit</surname> <given-names>S.H.C.</given-names></name> <name><surname>Spisic</surname> <given-names>D.</given-names></name></person-group> (<year>1997</year>). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Unpublished technical report.</citation></ref>
<ref id="ref77"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Muth&#x00E9;n</surname> <given-names>B.</given-names></name> <name><surname>Kaplan</surname> <given-names>D.</given-names></name></person-group> (<year>1985</year>). <article-title>A comparison of some methodologies for the factor analysis of non-normal Likert variables</article-title>. <source>Br. J. Math. Stat. Psychol.</source> <volume>38</volume>, <fpage>171</fpage>&#x2013;<lpage>189</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.2044-8317.1985.tb00832.x</pub-id></citation></ref>
<ref id="ref1500"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x2019;Connor</surname> <given-names>B. P.</given-names></name></person-group> (<year>2000</year>). <article-title>SPSS and SAS programs for determining the number of components using parallel analysis and Velicer&#x2019;s MAP test</article-title>. <source><italic>Behav. Res.</italic><italic>Method. Instru. Comput.</italic></source> <volume>32</volume>, <fpage>396</fpage>&#x2013;<lpage>402</lpage>.</citation></ref>
<ref id="ref78"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x2019;Neil</surname> <given-names>B.</given-names></name></person-group> (<year>2013</year>). <article-title>Mirror, mirror on the screen, what does all this ASCII mean?: a pilot study of spontaneous facial mirroring of emotions</article-title>. <source>Arbutus Rev</source> <volume>4</volume>, <fpage>19</fpage>&#x2013;<lpage>44</lpage>. doi: <pub-id pub-id-type="doi">10.18357/tar41201312681</pub-id></citation></ref>
<ref id="ref79"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Osler</surname> <given-names>L.</given-names></name></person-group> (<year>2021</year>). <article-title>Taking empathy online</article-title>. <source>Inquiry</source>, <fpage>1</fpage>&#x2013;<lpage>28</lpage>. doi: <pub-id pub-id-type="doi">10.1080/0020174X.2021.1899045</pub-id></citation></ref>
<ref id="ref80"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paciello</surname> <given-names>M.</given-names></name> <name><surname>Tramontano</surname> <given-names>C.</given-names></name> <name><surname>Nocentini</surname> <given-names>A.</given-names></name> <name><surname>Fida</surname> <given-names>R.</given-names></name> <name><surname>Menesini</surname> <given-names>E.</given-names></name></person-group> (<year>2020</year>). <article-title>The role of traditional and online moral disengagement on cyberbullying: do externalising problems make any difference?</article-title> <source>Comput. Hum. Behav.</source> <volume>103</volume>, <fpage>190</fpage>&#x2013;<lpage>198</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.chb.2019.09.024</pub-id></citation></ref>
<ref id="ref81"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pfetsch</surname> <given-names>J. S.</given-names></name></person-group> (<year>2017</year>). <article-title>Empathic skills and cyberbullying: relationship of different measures of empathy to cyberbullying in comparison to offline bullying among young adults</article-title>. <source>J. Genet. Psychol.</source> <volume>178</volume>, <fpage>58</fpage>&#x2013;<lpage>72</lpage>. doi: <pub-id pub-id-type="doi">10.1080/00221325.2016.1256155</pub-id>, PMID: <pub-id pub-id-type="pmid">28121287</pub-id></citation></ref>
<ref id="ref1700"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Preece</surname> <given-names>J.</given-names></name></person-group> (<year>1999</year>). <article-title>Empathy online</article-title>. <source>Virtual Reality</source> <volume>4</volume>, <fpage>74</fpage>&#x2013;<lpage>84</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF01434996</pub-id></citation></ref>
<ref id="ref82"><citation citation-type="book"><person-group person-group-type="author"><collab id="coll3">R Core Team</collab></person-group>. (<year>2020</year>). <source>R: A language and environment for statistical computing</source>. <publisher-loc>Vienna</publisher-loc>: <publisher-name>R Foundation for Statistical Computing</publisher-name></citation></ref>
<ref id="ref83"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reckase</surname> <given-names>M. D.</given-names></name></person-group> (<year>1985</year>). <article-title>The difficulty of test items that measure more than one ability</article-title>. <source>Appl. Psychol. Meas.</source> <volume>9</volume>, <fpage>401</fpage>&#x2013;<lpage>412</lpage>. doi: <pub-id pub-id-type="doi">10.1177/014662168500900409</pub-id></citation></ref>
<ref id="ref84"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Redondo</surname> <given-names>I.</given-names></name> <name><surname>Herrero-Fern&#x00E1;ndez</surname> <given-names>D.</given-names></name></person-group> (<year>2018</year>). <article-title>Adaptaci&#x00F3;n del Empathy Quotient (EQ) en una muestra espa&#x00F1;ola</article-title>. <source>Terapia Psicol</source> <volume>36</volume>, <fpage>81</fpage>&#x2013;<lpage>89</lpage>. doi: <pub-id pub-id-type="doi">10.4067/S0718-48082018000200081</pub-id></citation></ref>
<ref id="ref85"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rodrigues</surname> <given-names>J.</given-names></name> <name><surname>Lopes</surname> <given-names>A.</given-names></name> <name><surname>Giger</surname> <given-names>J.-C.</given-names></name> <name><surname>Gomes</surname> <given-names>A.</given-names></name> <name><surname>Santos</surname> <given-names>J.</given-names></name> <name><surname>Gon&#x00E7;alves</surname> <given-names>G.</given-names></name></person-group> (<year>2011</year>). <article-title>Escalas de medi&#x00E7;&#x00E3;o do Quociente de Empatia/Sistematiza&#x00E7;&#x00E3;o: Um ensaio de valida&#x00E7;&#x00E3;o para a popula&#x00E7;&#x00E3;o portuguesa</article-title>. <source>Psicologia</source> <volume>25</volume>, <fpage>73</fpage>&#x2013;<lpage>89</lpage>. doi: <pub-id pub-id-type="doi">10.17575/rpsicol.v25i1.280</pub-id></citation></ref>
<ref id="ref86"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Romera</surname> <given-names>E. M.</given-names></name> <name><surname>Ortega-Ruiz</surname> <given-names>R.</given-names></name> <name><surname>Runions</surname> <given-names>K.</given-names></name> <name><surname>Falla</surname> <given-names>D.</given-names></name></person-group> (<year>2021</year>). <article-title>Moral disengagement strategies in online and offline bullying</article-title>. <source>Psychosoc. Interv.</source> <volume>30</volume>, <fpage>85</fpage>&#x2013;<lpage>93</lpage>. doi: <pub-id pub-id-type="doi">10.5093/pi2020a21</pub-id></citation></ref>
<ref id="ref87"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosseel</surname> <given-names>Y.</given-names></name></person-group> (<year>2012</year>). <article-title>Lavaan: an R package for structural equation modeling</article-title>. <source>J. Stat. Softw.</source> <volume>48</volume>, <fpage>1</fpage>&#x2013;<lpage>36</lpage>. doi: <pub-id pub-id-type="doi">10.18637/jss.v048.i02</pub-id></citation></ref>
<ref id="ref88"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Runions</surname> <given-names>K. C.</given-names></name> <name><surname>Bak</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Online moral disengagement, cyberbullying, and cyber-aggression</article-title>. <source>Cyberpsychol. Behav. Soc. Netw.</source> <volume>18</volume>, <fpage>400</fpage>&#x2013;<lpage>405</lpage>. doi: <pub-id pub-id-type="doi">10.1089/cyber.2014.0670</pub-id>, PMID: <pub-id pub-id-type="pmid">26167839</pub-id></citation></ref>
<ref id="ref11000"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Samejima</surname> <given-names>F.</given-names></name></person-group> (<year>1969</year>). <article-title>Estimation of Latent Ability Using a Response Pattern of Graded Scores</article-title>. <source>Psychometrika</source> <volume>34</volume>, <fpage>1</fpage>&#x2013;<lpage>97</lpage>. doi: <pub-id pub-id-type="doi">10.1007/BF03372160</pub-id></citation></ref>
<ref id="ref89"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schultze-Krumbholz</surname> <given-names>A.</given-names></name> <name><surname>Hess</surname> <given-names>M.</given-names></name> <name><surname>Pfetsch</surname> <given-names>J.</given-names></name> <name><surname>Scheithauer</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). <article-title>Who is involved in cyberbullying? Latent class analysis of cyberbullying roles and their associations with aggression, self-esteem, and empathy</article-title>. <source>J. Psychosocial Res. Cyberspace</source> <volume>12</volume>. doi: <pub-id pub-id-type="doi">10.5817/CP2018-4-2</pub-id></citation></ref>
<ref id="ref90"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>P. K.</given-names></name> <name><surname>Slonje</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). &#x201C;<article-title>Cyberbullying: the nature and extent of a new kind of bullying, in and out of school</article-title>&#x201D; in <source>In handbook of bullying in schools: an international perspective</source>. eds. <person-group person-group-type="editor"><name><surname>Jimerson</surname> <given-names>S. R.</given-names></name> <name><surname>Swearer</surname> <given-names>S. M.</given-names></name> <name><surname>Espelage</surname> <given-names>D. L.</given-names></name></person-group> (<publisher-name>Routledge</publisher-name>)</citation></ref>
<ref id="ref1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Suler</surname> <given-names>J.</given-names></name></person-group> (<year>2004</year>). <article-title>The online disinhibition effect</article-title>. <source>Cycberpsychol. Behav.</source> <volume>7</volume>, <fpage>321</fpage>&#x2013;<lpage>326</lpage>. doi: <pub-id pub-id-type="doi">10.1089/1094931041291295</pub-id></citation></ref>
<ref id="ref91"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tampke</surname> <given-names>E. C.</given-names></name> <name><surname>Fite</surname> <given-names>P. J.</given-names></name> <name><surname>Cooley</surname> <given-names>J. L.</given-names></name></person-group> (<year>2020</year>). <article-title>Bidirectional associations between affective empathy and proactive and reactive aggression</article-title>. <source>Aggress. Behav.</source> <volume>46</volume>, <fpage>317</fpage>&#x2013;<lpage>326</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ab.21891</pub-id>, PMID: <pub-id pub-id-type="pmid">32227484</pub-id></citation></ref>
<ref id="ref92"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Terry</surname> <given-names>C.</given-names></name> <name><surname>Cain</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>The emerging issue of digital empathy</article-title>. <source>Am. J. Pharm. Educ.</source> <volume>80</volume>:<fpage>58</fpage>. doi: <pub-id pub-id-type="doi">10.5688/ajpe80458</pub-id>, PMID: <pub-id pub-id-type="pmid">27293225</pub-id></citation></ref>
<ref id="ref93"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thornberg</surname> <given-names>R.</given-names></name> <name><surname>Jungert</surname> <given-names>T.</given-names></name></person-group> (<year>2014</year>). <article-title>School bullying and the mechanisms of moral disengagement</article-title>. <source>Aggress. Behav.</source> <volume>40</volume>, <fpage>99</fpage>&#x2013;<lpage>108</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ab.21509</pub-id>, PMID: <pub-id pub-id-type="pmid">24496999</pub-id></citation></ref>
<ref id="ref1400"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thornberg</surname> <given-names>R.</given-names></name> <name><surname>W&#x00E4;nstr&#x00F6;m</surname> <given-names>L.</given-names></name> <name><surname>Pozzoli</surname> <given-names>T.</given-names></name> <name><surname>Hong</surname> <given-names>J. S.</given-names></name></person-group> (<year>2019</year>). <article-title>Moral disengagement and school bullying perpetration in middle childhood: A short-term longitudinal study in Sweden</article-title>. <source>J. School Viol.</source> <volume>18</volume>, <fpage>585</fpage>&#x2013;<lpage>596</lpage>. doi: <pub-id pub-id-type="doi">10.1080/15388220.2019.1636383</pub-id></citation></ref>
<ref id="ref94"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tillman</surname> <given-names>C.</given-names></name> <name><surname>Gonzalez</surname> <given-names>K.</given-names></name> <name><surname>Whitman</surname> <given-names>M. V.</given-names></name> <name><surname>Crawford</surname> <given-names>W. S.</given-names></name> <name><surname>Hood</surname> <given-names>A. C.</given-names></name></person-group> (<year>2018</year>). <article-title>A multi-functional view of moral disengagement: exploring the effects of learning the consequences</article-title>. <source>Front. Psychol.</source> <volume>8</volume>, <fpage>1</fpage>&#x2013;<lpage>14</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2017.02286</pub-id></citation></ref>
<ref id="ref95"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Timmerman</surname> <given-names>M. E.</given-names></name> <name><surname>Lorenzo-Seva</surname> <given-names>U.</given-names></name></person-group> (<year>2011</year>). <article-title>Dimensionality assessment of ordered polytomous items with parallel analysis</article-title>. <source>Psychol. Methods</source> <volume>16</volume>, <fpage>209</fpage>&#x2013;<lpage>220</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0023353</pub-id>, PMID: <pub-id pub-id-type="pmid">21500916</pub-id></citation></ref>
<ref id="ref96"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wakabayashi</surname> <given-names>A.</given-names></name> <name><surname>Baron-Cohen</surname> <given-names>S.</given-names></name> <name><surname>Wheelwright</surname> <given-names>S.</given-names></name> <name><surname>Goldenfeld</surname> <given-names>N.</given-names></name> <name><surname>Delaney</surname> <given-names>J.</given-names></name> <name><surname>Fine</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2006</year>). <article-title>Development of short forms of the empathy quotient (EQ-short) and the systemizing quotient (SQ-short)</article-title>. <source>Personal. Individ. Differ.</source> <volume>41</volume>, <fpage>929</fpage>&#x2013;<lpage>940</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.paid.2006.03.017</pub-id></citation></ref>
<ref id="ref97"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walther</surname> <given-names>J. B.</given-names></name></person-group> (<year>1992</year>). <article-title>Interpersonal effects in computer-mediated interaction: a relational perspective</article-title>. <source>Commun. Res.</source> <volume>19</volume>, <fpage>52</fpage>&#x2013;<lpage>90</lpage>. doi: <pub-id pub-id-type="doi">10.1177/009365092019001003</pub-id></citation></ref>
<ref id="ref98"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walther</surname> <given-names>J.</given-names></name></person-group> (<year>1995</year>). <article-title>Relational aspects of computer-mediated communication</article-title>. <source>Organ. Sci.</source> <volume>6</volume>, <fpage>186</fpage>&#x2013;<lpage>203</lpage>. doi: <pub-id pub-id-type="doi">10.1287/orsc.6.2.186</pub-id></citation></ref>
<ref id="ref99"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walther</surname> <given-names>J. B.</given-names></name></person-group> (<year>2015</year>). <article-title>&#x201C;Social information processing theory (CMC)&#x201D;</article-title> in <source>The International Encyclopedia of Interpersonal Communication</source>. eds. C. R. Berger, M. E. Roloff, S. R. Wilson, J. P. Dillard, J. Caughlin and D. Solomon. <fpage>1</fpage>&#x2013;<lpage>13</lpage>.</citation></ref>
<ref id="ref1600"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Goldberg</surname> <given-names>T. S.</given-names></name></person-group> (<year>2017</year>). <article-title>Using children&#x2019;s literature to decrease moral disengagement and victimization among elementary school students</article-title>. <source>Psychol. Schools</source> <volume>54</volume>, <fpage>918</fpage>&#x2013;<lpage>931</lpage>. doi: <pub-id pub-id-type="doi">10.1002/pits.22042</pub-id></citation></ref>
<ref id="ref100"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Woods</surname> <given-names>C. M.</given-names></name></person-group> (<year>2006</year>). <article-title>Careless responding to reverse-worded items: implications for confirmatory factor analysis</article-title>. <source>J. Psychopathol. Behav. Assess.</source> <volume>28</volume>, <fpage>186</fpage>&#x2013;<lpage>191</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10862-005-9004-7</pub-id></citation></ref>
<ref id="ref101"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yuan</surname> <given-names>K. H.</given-names></name> <name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>1998</year>). <article-title>Structural equation modeling with robust Covariances</article-title>. <source>Sociol. Methodol.</source> <volume>28</volume>, <fpage>363</fpage>&#x2013;<lpage>396</lpage>. doi: <pub-id pub-id-type="doi">10.1111/0081-1750.00052</pub-id></citation></ref>
<ref id="ref102"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>L.</given-names></name> <name><surname>Yu</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>A meta-analytic review of moral disengagement and cyberbullying</article-title>. <source>Front. Psychol.</source> <volume>12</volume>:<fpage>681299</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2021.681299</pub-id>, PMID: <pub-id pub-id-type="pmid">34916984</pub-id></citation></ref>
<ref id="ref1800"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhu</surname> <given-names>C.</given-names></name> <name><surname>Huang</surname> <given-names>S.</given-names></name> <name><surname>Evans</surname> <given-names>R.</given-names></name> <name><surname>Zhang</surname> <given-names>W.</given-names></name></person-group> (<year>2021</year>). <article-title>Cyberbullying among adolescents and children: A comprehensive review of the global situation, risk factors, and preventive measures</article-title>. <source>Front. Public Health.</source> <volume>9</volume>:<fpage>634909</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpubh.2021.634909</pub-id></citation></ref>
<ref id="ref103"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zwick</surname> <given-names>R. W.</given-names></name> <name><surname>Velicer</surname> <given-names>F. V.</given-names></name></person-group> (<year>1986</year>). <article-title>Comparison of five rules for determining the number of components to retain</article-title>. <source>Psychol. Bull.</source> <volume>99</volume>, <fpage>432</fpage>&#x2013;<lpage>442</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0033-2909.99.3.432</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn0004"><p><sup>1</sup>Unstandardized path coefficients and corresponding significant statistics were not available for ULS, thus, we present values from the ML with Bollen-Stine Bootstrap.</p></fn></fn-group>
</back>
</article>