<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2018.00253</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Being Bullied in Virtual Environments: Experiences and Reactions of Male and Female Students to a Male or Female Oppressor</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Kr&#x00E4;mer</surname> <given-names>Nicole</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/353980/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Sobieraj</surname> <given-names>Sabrina</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/451961/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Feng</surname> <given-names>Dan</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/487444/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Trubina</surname> <given-names>Elisabeth</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Marsella</surname> <given-names>Stacy</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/525370/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Computer Science and Applied Cognitive Science, University of Duisburg-Essen</institution>, <addr-line>Essen</addr-line>, <country>Germany</country></aff>
<aff id="aff2"><sup>2</sup><institution>College of Computer and Information Science, Northeastern University</institution>, <addr-line>Boston, MA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: <italic>Massimo Bergamasco, Sant&#x2019;Anna School of Advanced Studies, Italy</italic></p></fn>
<fn fn-type="edited-by"><p>Reviewed by: <italic>Domna Banakou, Universitat de Barcelona, Spain; Jennifer Hofmann, University of Zurich, Switzerland</italic></p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x002A;Correspondence: <italic>Nicole Kr&#x00E4;mer, <email>nicole.kraemer@uni-due.de</email></italic></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Human-Media Interaction, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>06</day>
<month>03</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>9</volume>
<elocation-id>253</elocation-id>
<history>
<date date-type="received">
<day>09</day>
<month>09</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>15</day>
<month>02</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2018 Kr&#x00E4;mer, Sobieraj, Feng, Trubina and Marsella.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Kr&#x00E4;mer, Sobieraj, Feng, Trubina and Marsella</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Bullying is a pressing societal problem. As such, it is important to gain a better understanding of the mechanisms involved in bullying and of resilience factors which might protect victims. Moreover, it is necessary to provide tools that can train potential victims to strengthen their resilience. To facilitate both of these goals, the current study tests a recently developed virtual environment that puts participants in the role of a victim who is being oppressed by a superior. In a 2 &#x00D7; 2 between-subjects experiment (<italic>N</italic> = 81), we measured the effects of gender of the oppressor and gender of the participant on psychophysiological reactions, subjective experiences and willingness to report the event. The results reveal that even when a male and a female bully show the exact same behavior, the male bully is perceived as more threatening. In terms of gender of the victim, the only difference that emerged was a more pronounced increase in heart rate in males. The results were moderated by the personality factors social gender, neuroticism, and need to belong, while self-esteem did not show any moderating influence.</p>
</abstract>
<kwd-group>
<kwd>virtual environments</kwd>
<kwd>bullying</kwd>
<kwd>gender</kwd>
<kwd>psychophysiology</kwd>
<kwd>resilience</kwd>
<kwd>psychological</kwd>
</kwd-group>
<counts>
<fig-count count="9"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="82"/>
<page-count count="16"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<p>The use of virtual environments (VE) is nowadays widespread. Their potential in academia has been discussed extensively, and numerous research applications have been presented. Since VEs offer the possibility to create settings of high ecological validity that can be fully controlled, they have been suggested for and employed in fundamental research (<xref ref-type="bibr" rid="B10">Blascovich et al., 2002</xref>; <xref ref-type="bibr" rid="B51">Mapala et al., 2017</xref>) and for therapeutic and training purposes (e.g., <xref ref-type="bibr" rid="B14">Bossard et al., 2007</xref>; <xref ref-type="bibr" rid="B64">Potkonjak et al., 2016</xref>). Fundamental research uses virtual environments to study and understand fundamental mechanisms, for example regarding deceptive behavior (<xref ref-type="bibr" rid="B51">Mapala et al., 2017</xref>) or proxemics behavior (<xref ref-type="bibr" rid="B80">Yee et al., 2007</xref>; <xref ref-type="bibr" rid="B36">Iachini et al., 2016</xref>). Moreover, VEs can be employed to examine and reduce stereotype bias in terms of racial or age stereotypes (<xref ref-type="bibr" rid="B3">Banakou et al., 2016</xref>; <xref ref-type="bibr" rid="B58">Oh et al., 2016</xref>; <xref ref-type="bibr" rid="B32">Hasler et al., 2017</xref>). In the applied area of therapeutic interventions, virtual scenarios are being tested for the treatment of paranoia, post-traumatic stress disorders and other anxiety disorders (<xref ref-type="bibr" rid="B30">Gerardi et al., 2010</xref>) such as flight anxiety (<xref ref-type="bibr" rid="B16">Cardo&#x015F; et al., 2017</xref>) and speech anxiety (<xref ref-type="bibr" rid="B63">Pertaub et al., 2002</xref>). Increasingly, they are also being used for training purposes, mainly in the area of training motor skills, for example regarding surgery (<xref ref-type="bibr" rid="B72">Seymour et al., 2002</xref>), motor rehabilitation training (<xref ref-type="bibr" rid="B34">Holden, 2005</xref>; <xref ref-type="bibr" rid="B62">Pedreira da Fonseca et al., 2017</xref>) or to perfect skills in sports (<xref ref-type="bibr" rid="B54">Miles et al., 2012</xref>).</p>
<p>The development and evaluation of virtual environments for training resilience and future behavior in stressful situations has not been extensively addressed. Most notable among the exceptions is the stress resilience training conducted with military service members prior to their initial deployment (<xref ref-type="bibr" rid="B67">Rizzo et al., 2013</xref>). Here, users are immersed in a challenging context and train a range of psychoeducational and cognitive-behavioral emotional coping strategies believed to enhance stress resilience. More recently, a virtual environment application has been presented that enables resilience training for bullying situations (<xref ref-type="bibr" rid="B26">Feng et al., 2017</xref>; <xref ref-type="bibr" rid="B37">Jeong et al., 2017</xref>). Given its societal importance, bullying represents a critical, and yet widely neglected, field of application for virtual environment resilience training. Bullying can occur in various forms: as physical (e.g., slapping), verbal (e.g., offensive utterances), and relational (e.g., betrayal, social exclusion, spreading harmful gossip) violence (<xref ref-type="bibr" rid="B7">Berger, 2007</xref>). Due to its high prevalence rates in the population, bullying can be seen as a pressing societal problem. Indeed, in a meta-analytic review, <xref ref-type="bibr" rid="B7">Berger (2007)</xref> estimated that approximately 9&#x2013;25% of school children worldwide have already been victims of bullying.</p>
<p>Bullying can have a powerful impact on the victims, in terms of negative affect (e.g., feeling nervous) and physiological reactions (e.g., stress, headaches, pain, sleep problems) (<xref ref-type="bibr" rid="B31">Hansen et al., 2006</xref>). It can also cause long-term consequences such as depression (<xref ref-type="bibr" rid="B1">Agervold and Mikkelsen, 2004</xref>; <xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>).</p>
<p>In the current paper, we test the recently developed virtual environment application (<xref ref-type="bibr" rid="B26">Feng et al., 2017</xref>) with a special focus on the influence of gender (of the bully as well as the victim) and personality factors. The aim is twofold: We (a) employ virtual environment technology as an empirical testbed in order to learn more about the mechanisms and resilience factors influencing the effects of bullying (specifically regarding the impact of the bully&#x2019;s gender and the participant&#x2019;s personality variables) and (b) evaluate the effects of the environment on different groups of participants with regard to their stress levels, emotional states and behavioral intentions. The results of these analyses should form the basis for an effective training intervention which could be applied to train victims or enhance prevention workshops in schools or universities.</p>
</sec>
<sec><title>Theoretical Background</title>
<sec><title>Virtual Environments</title>
<p>Virtual environments are synthetic replications of the real world or of specific situations. Users are provided with the experience of being surrounded by these environments (<xref ref-type="bibr" rid="B48">Loomis et al., 1999</xref>), and they are often perceived as real. To immerse and interact in the environment, &#x201C;[u]sers wear displays that fully immerse a number of the senses in computer generated stimuli. Stereoscopic head-mounted displays (HMD) are a distinctive feature of such systems&#x201D; (<xref ref-type="bibr" rid="B9">Biocca and Delaney, 1995</xref>, p. 56). Virtual environments offer the possibility to vary characteristics of situations in very subtle ways: Environmental cues (e.g., creating a classroom, a farm or anything else) and social cues (e.g., the number of virtual persons present, their gender) can be systematically manipulated in order to examine their influence on participants&#x2019; social interaction, cognition and behavior (<xref ref-type="bibr" rid="B10">Blascovich et al., 2002</xref>; <xref ref-type="bibr" rid="B12">Bombari et al., 2015</xref>; <xref ref-type="bibr" rid="B50">Maister et al., 2015</xref>). One essential advantage of virtual environments lies in their possibility to enable persons to test their responses under fairly realistic conditions, without serious consequences. Therefore, virtual environments are nowadays successfully employed in a variety of settings for research and educational or training purposes. For instance, they are used for disaster training for healthcare professionals (<xref ref-type="bibr" rid="B25">Farra et al., 2015</xref>), police personnel (<xref ref-type="bibr" rid="B8">Bertram et al., 2015</xref>) or even for civilians learning how to behave in the case of an unexpected fire emergency (<xref ref-type="bibr" rid="B29">Gamberini et al., 2003</xref>). Moreover, they are implemented to treat paranoia, post-traumatic stress disorders, and other anxiety disorders (<xref ref-type="bibr" rid="B73">Slater et al., 2006</xref>; <xref ref-type="bibr" rid="B30">Gerardi et al., 2010</xref>; <xref ref-type="bibr" rid="B2">Atherton et al., 2016</xref>; <xref ref-type="bibr" rid="B16">Cardo&#x015F; et al., 2017</xref>). In addition, virtual environments are used for fundamental research in order to understand basic mechanisms, for instance, as mentioned above, regarding proxemics behavior, deception, or stereotype bias. Given these applications, it therefore seems feasible to employ a virtual scenario that can (a) serve highly controlled experimental research on the mechanisms and influencing factors underlying victims&#x2019; responses and potential resilience and (b) be refined to serve as an environment in which to train appropriate reactions and resilience. In order to employ virtual environments for both fundamental and applied research goals, it is necessary to demonstrate that the environment is able to elicit emotional and psychophysiological responses. Previous research demonstrated that virtual environments can indeed elicit strong emotional reactions (<xref ref-type="bibr" rid="B73">Slater et al., 2006</xref>; <xref ref-type="bibr" rid="B61">Pan and Slater, 2011</xref>). Moreover, <xref ref-type="bibr" rid="B43">Kotlyar et al. (2008)</xref> found that both blood pressure and heart rate were significantly increased in response to a speech stressor presented in a virtual environment. Most recently, <xref ref-type="bibr" rid="B42">Kothgassner et al. (2016)</xref> found comparable physiological stress responses in participants undergoing a public speaking task in a real-audience and a virtual-audience condition.</p>
<p>In conclusion, most findings indicate that virtual environments induce similar emotional and physiological reactions to those elicited in real-life situations, and compared to classic training methods (e.g., <xref ref-type="bibr" rid="B61">Pan and Slater, 2011</xref>; <xref ref-type="bibr" rid="B42">Kothgassner et al., 2016</xref>). We therefore suggest that a virtual scenario can be employed in a (mild) bullying setting to examine victims&#x2019; reactions by measuring physiological (during) and emotional reactions (afterward). In this way, we aim to contribute evidence regarding the influencing factors for emotional reactions and resilience. We further aim to derive suggestions for refining the environment for applied settings such as resilience training interventions.</p>
</sec>
<sec><title>Research on Bullying</title>
<p><xref ref-type="bibr" rid="B38">Juvonen and Graham (2014)</xref> state that &#x201C;[b]ullying involves targeted intimidation or humiliation. Typically, a physically stronger or socially more prominent person (ab)uses her/his power to threaten, demean, or belittle another. To make the target or victim feel powerless, (&#x2026;)&#x201D; (p. 161). While some researchers believe that bullying has to occur on a regular basis to have adverse effects (<xref ref-type="bibr" rid="B60">Olweus, 1993</xref>), <xref ref-type="bibr" rid="B38">Juvonen and Graham (2014)</xref> suggest that even one single mistreatment can be sufficient to elicit fear of further bullying. The negative consequences can range from negative feelings to severe psychophysiological reactions and clinical depression (<xref ref-type="bibr" rid="B31">Hansen et al., 2006</xref>). Bullying can be seen as a stress event, as described by <xref ref-type="bibr" rid="B71">Selye (1950)</xref> or <xref ref-type="bibr" rid="B45">Lazarus and Folkman (1984)</xref>.</p>
<p>One key characteristic of bullying is the power imbalance between the involved parties; there is always a bully (or perpetrator) and a victim. <xref ref-type="bibr" rid="B79">Wolke and Skew (2012)</xref> report that the roles (victims, bullies) are remarkably stable over time. This is underlined by recent meta-analytic findings of <xref ref-type="bibr" rid="B39">Kljakovic and Hunt (2016)</xref>, who confirmed the stability of roles with a large effect size. <xref ref-type="bibr" rid="B22">Einarsen (1999)</xref> reported that personality traits of the victim and psychosocial factors are decisive regarding the question of who becomes a victim.</p>
<sec><title>Prevalence of Bullying</title>
<p>Bullying is a societal problem which affects children, adolescents and adults. Referring to German, Austrian and English studies, <xref ref-type="bibr" rid="B22">Einarsen (1999)</xref> speculates that 70&#x2013;80% of working adults have been bullied by their supervisors. For United States workers, <xref ref-type="bibr" rid="B49">Lutgen-Sandvik et al. (2007)</xref> estimated that 35&#x2013;50% have been affected. Other data suggest that only approximately 10&#x2013;25% of the adult population across different countries (e.g., Europe, United States) has been affected by bullying (<xref ref-type="bibr" rid="B79">Wolke and Skew, 2012</xref>; <xref ref-type="bibr" rid="B77">van Heugten, 2013</xref>). Although a wide range of persons are affected by bullying, and the consequences can be devastating, some victims have the resources to cope with the difficult situation and to adjust in a positive way; they seem to be resilient. Research on resilience is currently focusing on the complex interplay of social resources (outside the family), family support and personal characteristics (<xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>). However, although resilience is an important factor, it has not received a great deal of attention in this context. This might be due to the difficulty of investigating resilience through survey studies, which are widely used in bullying research. As self-reports can become distorted over time, especially concerning felt emotions and immediate reactions, it is hard to identify the relation between personal resources and immediate reactions to bullying. Thus, one goal of the current study is to focus on resilience factors inherent in the victim and to relate these to the reactions that occur in the bullying situation.</p>
</sec>
<sec><title>Gender Differences in Bullying</title>
<p>There is consistent evidence that boys and male adolescents more often act as bullies compared to their female counterparts (<xref ref-type="bibr" rid="B4">Barlett and Coyne, 2014</xref>; <xref ref-type="bibr" rid="B55">Narayanan and Betts, 2014</xref>), especially with respect to physical bullying (<xref ref-type="bibr" rid="B38">Juvonen and Graham, 2014</xref>).</p>
<p>Moreover, studies have also demonstrated that boys and male adolescents are more frequently the victims of bullying (<xref ref-type="bibr" rid="B79">Wolke and Skew, 2012</xref>; <xref ref-type="bibr" rid="B55">Narayanan and Betts, 2014</xref>) compared to females. However, other studies found no gender effect (<xref ref-type="bibr" rid="B39">Kljakovic and Hunt, 2016</xref>), or that females were more likely to become victims of relational bullying (<xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>).</p>
<p>With regard to gender differences in the potential consequences of being bullied, and the question of whether gender might also function as a protective factor in terms of resilience, <xref ref-type="bibr" rid="B70">Sapouna and Wolke (2013)</xref> reported that males tend to show lower levels of depression, while females tend to be more vulnerable to depression. This was also demonstrated by <xref ref-type="bibr" rid="B75">Turner et al. (2013)</xref> with regard to cyberbullying. With regard to coping behavior, compared to men, women seem to be more willing to (a) to report their mistreatment to authorities and friends and (b) seek help (<xref ref-type="bibr" rid="B76">Unnever and Cornell, 2004</xref>; <xref ref-type="bibr" rid="B41">Kostev et al., 2013</xref>). <xref ref-type="bibr" rid="B76">Unnever and Cornell (2004)</xref> reported that girls found it easier to talk to their friends about victimization than to adults, who might rather be perceived as authorities. Approximately 30 percent of students do not report their victimization at all, because they are scared and do not believe that authorities in particular would be able to change their situation (<xref ref-type="bibr" rid="B76">Unnever and Cornell, 2004</xref>; <xref ref-type="bibr" rid="B7">Berger, 2007</xref>). <xref ref-type="bibr" rid="B7">Berger (2007)</xref> reported a positive effect of talking with peers about mistreatment. In line with these findings and open questions, the present study aims to evaluate whether a virtual bullying situation can be used as a testbed to learn about the factors influencing the willingness to report bullying.</p>
<p>While the aforementioned findings relate to biological gender, the literature also indicates that social gender can be a further determining factor. Social gender refers to personal characteristics, and addresses whether an individual has rather female or male attributes. Attributes that are perceived as female are communality, warmth and expressivity, while supposedly male attributes include instrumentality and dominance. People with atypical characteristics have been shown to be victimized more often (<xref ref-type="bibr" rid="B56">Navarro et al., 2015</xref>). Thus, it seems that both the biological and the social gender can predict involvement in a bullying situation. To our knowledge, the potential for resilience with respect to social gender has not yet been addressed, although it has been suggested as one of the personality traits influencing adjustment after victimization (e.g., <xref ref-type="bibr" rid="B19">Donnon and Hammond, 2007</xref>). Nevertheless, a person&#x2019;s social gender attributes might predict adverse reactions to a greater degree than biological attributes. For instance, oppression might induce more aversion in a person who is sensitive, sociable and caring (female attributes, <xref ref-type="bibr" rid="B65">Prentice and Carranza, 2002</xref>) than in a person who is assertive, competitive and aggressive (male attributes, <xref ref-type="bibr" rid="B65">Prentice and Carranza, 2002</xref>).</p>
<sec>
<title>Impact of bullies depending on their gender</title>
<p>Another unanswered question refers to the impact of the bully depending on his/her biological gender. According to gender stereotypes, men can be perceived as more threatening; thus, it can be asked whether male and female perpetrators are perceived in the same way. Men are seen as agentic and holding attributes like assertiveness and aggression, while women are associated with warmth and communality (see <xref ref-type="bibr" rid="B17">Cuddy et al., 2008</xref>). Additionally, men commonly have different physical attributes, which might be perceived as more menacing. On the other hand, female bullies might be perceived as more threatening because counter-stereotypical behaviors (i.e., being suppressive, dominant and aggressive instead of warm and kind) are unexpected and can lead to penalization (e.g., <xref ref-type="bibr" rid="B21">Eagly and Karau, 2002</xref>; <xref ref-type="bibr" rid="B15">Bosson and Michniewicz, 2013</xref>).</p>
</sec>
</sec>
<sec><title>Individual Differences in Bullying</title>
<p>As outlined above, it has repeatedly been suggested that it is not random who gets involved in bullying situations (<xref ref-type="bibr" rid="B38">Juvonen and Graham, 2014</xref>). As such, it has been discussed whether personality factors are associated with victimization (<xref ref-type="bibr" rid="B23">Einarsen et al., 1994</xref>). For example, studies demonstrated that victimization was positively correlated with neuroticism and negatively correlated with conscientiousness (<xref ref-type="bibr" rid="B11">Bollmer et al., 2006</xref>; <xref ref-type="bibr" rid="B81">Zapf and Einarsen, 2011</xref>; <xref ref-type="bibr" rid="B79">Wolke and Skew, 2012</xref>; <xref ref-type="bibr" rid="B40">Kod&#x017E;opelji&#x0107; et al., 2014</xref>; <xref ref-type="bibr" rid="B57">Nielsen and Knardahl, 2015</xref>). <xref ref-type="bibr" rid="B81">Zapf and Einarsen (2011)</xref> summarized that while some studies found extroversion, agreeableness and conscientiousness to be associated with victimization, others did not. Additionally, self-esteem and self-assertiveness can be important factors (<xref ref-type="bibr" rid="B81">Zapf and Einarsen, 2011</xref>). For instance, <xref ref-type="bibr" rid="B5">Baumeister et al. (2003)</xref> found that persons with low self-esteem ratings were more often victims than persons with high self-esteem. In addition, <xref ref-type="bibr" rid="B81">Zapf and Einarsen (2011)</xref> reported that victims score high on sensitivity, suspiciousness, anxiety and depression and low on assertiveness and competitiveness.</p>
<p>Individual traits also play a decisive role in terms of resilience (<xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>). In a more general context not specifically related to bullying, <xref ref-type="bibr" rid="B28">Friborg et al. (2005)</xref> stated that resilience was related to &#x201C;high score[s] on emotional stability [low neuroticism], extroversion, openness and conscientiousness [&#x2026;], as well as agreeableness&#x2026;&#x201D;. They found a strong negative correlation between neuroticism and resilience, and revealed that neurotic persons stated more negative affect and showed more symptoms of anxiety and depression. Transferring these results to resilience against bullying, it can be expected that victims with low scores on neuroticism will report less negative reactions (e.g., negative affect) than victims with high neuroticism scores.</p>
<p><xref ref-type="bibr" rid="B70">Sapouna and Wolke (2013)</xref> found that high self-esteem is positively associated with positive adjustment after victimization. <xref ref-type="bibr" rid="B78">Von Soest et al. (2010)</xref> further suggested that hardiness and a positive cognition of events (e.g., seeing chances/opportunities in negative situations/experiences) can lead to less negative reactions to stressful experiences. <xref ref-type="bibr" rid="B77">Van Heugten (2013)</xref> added that the perceived level of control on the part of the victim has an impact on the outcome of the bullying situation. In line with <xref ref-type="bibr" rid="B70">Sapouna and Wolke (2013)</xref>, we therefore suggest that self-esteem is positively associated with resilience and less negative reactions to victimization.</p>
<p>Another moderating factor might be the &#x201C;need to belong, that is, a need to form and maintain at least a minimum quantity of interpersonal relationships (&#x2026;)&#x201D; (<xref ref-type="bibr" rid="B6">Baumeister and Leary, 1995</xref>, p. 499). While it is fairly well testified that bullies strive for acceptance from their peers (e.g., <xref ref-type="bibr" rid="B59">Olthof and Goossens, 2008</xref>), the role of the need to belong on the part of the victim has received less research attention. For victims, the need to belong might especially affect the willingness to approach others after a bullying event.</p>
<p>To sum up, a broad body of research has found that bullying leads to stress reactions in terms of negative affect (e.g., feeling nervous) and physiological reactions (e.g., increased electrodermal activity). Moreover, (personality) traits of the victim (e.g., high neuroticism scores, gender) as well as attributes of the bully (e.g., male competitors are perceived as more dominant) seem to be influential. Although it is well known who is affected by bullying, less is known about resilience factors inherent in the victims. Most researchers applied survey studies to gain insights into bullying processes. While such studies provided a great deal of valuable results, the exploratory power of these results is partly limited. As virtual environments offer the opportunity to create situations of high control and systematization (<xref ref-type="bibr" rid="B48">Loomis et al., 1999</xref>; <xref ref-type="bibr" rid="B10">Blascovich et al., 2002</xref>), we strive to employ a virtual scenario in order to extend the basic research on these issues.</p>
</sec>
<sec><title>Research Questions and Hypotheses</title>
<p>Studies have revealed that prevalence rates of bullying are rather high, with approximately one third of the population across nations and across all ages having already been involved in bullying. The consequences can be far-reaching, especially for victims. For the experimental setting here, we specifically focus on bullying by an authority in an institutional setting, in order to represent a situation of clear power imbalance (<xref ref-type="bibr" rid="B38">Juvonen and Graham, 2014</xref>). Moreover, we are especially interested in the question of under which conditions bullying authorities would be reported. Regarding resilience factors, not every victim is permanently hurt/psychologically impaired by bullying; some victims show positive adjustments due to their coping potential (<xref ref-type="bibr" rid="B45">Lazarus and Folkman, 1984</xref>). Referring to the current literature on bullying and resilience (see Individual Differences in Bullying; <xref ref-type="bibr" rid="B28">Friborg et al., 2005</xref>; <xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>), we assume different personality attributes to be important, such as neuroticism, self-esteem and need to belong. Furthermore, the biological and social gender have been assumed to influence the victim&#x2019;s reaction to bullying (<xref ref-type="bibr" rid="B65">Prentice and Carranza, 2002</xref>; <xref ref-type="bibr" rid="B75">Turner et al., 2013</xref>). Based on this previous work, we state the following hypotheses:</p>
<list list-type="simple" prefix-word="simple">
<list-item><p>H1: Female victims will experience more adverse reactions (based on self-reports and physiological reactions) than male victims. These reactions will be moderated by the victim&#x2019;s personal characteristics (social gender, neuroticism, self-esteem and need to belong).</p></list-item>
</list>
<p>According to gender stereotypes, we assume that the biological gender of the bully can be an influencing factor.</p>
<list list-type="simple" prefix-word="simple">
<list-item><p>H2: A male bully will elicit more adverse reactions (based on self-reports and physiological reactions) than a female bully. These reactions will be moderated by the victim&#x2019;s personal characteristics (social gender, neuroticism, self-esteem and need to belong).</p></list-item>
</list>
<p>Moreover, we suppose an interaction between the biological sex of the victim and the biological sex of the bully.</p>
<list list-type="simple" prefix-word="simple">
<list-item><p>H3: Female victims oppressed by a male bully will show more adverse reactions (based on self-reports and physiological reactions) than male victims oppressed by a male bully, female victims oppressed by a female bully, and male victims oppressed by a female bully. These reactions will be moderated by the victim&#x2019;s personal characteristics (social gender, neuroticism, self-esteem and need to belong).</p></list-item>
</list>
</sec>
</sec></sec>
<sec id="s1" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec><title>Study Design and Virtual Scenario</title>
<p>To examine our hypotheses, we conducted an experiment with a 2 (bully&#x2019;s gender) &#x00D7; 2 (victim&#x2019;s gender) between-subject design (<italic>N</italic> = 81, 45 females, 36 males). The virtual environment was designed to simulate a bullying scenario by assigning the participants to a task that is impossible to complete to the bully&#x2019;s satisfaction. As shown in <bold>Figure <xref ref-type="fig" rid="F1">1A</xref></bold>, the virtual environment is a wide open space in which two virtual characters are displayed. Specifically, we simulated a rehearsal in an acting class scenario, because this is a situation in which feedback can be given naturally. To create the imbalance of power, the key element of bullying behavior, one of the virtual characters was designed to be the instructor (female/male) and the authority in the scene. The participants took the role of an acting student, reading lines from a script and interacting with a second (virtual) student who was also practicing his lines while taking instructions from a virtual instructor. The participant could see both the instructor and the fellow student (<bold>Figure <xref ref-type="fig" rid="F1">1A</xref></bold>) standing in a neutral, stage-like room. The virtual fellow student served to simulate a real-life acting class in which participants rehearse a scene together, as well as to enhance the participants&#x2019; feeling of being treated differently. The fellow student looked the same in all conditions and displayed the same, neutral behavior, saying his lines with default gaze behaviors following the person who speaks. Participants were asked to rehearse the script adapted from &#x2018;Romeo and Juliet: Act 3, Scene 3,&#x2019; with the virtual fellow student playing another character in the script, Friar Lawrence, while the participant played Romeo. There were no other interactions between the participant and the virtual student, beyond reading their different parts in the script. The researcher told the participants that their goal was to finish their rehearsal in a limited amount of time. Each time the participant finished reading a line, the virtual instructor provided feedback. Participants were told that the instructor&#x2019;s feedback was specifically tailored to their performance, and that they should follow the instructor&#x2019;s directions to the best of their ability. The negative feedback from the virtual instructor was scripted and identical for all participants regardless of their performance. Each time the participant finished reading a line, the virtual instructor verbally bullied the participants by providing strong negative feedback, using harsh language and even ridicule, with negative non-verbal behaviors (see <bold>Figure <xref ref-type="fig" rid="F1">1B</xref></bold>). For example, the negative feedback included sentences such as &#x201C;Ugh, stop. You sound like a dead fish,&#x201D; &#x201C;No no no, that&#x2019;s not right. Honestly, how hard is it?&#x201D; and &#x201C;Come on, work with me here. Say it like you mean it.&#x201D; (For a video of the situation featuring the male perpetrator see <bold><xref ref-type="supplementary-material" rid="SM1">Supplementary Materials</xref></bold>. Please note that the participants watched this with an oculus, i.e., saw only one picture).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p><bold>(A)</bold> Screenshot of the virtual environment. The character standing on the left is the virtual instructor and the character on the right is the virtual fellow student. The participant&#x2019;s lines appear on the 3D interface in front of the participant. <bold>(B)</bold> The example of negative non-verbal behaviors when the virtual instructor said &#x201C;No, that&#x2019;s not right. Honestly, how hard is it? Do it again!&#x201D;</p></caption>
<graphic xlink:href="fpsyg-09-00253-g001.tif"/>
</fig>
<sec><title>System Apparatus</title>
<p>The 3D virtual environment was developed using Unity3D. The virtual humans&#x2019; non-verbal behaviors such as facial expression and gestures were automatically generated using Cerebella (<xref ref-type="bibr" rid="B47">Lhommet and Marsella, 2013</xref>; <xref ref-type="bibr" rid="B52">Marsella et al., 2013</xref>) and the generated animations were controlled using Virtual Human Toolkit. The head-mounted display (HMD) was the Oculus Rift Development Kit 2. The experiment apparatus is shown in <bold>Figure <xref ref-type="fig" rid="F2">2</xref></bold>. An Empatica E4 sensor measured physiological signals, heart rate and electrodermal activity.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>System apparatus.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g002.tif"/>
</fig>
</sec>
</sec>
<sec><title>Procedure</title>
<p>The experiment took place in a virtual reality lab at the University Duisburg-Essen, Germany. Participants were recruited by personal contact online and offline. When they arrived at the university, they were welcomed by the experimenter, instructed about the setting and asked to provide informed consent. Then, the participants took a seat and were fitted with the Empatica E4 and asked to fill in the first part of the questionnaire including the personality traits. Afterward, the experimenter fitted the participants with the Oculus Rift. The experimenter started (a) the recording of the physiological data by tagging the Empatica E4 and (b) the video recording, and ended the recording after the interaction. Interactions took about three to 4 min; the total duration of the experiment was approximately 30 min. Finally, participants filled in the second part of the questionnaire and were debriefed.</p>
</sec>
<sec><title>Measures</title>
<p>To examine our hypotheses, we captured personality traits and participants&#x2019; adverse reactions. In addition, participants&#x2019; sociodemographic characteristics were determined (biological gender, age, level of education).</p>
<sec><title>Personality Traits</title>
<p>We used a subscale of the NEO-FFI (<xref ref-type="bibr" rid="B13">Borkenau and Ostendorf, 2008</xref>) to measure neuroticism (&#x03B1; = 0.810). Ratings were given on 5-point Likert scales (0 = not at all; 4 = absolutely), with high scores indicating a strong manifestation of the trait.</p>
<p>To measure the social gender, we employed the German version of the Personal Attributes Questionnaire (GEPAQ) by <xref ref-type="bibr" rid="B69">Runge et al. (1981)</xref>, which comprises three subscales (eight items each): <italic>masculinity</italic> (M+; &#x03B1; = 0.632), <italic>femininity</italic> (F+; &#x03B1; = 0.663) and <italic>masculinity-femininity</italic> (M-F; &#x03B1; = 0.590). The masculinity scale includes items like <italic>competitive</italic> and <italic>self-confident</italic>, while the femininity scale includes items like <italic>sensitive</italic> and <italic>emotional</italic>. Participants gave ratings on 5-point Likert scales (0 = not at all; 4 = absolutely). For the present analyses, we only used the masculinity and femininity subscale.</p>
<p>Self-esteem was captured using the Rosenberg Self-Esteem Scale (<xref ref-type="bibr" rid="B68">Rosenberg, 1965</xref>), which consists of ten items (&#x03B1; = 0.838). Ratings were made on 4-point Likert scales (0 = not at all; 3 = absolutely). High values of the sum score represent high self-esteem.</p>
<p>We measured the need to belong with the 10-item Need to Belong Scale (<xref ref-type="bibr" rid="B46">Leary et al., 2013</xref>). Ratings were made on 5-point Likert scales (1 = not at all; 5 = extremely), with high scores indicating a high need to belong (&#x03B1; = 0.840). We additionally measured causal attribution style (<xref ref-type="bibr" rid="B53">McAuley et al., 1992</xref>), although this is not relevant for the present article.</p>
</sec>
<sec><title>Adverse Reactions</title>
<p>To examine adverse reactions, we used self-reports and physiological measures.</p>
<sec>
<title>Physiological reactions</title>
<p>We captured electrodermal activity (EDA) and heart rate (HR) as indicators of physiological stress responses during the acting task, using the Empatica E4. This is a bracelet with four sensors (photoplethysmography, electrodermal activity sensor, accelerometer, thermometer), which can measure physiological responses in real time. Only the data of the first two sensors were used in order to derive heart rate and electrodermal activity (skin conductance level, SCL). A tagging button was used to mark the start and end of the experimental interaction. We captured a baseline before the beginning of the interaction for 3&#x2013;4 min while participants were able to look around the room. For further analyses, we calculated the differences between the physiological values at baseline and at the end of the interaction to obtain values for changes in heart rate and skin conductance level.</p>
</sec>
<sec>
<title>Self-reports</title>
<p>The current mental state was measured by 28 three-point semantic differentials (<xref ref-type="bibr" rid="B82">Zerssen and Koeller, 1976</xref>; 0 = positive pole, 1 = indifferent; 2 = negative pole) such as <italic>fresh-faint</italic>, <italic>irritated-placid</italic> or <italic>happy-upset</italic>. From these, the sum score was formed, with high scores representing mental unease and low scores representing high mental well-being.</p>
<p>Moreover, we asked participants about their perception of the bullying situation using 16 items rated on 9-point Likert scales (1 = totally disagree; 9 = totally agree). Example items are &#x201C;I felt oppressed by the instructor&#x2019;s behavior&#x201D; and &#x201C;The instructor&#x2019;s behavior made me insecure.&#x201D; A factor analysis using <xref ref-type="bibr" rid="B35">Horn&#x2019;s (1965)</xref> parallel analysis method resulted in a one-factor solution (&#x03B1; = 0.900); five items had to be removed from the analysis. High scores indicate a strong feeling of oppression.</p>
</sec>
<sec>
<title>Behavioral intentions</title>
<p>Finally, we measured behavioral intentions to report the mistreatment using 9-point Likert scales (1 = not at all; 9 = absolutely) after the bullying situation. We captured two different types of report: formal report (one item, &#x201C;Would you report the behavior of the instructor to the university?&#x201D;) and informal report (three items &#x201C;Would you report the behavior of the instructor to your friends/family/fellow students?&#x201D;; &#x03B1; = 0.846).</p>
</sec>
</sec></sec>
<sec><title>Sample</title>
<p>Of the 83 participants who took part in the study, two participants had to be excluded (one due to technical problems and one who switched off the Empathica E4). The final study sample thus comprised 81 participants (45 females, 36 males), with an age range from 18 to 31 years (<italic>M</italic> = 22.70, <italic>SD</italic> = 2.93). As the highest level of education, approximately 94% had completed university entrance-level examinations or a higher educational qualification; the remaining 6% named another qualification (e.g., graduated from a medium-track school). On average, the participants had 9 years of experience with video games (<italic>M</italic> = 9.63; <italic>SD</italic> = 6.81). The participants in the two conditions (female/male oppressor) did not differ concerning their video-gaming experience (female oppressor condition: <italic>M</italic> = 10.08, <italic>SD</italic> = 7.46; male oppressor condition: <italic>M</italic> = 9.20, <italic>SD</italic> = 6.16). However, they differed slightly regarding their average age, with those in the female condition being 1 year older (<italic>M</italic> = 23.40, <italic>SD</italic> = 0.49) than those in the male condition (<italic>M</italic> = 22.02, <italic>SD</italic> = 0.41). Gender was distributed equally across conditions (female participants: <italic>n</italic><sub>male bully</sub> = 22, <italic>n</italic><sub>female bully</sub> = 23; male participants: <italic>n</italic><sub>male bully</sub> = 19, <italic>n</italic><sub>female bully</sub> = 17).</p>
</sec>
</sec>
<sec><title>Results</title>
<p>To examine H1&#x2013;H3, we conducted a MANOVA with the independent factors bully&#x2019;s gender and participants&#x2019; gender and the dependent variables physiological reactions (electrodermal activity, heart rate), self-reports (bullying perception, mental state) and behavioral intentions to report the misbehavior of the instructor (informal, formal).</p>
<p>Regarding H1, which stated that female participants would experience more adverse reactions, the analysis showed a difference in heart rate between female and male participants, <italic>F</italic>(1,77) = 5.01, <italic>p</italic> = 0.028, <inline-formula><mml:math id="M1"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.061: Males showed higher heart rate changes (<italic>M</italic> = 30.29, <italic>SE</italic> = 2.75, <italic>CI</italic> [24.82, 35.76]) than females (<italic>M</italic> = 22.05, <italic>SE</italic> = 2.45, <italic>CI</italic> [17.16, 26.93]). There were no significant effects on SCL [<italic>F</italic>(1,77) = 1.64, <italic>p</italic> = 0.205, <inline-formula><mml:math id="M2"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.021]. The self-reports on mental state, <italic>F</italic>(1,77) = 0.38, <italic>p</italic> = 0.542, <inline-formula><mml:math id="M3"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.005, and the perception of the bullying situation, <italic>F</italic>(1,77) = 0.05, <italic>p</italic> = 0.831, <inline-formula><mml:math id="M4"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.001, did not differ significantly. Moreover, there was no difference between men and women in the intentions to report the bullying situation in a formal, <italic>F</italic>(1,77) = 0.15, <italic>p</italic> = 0.698, <inline-formula><mml:math id="M5"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.002, or informal way, <italic>F</italic>(1,77) = 0.00, <italic>p</italic> = 0.956, <inline-formula><mml:math id="M6"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.000.</p>
<p>Concerning H2, which stated that a male bully would elicit more adverse effects than a female bully, the analysis revealed no significant difference in the physiological reactions depending on the bully&#x2019;s gender [SCL <italic>F</italic>(1,77) = 2.34, <italic>p</italic> = 0.130, <inline-formula><mml:math id="M7"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.030; HR <italic>F</italic>(1,77) = 1.93, <italic>p</italic> = 0.169, <inline-formula><mml:math id="M8"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.024]. The self-report did not reveal a difference for the variable &#x201C;mental state ratings,&#x201D; <italic>F</italic>(1,77) = 0.15, <italic>p</italic> = 0.705, <inline-formula><mml:math id="M9"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.002, but a difference was found for the variable &#x201C;perception of the bullying situation&#x201D; depending on the bully&#x2019;s gender, <italic>F</italic>(1,77) = 5.08, <italic>p</italic> = 0.027, <inline-formula><mml:math id="M10"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.062. The male bully elicited a greater threat perception (<italic>M</italic> = 5.52, <italic>SE</italic> = 0.25, <italic>CI</italic> [5.03, 6.02]) than did the female bully (<italic>M</italic> = 4.72, <italic>SE</italic> = 0.25, <italic>CI</italic> [4.22, 5.23]). Regarding the behavioral intentions to report the bullying, the analysis did not reveal a difference depending on the bully&#x2019;s gender [informal <italic>F</italic>(1,77) = 0.14, <italic>p</italic> = 0.707, <inline-formula><mml:math id="M11"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.002; formal <italic>F</italic>(1,77) = 0.63, <italic>p</italic> = 0.432, <inline-formula><mml:math id="M12"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.008].</p>
<p>The interaction of bully&#x2019;s gender and participants&#x2019; gender (H3) did not show significant differences for physiological reactions [SCL <italic>F</italic>(1,77) = 0.01, <italic>p</italic> = 0.908, <inline-formula><mml:math id="M13"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.000; HR <italic>F</italic>(1,77) = 0.00, <italic>p</italic> = 0.974, <inline-formula><mml:math id="M14"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.000], self-reports [mental state <italic>F</italic>(1,77) = 0.37, <italic>p</italic> = 0.546, <inline-formula><mml:math id="M15"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.005; perception of bullying situation <italic>F</italic>(1,77) = 0.45, <italic>p</italic> = 0.505, <inline-formula><mml:math id="M16"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.006] and behavioral intentions to report the mistreatment by the instructor [informal <italic>F</italic>(1,77) = 2.56, <italic>p</italic> = 0.114, <inline-formula><mml:math id="M17"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.032; formal <italic>F</italic>(1,77) = 0.70, <italic>p</italic> = 0.406, <inline-formula><mml:math id="M18"><mml:msubsup><mml:mi mathvariant='normal' mathcolor='black'>&#x03b7;</mml:mi><mml:mi mathvariant='normal' mathcolor='black'>p</mml:mi><mml:mn mathvariant='normal' mathcolor='black'>2</mml:mn></mml:msubsup></mml:math></inline-formula> = 0.009].</p>
<p>To examine whether the personality variables self-esteem, need to belong, neuroticism, and social gender moderate the results of H1&#x2013;H3, we conducted three-way moderations (model 3) using the PROCESS macro by <xref ref-type="bibr" rid="B33">Hayes (2013)</xref>. To this end, we consecutively conducted moderations, with each personality trait (self-esteem, need to belong, neuroticism, and social gender) as a moderator and the physiological reactions [electrodermal activity (EDA) and heart rate], self-reports on experiences (perception of the bullying, mental state), and behavioral intentions to report the bullying behavior on a formal and informal level as dependent reactions.</p>
<sec><title>Self-Esteem</title>
<p>When self-esteem was used as a moderator for the relation of bully&#x2019;s and participants&#x2019; gender, there was no effect of self-esteem on the dependent variables and the inclusion of self-esteem did not change any of the results depicted above.</p>
</sec>
<sec><title>Need to Belong</title>
<p>In a next step, we ran analyses with need to belong (NTB) as a moderator. The overall model for skin conductance level did not reach significance <italic>F</italic>(7,73) = 1.51, <italic>p</italic> = 0.177, <italic>R</italic><sup>2</sup> = 0.15, but there was a significant three-way interaction effect of bully&#x2019;s gender, participants&#x2019; gender and NTB on SCL (<italic>b</italic> = -0.80, <italic>t</italic>(73) = -2.51, <italic>p</italic> = 0.014, <italic>CI</italic> [-1.43, -0.16]). <bold>Figure <xref ref-type="fig" rid="F3">3</xref></bold> depicts the interaction effect for low, medium and high levels of NTB. The Johnson-Neyman technique further showed that the interaction effect of bully&#x2019;s gender and participants&#x2019; gender on SCL changed significantly at NTB values below -7.76 (8.64%) and above 10.49 (7.41%). The female bully elicited higher SCL in female participants with a high NTB than did the male bully, while the opposite was the case for male participants with a high NTB. Moreover, the male and female bully elicited the same SCL for female participants with a low NTB; however, male participants with a low NTB showed increased SCL in response to the female bully.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>Three-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup>Participants&#x2019; Gender<sup>&#x2217;</sup>NTB on SCL.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g003.tif"/>
</fig>
<p>Concerning heart rate, the analysis revealed a non-significant overall model <italic>F</italic>(7,73) = 1.84, <italic>p</italic> = 0.093, <italic>R</italic><sup>2</sup> = 0.15. However, as in H1, there was a significant main effect of participants&#x2019; gender on heart rate, and a three-way interaction of bully&#x2019;s gender, participants&#x2019; gender and NTB, (<italic>b</italic> = 2.41, <italic>t</italic>(73) = 2.05, <italic>p</italic> = 0.044, <italic>CI</italic> [0.67, 4.75]). The latter finding, however, does not show significant transition points within the moderator scores using the Johnson-Neyman technique and will therefore not be interpreted.</p>
<p>With respect to the self-report data, the overall model for the perception of bullying was significant, [<italic>F</italic>(7,73) = 4.77, <italic>p</italic> &#x003C; 0.001, <italic>R</italic><sup>2</sup> = 0.25] and showed a main effect of bully&#x2019;s gender, (<italic>b</italic> = -0.81, <italic>t</italic>(73) = -2.41, <italic>p</italic> = 0.019, <italic>CI</italic> [-1.47, -0.14]), indicating more perceived threat from the male bully than from the female bully. Moreover, an interaction effect of bully&#x2019;s gender and NTB, (<italic>b</italic> = 0.20, <italic>t</italic>(73) = -4.55, <italic>p</italic> &#x003C; 0.001, <italic>CI</italic> [0.11, 0.29]) was found. <bold>Figure <xref ref-type="fig" rid="F4">4</xref></bold> shows that for the female bully, the perception of bullying increased with the NTB score, while the opposite pattern applied for the male bully.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Two-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup> NTB on perceived bullying.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g004.tif"/>
</fig>
<p>There was no effect of the need to belong on the reported mental state or on the intention to formally report the bullying, and neither of the moderators influenced the effects of the independent variables.</p>
<p>Although the overall model for informal report was also not significant, <italic>F</italic>(7,73) = 1.68, <italic>p</italic> = 0.129, <italic>R</italic><sup>2</sup> = 0.19, a main effect of NTB emerged (<italic>b</italic> = 0.75, <italic>t</italic>(73) = 2.32, <italic>p</italic> = 0.023, <italic>CI</italic> [0.01, 0.14]), suggesting that the higher the NTB, the greater the likelihood of an informal report.</p>
</sec>
<sec><title>Neuroticism</title>
<p>To examine the impact of neuroticism, we conducted the corresponding moderation analyses. There was no influence of neuroticism on skin conductance level. With regard to heart rate, the same participant gender effect as in H1 emerged. In addition, a three-way interaction effect of bully&#x2019;s gender, participants&#x2019; gender and neuroticism (<italic>b</italic> = 27.56, <italic>t</italic>(73) = 2.17, <italic>p</italic> = 0.033, <italic>CI</italic> [2.25, 52.86]) on heart rate was found. <bold>Figure <xref ref-type="fig" rid="F5">5</xref></bold> depicts the interaction effect for low, medium and high levels of neuroticism. The Johnson-Neyman technique further indicated that the interaction effect of bully&#x2019;s gender and participants&#x2019; gender on heart rate changed significantly at neuroticism values above 0.93 (9.88%). Bullies of both genders elicited an increase in HR in participants with high neuroticism scores.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption><p>Three-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup>Participants&#x2019; Gender<sup>&#x2217;</sup>Neuroticism on HR.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g005.tif"/>
</fig>
<p>The overall model on bullying perceptions was not significant, <italic>F</italic>(7,73) = 2.01, <italic>p</italic> = 0.065, <italic>R</italic><sup>2</sup> = 0.15, but showed the same main effect of bully&#x2019;s gender on bullying perception as in H2. However, a two-way interaction effect of bully&#x2019;s gender and neuroticism (<italic>b</italic> = 1.20, <italic>t</italic>(73) = 2.08, <italic>p</italic> = 0.041, <italic>CI</italic> [0.05, 2.35]) emerged. <bold>Figure <xref ref-type="fig" rid="F6">6</xref></bold> shows that with increasing neuroticism, the perception of bullying by the male bully decreased while the perception of bullying by the female bully increased.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption><p>Two-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup> Neuroticism on perceived bullying.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g006.tif"/>
</fig>
<p>Concerning the reported mental state, the overall model was not significant and did not reveal any significant main or interaction effects. Regarding the behavioral intentions, the overall model of informal report was not significant <italic>F</italic> (7,73) = 1.39, <italic>p</italic> = 0.223, <italic>R</italic><sup>2</sup> = 0.07, while the model of formal report was significant <italic>F</italic>(7,73) = 2.44, <italic>p</italic> = 0.026, <italic>R</italic><sup>2</sup> = 0.14. The informal model nevertheless revealed a significant interaction of bully&#x2019;s gender and participants&#x2019; gender (<italic>b</italic> = 1.56, <italic>t</italic>(73) = 2.14, <italic>p</italic> = 0.035, <italic>CI</italic> [0.11, 3.01]), which was not present when neuroticism was excluded from the model. Here, a cross-gender effect emerged: Female participants would be more likely to report mistreatment by a male bully than by a female bully, while the opposite was the case for male participants (<bold>Figure <xref ref-type="fig" rid="F7">7</xref></bold>). The analysis of formal reporting of the bullying situation showed an interaction of bully&#x2019;s gender and neuroticism (<italic>b</italic> = 2.83, <italic>t</italic>(73) = 2.97, <italic>p</italic> = 0.004, <italic>CI</italic> [0.93, 4.73]). <bold>Figure <xref ref-type="fig" rid="F8">8</xref></bold> shows that with increasing neuroticism values, participants would be more likely to report the female bully. The opposite pattern emerged with a respect to the male bully: The lower the neuroticism, the greater the likelihood of reporting mistreatment.</p>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption><p>Two-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup>Participants&#x2019; Gender on informal report.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g007.tif"/>
</fig>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption><p>Two-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup>Neuroticism on formal report.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g008.tif"/>
</fig>
</sec>
<sec><title>Social Gender</title>
<p>To test whether participants&#x2019; social gender influences their experiences and reactions, we calculated models with self-reported masculinity and femininity.</p>
<p>Masculinity did not show a distinct influence on skin conductance level or heart rate. Concerning perception of bullying and mental state, the inclusion of masculinity did not change the results reported in H1&#x2013;H3. Only the behavioral intentions to either formally or informally report the mistreatment were partially affected by masculinity. The overall model for formal report was significant, <italic>F</italic>(7,73) = 2.20, <italic>p</italic> = 0.044, <italic>R</italic><sup>2</sup> = 0.12, and revealed a significant effect of masculinity (<italic>b</italic> = 1.14, <italic>t</italic>(73) = 2.18, <italic>p</italic> = 0.032, <italic>CI</italic> [0.10, 2.19]): Masculinity was positively correlated with the probability of formal report. The model on informal report was not significant, <italic>F</italic>(7,73) = 1.20, <italic>p</italic> = 0.314, <italic>R</italic><sup>2</sup> = 0.07.</p>
<p>The inclusion of femininity did not lead to different results with regard to skin conductance and heart rate. Additionally, a two way interaction of bully&#x2019;s gender and femininity (<italic>b</italic> = 19.38, <italic>t</italic>(73) = 2.30, <italic>p</italic> = 0.024, <italic>CI</italic> [2.58, 36.18]) emerged. With increasing scores on femininity, the heart rate increased in response to the female bully, while femininity did not affect the heart rate in response to the male bully (<bold>Figure <xref ref-type="fig" rid="F9">9</xref></bold>). There were no effects on either of the self-reports or the behavioral intention variables.</p>
<fig id="F9" position="float">
<label>FIGURE 9</label>
<caption><p>Two-way interaction effect of Bully&#x2019;s Gender<sup>&#x2217;</sup>Participants&#x2019; Gender<sup>&#x2217;</sup> Femininity on HR.</p></caption>
<graphic xlink:href="fpsyg-09-00253-g009.tif"/>
</fig>
<p>In sum, the results indicate that with the exception of heart rate, which was higher for men than for women, women and men react similarly to a bullying scenario in a virtual environment (H1). H2 shows that regarding the gender of the bully, the male character was perceived as more threatening. There was no interaction between participants&#x2019; and bully&#x2019;s gender. With regard to potential moderators, only self-esteem did not prove to be influential, while social gender, neuroticism and need to belong showed various interactions, which are discussed in greater detail below.</p>
</sec>
</sec>
<sec><title>Discussion</title>
<p>The aim of the current study was twofold: We (a) employed virtual environment technology as a testbed in order to learn more about the influence of a bully&#x2019;s gender and of participants&#x2019; resilience factors on the effects of bullying, and (b) evaluated the effects of the gender of the bully (male vs. female) in one bullying situation (acting rehearsal) on the stress level, self-reported mental state, and behavioral intentions of two groups of participants (men and women). This should form the basis for an effective training intervention which might be applied as a training environment in prevention workshops in schools or universities. Therefore, we conducted an experimental between-subjects study in which we varied the bully&#x2019;s and participants&#x2019; gender. A virtual environment was used to create a mild bullying situation by a figure of authority and captured participants&#x2019; (adverse) reactions by means of physiological data, self-reports and behavioral intentions to report the mistreatment. Contrary to expectation (H1), we did not find that female victims experience more adverse reactions during a bullying situation than male victims. On the contrary, males experienced a stronger increase in heart rates than did females. In line with <xref ref-type="bibr" rid="B27">Fowles (1980)</xref>, this can be interpreted as an increased action readiness, and might be an indication that men tend to react more physically to threat. However, this needs to be further investigated in future studies. Despite this one difference, it seems that taken individually, the reactions of female and male victims are very similar. Moreover, moderators hardly changed these results. For potential applications of the virtual environment, this means that it might be useful to provide resilience training to both women and men.</p>
<p>We further assumed (H2) that a male bully would elicit more adverse reactions in participants, due to stereotypical beliefs about men and their different physical appearance. While we did not find any main effects for the physiological measures, the analyses revealed that the evaluation of the bullying situation is indeed more negative when the bully is male. Although participants did not report feeling worse, they described the situation as more threatening. While this might seem unsurprising at first glance, it is nevertheless remarkable that the same behavior leads to different effects if only the gender of the bully is changed. The fact that the same behavior displayed by women and men does not necessarily lead to the same effects or attributions has already been demonstrated in other realms (<xref ref-type="bibr" rid="B18">Deutsch et al., 1987</xref>). Although the male and the female bully&#x2019;s behavior were experienced differently, behavioral intentions to report the mistreatment were not affected by the bully&#x2019;s gender. For potential future application in resilience training, the more menacing effect of the male bully nevertheless suggests that to increase the effectiveness of such training, it may be more beneficial to include a male rather than a female bully. In addition, the gender could be customized to the &#x201C;victim&#x2019;s&#x201D; preferred degree of experienced threat.</p>
<p>According to H3, we expected that the male bully would trigger the strongest adverse reactions in female victims, due to the above-mentioned reasons. In contrast, we supposed that the female bully would elicit less adverse reactions especially when interacting with male victims. The analyses did not reveal any significant interaction effect of the bully&#x2019;s gender and participants&#x2019; gender, which is in line with the results regarding the main effects of bully&#x2019;s and victims&#x2019; gender, suggesting that overall, gender is rather unimportant concerning the effects of bullying.</p>
<p>However, the consideration of further moderators changes the influence of the bully&#x2019;s gender on different adverse reactions and the interaction of bully&#x2019;s gender and participants&#x2019; gender. We considered neuroticism, need to belong, self-esteem and social gender as potential moderators. Surprisingly, the only moderator that did not influence the results was self-esteem. This was particularly unexpected given that previous research (<xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>) indicated that high self-esteem would enable victims to cope better with such a situation. Our results indicate that high self-esteem did not lead participants to evaluate the situation as less threatening or to feel better. However, as we focused on the immediate reaction in the situation, this does not preclude that long-term coping might be more successful in participants with high self-esteem.</p>
<p>The impact of the bully&#x2019;s gender on the adverse reactions was affected by neuroticism, the need to belong and social gender. Starting with neuroticism, the results indicate that the higher the participants&#x2019; neuroticism scores, the more they perceived the female bully as threatening. The opposite pattern was observed for the male bully. While participants with low neuroticism found female bullies less threatening than males, people with high neuroticism evaluated both genders to be equally threatening. Moreover, participants with high neuroticism scores were more likely to formally report mistreatment from a female bully than from a male bully. Male bullies elicit more threat, while female bullies are perceived as less threatening, which may lead to less fear of complaining about mistreatment by females. Moreover, as female bullies are acting against their perceived female role of being warm and sincere, this violation may elicit a desire to penalize them (<xref ref-type="bibr" rid="B15">Bosson and Michniewicz, 2013</xref>), in this context through a formal report.</p>
<p>Moreover, the need to belong (<xref ref-type="bibr" rid="B6">Baumeister and Leary, 1995</xref>) moderated the relation between the bully&#x2019;s gender and the perception of the bullying situation. The higher the participants&#x2019; need to belong scores, the more threatened they felt by the female bully, while the male bully induced less threat. We assume that these findings are also attributable to gender stereotypes. Participants with a high need to belong, who have a strong wish for attachments and acceptance, might believe that it is easier to befriend females, as females are expected to be friendlier and more communicative and approachable (<xref ref-type="bibr" rid="B21">Eagly and Karau, 2002</xref>). However, in the case of the present scenario, the female bully violated her gender role, which in turn might be perceived as particularly threatening. In contrast to this, males are perceived as less approachable, more dominant and less communicative (<xref ref-type="bibr" rid="B65">Prentice and Carranza, 2002</xref>); thus, the male bully was acting more in accordance with his perceived role as a male. Another indication that the female bully was perceived as a role-violating person is provided by the interaction effect of the bully&#x2019;s gender and self-reported femininity on increase in heart rate. The more feminine attributes participants hold, the higher the heart rate increases when encountering the female bully, while the heart rate in response to the male bully was unaffected. One might assume that participants who indicate being more sensitive might more easily notice such a role violation, resulting in a higher heart rate, although this assumption is highly speculative at this point. The fact that only a physiological measure was affected, which is hard to control, might indicate that stereotypical beliefs are embedded on an implicit level, but controlled on an explicit level (i.e., self-report on perceived bullying). However, it needs to be acknowledged that the results on the other psychophysiological variable, skin conductance level, did not manifest themselves in exactly the same way. Although it might be seen as troubling that the two physiological measures did not yield the same results, such findings were also demonstrated in recent studies employing first-person shooter games (<xref ref-type="bibr" rid="B20">Drachen et al., 2010</xref>). A potential explanation for the differing impact on different psychophysiological measures might lie in the distinction between the behavioral activation system (BAS) and the behavioral inhibition system (BIS) (<xref ref-type="bibr" rid="B27">Fowles, 1980</xref>): While the BAS initiates behavior (approach) and is strongly associated with heart rate, the BIS is an anxiety system, which inhibits behavior and is associated with electrodermal activity. Against this background, a uniform reaction of heart rate and electrodermal activity would not be expected.</p>
<p>Besides the aforementioned effects, neuroticism and the need to belong also affected the interaction between bully&#x2019;s gender and participants&#x2019; gender regarding physiological responses and behavioral intentions. All of these moderations show the same pattern, which indicates specific cross-gender effects. High neuroticism values affected the relation between bully&#x2019;s gender and participants&#x2019; gender with respect to heart rate and informal report. Highly neurotic female participants showed larger heart rate changes in response to a male bully than to a female bully. The opposite was the case for highly neurotic male participants (note, however, that the highest increase in heart rate was observed in men with low neuroticism scores being bullied by a male, which is not in line with the pattern described). When only the cross-gender effects are addressed, it seems that in line with the construct of neuroticism (<xref ref-type="bibr" rid="B24">Eysenck, 1947</xref>), highly neurotic persons experience high stress levels especially when they are bullied by a person of the opposite sex. While research has shown that males more often bully males and that both females and males mistreat females (<xref ref-type="bibr" rid="B55">Narayanan and Betts, 2014</xref>), it might be that the unusual situation of male participants being oppressed by a female bully led the heart rate to increase. In contrast, although females might have experience of being bullied by both genders, the physical appearance of the male bully might have been more intimidating, leading to the increased heart rate. Although this claim cannot be corroborated by previous research, it seems generally plausible to assume that male bodies are perceived as more threatening. However, would this matter in a VR environment, in which no physical harm can be done? This also needs to be addressed in future research, but for the moment, in line with media equation assumptions (<xref ref-type="bibr" rid="B66">Reeves and Nass, 1996</xref>; <xref ref-type="bibr" rid="B44">Kr&#x00E4;mer et al., 2015</xref>), we suggest that people automatically react to virtual characters in the way they would toward real humans.</p>
<p>The same pattern of results was revealed for the intention to informally report the mistreatment: Highly neurotic males would be more likely to report bullying by a female to their friends, and might be disturbed by the role-incoherence of the female bully. In turn, highly neurotic females would be more likely to report bullying by a male to their friends.</p>
<p>The analyses showed a further interaction effect of participants&#x2019; gender and bully&#x2019;s gender on skin conductance for participants with a very low and a very high need to belong. Participants with a low need to belong had very similar skin conductance levels in response to the male and female bully, with the notable exception that male participants reacted more strongly to the female oppressor. However, those participants with a high need to belong seem to react in a special way to a same-sex bully: Female participants showed an increase in skin conductance level in the presence of the female bully, while male participants showed such an increase in response to the male bully. Female participants were rather unaffected by their need to belong level in the presence of a male bully; indeed, those with a high need to belong even showed a slight decrease in their skin conductance level. Most notably, the combination of a male participant being oppressed by a female bully was strongly affected by the participants&#x2019; need to belong: While male participants with a low need to belong had a very strong skin conductance increase, the conductance was rather low in those with a high need to belong. This pattern is &#x2013; as is customary with three-way interactions &#x2013; very difficult to interpret, but seems to indicate that especially for male participants, the need to belong influences their reactions, rendering male participants with a low need to belong especially susceptible to the female bully. Moreover, the results indicate again that people with a high need to belong rather strive for same-sex connections and are more affected when they are bullied by their own sex. With regard to psychophysiological reactions, however, this pattern only emerged for skin conductance. This might indicate that in this regard, reactions are less connected to energizing activity, and are rather associated with inhibition and anxiety (<xref ref-type="bibr" rid="B27">Fowles, 1980</xref>). Given that we cannot exhaustively explain the patterns (e.g., why people even feel threatened when they have a low need to belong, which appears to suggest that the need to belong is not a prerequisite for reactions), future research needs to incorporate the need to belong.</p>
<p>It is also very important to take a closer look at what the results might mean for the identification of resilience factors: In line with results by <xref ref-type="bibr" rid="B28">Friborg et al. (2005)</xref>, neuroticism affected the outcomes and especially influenced the impact of the bully&#x2019;s gender. However, low neuroticism or emotional stability did not ease reactions in general, but only depending on the bully&#x2019;s gender. Therefore, it cannot be seen as a general resilience factor. Findings regarding the role of need to belong were also mixed. While this trait affected perceived bullying and skin conductance, the results did not reveal a clear pattern. At the very least, this construct is worthy of inclusion and testing in future studies. Concerning the question of whether social gender can serve as a resilience factor, we found one single effect of self-reported masculinity on the willingness to formally report the bullying, indicating that with increasingly masculine attributes, the likelihood of reporting the mistreatment in a formal way increased. Given that masculine attributes comprise self-confidence and the ability to deal with pressure (<xref ref-type="bibr" rid="B74">Stein et al., 1992</xref>), it is logical that these attributes would support the participant to defend her/himself by reporting the mistreatment in formal situations. This is in line with findings that self-esteem fosters resilience (<xref ref-type="bibr" rid="B70">Sapouna and Wolke, 2013</xref>), although this effect did not directly emerge in our study. Moreover, social gender influenced the effect of the bully&#x2019;s gender on heart rate changes. In conclusion, we recommend the inclusion of social gender in further studies. However, as the reliability of the scales used in our study proved to be rather low, we would suggest the use of different instruments. Furthermore, an explicit consideration of androgyny would be beneficial, as this could turn out to be a more adequate resilience factor than masculinity, the effects of which were rather ambiguous.</p>
<p>With regard to the overarching question of whether the system could be used to train resilience and appropriate behavior after a bullying event, we can conclude that future developments in this direction would be worthwhile. As the results show that people react to bullies in virtual environments, and feel especially threatened by a male bully, the environment could conceivably be used to train resilience against bullying. The experience might, for example, be integrated into a workshop, in which participants learn to withstand the bullying, regulate their emotions, and are taught appropriate responses &#x2013; to the bully as well as regarding the reporting of the behavior.</p>
<p>The study is, of course, not without limitations. Most importantly, our results are limited to showing the effects of bullies of different gender on participants of different gender, additionally considering the role of several person variables. Our design cannot provide insights into the general question of whether the effects in the virtual environment differ from those in the real world and/or whether the effects are due to the specific bullying rather than the acting rehearsal situation. Although questions such as these have been targeted in previous research, it might be useful to address them again in further studies that include the appropriate control groups.</p>
<p>Although the sample is of a reasonable size for a laboratory study, the number of participants is nevertheless rather low when considering three-way interactions. Furthermore, the sample was quite homogenous and included mostly students. Therefore, the results are only generalizable to students &#x2013; although students constitute one of the most important target groups for future training interventions. Given the specific setting we used (bullying by a figure of authority in an institutional setting), the results might also not be generalizable to other, more informal bullying by peers. However, as a first step, we aimed to gain insights into people&#x2019;s willingness to report misbehavior of a superior, as this might even be more difficult and worthy of training compared to reporting bullying by peers. The specific setting also entailed a situation that might not have been appealing to all participants, although this would likely have been true for any type of task. However, it should be noted here that the situation might not have been sufficiently threatening, as the mean values show only mild perceptions of threat. Moreover, the setting only included a small amount of ridiculing, although this is a frequent element of bullying. Another potentially problematic aspect of the virtual environment is the fact that the second virtual character, the fellow student, was always male. Although this was kept constant in all conditions, it might have influenced especially female participants in specific ways.</p>
<p>Some limitations regarding the dependent variables also need to be noted. For example, the mental state scale was developed as a scale for clinical samples, which always bears the risk that there is only limited variance in a sample with non-clinical participants. However, variance appeared to be in a normal range in the present study. The psychophysiological measures have to be treated with caution, as the Empatica E4 has not been validated in previous studies, meaning that it is unclear whether the data might be influenced by artifacts. Another methodological problem is that during the baseline measurement, participants already knew whether they would be interacting with a female or male instructor, since they had seen a picture of the virtual character in the instructions. This might have attenuated the effects. For future studies including gender (especially gender of the bully), it would be advisable to collect data on stereotypical beliefs. An awareness of the participants&#x2019; gender stereotypes might facilitate the interpretation of some of the results. With regard to the person variables and potential moderators, we included those which have already been described in the literature (such as neuroticism, gender and self-esteem), but other variables, for instance prior experience with verbal and physical bullying, might, of course, also have influenced the results.</p>
</sec>
<sec><title>Conclusion</title>
<p>The present study demonstrates that a virtual bullying situation can have distinct effects. With regard to basic research, we conclude that the use of such an environment enables researchers to deepen their understanding of processes in bullying situations and to identify factors that influence victims&#x2019; reactions and resilience. Specifically, the results demonstrate that a male bully is perceived to be more threatening than a female bully, and that men in particular react to bullying with an increased heart rate, which might indicate their readiness to act. Moreover, the personality factors neuroticism, need to belong and social gender moderate the results. With a view to future applications, the environment could indeed be used in order to prepare people for potential future bullying situations &#x2013; especially when a male bully is used. The experience might be used as part of an education program that builds on the emotional reactions by reflecting on appropriate reactions and training self-regulation of one&#x2019;s own emotions, as well as learning about appropriate further actions such as formal reporting.</p>
</sec>
<sec><title>Ethics Statement</title>
<p>This study was carried out in accordance with the recommendations of the APA with written informed consent from all subjects. All subjects gave written informed consent in accordance with the Declaration of Helsinki. The protocol was approved by the local ethics committee of the Department of Computer Science and Applied Cognitive Science of the University of Duisburg-Essen.</p>
</sec>
<sec><title>Author Contributions</title>
<p>Conceptualization of the study: NK, SM, and DF. Development of the virtual environment: SM and DF. Collection of the data: ET. Technical support for data collection: DF. Data analyses: ET and SS. Writing of the manuscript: NK and SS. Editing of the manuscript: SM.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<sec sec-type="supplementary material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00253/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00253/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Video_1.mp4" id="SM1" mimetype="video/mp4" xmlns:xlink="http://www.w3.org/1999/xlink">
<label>VIDEO 1</label>
<caption><p>Oculus video of the bullying situation featuring the male perpetrator.</p></caption>
</supplementary-material>
<supplementary-material xlink:href="Video_1.mp4" id="S1" mimetype="video/mp4" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Agervold</surname> <given-names>M.</given-names></name> <name><surname>Mikkelsen</surname> <given-names>E. G.</given-names></name></person-group> (<year>2004</year>). <article-title>Relationships between bullying, psychosocial work environment and individual stress reactions.</article-title> <source><italic>Work Stress</italic></source> <volume>18</volume> <fpage>336</fpage>&#x2013;<lpage>351</lpage>. <pub-id pub-id-type="doi">10.1080/02678370412331319794</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Atherton</surname> <given-names>S.</given-names></name> <name><surname>Antley</surname> <given-names>A.</given-names></name> <name><surname>Evans</surname> <given-names>N.</given-names></name> <name><surname>Cernis</surname> <given-names>E.</given-names></name> <name><surname>Lister</surname> <given-names>R.</given-names></name> <name><surname>Dunn</surname> <given-names>G.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Self-confidence and paranoia: an experimental study using an immersive virtual reality social situation.</article-title> <source><italic>Behav. Cogn. Psychother.</italic></source> <volume>44</volume> <fpage>56</fpage>&#x2013;<lpage>64</lpage>. <pub-id pub-id-type="doi">10.1017/S1352465814000496</pub-id> <pub-id pub-id-type="pmid">25384608</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Banakou</surname> <given-names>D.</given-names></name> <name><surname>Hanumanthu</surname> <given-names>P. D.</given-names></name> <name><surname>Slater</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Virtual embodiment of white people in a black virtual body leads to a sustained reduction in their implicit racial bias.</article-title> <source><italic>Front. Hum. Neurosci.</italic></source> <volume>10</volume>:<issue>601</issue>. <pub-id pub-id-type="doi">10.3389/fnhum.2016.00601</pub-id> <pub-id pub-id-type="pmid">27965555</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barlett</surname> <given-names>C.</given-names></name> <name><surname>Coyne</surname> <given-names>S. M.</given-names></name></person-group> (<year>2014</year>). <article-title>A meta-analysis of sex differences in cyber-bullying behavior: the moderating role of age.</article-title> <source><italic>Aggress. Behav.</italic></source> <volume>40</volume> <fpage>474</fpage>&#x2013;<lpage>488</lpage>. <pub-id pub-id-type="doi">10.1002/ab.21555</pub-id> <pub-id pub-id-type="pmid">25098968</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baumeister</surname> <given-names>R. F.</given-names></name> <name><surname>Campbell</surname> <given-names>J. D.</given-names></name> <name><surname>Krueger</surname> <given-names>J. I.</given-names></name> <name><surname>Vohs</surname> <given-names>K. D.</given-names></name></person-group> (<year>2003</year>). <article-title>Does high self-esteem cause better performance, interpersonal success, happiness, or healthier lifestyles?</article-title> <source><italic>Psychol. Sci. Public Interest</italic></source> <volume>4</volume> <fpage>1</fpage>&#x2013;<lpage>44</lpage>. <pub-id pub-id-type="doi">10.1111/1529-1006.01431</pub-id> <pub-id pub-id-type="pmid">26151640</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baumeister</surname> <given-names>R. F.</given-names></name> <name><surname>Leary</surname> <given-names>M. R.</given-names></name></person-group> (<year>1995</year>). <article-title>The need to belong: desire for interpersonal attachments as a fundamental human motivation.</article-title> <source><italic>Psychol. Bull.</italic></source> <volume>117</volume>:<issue>497</issue>. <pub-id pub-id-type="doi">10.1037/0033-2909.117.3.497</pub-id> <pub-id pub-id-type="pmid">7777651</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berger</surname> <given-names>K. S.</given-names></name></person-group> (<year>2007</year>). <article-title>Update on bullying at school: science forgotten?</article-title> <source><italic>Dev. Rev.</italic></source> <volume>27</volume> <fpage>90</fpage>&#x2013;<lpage>126</lpage>. <pub-id pub-id-type="doi">10.1016/j.dr.2006.08.002</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bertram</surname> <given-names>J.</given-names></name> <name><surname>Moskaliuk</surname> <given-names>J.</given-names></name> <name><surname>Cress</surname> <given-names>U.</given-names></name></person-group> (<year>2015</year>). <article-title>Virtual training: making reality work?</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>43</volume> <fpage>284</fpage>&#x2013;<lpage>292</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2014.10.032</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Biocca</surname> <given-names>F.</given-names></name> <name><surname>Delaney</surname> <given-names>B.</given-names></name></person-group> (<year>1995</year>). <article-title>&#x201C;Immersive virtual reality technology,&#x201D; in</article-title> <source><italic>Communication in the Age of Virtual Reality</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Biocca</surname> <given-names>F.</given-names></name> <name><surname>Levy</surname> <given-names>M. R.</given-names></name></person-group> (<publisher-loc>Hillsdale, MI</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates</publisher-name>), <fpage>57</fpage>&#x2013;<lpage>124</lpage>.</citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blascovich</surname> <given-names>J.</given-names></name> <name><surname>Loomis</surname> <given-names>J.</given-names></name> <name><surname>Beall</surname> <given-names>A. C.</given-names></name> <name><surname>Swinth</surname> <given-names>K. R.</given-names></name> <name><surname>Hoyt</surname> <given-names>C. L.</given-names></name> <name><surname>Bailenson</surname> <given-names>J. N.</given-names></name></person-group> (<year>2002</year>). <article-title>Immersive virtual environment technology as a methodological tool for social psychology.</article-title> <source><italic>Psychol. Inq.</italic></source> <volume>13</volume> <fpage>103</fpage>&#x2013;<lpage>124</lpage>. <pub-id pub-id-type="doi">10.1207/S15327965PLI1302_01</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bollmer</surname> <given-names>J. M.</given-names></name> <name><surname>Harris</surname> <given-names>M. J.</given-names></name> <name><surname>Milich</surname> <given-names>R.</given-names></name></person-group> (<year>2006</year>). <article-title>Reactions to bullying and peer victimization: narratives, physiological arousal, and personality.</article-title> <source><italic>J. Res. Personal.</italic></source> <volume>40</volume> <fpage>803</fpage>&#x2013;<lpage>828</lpage>. <pub-id pub-id-type="doi">10.1016/j.jrp.2005.09.003</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bombari</surname> <given-names>D.</given-names></name> <name><surname>Mast</surname> <given-names>M. S.</given-names></name> <name><surname>Canadas</surname> <given-names>E.</given-names></name> <name><surname>Bachmann</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Studying social interactions through immersive virtual environment technology: virtues, pitfalls, and future challenges.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>6</volume>:<issue>869</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2015.00869</pub-id> <pub-id pub-id-type="pmid">26157414</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Borkenau</surname> <given-names>P.</given-names></name> <name><surname>Ostendorf</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <source><italic>NEO-F&#x00FC;nf-Faktoren Inventar: (NEO-FFI) nach Costa u. McCrae.</italic></source> <publisher-loc>G&#x00F6;ttingen</publisher-loc>: <publisher-name>Hogrefe Verlag f. Psychologie</publisher-name>.</citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bossard</surname> <given-names>C.</given-names></name> <name><surname>Kermarrec</surname> <given-names>G.</given-names></name> <name><surname>Buche</surname> <given-names>C.</given-names></name> <name><surname>Tisseau</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Transfer of learning in virtual environments: a new challenge?</article-title> <source><italic>Virtual Real.</italic></source> <volume>12</volume> <fpage>151</fpage>&#x2013;<lpage>161</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-008-0093-y</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bosson</surname> <given-names>J. K.</given-names></name> <name><surname>Michniewicz</surname> <given-names>K. S.</given-names></name></person-group> (<year>2013</year>). <article-title>Gender dichotomization at the level of ingroup identity: what it is, and why men use it more than women.</article-title> <source><italic>J. Pers. Soc. Psychol.</italic></source> <volume>105</volume> <fpage>425</fpage>&#x2013;<lpage>442</lpage>. <pub-id pub-id-type="doi">10.1037/a0033126</pub-id> <pub-id pub-id-type="pmid">23750813</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cardo&#x015F;</surname> <given-names>R. A.</given-names></name> <name><surname>David</surname> <given-names>O. A.</given-names></name> <name><surname>David</surname> <given-names>D. O.</given-names></name></person-group> (<year>2017</year>). <article-title>Virtual reality exposure therapy in flight anxiety: a quantitative meta-analysis.</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>72</volume> <fpage>371</fpage>&#x2013;<lpage>380</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2017.03.007</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cuddy</surname> <given-names>A. J. C.</given-names></name> <name><surname>Fiske</surname> <given-names>S. T.</given-names></name> <name><surname>Glick</surname> <given-names>P.</given-names></name></person-group> (<year>2008</year>). <article-title>&#x201C;Competence and warmth as universal trait dimensions of interpersonal and intergroup perception: the stereotype content model and the BIAS map,&#x201D; in</article-title> <source><italic>Advances in Experimental Social Psychology</italic></source>, <role>ed.</role> <person-group person-group-type="editor"><name><surname>Zanna</surname> <given-names>M. P.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Academic Press</publisher-name>), <fpage>61</fpage>&#x2013;<lpage>149</lpage>.</citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deutsch</surname> <given-names>F. M.</given-names></name> <name><surname>LeBaron</surname> <given-names>D.</given-names></name> <name><surname>Fryer</surname> <given-names>M. M.</given-names></name></person-group> (<year>1987</year>). <article-title>What is in a smile?</article-title> <source><italic>Psychol. Women Q.</italic></source> <volume>11</volume> <fpage>341</fpage>&#x2013;<lpage>352</lpage>. <pub-id pub-id-type="doi">10.1111/j.1471-6402.1987.tb00908.x</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Donnon</surname> <given-names>T.</given-names></name> <name><surname>Hammond</surname> <given-names>W.</given-names></name></person-group> (<year>2007</year>). <article-title>Understanding the relationship between resiliency and bullying in adolescence: an assessment of youth resiliency from five urban junior high schools.</article-title> <source><italic>Child Adolesc. Psychiatr. Clin. N. Am.</italic></source> <volume>16</volume> <fpage>449</fpage>&#x2013;<lpage>471</lpage>. <pub-id pub-id-type="doi">10.1016/j.chc.2006.11.007</pub-id> <pub-id pub-id-type="pmid">17349518</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Drachen</surname> <given-names>A.</given-names></name> <name><surname>Nacke</surname> <given-names>L. E.</given-names></name> <name><surname>Yannakakis</surname> <given-names>G.</given-names></name> <name><surname>Pedersen</surname> <given-names>A. L.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x201C;Correlaion between heart rate, electrodermal activity and player experience in first-person shooter games,&#x201D; in</article-title> <source><italic>Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games</italic></source>, (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>49</fpage>&#x2013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1145/1836135.1836143</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eagly</surname> <given-names>A. H.</given-names></name> <name><surname>Karau</surname> <given-names>S.</given-names></name></person-group> (<year>2002</year>). <article-title>Role congruity theory of prejudice toward female leaders.</article-title> <source><italic>Psychol. Rev.</italic></source> <volume>109</volume> <fpage>573</fpage>&#x2013;<lpage>598</lpage>. <pub-id pub-id-type="doi">10.1037//0033-295X.109.3.573</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Einarsen</surname> <given-names>S.</given-names></name></person-group> (<year>1999</year>). <article-title>The nature and causes of bullying at work.</article-title> <source><italic>Int. J. Manpow.</italic></source> <volume>20</volume> <fpage>16</fpage>&#x2013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1108/01437729910268588</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Einarsen</surname> <given-names>S.</given-names></name> <name><surname>Raknes</surname> <given-names>B. R. I.</given-names></name> <name><surname>Matthiesen</surname> <given-names>S. B.</given-names></name></person-group> (<year>1994</year>). <article-title>Bullying and harassment at work and their relationships to work environment quality: an exploratory study.</article-title> <source><italic>Eur. J. Work Organ. Psychol.</italic></source> <volume>4</volume> <fpage>381</fpage>&#x2013;<lpage>401</lpage>. <pub-id pub-id-type="doi">10.1080/13594329408410497</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eysenck</surname> <given-names>H. J.</given-names></name></person-group> (<year>1947</year>). <source><italic>Dimensions of Personality.</italic></source> <publisher-loc>Piscataway, NJ</publisher-loc>: <publisher-name>Transaction Publishers</publisher-name>.</citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farra</surname> <given-names>S. L.</given-names></name> <name><surname>Miller</surname> <given-names>E. T.</given-names></name> <name><surname>Hodgson</surname> <given-names>E.</given-names></name></person-group> (<year>2015</year>). <article-title>Virtual reality disaster training: translation to practice.</article-title> <source><italic>Nurse Educ. Pract.</italic></source> <volume>15</volume> <fpage>53</fpage>&#x2013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1016/j.nepr.2013.08.017</pub-id> <pub-id pub-id-type="pmid">24063793</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Feng</surname> <given-names>D.</given-names></name> <name><surname>Jeong</surname> <given-names>D. C.</given-names></name> <name><surname>Kr&#x00E4;mer</surname> <given-names>N. C.</given-names></name> <name><surname>Miller</surname> <given-names>L. C.</given-names></name> <name><surname>Marsella</surname> <given-names>S.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x201C;Is it just me?: Evaluating attribution of negative feedback as a function of virtual instructor&#x2019;s gender and proxemics,&#x201D; in</article-title> <source><italic>Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems</italic></source>, <publisher-loc>S&#x00E3;o Paulo</publisher-loc>, <fpage>810</fpage>&#x2013;<lpage>818</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fowles</surname> <given-names>D. C.</given-names></name></person-group> (<year>1980</year>). <article-title>The three arousal model: implications of gray&#x2019;s two-factor learning theory for heart rate. electrodermal activity, and psychopathy.</article-title> <source><italic>Psychophysiology</italic></source> <volume>17</volume> <fpage>87</fpage>&#x2013;<lpage>104</lpage>. <pub-id pub-id-type="doi">10.1111/j.1469-8986.1980.tb00117.x</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Friborg</surname> <given-names>O.</given-names></name> <name><surname>Barlaug</surname> <given-names>D.</given-names></name> <name><surname>Martinussen</surname> <given-names>M.</given-names></name> <name><surname>Rosenvinge</surname> <given-names>J. H.</given-names></name> <name><surname>Hjemdal</surname> <given-names>O.</given-names></name></person-group> (<year>2005</year>). <article-title>Resilience in relation to personality and intelligence.</article-title> <source><italic>Int. J. Methods Psychiatr. Res.</italic></source> <volume>14</volume> <fpage>29</fpage>&#x2013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.1002/mpr.15</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gamberini</surname> <given-names>L.</given-names></name> <name><surname>Cottone</surname> <given-names>P.</given-names></name> <name><surname>Spagnolli</surname> <given-names>A.</given-names></name> <name><surname>Varotto</surname> <given-names>D.</given-names></name> <name><surname>Mantovani</surname> <given-names>G.</given-names></name></person-group> (<year>2003</year>). <article-title>Responding to a fire emergency in a virtual environment: different patterns of action for different situations.</article-title> <source><italic>Ergonomics</italic></source> <volume>46</volume> <fpage>842</fpage>&#x2013;<lpage>858</lpage>. <pub-id pub-id-type="doi">10.1080/0014013031000111266</pub-id> <pub-id pub-id-type="pmid">12745982</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gerardi</surname> <given-names>M.</given-names></name> <name><surname>Cukor</surname> <given-names>J.</given-names></name> <name><surname>Difede</surname> <given-names>J.</given-names></name> <name><surname>Rizzo</surname> <given-names>A.</given-names></name> <name><surname>Rothbaum</surname> <given-names>B. O.</given-names></name></person-group> (<year>2010</year>). <article-title>Virtual reality exposure therapy for post-traumatic stress disorder and other anxiety disorders.</article-title> <source><italic>Curr. Psychiatry Rep.</italic></source> <volume>12</volume> <fpage>298</fpage>&#x2013;<lpage>305</lpage>. <pub-id pub-id-type="doi">10.1007/s11920-010-0128-4</pub-id> <pub-id pub-id-type="pmid">20535592</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hansen</surname> <given-names>&#x00C5;M.</given-names></name> <name><surname>Hogh</surname> <given-names>A.</given-names></name> <name><surname>Persson</surname> <given-names>R.</given-names></name> <name><surname>Karlson</surname> <given-names>B.</given-names></name> <name><surname>Garde</surname> <given-names>A. H.</given-names></name> <name><surname>&#x00D8;rb&#x00E6;k</surname> <given-names>P.</given-names></name></person-group> (<year>2006</year>). <article-title>Bullying at work, health outcomes, and physiological stress response.</article-title> <source><italic>J. Psychosom. Res.</italic></source> <volume>60</volume> <fpage>63</fpage>&#x2013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychores.2005.06.078</pub-id> <pub-id pub-id-type="pmid">16380312</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hasler</surname> <given-names>B. S.</given-names></name> <name><surname>Spanlang</surname> <given-names>B.</given-names></name> <name><surname>Slater</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). <article-title>Virtual race transformation reverses racial in-group bias.</article-title> <source><italic>PLoS One</italic></source> <volume>12</volume>:<issue>e0174965</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0174965</pub-id> <pub-id pub-id-type="pmid">28437469</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hayes</surname> <given-names>A. F.</given-names></name></person-group> (<year>2013</year>). <source><italic>Model Templates for PROCESS for SPSS and SAS.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name>.</citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holden</surname> <given-names>M. K.</given-names></name></person-group> (<year>2005</year>). <article-title>Virtual environments for motor rehabilitation: review.</article-title> <source><italic>Cyberpsychol. Behav.</italic></source> <volume>8</volume> <fpage>187</fpage>&#x2013;<lpage>211</lpage>. <pub-id pub-id-type="doi">10.1089/cpb.2005.8.187</pub-id> <pub-id pub-id-type="pmid">15971970</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horn</surname> <given-names>J. L.</given-names></name></person-group> (<year>1965</year>). <article-title>A rationale and test for the number of factors in factor analysis.</article-title> <source><italic>Psychometrika</italic></source> <volume>30</volume> <fpage>179</fpage>&#x2013;<lpage>185</lpage>. <pub-id pub-id-type="doi">10.1007/BF02289447</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iachini</surname> <given-names>T.</given-names></name> <name><surname>Coello</surname> <given-names>Y.</given-names></name> <name><surname>Frassinetti</surname> <given-names>F.</given-names></name> <name><surname>Senese</surname> <given-names>V. P.</given-names></name> <name><surname>Galante</surname> <given-names>F.</given-names></name> <name><surname>Ruggiero</surname> <given-names>G.</given-names></name></person-group> (<year>2016</year>). <article-title>Peripersonal and interpersonal space in virtual and real environments: effects of gender and age.</article-title> <source><italic>J. Environ. Psychol.</italic></source> <volume>45</volume> <fpage>154</fpage>&#x2013;<lpage>164</lpage>. <pub-id pub-id-type="doi">10.1016/j.jenvp.2016.01.004</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jeong</surname> <given-names>D. C.</given-names></name> <name><surname>Feng</surname> <given-names>D.</given-names></name> <name><surname>Kr&#x00E4;mer</surname> <given-names>N. C.</given-names></name> <name><surname>Miller</surname> <given-names>L. C.</given-names></name> <name><surname>Marsella</surname> <given-names>S.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x201C;Negative feedback in your face: examining the effects of proxemics and gender on learning,&#x201D; in</article-title> <source><italic>Proceedings of the International Conference on Intelligent Virtual Agents</italic></source>, (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>170</fpage>&#x2013;<lpage>183</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-67401-8_19</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Juvonen</surname> <given-names>J.</given-names></name> <name><surname>Graham</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>Bullying in schools: the power of bullies and the plight of victims.</article-title> <source><italic>Annu. Rev. Psychol.</italic></source> <volume>65</volume> <fpage>159</fpage>&#x2013;<lpage>185</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-psych-010213-115030</pub-id> <pub-id pub-id-type="pmid">23937767</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kljakovic</surname> <given-names>M.</given-names></name> <name><surname>Hunt</surname> <given-names>C.</given-names></name></person-group> (<year>2016</year>). <article-title>A meta-analysis of predictors of bullying and victimisation in adolescence.</article-title> <source><italic>J. Adolesc.</italic></source> <volume>49</volume> <fpage>134</fpage>&#x2013;<lpage>145</lpage>. <pub-id pub-id-type="doi">10.1016/j.adolescence.2016.03.002</pub-id> <pub-id pub-id-type="pmid">27060847</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kod&#x017E;opelji&#x0107;</surname> <given-names>J.</given-names></name> <name><surname>Smederevac</surname> <given-names>S.</given-names></name> <name><surname>Mitrovi&#x0107;</surname> <given-names>D.</given-names></name> <name><surname>Dini&#x0107;</surname> <given-names>B.</given-names></name> <name><surname>&#x00C8;olovi&#x0107;</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). <article-title>School bullying in adolescence and personality traits: a person-centered approach.</article-title> <source><italic>J. Interpers. Violence</italic></source> <volume>29</volume> <fpage>736</fpage>&#x2013;<lpage>757</lpage>. <pub-id pub-id-type="doi">10.1177/0886260513505216</pub-id> <pub-id pub-id-type="pmid">24255068</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kostev</surname> <given-names>K.</given-names></name> <name><surname>Rex</surname> <given-names>J.</given-names></name> <name><surname>Schr&#x00F6;der-Bernhardi</surname> <given-names>D.</given-names></name> <name><surname>Mergenthaler</surname> <given-names>U.</given-names></name> <name><surname>Waehlert</surname> <given-names>L.</given-names></name></person-group> (<year>2013</year>). <article-title>Risk of psychiatric and neurological diseases in patients with workspace mobbing experience in Germany: a retrospective database analysis.</article-title> <source><italic>Ger. Med. Sci.</italic></source> <fpage>16</fpage>. <pub-id pub-id-type="doi">10.1016/j.jval.2013.08.1371</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kothgassner</surname> <given-names>O. D.</given-names></name> <name><surname>Felnhofer</surname> <given-names>A.</given-names></name> <name><surname>Hlavacs</surname> <given-names>H.</given-names></name> <name><surname>Beutl</surname> <given-names>L.</given-names></name> <name><surname>Palme</surname> <given-names>R.</given-names></name> <name><surname>Kryspin-Exner</surname> <given-names>I.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Salivary cortisol and cardiovascular reactivity to a public speaking task in a virtual and real-life environment.</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>62</volume> <fpage>124</fpage>&#x2013;<lpage>135</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2016.03.081</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kotlyar</surname> <given-names>M.</given-names></name> <name><surname>Donahue</surname> <given-names>C.</given-names></name> <name><surname>Thuras</surname> <given-names>P.</given-names></name> <name><surname>Kushner</surname> <given-names>M. G.</given-names></name> <name><surname>O&#x2019;Gorman</surname> <given-names>N.</given-names></name> <name><surname>Smith</surname> <given-names>E. A.</given-names></name><etal/></person-group> (<year>2008</year>). <article-title>Physiological response to a speech stressor presented in a virtual reality environment.</article-title> <source><italic>Psychophysiology</italic></source> <volume>45</volume> <fpage>1034</fpage>&#x2013;<lpage>1037</lpage>. <pub-id pub-id-type="doi">10.1111/j.1469-8986.2008.00690.x</pub-id> <pub-id pub-id-type="pmid">18778321</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kr&#x00E4;mer</surname> <given-names>N. C.</given-names></name> <name><surname>Rosenthal-von der P&#x00FC;tten</surname> <given-names>A.</given-names></name> <name><surname>Hoffmann</surname> <given-names>L.</given-names></name></person-group> (<year>2015</year>). <article-title>&#x201C;Social effects of virtual and robot companions,&#x201D; in</article-title> <source><italic>The Handbook of the Psychology of Communication Technology</italic></source>, <role>ed.</role> <person-group person-group-type="editor"><name><surname>Sundar</surname> <given-names>S. S.</given-names></name></person-group> (<publisher-loc>Chichester</publisher-loc>: <publisher-name>John Wiley</publisher-name>), <fpage>137</fpage>&#x2013;<lpage>151</lpage>.</citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lazarus</surname> <given-names>R.</given-names></name> <name><surname>Folkman</surname> <given-names>S.</given-names></name></person-group> (<year>1984</year>). <source><italic>Stress, Appraisal and Coping.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>.</citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leary</surname> <given-names>M. R.</given-names></name> <name><surname>Kelly</surname> <given-names>K. M.</given-names></name> <name><surname>Cottrell</surname> <given-names>C. A.</given-names></name> <name><surname>Schreindorfer</surname> <given-names>L. S.</given-names></name></person-group> (<year>2013</year>). <article-title>Construct validity of the need to belong scale: mapping the nomological network.</article-title> <source><italic>J. Pers. Assess.</italic></source> <volume>95</volume> <fpage>610</fpage>&#x2013;<lpage>624</lpage>. <pub-id pub-id-type="doi">10.1080/00223891.2013.819511</pub-id> <pub-id pub-id-type="pmid">23905716</pub-id></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lhommet</surname> <given-names>M.</given-names></name> <name><surname>Marsella</surname> <given-names>S. C.</given-names></name></person-group> (<year>2013</year>). <source><italic>Gesture with Meaning. In International Workshop on Intelligent Virtual Agents.</italic></source> <publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>, <fpage>303</fpage>&#x2013;<lpage>312</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-642-40415-3_27</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loomis</surname> <given-names>J. M.</given-names></name> <name><surname>Blascovich</surname> <given-names>J. J.</given-names></name> <name><surname>Beall</surname> <given-names>A. C.</given-names></name></person-group> (<year>1999</year>). <article-title>Immersive virtual environment technology as a basic research tool in psychology.</article-title> <source><italic>Behav. Res. Methods Instrum. Comput.</italic></source> <volume>31</volume> <fpage>557</fpage>&#x2013;<lpage>564</lpage>. <pub-id pub-id-type="doi">10.3758/BF03200735</pub-id> <pub-id pub-id-type="pmid">10633974</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lutgen-Sandvik</surname> <given-names>P.</given-names></name> <name><surname>Tracy</surname> <given-names>S. J.</given-names></name> <name><surname>Alberts</surname> <given-names>J. K.</given-names></name></person-group> (<year>2007</year>). <article-title>Burned by bullying in the American workplace: prevalence, perception, degree and impact.</article-title> <source><italic>J. Manag. Stud.</italic></source> <volume>44</volume> <fpage>837</fpage>&#x2013;<lpage>862</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-6486.2007.00715.x</pub-id></citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maister</surname> <given-names>L.</given-names></name> <name><surname>Slater</surname> <given-names>M.</given-names></name> <name><surname>Sanchez-Vives</surname> <given-names>M. V.</given-names></name> <name><surname>Tsakiris</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Changing bodies changes minds: owning another body affects social cognition.</article-title> <source><italic>Trends Cogn. Sci.</italic></source> <volume>19</volume> <fpage>6</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1016/j.tics.2014.11.001</pub-id> <pub-id pub-id-type="pmid">25524273</pub-id></citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mapala</surname> <given-names>T.</given-names></name> <name><surname>Warmelink</surname> <given-names>L.</given-names></name> <name><surname>Linkenauger</surname> <given-names>S. A.</given-names></name></person-group> (<year>2017</year>). <article-title>Jumping the gun: faster response latencies to deceptive questions in a realistic scenario.</article-title> <source><italic>Psychon. Bull. Rev.</italic></source> <volume>24</volume> <fpage>1350</fpage>&#x2013;<lpage>1358</lpage>. <pub-id pub-id-type="doi">10.3758/s13423-016-1218-z</pub-id> <pub-id pub-id-type="pmid">28290127</pub-id></citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marsella</surname> <given-names>S.</given-names></name> <name><surname>Xu</surname> <given-names>Y.</given-names></name> <name><surname>Lhommet</surname> <given-names>M.</given-names></name> <name><surname>Feng</surname> <given-names>A.</given-names></name> <name><surname>Scherer</surname> <given-names>S.</given-names></name> <name><surname>Shapiro</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). &#x201C;<article-title>Virtual character performance from speech</article-title>,&#x201D; in <source><italic>Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation</italic></source>, (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>25</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1145/2485895.2485900</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McAuley</surname> <given-names>E.</given-names></name> <name><surname>Duncan</surname> <given-names>T. E.</given-names></name> <name><surname>Russell</surname> <given-names>D. W.</given-names></name></person-group> (<year>1992</year>). <article-title>Measuring causal attributions: the Revised Causal Dimensions Scale (CDSII).</article-title> <source><italic>Pers. Soc. Psychol. Bull.</italic></source> <volume>18</volume> <fpage>566</fpage>&#x2013;<lpage>573</lpage>. <pub-id pub-id-type="doi">10.1177/0146167292185006</pub-id></citation></ref>
<ref id="B54"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miles</surname> <given-names>H. C.</given-names></name> <name><surname>Pop</surname> <given-names>S. R.</given-names></name> <name><surname>Watt</surname> <given-names>S. J.</given-names></name> <name><surname>Lawrence</surname> <given-names>G. P.</given-names></name> <name><surname>John</surname> <given-names>N. W.</given-names></name></person-group> (<year>2012</year>). <article-title>A review of virtual environments for training in ball sports.</article-title> <source><italic>Comput. Graph.</italic></source> <volume>36</volume> <fpage>714</fpage>&#x2013;<lpage>726</lpage>. <pub-id pub-id-type="doi">10.1016/j.cag.2012.04.007</pub-id></citation></ref>
<ref id="B55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Narayanan</surname> <given-names>A.</given-names></name> <name><surname>Betts</surname> <given-names>L. R.</given-names></name></person-group> (<year>2014</year>). <article-title>Bullying behaviors and victimization experiences among adolescent students: the role of resilience.</article-title> <source><italic>J. Genet. Psychol.</italic></source> <volume>175</volume> <fpage>134</fpage>&#x2013;<lpage>146</lpage>. <pub-id pub-id-type="doi">10.1080/00221325.2013.834290</pub-id> <pub-id pub-id-type="pmid">24796160</pub-id></citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Navarro</surname> <given-names>R.</given-names></name> <name><surname>Yubero</surname> <given-names>S.</given-names></name> <name><surname>Larra&#x00F1;aga</surname> <given-names>E.</given-names></name></person-group> (<year>2015</year>). <article-title>Psychosocial risk factors for involvement in bullying behaviors: empirical comparison between cyberbullying and social bullying victims and bullies.</article-title> <source><italic>School Ment. Health</italic></source> <volume>7</volume> <fpage>235</fpage>&#x2013;<lpage>248</lpage>. <pub-id pub-id-type="doi">10.1007/s12310-015-9157-9</pub-id></citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nielsen</surname> <given-names>M. B.</given-names></name> <name><surname>Knardahl</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>Is workplace bullying related to the personality traits of victims? A two-year prospective study.</article-title> <source><italic>Work Stress</italic></source> <volume>29</volume> <fpage>128</fpage>&#x2013;<lpage>149</lpage>. <pub-id pub-id-type="doi">10.1080/02678373.2015.1032383</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oh</surname> <given-names>S. Y.</given-names></name> <name><surname>Bailenson</surname> <given-names>J.</given-names></name> <name><surname>Weisz</surname> <given-names>E.</given-names></name> <name><surname>Zaki</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>Virtually old: embodied perspective taking and the reduction of ageism under threat.</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>60</volume> <fpage>398</fpage>&#x2013;<lpage>410</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2016.02.007</pub-id></citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Olthof</surname> <given-names>T.</given-names></name> <name><surname>Goossens</surname> <given-names>F. A.</given-names></name></person-group> (<year>2008</year>). <article-title>Bullying and the need to belong: early adolescents&#x2019; bullying-related behavior and the acceptance they desire and receive from particular classmates.</article-title> <source><italic>Soc. Dev.</italic></source> <volume>17</volume> <fpage>24</fpage>&#x2013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-9507.2007.00413.x</pub-id></citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Olweus</surname> <given-names>D.</given-names></name></person-group> (<year>1993</year>). <article-title>&#x201C;Victimization by peers: antecedents and long-term outcomes,&#x201D; in</article-title> <source><italic>Social Withdrawal, Inhibition, and Shyness in Childhood</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Rubin</surname> <given-names>K. H.</given-names></name> <name><surname>Asendorpf</surname> <given-names>J. B.</given-names></name></person-group> (<publisher-loc>Hillsdale, MI</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates, Inc.</publisher-name>), <fpage>315</fpage>&#x2013;<lpage>341</lpage>.</citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pan</surname> <given-names>X.</given-names></name> <name><surname>Slater</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>&#x201C;Confronting a moral dilemma in virtual reality: a pilot study,&#x201D; in</article-title> <source><italic>Proceedings of the 25th BCS Conference on Human-Computer Interaction</italic></source>, (<publisher-loc>Swindon</publisher-loc>: <publisher-name>British Computer Society</publisher-name>), <fpage>46</fpage>&#x2013;<lpage>51</lpage>.</citation></ref>
<ref id="B62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pedreira da Fonseca</surname> <given-names>E.</given-names></name> <name><surname>Ribeiro da Silva</surname> <given-names>N. M.</given-names></name> <name><surname>Pinto</surname> <given-names>E. B.</given-names></name></person-group> (<year>2017</year>). <article-title>Therapeutic effect of virtual reality on post-stroke patients: randomized clinical trial.</article-title> <source><italic>J. Stroke Cerebrovasc. Dis.</italic></source> <volume>26</volume> <fpage>94</fpage>&#x2013;<lpage>100</lpage>. <pub-id pub-id-type="doi">10.1016/j.jstrokecerebrovasdis.2016.08.035</pub-id> <pub-id pub-id-type="pmid">27693404</pub-id></citation></ref>
<ref id="B63"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pertaub</surname> <given-names>D. P.</given-names></name> <name><surname>Slater</surname> <given-names>M.</given-names></name> <name><surname>Barker</surname> <given-names>C.</given-names></name></person-group> (<year>2002</year>). <article-title>An experiment on public speaking anxiety in response to three different types of virtual audience.</article-title> <source><italic>Presence</italic></source> <volume>11</volume> <fpage>68</fpage>&#x2013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.1162/105474602317343668</pub-id></citation></ref>
<ref id="B64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Potkonjak</surname> <given-names>V.</given-names></name> <name><surname>Gardner</surname> <given-names>M.</given-names></name> <name><surname>Callaghan</surname> <given-names>V.</given-names></name> <name><surname>Mattila</surname> <given-names>P.</given-names></name> <name><surname>Guetl</surname> <given-names>C.</given-names></name> <name><surname>Petrovi&#x0107;</surname> <given-names>V. M.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Virtual laboratories for education in science, technology, and engineering: a review.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>95</volume> <fpage>309</fpage>&#x2013;<lpage>327</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2016.02.002</pub-id></citation></ref>
<ref id="B65"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Prentice</surname> <given-names>D. A.</given-names></name> <name><surname>Carranza</surname> <given-names>E.</given-names></name></person-group> (<year>2002</year>). <article-title>What women and men should be, shouldn&#x2019;t be, are allowed to be, and don&#x2019;t have to be: the contents of prescriptive gender stereotypes.</article-title> <source><italic>Psychol. Women Q.</italic></source> <volume>26</volume> <fpage>269</fpage>&#x2013;<lpage>281</lpage>. <pub-id pub-id-type="doi">10.1111/1471-6402.t01-1-00066</pub-id></citation></ref>
<ref id="B66"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reeves</surname> <given-names>B.</given-names></name> <name><surname>Nass</surname> <given-names>C.</given-names></name></person-group> (<year>1996</year>). <source><italic>The Media Equation: How People Treat Computers, Television, and New Media like Real People and Places.</italic></source> <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="B67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rizzo</surname> <given-names>A.</given-names></name> <name><surname>John</surname> <given-names>B.</given-names></name> <name><surname>Newman</surname> <given-names>B.</given-names></name> <name><surname>Williams</surname> <given-names>J.</given-names></name> <name><surname>Hartholt</surname> <given-names>A.</given-names></name> <name><surname>Lethin</surname> <given-names>C.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Virtual reality as a tool for delivering PTSD exposure therapy and stress resilience training.</article-title> <source><italic>Mil. Behav. Health</italic></source> <volume>1</volume> <fpage>52</fpage>&#x2013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.1080/21635781.2012.721064</pub-id></citation></ref>
<ref id="B68"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosenberg</surname> <given-names>M.</given-names></name></person-group> (<year>1965</year>). <source><italic>Society and the Adolescent Self-Image.</italic></source> <publisher-loc>Princeton, NJ</publisher-loc>: <publisher-name>Princeton University Press</publisher-name>.</citation></ref>
<ref id="B69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Runge</surname> <given-names>T. E.</given-names></name> <name><surname>Frey</surname> <given-names>D.</given-names></name> <name><surname>Gollwitzer</surname> <given-names>P. M.</given-names></name> <name><surname>Helmreich</surname> <given-names>R. L.</given-names></name> <name><surname>Spence</surname> <given-names>J. T.</given-names></name></person-group> (<year>1981</year>). <article-title>Masculine (instrumental) and feminine (expressive) traits: a comparison between students in the United States and West Germany.</article-title> <source><italic>J. Cross Cult. Psychol.</italic></source> <volume>12</volume> <fpage>142</fpage>&#x2013;<lpage>162</lpage>. <pub-id pub-id-type="doi">10.1177/0022022181122002</pub-id> <pub-id pub-id-type="pmid">19500856</pub-id></citation></ref>
<ref id="B70"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sapouna</surname> <given-names>M.</given-names></name> <name><surname>Wolke</surname> <given-names>D.</given-names></name></person-group> (<year>2013</year>). <article-title>Resilience to bullying victimization: the role of individual, family and peer characteristics.</article-title> <source><italic>Child Abuse Negl.</italic></source> <volume>37</volume> <fpage>997</fpage>&#x2013;<lpage>1006</lpage>. <pub-id pub-id-type="doi">10.1016/j.chiabu.2013.05.009</pub-id> <pub-id pub-id-type="pmid">23809169</pub-id></citation></ref>
<ref id="B71"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selye</surname> <given-names>H.</given-names></name></person-group> (<year>1950</year>). <source><italic>The Physiology and Pathology of Exposure to STRESS.</italic></source> <publisher-loc>Montreal</publisher-loc>: <publisher-name>ACTA Medical Publishers</publisher-name>.</citation></ref>
<ref id="B72"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seymour</surname> <given-names>N. E.</given-names></name> <name><surname>Gallagher</surname> <given-names>A. G.</given-names></name> <name><surname>Roman</surname> <given-names>S. A.</given-names></name> <name><surname>O&#x2019;brien</surname> <given-names>M. K.</given-names></name> <name><surname>Bansal</surname> <given-names>V. K.</given-names></name> <name><surname>Andersen</surname> <given-names>D. K.</given-names></name><etal/></person-group> (<year>2002</year>). <article-title>Virtual reality training improves operating room performance: results of a randomized, double-blinded study.</article-title> <source><italic>Ann. Surg.</italic></source> <volume>236</volume> <fpage>458</fpage>&#x2013;<lpage>463</lpage>. <pub-id pub-id-type="doi">10.1097/00000658-200210000-00008</pub-id></citation></ref>
<ref id="B73"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Slater</surname> <given-names>M.</given-names></name> <name><surname>Pertaub</surname> <given-names>D. P.</given-names></name> <name><surname>Barker</surname> <given-names>C.</given-names></name> <name><surname>Clark</surname> <given-names>D. M.</given-names></name></person-group> (<year>2006</year>). <article-title>An experimental study on fear of public speaking using a virtual environment.</article-title> <source><italic>CyberPsychol. Behav.</italic></source> <volume>9</volume> <fpage>627</fpage>&#x2013;<lpage>633</lpage>. <pub-id pub-id-type="doi">10.1089/cpb.2006.9.627</pub-id> <pub-id pub-id-type="pmid">17034333</pub-id></citation></ref>
<ref id="B74"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stein</surname> <given-names>J. A.</given-names></name> <name><surname>Newcomb</surname> <given-names>M. D.</given-names></name> <name><surname>Bentler</surname> <given-names>P. M.</given-names></name></person-group> (<year>1992</year>). <article-title>The effect of agency and communality on self-esteem: gender differences in longitudinal data.</article-title> <source><italic>Sex Roles</italic></source> <volume>26</volume> <fpage>465</fpage>&#x2013;<lpage>483</lpage>. <pub-id pub-id-type="doi">10.1007/BF00289869</pub-id></citation></ref>
<ref id="B75"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Turner</surname> <given-names>M. G.</given-names></name> <name><surname>Exum</surname> <given-names>M.</given-names></name> <name><surname>Brame</surname> <given-names>R.</given-names></name> <name><surname>Holt</surname> <given-names>T. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Bullying victimization and adolescent mental health: general and typological effects across sex.</article-title> <source><italic>J. Crim. Justice</italic></source> <volume>41</volume> <fpage>53</fpage>&#x2013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.1016/j.jcrimjus.2012.12.005</pub-id></citation></ref>
<ref id="B76"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Unnever</surname> <given-names>J. D.</given-names></name> <name><surname>Cornell</surname> <given-names>D. G.</given-names></name></person-group> (<year>2004</year>). <article-title>Middle school victims of bullying: who reports being bullied?</article-title> <source><italic>Aggress. Behav.</italic></source> <volume>30</volume> <fpage>373</fpage>&#x2013;<lpage>388</lpage>. <pub-id pub-id-type="doi">10.1002/ab.20030</pub-id></citation></ref>
<ref id="B77"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Heugten</surname> <given-names>K.</given-names></name></person-group> (<year>2013</year>). <article-title>Resilience as an underexplored outcome of workplace bullying.</article-title> <source><italic>Qual. Health Res.</italic></source> <volume>23</volume> <fpage>291</fpage>&#x2013;<lpage>301</lpage>. <pub-id pub-id-type="doi">10.1177/1049732312468251</pub-id> <pub-id pub-id-type="pmid">23211611</pub-id></citation></ref>
<ref id="B78"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>von Soest</surname> <given-names>T.</given-names></name> <name><surname>Mossige</surname> <given-names>S.</given-names></name> <name><surname>Stefansen</surname> <given-names>K.</given-names></name> <name><surname>Hjemdal</surname> <given-names>O.</given-names></name></person-group> (<year>2010</year>). <article-title>A validation study of the resilience scale for adolescents (READ).</article-title> <source><italic>J. Psychopathol. Behav. Assess.</italic></source> <volume>32</volume> <fpage>215</fpage>&#x2013;<lpage>225</lpage>. <pub-id pub-id-type="doi">10.1007/s10862-009-9149-x</pub-id> <pub-id pub-id-type="pmid">15076820</pub-id></citation></ref>
<ref id="B79"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wolke</surname> <given-names>D.</given-names></name> <name><surname>Skew</surname> <given-names>A. J.</given-names></name></person-group> (<year>2012</year>). <article-title>Family factors, bullying victimisation and wellbeing in adolescents.</article-title> <source><italic>Longit. Life Course Stud.</italic></source> <volume>3</volume> <fpage>101</fpage>&#x2013;<lpage>119</lpage>. <pub-id pub-id-type="doi">10.14301/llcs.v3i1.165</pub-id> <pub-id pub-id-type="pmid">28588894</pub-id></citation></ref>
<ref id="B80"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yee</surname> <given-names>N.</given-names></name> <name><surname>Bailenson</surname> <given-names>J. N.</given-names></name> <name><surname>Urbanek</surname> <given-names>M.</given-names></name> <name><surname>Chang</surname> <given-names>F.</given-names></name> <name><surname>Merget</surname> <given-names>D.</given-names></name></person-group> (<year>2007</year>). <article-title>The unbearable likeness of being digital: the persistence of nonverbal social norms in online virtual environments.</article-title> <source><italic>CyberPsychol. Behav.</italic></source> <volume>10</volume> <fpage>115</fpage>&#x2013;<lpage>121</lpage>. <pub-id pub-id-type="doi">10.1089/cpb.2006.9984</pub-id> <pub-id pub-id-type="pmid">17305457</pub-id></citation></ref>
<ref id="B81"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zapf</surname> <given-names>D.</given-names></name> <name><surname>Einarsen</surname> <given-names>S.</given-names></name></person-group> (<year>2011</year>). <article-title>&#x201C;Individual antecedents of bullying: victims and perpetrators,&#x201D; in</article-title> <source><italic>Bullying and Harassment in the Workplace: Developments in theory, Research, and Practice</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Einarsen</surname> <given-names>S.</given-names></name> <name><surname>Hoel</surname> <given-names>H.</given-names></name> <name><surname>Zapf</surname> <given-names>D.</given-names></name> <name><surname>Cooper</surname> <given-names>C. L.</given-names></name></person-group> (<publisher-loc>Boca Raton</publisher-loc>: <publisher-name>Taylor &#x0026; Francis</publisher-name>), <fpage>177</fpage>&#x2013;<lpage>200</lpage>.</citation></ref>
<ref id="B82"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zerssen</surname> <given-names>D. V.</given-names></name> <name><surname>Koeller</surname> <given-names>D. M.</given-names></name></person-group> (<year>1976</year>). <source><italic>Die Befindlichkeits-Skala, Parallelformen BF-S und BF-S&#x2019;.</italic></source> <publisher-loc>Weinheim</publisher-loc>: <publisher-name>Beltz Test Gesellschaft mbH</publisher-name>.</citation></ref>
</ref-list>
</back>
</article>