<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="review-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2024.1116860</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Understanding the situation of bystanders to inform anti-bullying interventions</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Cohane</surname> <given-names>Samantha K.</given-names></name>
<uri xlink:href="https://loop.frontiersin.org/people/2019059/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Schneider</surname> <given-names>Barry H.</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
</contrib>
</contrib-group>
<aff><institution>Department of Psychology and Neuroscience, Boston College</institution>, <addr-line>Chestnut Hill, MA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0002">
<p>Edited by: Marilyn Anne Campbell, Queensland University of Technology, Australia</p>
</fn>
<fn fn-type="edited-by" id="fn0003">
<p>Reviewed by: Shuailei Lian, Yangtze University, China</p>
<p>Gerald Matthews, George Mason University, United States</p>
</fn>
<corresp id="c001">&#x002A;Correspondence: Barry H. Schneider, <email>barry.schneider@bc.edu</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>14</day>
<month>10</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>15</volume>
<elocation-id>1116860</elocation-id>
<history>
<date date-type="received">
<day>05</day>
<month>12</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>19</day>
<month>08</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2024 Cohane and Schneider.</copyright-statement>
<copyright-year>2024</copyright-year>
<copyright-holder>Cohane and Schneider</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Bystanders who witness a bully-victim exchange at their school differ from bystanders who witness many incidents of violence in their community, due to the web of mutual relationships that exist within a school setting. Research conducted in many countries has revealed a variety of ways in which peers too often support and encourage bullies, thereby reinforcing the bully&#x2019;s behavior and further marginalizing their victims. This elucidates the potential benefits of channeling bystanders&#x2019; neutrality into opposition to bullying that is beneficial and supportive of victims. This goal has been incorporated into preventive anti-bullying interventions that have been implemented and evaluated. In this paper, we focus on the contention that systematic anti-bullying intervention in schools and communities can affect the stance of bystanders. We pay particular attention to the KiVa program, which was originally developed in Finland but has since been implemented in schools throughout many countries due to promising data regarding its effectiveness as well as its emphasis on the role of bystanders. We discuss the data documenting the effectiveness of preventive school-based anti-bullying programs, considering the proposition that these programs reduce bullying at least partially by improving bystander behavior. Despite ample evidence that KiVa reduces bullying, there is little specific data showing that the effects of KiVa are mediated by improvements in bystander behavior. The paper concludes with speculation about the possibility of a more direct and active mobilization of student mediators and student leaders to influence the behavior of bystanders in their classrooms and schools.</p>
</abstract>
<kwd-group>
<kwd>bullying</kwd>
<kwd>victimization</kwd>
<kwd>bystanders</kwd>
<kwd>prevention</kwd>
<kwd>aggressive behavior</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="39"/>
<page-count count="8"/>
<word-count count="7022"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Personality and Social Psychology</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<label>1</label>
<title>Introduction</title>
<p>Public concern about inaction by bystanders who witness an act of violence was aroused by the murder of Kitty Genovese in New York City at 3&#x2009;a.m. on a cold March night in 1964. Genovese was attacked in full view of neighbors who shared the courtyard of her apartment building. None of them called the police during the 35-min attack until it was over. The bystander effect shocked the U.S. and the world so strongly that the case is still discussed in scholarly writings (<xref ref-type="bibr" rid="ref20">Kassin, 2017</xref>). The incident also inspired considerable theory-building and research in psychology. <xref ref-type="bibr" rid="ref7">Casey et al. (2017)</xref> summarize the main elements of the <italic>situational model of bystander behavior</italic> espoused by <xref ref-type="bibr" rid="ref8">Darley and Latan&#x00E9; (1968)</xref>. First, bystanders must notice the behavior in question and must perceive it as problematic, serious, and wrong. They must recognize that they have an obligation to intervene in the situation. Finally, they must know what to do or how to decide what to do. Editorials in newspapers around the world decried the anonymity of urban life, which seems to render people indifferent to human beings they do not know.</p>
<p>There is relatively little mention of the fact that neighbors may have failed to help Ms. Genovese because she was an individual of minority sexual orientation (<xref ref-type="bibr" rid="ref20">Kassin, 2017</xref>), as are many victims of bullying in schools today. There has been very limited research on the role of bystanders in incidents of homophobic bullying at school. An important exception is a study by <xref ref-type="bibr" rid="ref2">Ant&#x00F3;nio et al. (2023)</xref>, who found that contact with a hypothetical fellow pupil of minority sexual orientation increased the likelihood of younger, female participants, but not others, to intervene on the victim&#x2019;s behalf. Unfortunately, the major published anti-bullying programs, i.e., KiVa, Second Step and the Olweus program, do not focus specifically on homophobic bullying. It has been found, however, that by insisting that all bullying is wrong regardless of the victim&#x2019;s personal characteristics, they do reduce the victimization of students of minority sexual orientation, as by the gold-standard KiVa program (<xref ref-type="bibr" rid="ref12">Granero Andujar and Manzano-Leon, 2018</xref>). Preliminary results of targeted interventions designed to reduce homophobia, however, suggest that further gain, including more helpful bystander behavior in cases of homophobic bullying, might result if more specific content on homophobia were included (<xref ref-type="bibr" rid="ref1">Amadori et al., 2023</xref>).</p>
<p>Only one in five or six pupils are typically identified by their classmates as bystanders who would intervene actively to defend the victim if they witnessed a fellow pupil being bullied at school. Other bystanders would do nothing, or, even worse, assist the bully or approve of their bullying (<xref ref-type="bibr" rid="ref31">Salmivalli, 2010</xref>), even though many of them express the intention to help the victim even though they do not follow through and act on their intentions (<xref ref-type="bibr" rid="ref6">Boulton et al., 2002</xref>). Scholars recognize that only some parts of the Darley and Latan&#x00E9; model of bystander behavior apply to decision-making concerning bully-victim encounters at school. Those encounters are not usually anonymous as the bully and victim are pupils at the same school. Bystanders may, however, remain uninvolved because they believe that someone else is likely to intervene.</p>
<p>In their pioneering work on bystander behavior in bully-victim encounters at school, Salmivalli (e.g., 2010) identified other aspects of decision-making regarding whether to intervene as a bystander to bullying at school, introducing several constructs not considered in the classic research on the bystander effect. The most important issue mentioned is the need and desire of bystanders regarding their own popularity among their school peers: Bullies, their assistants and those who support and encourage them may feel that their behavior will make them more popular, which tends to be particularly important to them. In this instance, popularity may mean that peers consider them powerful and admire their strength, not necessarily that they are liked or sought after as friends. It has indeed been found that bullying or helping the bully can make an individual popular in some schools and classrooms but not all (<xref ref-type="bibr" rid="ref35">Sentse et al., 2007</xref>).</p>
<p>Working with a large sample of Italian adolescents, <xref ref-type="bibr" rid="ref002">Pozzoli et al. (2012)</xref> confirmed that some of the elements in Darley and Latan&#x00E9;&#x2019;s classic model do apply to thinking about intervening during bullying incidents at school, at least according to the self-reports of the potential intervenors. Their research also elucidated several other important variables that play a role in adolescents&#x2019; decisions about whether to intervene when they witness a bullying episode. Pozzoli and Gini found that the participants&#x2019; decision to defend the victim depended upon their own attitudes regarding bullying and victimization as well as the feeling that they had a moral responsibility to intervene. In addition to variables suggested by Darley and Latan&#x00E9;, pressure by parents and peers emerged in the Italian data as potent predictors of adolescents&#x2019; decision-making. Once more, the methodology used in this study may have affected the findings. Although self-reports were probably the only viable way of obtaining data on decision-making from a large sample, self-reports have various known biases, including the tendency to project a socially desirable image. The self-results of aggressive children are particularly questionable (e.g., <xref ref-type="bibr" rid="ref15">Huizinga, 1991</xref>). Self-reports have the advantage, however, of providing the best access to mental processes accruing within the mental space of an individual.</p>
<p>Many personal characteristics of bullies, victims, and bystanders have been studied. Among these, empathy is highly relevant to the processes that lead bystanders to elect to act in a prosocial way and come to the aid of a victimized fellow student. Specifically, the differences between the two subtypes of empathy, cognitive empathy and affective empathy, as well as the subsequent influence both exert on bystander behaviors have been examined.</p>
<p>Researchers have devoted considerable attention to the study of the associations between empathy and bystander behavior. A three-level meta-analysis of 35 independent studies, by <xref ref-type="bibr" rid="ref9">Deng et al. (2021)</xref>, sought to address the discrepancy in the research regarding empathy&#x2019;s impact on bystander behavior. While many studies report a strong correlation between empathy and bystander defending, others failed to reveal a statistically significant relationship between the two. Deng and colleagues also analyzed whether the type of empathy moderates its effect on bystander behavior. The meta-analysis revealed that there is indeed a positive correlation between empathy and defending behavior from bystanders some interventions designed to improve empathy attempt to get participants to empathize with real people in their lives; others involve hypothetical protagonists, as in stories. <xref ref-type="bibr" rid="ref34">Scott et al. (2022)</xref> designed an intervention to promote positive bystander behavior using children&#x2019;s literature. Empathy was an important component of their intervention with elementary school students from low-SES families. The results indicated an improvement in bystander behavior for the experimental group but not the control participants.</p>
</sec>
<sec sec-type="methods" id="sec2">
<label>2</label>
<title>Method</title>
<p>With evidence that bystanders can improve situations of bullying, it is important to evaluate the effectiveness of potential interventions that specifically target bystanders. We do so by compiling a detailed narrative review of a selection of studies examining KiVa, the most promising of the anti-bullying interventions that specifically target bystander behavior. We examined a variety of randomized control trials (RCTs) of the KiVa program, which took place across multiple different countries, by looking at KiVa&#x2019;s ability to reduce both bullying and victimization. Our review involved careful scrutiny of these studies in order to discover whether the outcome data might be influenced by the sampling, intervention method, research design, and outcome measure selected by the authors. All studies examined include outcome measures related to both bullying and victimization. In our review, we separate studies conducted by the researchers who developed KiVa from studies implemented by other researchers outside of Finland (where the program was most developed). We believe that this generalizability is a fundamental part of the general appraisal of KiVa. We hypothesized that KiVa would be effective at reducing rates of both bullying and victimization, given the growing body of research underscoring the importance of the role bystanders play in bullying situations.</p>
<sec id="sec3">
<label>2.1</label>
<title>KiVa: a prevention program that highlights bystander intervention</title>
<p>KiVa, an Antibullying Program developed at the University of Turku, Finland, specifically focuses on and targets bystander behavior. KiVa asserts that its cornerstones are prevention, intervention, and monitoring (<italic>What is Kiva?</italic>).<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref> The other major school-based prevention programs, Second Step and the Olweus program, provide only general instructions to pupils about not supporting the bully, reporting bullying incidents to an adult, etc. Bystander behavior is featured prominently in a much briefer intervention for secondary-school students called <italic>Say Something</italic> (<xref ref-type="bibr" rid="ref5">Booker et al., 2023</xref>). This intervention consists only of a single 150-min workshop. Despite the small scale of the intervention, the intervention participants reported intervening to support victims of bullying more frequently than members of the control group. Further study and, especially, follow-up data are needed.</p>
<p>KiVa equips teachers with a variety of resources including training modules, materials, and lesson plan manuals. It also includes resources for parents such as a guide that includes general information about bullying, bullying detection, and bullying prevention. According to its website, KiVa is the most rigorously studied antibullying program. The creators of KiVa hypothesized that the less positive reinforcement a bully receives from his or her classmates, the less rewarding bullying will be, which will decrease the motivation to bully to begin with (<xref ref-type="bibr" rid="ref18">K&#x00E4;rn&#x00E4; et al., 2011b</xref>). Indeed, KiVa assumes that bullying is a social, group phenomenon, (<xref ref-type="bibr" rid="ref32">Salmivalli et al., 1996</xref>) meaning that bystander behavior modulates bullying (<xref ref-type="bibr" rid="ref19">K&#x00E4;rn&#x00E4; et al., 2011a</xref>). For this reason, KiVa puts a particular emphasis on shaping the attitudes and behaviors of students who are bystanders.</p>
<p>The bystander material in KiVa does address some components of the situational model of bystander behavior that has emerged from broader research on the bystander effect, introduced earlier. In KiVa, potential bystanders learn very clearly that bullying is a serious problem. They also learn what they can and should do if they witness bullying at school. The identification of bystanders who have fulfilled their responsibilities reduced the anonymity that has been found to lead to standing by idly. Besides being the antibullying program that focuses most specifically on bystander behavior, it is also the one bolstered by the greatest among evaluation data.</p>
<p>The program consists of three separate versions, each tailored to a specific age group (Grades 1&#x2013;3 (ages 6&#x2013;9), Grades 4&#x2013;6 (ages 10&#x2013;12), and Grades 7&#x2013;9 (ages 13&#x2013;16)). In all three versions of the program, KiVa is divided into two types of actions: universal actions and indicated actions. Universal actions are targeted to the entire school and are meant to be implemented, regardless of the circumstances. These actions include 20&#x2009;h of classroom instruction time, consisting of 10 lessons that cover a variety of topics including peer pressure, respect, and the negative outcomes of bullying. The objective of these lessons is to increase students&#x2019; empathy toward bullying victims, spread awareness about the issue of bullying as well as the role the &#x201C;group&#x201D; plays in addressing and preventing it, and equip kids with adequate skills to intervene in situations of bullying, thereby increasing their self-efficacy. Students can strengthen their knowledge of these subjects and improve their defending skills by participating in a computer game as part of KiVa (<xref ref-type="bibr" rid="ref28">Poskiparta et al., 2012</xref>). The game is broken into three parts: &#x201C;I KNOW,&#x201D; &#x201C;I CAN,&#x201D; and &#x201C;I DO.&#x201D; The &#x201C;I CAN&#x201D; and &#x201C;I DO.&#x201D; Parts of the game specifically target bystander behavior by teaching students how to do the right thing in situations of bullying and motivating them to defend victims (&#x201C;I CAN&#x201D;) and then giving them real-world scenarios where they can put these new defending skills into practice (&#x201C;I KNOW&#x201D;). Indicated actions are only utilized in instances when bullying is reported to the school. A team consisting of three teachers (or other school faculty) and the bullied student&#x2019;s classroom teacher is created to address the specific case of bullying. The classroom teacher holds a meeting with between two and four students who exhibit prosocial behaviors and who are considered to be of high social status. Currently, there is no standardized method of picking these students, so it may be beneficial to systematize thus in future evaluation research and/or future revisions revision of the KiVa program. Individual and small group discussions with victims and bullies are implemented, complemented by follow-up meetings.</p>
</sec>
<sec id="sec4">
<label>2.2</label>
<title>The effectiveness of KiVa in Finland</title>
<p>The studies by Salmivalli and her Finnish colleagues that document the effectiveness of KiVa are many, including several featuring longitudinal follow-up and control conditions. The very first RCT of KiVa took place during the 2007&#x2013;2008 academic year when KiVa was implemented in schools throughout Finland in grades 4 through 6 whilst being studied for effectiveness (<xref ref-type="bibr" rid="ref19">K&#x00E4;rn&#x00E4; et al., 2011a</xref>). 78 schools participated in the study, 39 of which were in the KiVa condition (4,207 students) and the other half of which were in the control condition (4,030 students). The study established KiVa as an effective program to target bullying and demonstrated that after only 9&#x2009;months of implementation, KiVa was effective at reducing both victimization and bullying. In addition to demonstrating the overall effectiveness of KiVa, <xref ref-type="bibr" rid="ref19">K&#x00E4;rn&#x00E4; et al. (2011a)</xref> highlighted KiVa&#x2019;s potential to increase prosocial bystander attitudes and empathy, as well as improve bystander behavior. At Wave 2, students in the intervention condition showed increased anti-bullying attitudes and increased empathy. Unfortunately, these effects were rendered null by Wave 3. A similar trend was seen when bystander behavior was analyzed. At Wave 2, students in the intervention condition exhibited defending behaviors more frequently than their counterparts in the control condition. Yet, once again the effect of the intervention on defending behavior was not significant by Wave 3. Despite this, there was a decrease in assisting and reinforcing behaviors at Wave 3. These results are indicative of KiVa&#x2019;s effectiveness at improving bystander responses to bullying, and the areas where KiVa was not effective (i.e., significant effects at Wave 2 that were nonsignificant at Wave 3) guide future research. Future studies should investigate why might this change be occurring, and how KiVa can be improved to create a long-lasting impact on bystander behavior.</p>
<p>The goal of another study by <xref ref-type="bibr" rid="ref003">Saarento et al. (2015)</xref> was to uncover which mechanisms in KiVa lead to this reduction of reported victimization amongst students in grades 4 through 6 who have undergone the program. The results confirmed that students in KiVa schools perceived a significant increase in the number of classmates as defenders of the victim and an increase in their classmates&#x2019; defending behavior. In contrast to their hypothesis, however, these perceptions were not predictive of future bullying. Participants in the KiVa program showed an increase in affective empathy as well as in antibullying attitudes (<xref ref-type="bibr" rid="ref003">Saarento et al., 2015</xref>). Results of the study revealed that antibullying attitudes acted as a mediator for self-reported bullying measures, though this was not the case for affective empathy. As well, participants also perceived an increase in their teacher&#x2019;s overall disapproval of bullying, which led to a statistically significant reduction in self-reported bullying. Results showed that the teacher&#x2019;s attitudes toward bullying also mediated KiVa&#x2019;s effects.</p>
<p><xref ref-type="bibr" rid="ref11">Garandeau et al. (2021)</xref> similarly considered KiVa&#x2019;s impact on empathy, querying whether the KiVa program increases cognitive and/or affective empathy in its participants. Further, they questioned if such effects were consistent across all populations (i.e., people of different genders, races, etc.). They discovered that KiVa had a positive impact on affective empathy, and this effect was seen consistently across students of all demographic backgrounds. At the individual level, affective empathy was significantly higher for participants in the KiVa program, though the effect size was quite small. At the classroom level, a significant positive effect of KiVa on affective empathy was also seen and had a slightly larger, but nonetheless small effect size. The same positive effects were not seen on cognitive empathy. While <xref ref-type="bibr" rid="ref11">Garandeau et al. (2021)</xref> did not measure KiVa&#x2019;s direct influence on bystander behavior, the increase in affective empathy after participation in KiVa might act as a mediator variable and lead to an increase in defending behaviors, considering previous research that demonstrates a positive correlation between bystander defending and affective empathy (<xref ref-type="bibr" rid="ref9">Deng et al., 2021</xref>).</p>
<p><xref ref-type="bibr" rid="ref001">Garandeau et al. (2023)</xref> sought to determine the degree of impact KiVa has on defending behaviors, as well as the individual-level factors that influenced such defending behaviors as measured by the Participant Role Questionnaire (<xref ref-type="bibr" rid="ref33">Salmivalli and Voeten, 2004</xref>). The results showed that at 5&#x2009;months and 9&#x2009;months, KiVa had a positive effect on defending behavior. While the result was not significant at 9&#x2009;months when controlling for baseline and 5&#x2009;months at the same time, there was still a significant indirect effect of KiVa on defending behaviors at 9&#x2009;months via defending at 5&#x2009;months (<xref ref-type="bibr" rid="ref001">Garandeau et al., 2023</xref>). The only significant mediator found to have a consistently positive effect on defending behaviors was responsibility to intervene, when measured at 5&#x2009;months.</p>
<p>Despite these positive results, one study raises possible concerns regarding KiVa&#x2019;s effectiveness on bystander behavior. The results of <xref ref-type="bibr" rid="ref17">K&#x00E4;rn&#x00E4; et al. (2013)</xref>, an RCT that studied KiVa&#x2019;s effectiveness on a population of students in Grades 1&#x2013;3 and Grades 7&#x2013;9 (populations that, at the time of the study, had yet to be studied for KiVa&#x2019;s effectiveness) showed that those in the intervention condition exhibited a decrease in defending behaviors after undergoing KiVa. All students were also asked to nominate an unlimited number of peers as defenders. Students were able to simply report &#x201C;no one,&#x201D; if they could not identify a peer whom they saw as a defender. While the intervention effect of KiVa was statistically significant, it was not in the hypothesized or desired direction: defending actually <italic>decreased</italic> in the intervention condition. This was consistent across all age groups in the study, though the effect increased with age. Future research should seek to address these differing results between studies.</p>
</sec>
<sec id="sec5">
<label>2.3</label>
<title>The effectiveness of KiVa outside of Finland</title>
<p>KiVa has also proven to be effective outside of its country of origin. In a Dutch trial of KiVa, a support-group approach was added to the indicated actions protocol, and its subsequent impact on victimization and defending was measured (<xref ref-type="bibr" rid="ref40">Van Der Ploeg et al., 2016</xref>). To measure any change in defending bystander behavior, data was collected from students in October and again in May. Students who indicated that they were victims of bullying were asked to nominate defenders. Change was indicated by measuring the difference between the total number of defenders each victimized student nominated in October and May. To analyze the differences between students who participated in the support group approach and those who did not, students in both conditions were statistically matched to one another. Victims with a support group had more defenders by May than those who did not have a support group. Descriptive statistics also convey these results, with 52.6% of victims in the support group condition reporting an increase in defending as opposed to only 34.7% of victims in the control condition reporting an increase in defending. The results of <xref ref-type="bibr" rid="ref40">Van Der Ploeg et al. (2016)</xref> show that a support-group approach to increasing bystander defending is effective.</p>
<p>In further support of KiVa&#x2019;s effectiveness at improving bystander behavior in countries other than just Finland, data from a Chilean trial of KiVa revealed improvement in the psychosocial adjustment of youths enrolled in schools that offered the KiVa program (<xref ref-type="bibr" rid="ref39">Valenzuela et al., 2022</xref>). Psychosocial adjustment was measured by a self-report which included questionnaire items related to prosocial behavior, which probably includes helpful bystander behavior although bystander helping was not specifically isolated. Further analysis of this data could allow the researchers to pinpoint if the prosocial behavior was a main component impacting the improvement in psychosocial adjustment, or if it may have been another factor.</p>
<p>The following table summarizes the eight major trials of KiVa that have yielded results and taken place outside of its country of origin, Finland, during the period covered by our literature review. The inclusion criteria for our literature review were that the study had to include, first of all, quantitative data on the effects of Kiva. It had to either be a published study indexed in PSYCINFO before DATE or a study mentioned in the articles already retrieved; and the trial of KiVa had to be conducted outside of Finland (<xref ref-type="table" rid="tab1">Table 1</xref>). Eight studies emerged, including <xref ref-type="bibr" rid="ref24">Nocentini and Menesini (2016)</xref>, <xref ref-type="bibr" rid="ref40">Van der Ploeg et al. (2016)</xref>, <xref ref-type="bibr" rid="ref37">Swift et al. (2017)</xref>, <xref ref-type="bibr" rid="ref13">Green et al. (2020)</xref>, <xref ref-type="bibr" rid="ref4">Axford et al. (2020)</xref>, <xref ref-type="bibr" rid="ref14">Huitsing et al. (2020)</xref>, <xref ref-type="bibr" rid="ref22">L&#x00F3;pez-Catal&#x00E1;n et al. (2022)</xref>, and <xref ref-type="bibr" rid="ref39">Valenzuela et al. (2022)</xref>.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Results of major evaluation studies of Kiva outside of Finland: bullying perpetration and victimization.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">Source</th>
<th align="left" valign="top">Country</th>
<th align="left" valign="top">Grades (ages)</th>
<th align="left" valign="top">Condition(s)</th>
<th align="left" valign="top">Sample size</th>
<th align="left" valign="top">Data collection points</th>
<th align="left" valign="top">Bullying measures</th>
<th align="left" valign="top">Bullying results</th>
<th align="left" valign="top">Victimization measures</th>
<th align="left" valign="top">Victimization results</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref24">Nocentini and Menesini (2016)</xref>
</td>
<td align="left" valign="top">Italy</td>
<td align="left" valign="top">4, 6 (mean&#x2009;=&#x2009;8.85, 10.93)</td>
<td align="left" valign="top">Intervention (KiVa)<break/>Non-treatment Control (No KiVa)</td>
<td align="left" valign="top">1,039 &#x2014;Intervention<break/>1,003 &#x2014;Control</td>
<td align="left" valign="top">Pre-test (beginning of school year)<break/>Post-test (end of school year)</td>
<td align="left" valign="top">Self-reports: Florence Bullying and Victimization Scale (<xref ref-type="bibr" rid="ref26">Palladino et al., 2016</xref>)<break/>Global key question&#x2014;two items from Olweus Bully / Victim Questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Bullying significantly decreased over time in the experimental group, not in the control group (stronger effect in Grade 4)</td>
<td align="left" valign="top">Self-reports: Florence Bullying and Victimization Scale (<xref ref-type="bibr" rid="ref26">Palladino et al., 2016</xref>)<break/>Global key question&#x2014;two items from Olweus Bully / Victim Questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Odds of being a victim were significantly lower for students at KiVa schools.<break/>Victimization significantly decreased over time in the experimental group, not in the control group (stronger effect in Grade 4)</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref40">Van der Ploeg et al. (2016)</xref>
</td>
<td align="left" valign="top">The Netherlands</td>
<td align="left" valign="top">2&#x2013;6 (7&#x2013;12)</td>
<td align="left" valign="top">KiVa<break/>KiVa + support group<break/>Control (&#x201C;care as usual&#x201D;)</td>
<td align="left" valign="top">38 schools &#x2014; KiVa<break/>28 schools&#x2014; KiVa + support group</td>
<td align="left" valign="top">Pre-assessment (May 2012)<break/>October 2012, 2013<break/>May 2013, 2014</td>
<td align="left" valign="top">Self-report: Online questionnaire (<xref ref-type="bibr" rid="ref18">K&#x00E4;rn&#x00E4; et al., 2011b</xref>)<break/>Peer reports:<break/>Peer nominations of both bullies and defenders (as previously used in research)</td>
<td align="left" valign="top">Victims with a support group had more defenders by the end of the school year than did those without a support group (<italic>z</italic> =&#x2009;&#x2212;2.39, <italic>p</italic> =&#x2009;0.01) yielding an effect size of 0.31.</td>
<td align="left" valign="top">Self-report:<break/>Online questionnaire (<xref ref-type="bibr" rid="ref18">K&#x00E4;rn&#x00E4; et al., 2011b</xref>);<break/>Olweus Bully / Victim Questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>);<break/>Peer reports:<break/>Peer nominations of victims (as previously used in research)</td>
<td align="left" valign="top">For the two intervention conditions there was no difference in victimization (z&#x2009;=&#x2009;&#x2212;0.03, <italic>p</italic> =&#x2009;0.49) but those with a support group were less frequently victimized (z&#x2009;=&#x2009;&#x2212;3.27, <italic>p</italic> =&#x2009;0.00). In the short term, victimization improved, but these changes were not sustained leading to no difference being found at the end of the school year for the two intervention conditions.</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref37">Swift et al. (2017)</xref>
</td>
<td align="left" valign="top">United States</td>
<td align="left" valign="top">4&#x2013;5</td>
<td align="left" valign="top">Pre-KiVa<break/>Post-KiVa (same group, 1&#x2009;year later)</td>
<td align="left" valign="top">1,409</td>
<td align="left" valign="top">Pre-test (beginning of school year)<break/>Post-test (end of school year)</td>
<td align="left" valign="top">Self-reports: Bullying Behavior Scale &#x201C;BBS&#x201D; (<xref ref-type="bibr" rid="ref3">Austin and Joseph, 1996</xref>)<break/>Peer-reports: BBS (<xref ref-type="bibr" rid="ref3">Austin and Joseph, 1996</xref>) with peer nominations</td>
<td align="left" valign="top">Self-reported bullying had an average Cronbach&#x2019;s alpha of 0.84 at T1 and T2 and a correlation of 0.45.<break/>Peer-reported bullying had an average Cronbach&#x2019;s alpha of 0.895 with a correlation of 0.72 between T1 and T2.</td>
<td align="left" valign="top">Self- reports: Comprehensive Scales of Traditional Peer Victimization &#x201C;CSTPV&#x201D; (<xref ref-type="bibr" rid="ref23">Morrow et al., 2014</xref>)<break/>Peer-reports: CSTPV (<xref ref-type="bibr" rid="ref23">Morrow et al., 2014</xref>) with peer nominations</td>
<td align="left" valign="top">Self-reported victimization had a Cronbach&#x2019;s alpha of 0.94 and a correlation of 0.61 between T1 and T2.<break/>Correlation between T1 and T2 for peer-reported victimization was 0.58.</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref13">Green et al. (2020)</xref>
</td>
<td align="left" valign="top">New Zealand</td>
<td align="left" valign="top">2&#x2013;6 (6&#x2013;10)</td>
<td align="left" valign="top">Pre-KiVa<break/>Post-KiVa (same group, 1&#x2009;year later)</td>
<td align="left" valign="top">1,175<break/>985</td>
<td align="left" valign="top">Pre-test (prior to any knowledge of KiVa)<break/>Post-test (1&#x2009;year after KiVa&#x2019;s implementation)</td>
<td align="left" valign="top">Self-reports: questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Significant decrease in the frequency of bullying 1&#x2009;year after KiVa&#x2019;s implementation.</td>
<td align="left" valign="top">Self-reports: questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Significant decrease in victimization 1&#x2009;year after KiVa&#x2019;s implementation, however results varied by gender and grade level (i.e., bigger impact on victimization rates for females).</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref4">Axford et al. (2020)</xref>
</td>
<td align="left" valign="top">United Kingdom</td>
<td align="left" valign="top">2&#x2013;5 (7&#x2013;11)</td>
<td align="left" valign="top">Intervention (KiVa; KiVa also offered for another year post trial)<break/>Waitlist control (KiVa offered for 2&#x2009;years post trial)</td>
<td align="left" valign="top">1,588 &#x2014;Intervention<break/>1,892 &#x2014;Waitlist control</td>
<td align="left" valign="top">Pre-test (June/July 2013)<break/>Post-test (June/July 2014)</td>
<td align="left" valign="top">Self-reports: questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">No significant effect of the intervention on self-reported bullying</td>
<td align="left" valign="top">Self-reports: questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">No significant effect of the intervention on self-reported victimization</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref14">Huitsing et al. (2020)</xref>
</td>
<td align="left" valign="top">The Netherlands</td>
<td align="left" valign="top">3&#x2013;4 (Dutch grades 5&#x2013;6) (mean&#x2009;=&#x2009;8.7)</td>
<td align="left" valign="top">Intervention (KiVa)<break/>Control (no KiVa; &#x201C;care as usual&#x201D;)</td>
<td align="left" valign="top">3,309&#x2014;Intervention<break/>1,405&#x2014;Control</td>
<td align="left" valign="top">First baseline assessment (before summer)<break/>Second baseline assessment (beginning of new school year)<break/>First follow-up test (end of school year)<break/>Second follow-up test (beginning of new school year)<break/>Post-test (end of second school year)</td>
<td align="left" valign="top">Self-reports: questionnaire (10 items) (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Self-reported bullying decreased over time in both conditions.<break/>By the 2-year post-test, students in KiVa schools had significantly lower rates of bullying.<break/>There were interaction effects of KiVa on bullying at all 3 follow-up assessments in the intervention condition.</td>
<td align="left" valign="top">Self-reports: questionnaire (10 items) (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Over time, the number of victimized students decreased in both the control and intervention conditions, though this effect was stronger in KiVa schools.<break/>At the 1-year follow-up test, the intervention effect was not significant at reducing victimization, though the effect was in the right direction.<break/>By the 2-year post-test, the effect on decreasing victimization in the intervention condition as opposed to the control was significant on the maximum score but not the global score.</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref22">L&#x00F3;pez-Catal&#x00E1;n et al. (2022)</xref>
</td>
<td align="left" valign="top">Spain</td>
<td align="left" valign="top">Primary school (6&#x2013;12)<break/>Secondary school (12&#x2013;16)</td>
<td align="left" valign="top">Pre-Kiva<break/>Post-Kiva (same group, measured a year after KiVa&#x2019;s implementation)</td>
<td align="left" valign="top">3,738</td>
<td align="left" valign="top">Pre-survey<break/>Post-survey (1&#x2009;year later)</td>
<td align="left" valign="top">Self-reports: questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Following the first year of KiVa implementation, there was a 9.3% increase in students who claimed they did not bully other students and decreases in the percentages of students who claimed they bullied others.<break/>A Chi-square test confirmed that statistically less children were perpetrators of bullying 1&#x2009;year following KiVa&#x2019;s implementation.</td>
<td align="left" valign="top">Self-reports: questionnaire (<xref ref-type="bibr" rid="ref25">Olweus, 1996</xref>)</td>
<td align="left" valign="top">Following the first year of KiVa implementation, there was an 8.4% increase in students who claimed they were not victims of bullying.<break/>Following the first year of KiVa implementation, there was a 2.5 and 5.8% decrease in students who claimed they were bullied once or twice a month and bullied frequently, respectively.<break/>A Chi-square test confirmed that statistically less children were victims of bullying 1&#x2009;year following KiVa&#x2019;s implementation.</td>
</tr>
<tr>
<td align="left" valign="top">
<xref ref-type="bibr" rid="ref39">Valenzuela et al. (2022)</xref>
</td>
<td align="left" valign="top">Chile</td>
<td align="left" valign="top">5&#x2013;6 (10&#x2013;12)</td>
<td align="left" valign="top">Full KiVa (includes computer game)<break/>Partial KiVa (does not include computer game)<break/>Non-treatment Control (No KiVa)</td>
<td align="left" valign="top">1,363 &#x2014;Full KiVa<break/>1,260 &#x2014;Partial KiVa<break/>1,345 &#x2014;Control</td>
<td align="left" valign="top">Pre-test (beginning of school year)<break/>Post-test (end of school year)</td>
<td align="left" valign="top">Self-reports: questionnaire&#x2014;additional item for witnessing bullying added &#x2014;Revised Olweus Bully/Victim Questionnaire (<xref ref-type="bibr" rid="ref10">Gaete et al., 2021</xref>)</td>
<td align="left" valign="top">Significant reduction in witnessing bullying in the partial KiVa group as compared to the control group (stronger effect in 5th graders).<break/>No significant difference between partial KiVa condition and control for self-reported bullying.<break/>No significant effect of full KiVa intervention as opposed to control or full KiVa as opposed to partial on self-reported bullying and witnessing bullying.</td>
<td align="left" valign="top">Self-reports: questionnaire&#x2014;Revised Olweus Bully/Victim Questionnaire (<xref ref-type="bibr" rid="ref10">Gaete et al., 2021</xref>)</td>
<td align="left" valign="top">Victimization was significantly lower in the partial KiVa group than in the control group (stronger effect in 5th graders).<break/>No significant effect of full KiVa intervention as opposed to control or full KiVa as opposed to partial on self-reported victimization.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>The cutoff point for statistical significance is <italic>p</italic>&#x2009;&#x003C;&#x2009;0.05.</p>
</table-wrap-foot>
</table-wrap>
<p>The table shows that, in seven out of the eight studies, KiVa had a statistically significant positive effect on reducing both victimization and bullying on self-report measures (all studies) and peer-report measures (2 studies). The main findings of these studies, as outlined in the table, and they highlight that KiVa is effective and can be implemented outside of Finland. This bolsters the support for KiVa as an anti-bullying intervention, as it confirms that the effectiveness of KiVa is not bound to one setting or culture, but rather that it is an intervention that can be universally implemented to address school bullying. Moreover, when determining the effectiveness of any psychosocial intervention, it is important for similar or replication studies to be conducted by scholars who were not creators of the intervention. Of the XX studies conducted outside of Finland, YY did not involve researchers involved in the development of KiVa. Despite these positive results, it is also important to consider that the results of two of these studies, <xref ref-type="bibr" rid="ref14">Huitsing et al. (2020)</xref> and <xref ref-type="bibr" rid="ref40">Van der Ploeg et al. (2016)</xref>, demonstrate that KiVa&#x2019;s effectiveness appears to dwindle over time, consistent with the results of some of the original Finnish studies. The reason for this is unclear and future research must be done to determine why this occurs and how maintain KiVa&#x2019;s effectiveness over time. We theorize that adding &#x201C;booster&#x201D; sessions of KiVa could be beneficial.</p>
</sec>
</sec>
<sec sec-type="conclusions" id="sec6">
<label>3</label>
<title>Conclusion</title>
<p>Thus, with regard to KiVa&#x2019;s general status as a preventive intervention to reduce school bullying as well as improve bystander responses to bullying, the data suggests that KiVa is an effective intervention technique. Most of the research regarding KiVa&#x2019;s effectiveness specifically at changing bystander behavior has taken place in Finland, and more research is needed in countries other than Finland, to ensure that KiVa&#x2019;s ability to improve bystander behavior is not limited to one cultural context. Though the data from the Netherlands and even Chile on the general effectiveness of the program suggest that KiVa is effective at improving bystander responses to bullying cross-culturally, further studies are still needed. Despite the very impressive record of success, the crowning achievement remains for future studies: showing that KiVa not only leads to a reduction in bullying and an improvement in bystander behavior, but also, by including a mediation analysis shows that it is the improvement of bystander behavior rather than some other feature of the intervention that accounts for the reduction in bullying.</p>
<sec id="sec7">
<label>3.1</label>
<title>New directions in intervention: a more active role for bystanders</title>
<p>The possible benefits of moving well beyond preventive programming to more intensive peer-mediated school interventions are just beginning to be explored. These interventions are inspired by generations of research on peer-mediated interventions for children with special learning needs, very often conditions on the autism spectrum. The interventions are administered by classmates who show leadership potential under the guidance of teachers and/or mental health professionals (<xref ref-type="bibr" rid="ref36">Strain and Bovey, 2015</xref>).</p>
<p>The very limited results to date come from two studies conducted in Spain, with mixed results. <xref ref-type="bibr" rid="ref27">Pina et al. (2021)</xref> developed the &#x201C;Count on Me&#x201D; program. Pupils elected the student leaders whom they wanted to serve as peer mediators among the students who volunteered. The teachers helped the volunteer leaders learn how to recognize, point out, and praise positive behaviors by both teachers and pupils. Based on specific rules and guidelines, the mediators learned how to resolve conflicts. The peer mediation intervention continued for several months. The experimental group that participated in the peer mediation program experienced reduced violence and increased prosocial behavior in comparison with the control group. The effects of the Count on Me program on bystander behavior have yet to be studied. It is possible to conceive of this type of program as guided practice in becoming a prosocial bystander. However, another study in Spain on a peer-mediation program failed to yield a significant improvement in pro-victim attitudes, bystander roles, or school climate (<xref ref-type="bibr" rid="ref41">Villanueva Badenes et al., 2022</xref>).</p>
<p>Pending further study, there is no strong reason to believe that these more intrusive peer-mediated interventions improve bystander behavior more than the better-established KiVa program. However, these two small studies on peer mediation, with conflicting results, cannot be considered conclusive. Future studies should seek to focus on which specific components and mechanisms of KiVa lead to positive change in situations of school bullying. As well, the null results produced by some studies of KiVa should be investigated. It is important to note that the studies available to review establish the effectiveness of KiVa on bullying and victimization. These studies do not necessarily indicate that it is the bystander focus that accounts for the outcomes reported or that KiVa is the only possible intervention that could be effective; these issues would have to be explored in new studies in which these issues are explored systematically as different intervention conditions.</p>
</sec>
</sec>
</body>
<back>
<sec sec-type="author-contributions" id="sec8">
<title>Author contributions</title>
<p>BS and SC wrote sections of the manuscript. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="sec17a">
<title>Funding</title>
<p>A portion of the publication fee was reimbursed by Boston College Libraries.</p>
</sec>
<sec sec-type="COI-statement" id="sec9">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="sec10">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<fn-group>
<fn id="fn0001">
<p><sup>1</sup> What is KiVa? KiVa Program &#x0026; University of Turku. Available at: <ext-link xlink:href="https://www.kivaprogram.net/what-is-kiva/" ext-link-type="uri">https://www.kivaprogram.net/what-is-kiva/</ext-link> &#x2006; (Accessed September 20, 2024).</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amadori</surname> <given-names>A.</given-names></name> <name><surname>Intra</surname> <given-names>S.</given-names></name> <name><surname>Taverna</surname> <given-names>L.</given-names></name> <name><surname>Brighi</surname> <given-names>A.</given-names></name></person-group> (<year>2023</year>). <article-title>Systematic review of intervention and prevention programs to tackle homophobic bullying at school: a social-emotional learning skills perspective</article-title>. <source>Int. J. Bullying Preven.</source>. <volume>4</volume>, <fpage>1</fpage>&#x2013;<lpage>17</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s42380-023-00198-2</pub-id></citation></ref>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ant&#x00F3;nio</surname> <given-names>R.</given-names></name> <name><surname>Guerra</surname> <given-names>R.</given-names></name> <name><surname>Cameron</surname> <given-names>L.</given-names></name> <name><surname>Moleiro</surname> <given-names>C.</given-names></name></person-group> (<year>2023</year>). <article-title>Imagined and extended contact experiences and adolescent bystanders' behavioral intentions in homophobic bullying episodes</article-title>. <source>Aggress. Behav.</source> <volume>49</volume>, <fpage>110</fpage>&#x2013;<lpage>126</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ab.22059</pub-id>, PMID: <pub-id pub-id-type="pmid">36332082</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Austin</surname> <given-names>S.</given-names></name> <name><surname>Joseph</surname> <given-names>S.</given-names></name></person-group> (<year>1996</year>). <article-title>Assessment of bully/victim problems in 8 to 11 year-olds</article-title>. <source>Br. J. Educ. Psychol.</source> <volume>66</volume>, <fpage>447</fpage>&#x2013;<lpage>456</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.2044-8279.1996.tb01211.x</pub-id>, PMID: <pub-id pub-id-type="pmid">9008423</pub-id></citation></ref>
<ref id="ref4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Axford</surname> <given-names>N.</given-names></name> <name><surname>Bjornstad</surname> <given-names>G.</given-names></name> <name><surname>Clarkson</surname> <given-names>S.</given-names></name> <name><surname>Ukoumunne</surname> <given-names>O. C.</given-names></name> <name><surname>Wrigley</surname> <given-names>Z.</given-names></name> <name><surname>Matthews</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>The effectiveness of the KiVa bullying prevention program in Wales, UK: results from a pragmatic cluster randomized controlled trial</article-title>. <source>Prev. Sci.</source> <volume>21</volume>, <fpage>615</fpage>&#x2013;<lpage>626</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11121-020-01103-9</pub-id>, PMID: <pub-id pub-id-type="pmid">32240480</pub-id></citation></ref>
<ref id="ref5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Booker</surname> <given-names>J.</given-names></name> <name><surname>McCarty</surname> <given-names>S.</given-names></name> <name><surname>Pacqu&#x00E9;</surname> <given-names>K.</given-names></name> <name><surname>Liskey</surname> <given-names>M.</given-names></name></person-group> (<year>2023</year>). <article-title>Evaluating an integrated promotion and prevention bystander approach: early evidence of intervention benefits and moderators</article-title>. <source>J. Prev. Interv. Community</source> <volume>51</volume>, <fpage>352</fpage>&#x2013;<lpage>374</lpage>. doi: <pub-id pub-id-type="doi">10.1080/10852352.2024.2313383</pub-id>, PMID: <pub-id pub-id-type="pmid">38440847</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boulton</surname> <given-names>M. J.</given-names></name> <name><surname>Trueman</surname> <given-names>M.</given-names></name> <name><surname>Flemington</surname> <given-names>I.</given-names></name></person-group> (<year>2002</year>). <article-title>Associations between secondary school pupils' definitions of bullying, attitudes towards bullying, and tendencies to engage in bullying: age and sex differences</article-title>. <source>Educ. Stud.</source> <volume>28</volume>, <fpage>353</fpage>&#x2013;<lpage>370</lpage>. doi: <pub-id pub-id-type="doi">10.1080/0305569022000042390</pub-id></citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casey</surname> <given-names>E. A.</given-names></name> <name><surname>Lindhorst</surname> <given-names>T.</given-names></name> <name><surname>Storer</surname> <given-names>H. L.</given-names></name></person-group> (<year>2017</year>). <article-title>The situational-cognitive model of adolescent bystander behavior: modeling bystander decision-making in the context of bullying and teen dating violence</article-title>. <source>Psychol. Violence</source> <volume>7</volume>, <fpage>33</fpage>&#x2013;<lpage>44</lpage>. doi: <pub-id pub-id-type="doi">10.1037/vio0000033</pub-id>, PMID: <pub-id pub-id-type="pmid">33884221</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Darley</surname> <given-names>J. M.</given-names></name> <name><surname>Latan&#x00E9;</surname> <given-names>B.</given-names></name></person-group> (<year>1968</year>). <article-title>Bystander intervention in emergencies: diffusion of responsibility</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>8</volume>, <fpage>377</fpage>&#x2013;<lpage>383</lpage>. doi: <pub-id pub-id-type="doi">10.1037/h0025589</pub-id></citation></ref>
<ref id="ref9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deng</surname> <given-names>X.</given-names></name> <name><surname>Yang</surname> <given-names>J.</given-names></name> <name><surname>Wu</surname> <given-names>Y.</given-names></name></person-group> (<year>2021</year>). <article-title>Adolescent empathy influences bystander defending in school bullying: a three-level meta-analysis</article-title>. <source>Front. Psychol.</source> <volume>12</volume>:<fpage>690898</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2021.690898</pub-id>, PMID: <pub-id pub-id-type="pmid">34421742</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gaete</surname> <given-names>J.</given-names></name> <name><surname>Valenzuela</surname> <given-names>D.</given-names></name> <name><surname>Godoy</surname> <given-names>M. I.</given-names></name> <name><surname>Rojas-Barahona</surname> <given-names>C. A.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name> <name><surname>Araya</surname> <given-names>R.</given-names></name></person-group> (<year>2021</year>). <article-title>Validation of the revised Olweus bully/victim questionnaire (OBVQ-R) among adolescents in Chile</article-title>. <source>Front. Psychol.</source> <volume>12</volume>:<fpage>578661</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2021.578661</pub-id>, PMID: <pub-id pub-id-type="pmid">33912096</pub-id></citation></ref>
<ref id="ref001"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garandeau</surname> <given-names>C. F.</given-names></name> <name><surname>Turunen</surname> <given-names>T.</given-names></name> <name><surname>Saarento-Zaprudin</surname> <given-names>S.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2023</year>). <article-title>Effects of the kiva anti-bullying program on defending behavior: Investigating individual-level mechanisms of change</article-title>. <source>J. Sch. Psychol</source>. <volume>99</volume>:<fpage>101226</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jsp.2023.101226</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garandeau</surname> <given-names>C. F.</given-names></name> <name><surname>Laninga-Wijnen</surname> <given-names>L.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2021</year>). <article-title>Effects of the kiva anti-bullying program on affective and cognitive empathy in children and adolescents</article-title>. <source>J. Clin. Child Adolesc. Psychol.</source> <volume>51</volume>, <fpage>515</fpage>&#x2013;<lpage>529</lpage>. doi: <pub-id pub-id-type="doi">10.1080/15374416.2020.1846541</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Granero Andujar</surname> <given-names>A.</given-names></name> <name><surname>Manzano-Leon</surname> <given-names>A.</given-names></name></person-group> (<year>2018</year>). <article-title>Posibilidades de del Programa KiVa para hacer frente al bullying homof&#x00F3;bico y tranfobico [Possibilities of the KiVa program to stand up to homophobic and transphobic bullying]</article-title>. <source>Revista Complutense de Educacion</source> <volume>29</volume>, <fpage>943</fpage>&#x2013;<lpage>958</lpage>. doi: <pub-id pub-id-type="doi">10.5209/RCED.54346</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Green</surname> <given-names>V. A.</given-names></name> <name><surname>Woods</surname> <given-names>L.</given-names></name> <name><surname>Wegerhoff</surname> <given-names>D.</given-names></name> <name><surname>Harcourt</surname> <given-names>S.</given-names></name> <name><surname>Tannahill</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>An evaluation of the KiVa. Anti-bullying program in New Zealand</article-title>. <source>Int. J. Bullying Prev.</source> <volume>2</volume>, <fpage>225</fpage>&#x2013;<lpage>237</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s42380-019-00034-6</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huitsing</surname> <given-names>G.</given-names></name> <name><surname>Lodder</surname> <given-names>G. M. A.</given-names></name> <name><surname>Browne</surname> <given-names>W. J.</given-names></name> <name><surname>Oldenburg</surname> <given-names>B.</given-names></name> <name><surname>Van der Ploeg</surname> <given-names>R.</given-names></name> <name><surname>Veenstra</surname> <given-names>R.</given-names></name></person-group> (<year>2020</year>). <article-title>A large-scale replication of the effectiveness of the KiVa Antibullying program: a Randoized controlled trial in the Netherlands</article-title>. <source>Prev. Sci.</source> <volume>21</volume>, <fpage>627</fpage>&#x2013;<lpage>638</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11121-020-01116-4</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huizinga</surname> <given-names>D.</given-names></name></person-group> (<year>1991</year>). <article-title>Assessing violent behavior with self-reports</article-title>. <source>Neuropsychol. Aggression</source>. <volume>4</volume>, <fpage>47</fpage>&#x2013;<lpage>66</lpage>. doi: <pub-id pub-id-type="doi">10.1007/978-1-4615-3878-3_3</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00E4;rn&#x00E4;</surname> <given-names>A.</given-names></name> <name><surname>Voeten</surname> <given-names>M. J. M.</given-names></name> <name><surname>Little</surname> <given-names>T. D.</given-names></name> <name><surname>Alanen</surname> <given-names>E.</given-names></name> <name><surname>Poskiparta</surname> <given-names>E. H.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <article-title>Effectiveness of the KiVa Antibullying program: grades 1-3 and 7-9</article-title>. <source>J. Educ. Psychol.</source> <volume>105</volume>, <fpage>535</fpage>&#x2013;<lpage>551</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0030417</pub-id></citation></ref>
<ref id="ref18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00E4;rn&#x00E4;</surname> <given-names>A.</given-names></name> <name><surname>Voeten</surname> <given-names>M.</given-names></name> <name><surname>Little</surname> <given-names>T. D.</given-names></name> <name><surname>Poskiparta</surname> <given-names>E.</given-names></name> <name><surname>Alanen</surname> <given-names>E.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2011b</year>). <article-title>Going to scale: a nonrandomized nationwide trial of the KiVa antibullying program for grades 1&#x2013;9</article-title>. <source>J. Consult. Clin. Psychol.</source> <volume>79</volume>, <fpage>796</fpage>&#x2013;<lpage>805</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0025740</pub-id></citation></ref>
<ref id="ref19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x00E4;rn&#x00E4;</surname> <given-names>A.</given-names></name> <name><surname>Voeten</surname> <given-names>M.</given-names></name> <name><surname>Little</surname> <given-names>T. D.</given-names></name> <name><surname>Poskiparta</surname> <given-names>E.</given-names></name> <name><surname>Kaljonen</surname> <given-names>A.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2011a</year>). <article-title>A large-scale evaluation of the KiVa Antibullying program: grades 4&#x2013;6</article-title>. <source>Child Dev.</source> <volume>82</volume>, <fpage>311</fpage>&#x2013;<lpage>330</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1467-8624.2010.01557.x</pub-id>, PMID: <pub-id pub-id-type="pmid">21291444</pub-id></citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kassin</surname> <given-names>S. M.</given-names></name></person-group> (<year>2017</year>). <article-title>The killing of kitty Genovese: what Else does this case tell us?</article-title> <source>Perspect. Psychol. Sci.</source> <volume>12</volume>, <fpage>374</fpage>&#x2013;<lpage>381</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1745691616679465</pub-id></citation></ref>
<ref id="ref22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>L&#x00F3;pez-Catal&#x00E1;n</surname> <given-names>B.</given-names></name> <name><surname>M&#x00E4;kela</surname> <given-names>T.</given-names></name> <name><surname>S&#x00E1;nchez S&#x00E1;nchez</surname> <given-names>F.</given-names></name> <name><surname>L&#x00F3;pez-Cat&#x00E1;lan</surname> <given-names>L.</given-names></name></person-group> (<year>2022</year>). <article-title>Implementing kiva antibullying program in pioneer schools in Spain</article-title>. <source>Int. J. Educ. Res. Innov.</source> <volume>17</volume>, <fpage>198</fpage>&#x2013;<lpage>214</lpage>. doi: <pub-id pub-id-type="doi">10.46661/ijeri.6252</pub-id></citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morrow</surname> <given-names>M. T.</given-names></name> <name><surname>Hubbard</surname> <given-names>J. A.</given-names></name> <name><surname>Swift</surname> <given-names>L. E.</given-names></name></person-group> (<year>2014</year>). <article-title>Relations among multiple types of peer victimization, reactivity to peer victimization, and academic achievement in fifth-grade boys and girls</article-title>. <source>Merrill-Palmer Q.</source> <volume>60</volume>, <fpage>302</fpage>&#x2013;<lpage>327</lpage>. doi: <pub-id pub-id-type="doi">10.13110/merrpalmquar1982.60.3.0302</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nocentini</surname> <given-names>A.</given-names></name> <name><surname>Menesini</surname> <given-names>E.</given-names></name></person-group> (<year>2016</year>). <article-title>KiVa anti-bullying program in Italy: evidence of effectiveness in a randomized control trial</article-title>. <source>Prev. Sci.</source> <volume>17</volume>, <fpage>1012</fpage>&#x2013;<lpage>1023</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11121-016-0690-z</pub-id>, PMID: <pub-id pub-id-type="pmid">27488457</pub-id></citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Olweus</surname> <given-names>D. A.</given-names></name></person-group> (<year>1996</year>). <article-title>The Olweus bully/victim questionnaire</article-title>. <source>PsycTESTS Dataset</source>. doi: <pub-id pub-id-type="doi">10.1037/t09634-000</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Palladino</surname> <given-names>B. E.</given-names></name> <name><surname>Nocentini</surname> <given-names>A.</given-names></name> <name><surname>Menesini</surname> <given-names>E.</given-names></name></person-group> (<year>2016</year>). <article-title>Evidence-based intervention against bullying and cyberbullying: evaluation of the NoTrap! Program in two independent trials</article-title>. <source>Aggress. Behav.</source> <volume>42</volume>, <fpage>194</fpage>&#x2013;<lpage>206</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ab.21636</pub-id>, PMID: <pub-id pub-id-type="pmid">26879897</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pina</surname> <given-names>D.</given-names></name> <name><surname>Ruiz-Hern&#x00E1;ndez</surname> <given-names>J. A.</given-names></name> <name><surname>Llor-Esteban</surname> <given-names>B.</given-names></name> <name><surname>Mat&#x00E1;s-Castillo</surname> <given-names>M.</given-names></name> <name><surname>Pag&#x00E1;n-Escribano</surname> <given-names>M.</given-names></name> <name><surname>Puente-L&#x00F3;pez</surname> <given-names>E.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x201C;Count on me&#x201D; program to improve school coexisting in primary education</article-title>. <source>Child Youth Serv. Rev.</source> <volume>127</volume>:<fpage>106121</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.childyouth.2021.106121</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Poskiparta</surname> <given-names>E.</given-names></name> <name><surname>Kaukiainen</surname> <given-names>A.</given-names></name> <name><surname>P&#x00F6;yh&#x00F6;nen</surname> <given-names>V.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2012</year>). &#x201C;<article-title>Anti-bullying computer game as part of the KiVa program: students&#x2019; perceptions of the game</article-title>&#x201D; in <source>The impact of technology on relationships in educational settings: international perspectives</source>. eds. <person-group person-group-type="editor"><name><surname>Costabile</surname> <given-names>A.</given-names></name> <name><surname>Spears</surname> <given-names>B.</given-names></name></person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>Routledge</publisher-name>), <fpage>158</fpage>&#x2013;<lpage>168</lpage>.</citation></ref>
<ref id="ref002"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pozzoli</surname> <given-names>T.</given-names></name> <name><surname>Gini</surname> <given-names>G.</given-names></name> <name><surname>Vieno</surname> <given-names>A.</given-names></name></person-group> (<year>2012</year>). <article-title>Individual and class moral disengagement in bullying among elementary school children</article-title>. <source>Aggre. Behav</source>. <volume>38</volume>, <fpage>378</fpage>&#x2013;<lpage>388</lpage>. doi: <pub-id pub-id-type="doi">10.1002/ab.21442</pub-id>, PMID: <pub-id pub-id-type="pmid">34421742</pub-id></citation></ref>
<ref id="ref003"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saarento</surname> <given-names>S.</given-names></name> <name><surname>Boulton</surname> <given-names>A. J.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2015</year>). <article-title>Reducing bullying and victimization: student- and classroom-level mechanisms of change</article-title>. <source>J. Abnorm. Child Psychol.</source> <volume>43</volume>, <fpage>61</fpage>&#x2013;<lpage>76</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10802-013-9841-x</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salmivalli</surname> <given-names>C.</given-names></name></person-group> (<year>2010</year>). <article-title>Bullying and the peer group: a review</article-title>. <source>Aggress. Violent Behav.</source> <volume>15</volume>, <fpage>112</fpage>&#x2013;<lpage>120</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.avb.2009.08.007</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salmivalli</surname> <given-names>C.</given-names></name> <name><surname>Lagerspetz</surname> <given-names>K.</given-names></name> <name><surname>Bj&#x00F6;rkqvist</surname> <given-names>K.</given-names></name> <name><surname>&#x00D6;sterman</surname> <given-names>K.</given-names></name> <name><surname>Kaukiainen</surname> <given-names>A.</given-names></name></person-group> (<year>1996</year>). <article-title>Bullying as a group process: participant roles and their relations to social status within the group</article-title>. <source>Aggress. Behav.</source> <volume>22</volume>, <fpage>1</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.1002/(SICI)1098-2337(1996)22:1</pub-id></citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salmivalli</surname> <given-names>C.</given-names></name> <name><surname>Voeten</surname> <given-names>M.</given-names></name></person-group> (<year>2004</year>). <article-title>Connections between attitudes, group norms, and behaviour in bullying situations</article-title>. <source>Int. J. Behav. Dev.</source> <volume>28</volume>, <fpage>246</fpage>&#x2013;<lpage>258</lpage>. doi: <pub-id pub-id-type="doi">10.1080/01650250344000488</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scott</surname> <given-names>A.</given-names></name> <name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Cheong</surname> <given-names>Y.</given-names></name></person-group> (<year>2022</year>). <article-title>The bullying literature project: promoting bystander behavior using children&#x2019;s literature</article-title>. <source>Sch. Mental Health Multidisciplin. Res. Pract. J.</source> <volume>15</volume>, <fpage>123</fpage>&#x2013;<lpage>137</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s12310-022-09537-y</pub-id></citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sentse</surname> <given-names>M.</given-names></name> <name><surname>Scholte</surname> <given-names>R.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name> <name><surname>Voeten</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>Person-group dissimilarity in involvement in bullying and its relation with social status</article-title>. <source>J. Abnorm. Child Psychol.</source> <volume>35</volume>, <fpage>1009</fpage>&#x2013;<lpage>1019</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10802-007-9150-3</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Strain</surname> <given-names>P. S.</given-names></name> <name><surname>Bovey</surname> <given-names>E. H.</given-names> <suffix>II</suffix></name></person-group> (<year>2015</year>). &#x201C;<article-title>The power of preschool peers to influence social outcomes for children with special needs</article-title>&#x201D; in <source>The power of peers in the classroom: Enhancing learning and social skills</source>. eds. <person-group person-group-type="editor"><name><surname>Harris</surname> <given-names>K. R.</given-names></name> <name><surname>Meltzer</surname> <given-names>L.</given-names></name></person-group> (<publisher-name>The Guilford Press</publisher-name>), <fpage>288</fpage>&#x2013;<lpage>322</lpage>. Available at: <ext-link xlink:href="https://scholar.google.com/scholar_lookup?title=The+power+of+preschool+peers+to+influence+social+outcomes+for+children+with+special+needs&#x0026;author=P.+S.+Strain&#x0026;author=E.+H.+Bovey&#x0026;publication_year=2015&#x0026;pages=288-316" ext-link-type="uri">https://scholar.google.com/scholar_lookup?title=The+power+of+preschool+peers+to+influence+social+outcomes+for+children+with+special+needs&#x0026;author=P.+S.+Strain&#x0026;author=E.+H.+Bovey&#x0026;publication_year=2015&#x0026;pages=288-316</ext-link></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Swift</surname> <given-names>L. E.</given-names></name> <name><surname>Hubbard</surname> <given-names>J. A.</given-names></name> <name><surname>Bookhout</surname> <given-names>M. K.</given-names></name> <name><surname>Grassetti</surname> <given-names>S. N.</given-names></name> <name><surname>Smith</surname> <given-names>M. A.</given-names></name> <name><surname>Morrow</surname> <given-names>M. T.</given-names></name></person-group> (<year>2017</year>). <article-title>Teacher factors contributing to dosage of the KiVa anti-bullying program</article-title>. <source>J. Sch. Psychol.</source> <volume>65</volume>, <fpage>102</fpage>&#x2013;<lpage>115</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jsp.2017.07.005</pub-id>, PMID: <pub-id pub-id-type="pmid">29145938</pub-id></citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Valenzuela</surname> <given-names>D.</given-names></name> <name><surname>Turunen</surname> <given-names>T.</given-names></name> <name><surname>Gana</surname> <given-names>S.</given-names></name> <name><surname>Rojas-Barahona</surname> <given-names>C. A.</given-names></name> <name><surname>Araya</surname> <given-names>R.</given-names></name> <name><surname>Salmivalli</surname> <given-names>C.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Effectiveness of the KiVa Antibullying program with and without the online game in Chile: a three-arm cluster randomized controlled trial</article-title>. <source>Preven. Sci.</source> <volume>23</volume>, <fpage>1470</fpage>&#x2013;<lpage>1482</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11121-022-01379-z</pub-id>, PMID: <pub-id pub-id-type="pmid">35739339</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van der Ploeg</surname> <given-names>R.</given-names></name> <name><surname>Steglich</surname> <given-names>C.</given-names></name> <name><surname>Veenstra</surname> <given-names>R.</given-names></name></person-group> (<year>2016</year>). <article-title>The support group approach in the Dutch KiVa anti-bullying programme: effects on victimisation, defending and well-being at school</article-title>. <source>Educ. Res.</source> <volume>58</volume>, <fpage>221</fpage>&#x2013;<lpage>236</lpage>. doi: <pub-id pub-id-type="doi">10.1080/00131881.2016.1184949</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Villanueva Badenes</surname> <given-names>L.</given-names></name> <name><surname>Us&#x00F3; Guiral</surname> <given-names>I.</given-names></name> <name><surname>Adri&#x00E1;n Serrano</surname> <given-names>J. E.</given-names></name></person-group> (<year>2022</year>). <article-title>&#x00BF;Son eficaces para disminuir el acoso escolar los programas de alumno mediador de reciente implantaci&#x00F3;n? [Are recently introduced pupil-mediated programs effective in reducing school bullying?]</article-title>. <source>Informacio Psicol.</source> <volume>122</volume>, <fpage>63</fpage>&#x2013;<lpage>76</lpage>. doi: <pub-id pub-id-type="doi">10.14635/ipsic.1899</pub-id></citation></ref>
</ref-list>
</back>
</article>