<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="research-article" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Integr. Neurosci.</journal-id>
<journal-title>Frontiers in Integrative Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Integr. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5145</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnint.2023.1232523</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Moralizing Effect: self-directed emotions and their impact on culpability attributions</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Sirgiovanni</surname>
<given-names>Elisabetta</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/695792/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Smolenski</surname>
<given-names>Joanna</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2562309/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Abelson</surname>
<given-names>Ben</given-names>
</name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Webb</surname>
<given-names>Taylor</given-names>
</name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2570025/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Section of History of Medicine, Department of Molecular Medicine, Sapienza University of Rome</institution>, <addr-line>Rome</addr-line>, <country>Italy</country></aff>
<aff id="aff2"><sup>2</sup><institution>Center for Medical Ethics and Health Policy, Baylor College of Medicine</institution>, <addr-line>Houston, TX</addr-line>, <country>United States</country></aff>
<aff id="aff3"><sup>3</sup><institution>School of Liberal Arts, Mercy College</institution>, <addr-line>Dobbs Ferry, NY</addr-line>, <country>United States</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Psychology, University of California, Los Angeles</institution>, <addr-line>Los Angeles, CA</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001"><p>Edited by: Giorgia Silani, University of Vienna, Austria</p></fn>
<fn fn-type="edited-by" id="fn0002"><p>Reviewed by: Alexandre Erler, The Chinese University of Hong Kong, China; Salvatore M. Aglioti, Sapienza University of Rome, Italy</p></fn>
<corresp id="c001">&#x002A;Correspondence: Elisabetta Sirgiovanni, <email>elisabetta.sirgiovanni@uniroma1.it</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>28</day>
<month>11</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>17</volume>
<elocation-id>1232523</elocation-id>
<history>
<date date-type="received">
<day>31</day>
<month>05</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>30</day>
<month>10</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Sirgiovanni, Smolenski, Abelson and Webb.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Sirgiovanni, Smolenski, Abelson and Webb</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<sec>
<title>Introduction</title>
<p>A general trend in the psychological literature suggests that guilt contributes to morality more than shame does. Unlike shame-prone individuals, guilt-prone individuals internalize the causality of negative events, attribute responsibility in the first person, and engage in responsible behavior. However, it is not known how guilt- and shame-proneness interact with the attribution of responsibility to others.</p>
</sec>
<sec>
<title>Methods</title>
<p>In two Web-based experiments, participants reported their attributions of moral culpability (i.e., responsibility, causality, punishment and decision-making) about morally ambiguous acts of killing in different conditions. In Study 1 the vignettes were presented in the 1st person, while in Study 2 in the 3rd person. To test proneness to guilt and shame, we utilized the GASP scale, which differentiates between the affective and behavioral components of each emotion. Statistical analyses were performed in Matlab and R.</p>
</sec>
<sec>
<title>Results</title>
<p>We found that guilt- and shame-proneness were associated with the severity of attributions in both the first and the third person, but the effect was strong only in the guilt case (both subtypes) and shame-affect case, and not in the shame-behavior case. We call this the Moralizing Effect.</p>
</sec>
<sec>
<title>Discussion</title>
<p>We wonder whether our finding that guilt-prone people tend to attribute a higher degree of culpability to others is really consistent with the view that guilt motivates people to choose the &#x201C;moral paths in life&#x201D;. This echoes views about the harmful aspects of guilt, which have been expressed historically in philosophy, for example, by Friedrich Nietzsche.</p>
</sec>
</abstract>
<kwd-group>
<kwd>guilt</kwd>
<kwd>shame</kwd>
<kwd>self-directed emotion</kwd>
<kwd>responsibility</kwd>
<kwd>culpability</kwd>
<kwd>morality</kwd>
<kwd>judgment</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="6"/>
<equation-count count="0"/>
<ref-count count="85"/>
<page-count count="12"/>
<word-count count="10586"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<title>Introduction</title>
<p>Psychological research on moral judgment has recently renewed interest in complex, self-directed emotions (e.g., guilt and shame). These emotions had been neglected for a couple of decades (<xref ref-type="bibr" rid="ref61">Prinz, 2011</xref>). In fact, after some seminal research in the 1990s (see <xref ref-type="bibr" rid="ref72">Tangney and Dearing, 2002</xref> for a review), moral psychology had focused mainly on basic, other-directed emotions (e.g., disgust, anger, and contempt, see <xref ref-type="bibr" rid="ref65">Rozin et al., 1999</xref>; <xref ref-type="bibr" rid="ref28">Haidt, 2003</xref>; <xref ref-type="bibr" rid="ref84">Wheatley and Haidt, 2005</xref>; <xref ref-type="bibr" rid="ref67">Schnall et al., 2008</xref>; <xref ref-type="bibr" rid="ref59">Pizzarro et al., 2011</xref>; <xref ref-type="bibr" rid="ref68">Seidel and Prinz, 2013</xref>). Guilt and shame are both negative, painful emotions one experiences when transgressing against some moral rule (<xref ref-type="bibr" rid="ref77">Tangney et al., 2007</xref>). They have been shown to co-occur and laypeople tend to not consistently distinguish between the two terms (<xref ref-type="bibr" rid="ref72">Tangney and Dearing, 2002</xref>, Ch. 2). However, psychology (<xref ref-type="bibr" rid="ref40">Keltner and Buswell, 1996</xref>; <xref ref-type="bibr" rid="ref74">Tangney et al., 1996</xref>) and neuroscience (<xref ref-type="bibr" rid="ref50">Michl et al., 2014</xref>; <xref ref-type="bibr" rid="ref4">Bastin et al., 2016</xref>) have provided evidence that they are distinct emotions. Accordingly, some theoretical distinctions between guilt and shame have been adopted in empirical research. These include the idea that guilt is directed toward behavior while shame is toward the self (<xref ref-type="bibr" rid="ref44">Lewis, 1971</xref>), and that guilt occurs when one&#x2019;s moral infractions remain private, while shame is caused by public display of one&#x2019;s transgressions (<xref ref-type="bibr" rid="ref6">Benedict, 1946</xref>). The two emotions have also been associated with characteristic behavioral responses: reparative behavior for guilt and avoidant behavior for shame, respectively (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>). Excessive guilt and shame are also included as symptoms of many psychiatric conditions (e.g., depression, hypomanic episodes, post-traumatic stress disorder, dissociative disorders, eating disorders, sexual dysfunction, borderline personality disorder, and paraphilic disorder for guilt; obsessive-compulsive disorder, post-traumatic stress disorder, dissociative disorders, eating disorders, borderline, avoidant disorder, and anxiety for shame) (<xref ref-type="bibr" rid="ref1">American Psychiatric Association, 2013</xref>), while individuals with antisocial traits have been shown to lack these two emotions (<xref ref-type="bibr" rid="ref29">Hare, 1998</xref>), especially guilt. Nevertheless, guilt and shame are not always distinguished consistently in the DSM (see <xref ref-type="bibr" rid="ref22">Fontenelle et al., 2015</xref>).</p>
<p>Indeed, there is a general trend in the psychological literature suggesting that guilt contributes to morality more than shame does. Remarkably, there are divergent meanings of what &#x201C;<italic>being</italic> moral&#x201D; might denote, for instance either acting in a certain way (i.e., being a moral <italic>agent</italic>) or distinguishing right from wrong (i.e., being a moral <italic>judge</italic>) - and it is not so obvious that one sense should entail the other as traditional moral philosophers believed (<xref ref-type="bibr" rid="ref14">Cova, 2013</xref>). In this area of research about guilt and shame, morality has been intended mostly in agentive rather than reflective terms, i.e., in this context morality has meant pro-sociality. In June Tangney and collaborators&#x2019; words, &#x201C;empirical results converge, indicating that guilt but not shame is most effective in motivating people to choose the moral paths in life&#x201D; (<xref ref-type="bibr" rid="ref77">Tangney et al., 2007</xref>, p. 10). The narrative of guilt being more moral than shame has developed largely due to research on the relationship between guilt/shame and behavioral intentions concerning hypothetical scenarios (i.e., participants responded to questions like &#x201C;<italic>how would you behave in such situation?</italic>&#x201D;), and less often explicitly on the relationship between guilt/shame and moral judgments of the rightness/wrongness of actions (for an overview, <xref ref-type="bibr" rid="ref72">Tangney and Dearing, 2002</xref>; see also <xref ref-type="bibr" rid="ref10">Cohen et al., 2012</xref>). In support of the claim about the agentive morality of guilt vs. shame, <xref ref-type="bibr" rid="ref71">Tangney (1994)</xref> found evidence of a positive correlation between self-reported moral behavior with guilt, but not with shame. Guilt in general seems to enhance one&#x2019;s sense of self-control and risky judgments (<xref ref-type="bibr" rid="ref41">Kouchaki et al., 2014</xref>) and positively correlates with forgiveness-seeking, but only in the absence of shame (<xref ref-type="bibr" rid="ref62">Riek et al., 2014</xref>). Moreover, high guilt-prone individuals engage in counterproductive work behavior less frequently (<xref ref-type="bibr" rid="ref10">Cohen et al., 2012</xref>, <xref ref-type="bibr" rid="ref11">2013</xref>), have better leadership skills (<xref ref-type="bibr" rid="ref66">Schaumberg and Flynn, 2012</xref>), and are more likely to be interpersonally trustworthy at the workplace (<xref ref-type="bibr" rid="ref43">Levine et al., 2018</xref>), than low guilt-prone individuals. By contrast, shame, but not guilt, has been linked to anger and self-reported aggression (<xref ref-type="bibr" rid="ref79">Tangney et al., 1992a</xref>,<xref ref-type="bibr" rid="ref80">b</xref>), as well as criminal behavior and recidivism (<xref ref-type="bibr" rid="ref75">Tangney et al., 2011</xref>, <xref ref-type="bibr" rid="ref76">2014</xref>). It must be noted, however, that in most of these experiments, the actions correlating with guilt and shame were hypothetical and self-reported. Some correlations, (e.g., between shame and criminal behavior) were based on arrest records.</p>
<p>Speculative attempts at characterizing potentially harmful aspects of guilt were engaged in by the philosopher Friedrich Nietzsche in his second essay of <italic>On the Genealogy of Morality</italic> (1887), &#x201C;&#x2018;Guilt&#x2019;, &#x2018;bad conscience&#x2019; and related matters.&#x201D; Nietzsche thought that guilt, being an inward cruelty, turned into a <italic>bad conscience</italic>, which is potentially a result of the internalization of outward moralization (particularly, that associated with the Christian tradition) created by <italic>ressentiment</italic> towards others, an attitude that he views negatively. In his own words, &#x201C;it is easy to guess who has the invention of &#x2018;bad conscience&#x2019; on his conscience, &#x2212; the man of <italic>ressentiment</italic>!&#x201D; (<xref ref-type="bibr" rid="ref55">Nietzsche, 1887/2006</xref>, p. 49, original italics; for a discussion see <xref ref-type="bibr" rid="ref19">Elgat, 2017</xref>). These ideas, elaborated by Freudian psychoanalysis (e.g., <xref ref-type="bibr" rid="ref23">Freud, 1923</xref>; see also <xref ref-type="bibr" rid="ref58">Piers and Singer, 1953</xref>; on Nietzsche and Freud see <xref ref-type="bibr" rid="ref27">Greer, 2002</xref>; see also <xref ref-type="bibr" rid="ref37">Jervis, 1998</xref>), have been discarded by empirical psychology as they were thought to conflate guilt and shame, thereby mislabeling shame experiences as guilt experiences (<xref ref-type="bibr" rid="ref44">Lewis, 1971</xref>; <xref ref-type="bibr" rid="ref72">Tangney and Dearing, 2002</xref>). Some traces of these ideas, however, remain in clinical psychopathology, where guilt is believed to play not only a &#x201C;social-adaptive role,&#x201D; but to be psychologically &#x201C;destructive&#x201D; at an intrapsychic level, or in other words, excessively self-punitive (<xref ref-type="bibr" rid="ref7">Carn&#x00EC; et al., 2013</xref> for an overview). Deontological guilt, a form of guilt elicited by having disobeyed an intuitive moral rule, was shown to lead to ethically questionable decisions such as failure to flip the switch in the standard trolley dilemma (<xref ref-type="bibr" rid="ref45">Mancini and Gangemi, 2015</xref>), or acceptance of unfair offers in ultimatum game tasks (<xref ref-type="bibr" rid="ref47">Mancini and Mancini, 2015</xref>). Other recent experiments, such as those showing that guilt makes people excessively focus their attention on the victim of their behavior at the expense of others, have similarly questioned the morality of guilt (<xref ref-type="bibr" rid="ref16">de Hooge et al., 2011</xref>). A few authors have speculated in defense of shame, for example, as a &#x201C;guardian&#x201D; of self-identity and integrity (<xref ref-type="bibr" rid="ref17">Deonna et al., 2012</xref>). However, the general narrative that shame, but not guilt, can be deleterious is deep-rooted in psychology and philosophy (see <xref ref-type="bibr" rid="ref56">Nussbaum, 2009</xref>).</p>
<p>Moreover, one might suppose that divergent moral outcomes result from the link, presumed by Nietzsche scholars and Freudians, between guilt/shame and different religious traditions, or from the link between these emotions and different cultures, as proposed by some anthropologists (<xref ref-type="bibr" rid="ref6">Benedict, 1946</xref>). These ideas have inspired only a few, inconclusive, empirical studies (e.g., <xref ref-type="bibr" rid="ref36">Hutchinson et al., 1998</xref>; <xref ref-type="bibr" rid="ref83">Walinga et al., 2005</xref>; <xref ref-type="bibr" rid="ref82">Vaisey and Smith, 2008</xref>; see also <xref ref-type="bibr" rid="ref72">Tangney and Dearing, 2002</xref>, pp. 152&#x2013;153).</p>
<p>However, guilt and shame are not only significant for their contribution to pro- or anti-social behaviors. Experts in the field tend to agree that when these emotions are present, &#x201C;some degree of moral judgment would seem to be indirectly involved&#x201D; (<xref ref-type="bibr" rid="ref72">Tangney &#x0026; Dearing, 2002</xref>, p. 43) and that &#x201C;one has internalized moral values&#x201D; (<xref ref-type="bibr" rid="ref10">Cohen et al., 2012</xref>, p. 355). In the debate about guilt and shame, these emotions are considered &#x201C;&#x2018;self-conscious emotions&#x2019; that are evoked by self-reflection and self-evaluation&#x201D; (<xref ref-type="bibr" rid="ref78">Tangney and Tracy, 2013</xref>), whether &#x201C;implicit or explicit, consciously experienced or transpiring beyond our awareness,&#x201D; directed alternatively toward the behavior or toward the self (see also <xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>). Although moral judgment is not necessarily indicative of moral action (<xref ref-type="bibr" rid="ref14">Cova, 2013</xref>), our research was driven by the idea that it is worthwhile to understand the moral judgments that guilt/shame prone individuals make, so as to better characterize the connection between these emotions, beliefs and the kind of actions they motivate. Indeed, this assessment of the &#x201C;antecedents&#x201D; of moral behavior may be a first step in addressing a question about morality that has been taken to be relevant to past empirical research on moral emotions in general (<xref ref-type="bibr" rid="ref20">Ellemers et al., 2019</xref>).</p>
<p>In order to be morally accountable, an agent need not possess a sophisticated knowledge of her moral reasons (i.e., so-called <italic>deliberative agency</italic>, see <xref ref-type="bibr" rid="ref42">Levi and Bayne, 2004</xref>), but at least she has to recognize the conditions under which one, including herself, might be held responsible or punished for some transgressions. This is a minimal solution to problems such as automatism or involuntary conduct, which has been suggested in the legal domain (<xref ref-type="bibr" rid="ref85">Yannoulidis, 2012</xref>), and is easily applicable to morality.</p>
<p>We broadly define prosocial or antisocial emotions, respectively, as those that elicit behavior that may benefit or hurt others, including society as a whole (see <xref ref-type="bibr" rid="ref24">Gilbert and Basran, 2019</xref>). It is worth noting that in order to differentiate between the prosocial or antisocial nature of an emotion, we focus on the behavior, rather than on the emotion itself. To characterize guilt and shame as pro-social or anti-social, we consider the benefit or harm to others that would result from their effect on moral judgment. It must also be noted that the idea of equating morality with mere pro-sociality is contested by influential moral philosophers. For example, according to John Harris, morality is conceived as &#x201C;basically a matter of choosing what is for the best all things considered, not simply being well motivated or pro-social; in short that to be good is not simply happening to do no evil but choosing for a reason, choosing on the basis of evidence and argument, not to do wrong&#x201D; (<xref ref-type="bibr" rid="ref30">Harris, 2016a</xref>, p. 270; see also <xref ref-type="bibr" rid="ref31">Harris, 2016b</xref>). This position contests the view defended by some neuropsychologists that emotional interventions aimed at increasing pro-sociality, bypassing cognition, would be sufficient to enhance someone&#x2019;s moral behavior.</p>
<p>Additionally, guilt and shame are intimately related to the notion of responsibility - indeed, &#x2018;guilty&#x2019; and &#x2018;responsible&#x2019; are often used as synonyms in ordinary language. Given that responsibility attributions are a significant metric for investigating people&#x2019;s moral beliefs (<xref ref-type="bibr" rid="ref53">Nichols and Knobe, 2007</xref>), investigating this relationship can give us insight into the moral beliefs of guilt- and shame-prone individuals and contribute to the analysis of the morality of these emotions. Thus far, attributions of responsibility have only been tested in the context of guilt and shame in the first-person dimension (<xref ref-type="bibr" rid="ref70">Tangney, 1990</xref>; <xref ref-type="bibr" rid="ref74">Tangney et al., 1996</xref>; <xref ref-type="bibr" rid="ref62">Riek et al., 2014</xref>). The links with attributional styles (in terms of causality and blame) have also been addressed, but only when the scenarios were presented in the first person. It was found that guilt tends to result in the internalization of cause or blame for negative events (self-blame), while shame results in their externalization (<xref ref-type="bibr" rid="ref70">Tangney, 1990</xref>; <xref ref-type="bibr" rid="ref79">Tangney et al., 1992a</xref>,<xref ref-type="bibr" rid="ref80">b</xref>). The relation between guilt/shame and responsibility attributions in the third-person dimension, the existence of which seems less obvious than in the first-person, has not been explicitly investigated. Specifically, although it is known that guilt-prone individuals make severe attributions of responsibility to themselves, we do not know whether they will also make such severe judgments about others. A large body of previous work has highlighted asymmetries between first and third person judgements, such as the actor-observer asymmetry (<xref ref-type="bibr" rid="ref38">Jones and Nisbett, 1971</xref>), the self-serving bias (<xref ref-type="bibr" rid="ref51">Miller and Ross, 1975</xref>), or the fundamental attribution error (<xref ref-type="bibr" rid="ref63">Ross, 1977</xref>), all evidencing more benevolent judgments in the first person than in the third. However, it is not known whether and how these asymmetries will interact with guilt- and shame-proneness.</p>
<p>Another open question concerns the distinct factors that contribute to responsibility attributions in folk ethics. People usually believe, to hold someone responsible for an action, the someone in question must have caused the outcomes of an action (causality), decided intentionally to act that way (decision-making), and be consistently punishable for that action (punishment) (<xref ref-type="bibr" rid="ref21">Fischer and Ravizza, 1998</xref>). These other dimensions, relevant to responsibility, are different, separate components that contribute to responsibility attributions in degrees and have not been investigated together by previous studies. Among the three, punishment attributions concern a self-reported action to be taken in the future (i.e., to punish or not), so they are related to agentive morality exactly as most previous literature on guilt/shame investigates. Thus, considering punishment alongside with other antecedent conditions (causality, decision-making) may suggest an interesting relationship between guilt/shame and moral action/judgment.</p>
<p>The case for investigating causality and decision-making separately is based on the well-established fact that people sometimes tend to judge negatively harm caused even unintentionally (<xref ref-type="bibr" rid="ref15">Cushman, 2008</xref>). We must note that, even in folk ethics, there are apparently exceptions to the presence of causality (i.e., omissions) and decision-making (i.e., negligence) for responsibility attributions. However, it seems that even in these exceptional cases causality and decision-making are somehow present and relevant. In omissions, one just performs a <italic>different action</italic> from the action one should perform as prescribed by social norms, while in negligence one still decides and intends to act in a certain way even if one somehow ignores the <italic>consequences</italic> of that action.</p>
<p>To this end, the objective of our study was to see whether and how guilt and shame impact responsibility attributions in all their specific dimensions that precede and follow the action, including causality, decision-making, and punishment. Moral <italic>culpability</italic> (<xref ref-type="bibr" rid="ref52">Moore, 1996</xref>) seems to be the concept that properly brings together responsibility, causality, decision-making, and punishment, in the guilt dimension, given that <italic>culpa</italic> is the Latin word for guilt.</p>
<p>We tested the severity of culpability attributions both in the first- and third-person for individuals who are prone to guilt or shame. Apart from examining the first/third person dimension, we also explored the impact of: (a) different types of interconnected attributions, all related to the broader concept of moral culpability (i.e., responsibility, causality, decision-making, and punishment) (see for example <xref ref-type="bibr" rid="ref33">Hitchcock and Knobe, 2009</xref> for the link between norms and causality); (b) the introduction of mitigating conditions (such as coercion) and (c) affective and behavioral components of guilt and shame, using a recently introduced trait assessment, the GASP scale (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>) that differentiates between these subcomponents.</p>
<p>We hypothesized that culpability attributions would be more severe in guilt-prone individuals than in shame-prone individuals. In the psychological literature, amplifying the moral significance of violations when making moral judgments has been named <italic>moralizing</italic> (<xref ref-type="bibr" rid="ref64">Rozin, 1999</xref>; <xref ref-type="bibr" rid="ref35">Horberg et al., 2009</xref>, <xref ref-type="bibr" rid="ref34">2011</xref>). Consistent with this literature, we refer to severe culpability attributions as moralizing. We also hypothesized that, consistently with the attributional style patterns found for guilt and shame by previous studies (<xref ref-type="bibr" rid="ref70">Tangney, 1990</xref>; <xref ref-type="bibr" rid="ref79">Tangney et al., 1992a</xref>,<xref ref-type="bibr" rid="ref80">b</xref>), showing that guilt internalizes causality and blame of actions while shame externalizes them, the effect would be more pronounced in the first-person dimension than in the third for guilt-prone individuals (<italic>self-critical</italic> moralizing, or a form of internalization of the blaming). Alternatively, we expected more severity in the third-person than in the first for shame-prone individuals (<italic>other-critical</italic> moralizing, or a form of externalization of the blaming).</p>
</sec>
<sec sec-type="materials|methods" id="sec2">
<title>Materials and methods</title>
<p>We performed two Internet-based experiments to test whether proneness to guilt and/or shame affects culpability attributions. The research, including its materials and methods, was approved by the Institutional Review Board at the City University of New York. Formal permission for using the Guilt and Shame Proneness Scale (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>) was provided by the American Psychological Association and by the first author of the scale.</p>
<p>The two surveys, composed of 5 sections totaling 27 questions, were designed through the SurveyMonkey platform. English-speaking participants were recruited through Amazon Mechanical Turk. While we are aware that online crowdsourcing platforms may have several limitations, among them, MTurk has been shown to obtain quality and representative data, especially within the United States, and is also an especially diverse subject pool (<xref ref-type="bibr" rid="ref48">Mason and Suri, 2012</xref>; <xref ref-type="bibr" rid="ref69">Strickland and Stoops, 2019</xref>).</p>
<p>All participants expressed written informed consent at the beginning of each survey (Section 1, Q1). After being assigned a code, they were compensated with a small sum (0.50 USD) for their participation at the end of the survey.</p>
<p>We collected a sample of online participants in both studies 1 and 2. The number of participants who completed the survey in Study 1 were <italic>N&#x2009;=</italic> 101, including 48 women, 52 men and 1 subject who did not identify with either category. Participants&#x2019; ages ranged from 19 to 69&#x2009;years old (<italic>M&#x2009;=</italic> 35.48). A hundred participants were from the United States, and only one was from elsewhere.</p>
<p>In Study 2, <italic>N</italic> =&#x2009;116 participants completed the survey, including 56 women, 57 men, and 3 individuals who did not identify with either of these categories. Participants&#x2019; ages ranged from 18 to 75&#x2009;years old (<italic>M&#x2009;=</italic> 35.4), and all participants were from the U.S. Information regarding the ethnicity and religious affiliation of all participants in both studies can be found in <xref ref-type="table" rid="tab1">Table 1</xref>.</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Demographic information for all participants in Study 1 (<italic>N</italic> =&#x2009;101) and Study 2 (<italic>N</italic> =&#x2009;116).</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">
<bold>A.</bold>
</th>
<th/>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td/>
<td align="center" valign="top">Study 1</td>
<td align="center" valign="top">Study 2</td>
</tr>
<tr>
<td align="left" valign="top">African American, Black</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">11</td>
</tr>
<tr>
<td align="left" valign="top">Chinese</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">2</td>
</tr>
<tr>
<td align="left" valign="top">Indian</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">2</td>
</tr>
<tr>
<td align="left" valign="top">Japanese</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">1</td>
</tr>
<tr>
<td align="left" valign="top">Korean</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">1</td>
</tr>
<tr>
<td align="left" valign="top">Southeast Asian</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">1</td>
</tr>
<tr>
<td align="left" valign="top">White Caucasian - Non Hispanic</td>
<td align="center" valign="top">50</td>
<td align="center" valign="top">63</td>
</tr>
<tr>
<td align="left" valign="top">Hispanic or Latino</td>
<td align="center" valign="top">7</td>
<td align="center" valign="top">3</td>
</tr>
<tr>
<td align="left" valign="top">Mexican</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">1</td>
</tr>
<tr>
<td align="left" valign="top">American Indian, Alaskan Native</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top">Middle Eastern</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top">European, White</td>
<td align="center" valign="top">19</td>
<td align="center" valign="top">24</td>
</tr>
<tr>
<td align="left" valign="top">More than one race</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">3</td>
</tr>
<tr>
<td align="left" valign="top">Not reported or listed</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">2</td>
</tr>
<tr>
<td align="left" valign="top">Decline to answer</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">2</td>
</tr>
</tbody>
</table>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="top" colspan="5">(B)</th>
</tr>
<tr>
<th/>
<th align="center" valign="top">Study 1 (RA - childhood)</th>
<th align="center" valign="top">Study 1 (RA - current)</th>
<th align="center" valign="top">Study 2 (RA - childhood)</th>
<th align="center" valign="top">Study 2 (RA - current)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Protestant</td>
<td align="center" valign="top">24</td>
<td align="center" valign="top">17</td>
<td align="center" valign="top">40</td>
<td align="center" valign="top">25</td>
</tr>
<tr>
<td align="left" valign="top">Orthodox</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">4</td>
<td align="center" valign="top">3</td>
</tr>
<tr>
<td align="left" valign="top">Catholic</td>
<td align="center" valign="top">37</td>
<td align="center" valign="top">22</td>
<td align="center" valign="top">27</td>
<td align="center" valign="top">18</td>
</tr>
<tr>
<td align="left" valign="top">Islamic</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top">Jewish</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">3</td>
</tr>
<tr>
<td align="left" valign="top">Buddhist</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">2</td>
</tr>
<tr>
<td align="left" valign="top">Hindu</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">1</td>
<td align="center" valign="top">1</td>
</tr>
<tr>
<td align="left" valign="top">Confucian</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
<td align="center" valign="top">0</td>
</tr>
<tr>
<td align="left" valign="top">Yes (religious), not listed</td>
<td align="center" valign="top">10</td>
<td align="center" valign="top">13</td>
<td align="center" valign="top">11</td>
<td align="center" valign="top">14</td>
</tr>
<tr>
<td align="left" valign="top">None (Atheist, Agnostic, etc.)</td>
<td align="center" valign="top">23</td>
<td align="center" valign="top">39</td>
<td align="center" valign="top">26</td>
<td align="center" valign="top">44</td>
</tr>
<tr>
<td align="left" valign="top">Decline to answer</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">2</td>
<td align="center" valign="top">3</td>
<td align="center" valign="top">6</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><bold>(A)</bold> Ethnic and racial background. <bold>(B)</bold> Religious affiliation (RA - childhood and current).</p>
</table-wrap-foot>
</table-wrap>
<p>To test attributions of moral culpability, we designed 4 different vignettes, each of which described the same morally ambiguous act of killing under different conditions. These vignettes were presented randomly to participants in Section 2 (Q2-5) just after expressing informed consent. In each of the 4 scenarios, the agent finds a stranger at home and fatally stabs and kills this intruder. Three of the vignettes include a different potentially mitigating circumstance (i.e., intoxication, coercion, and false information), and the 4th, a control vignette, had no such circumstance (see <xref ref-type="table" rid="tab2">Table 2</xref>). Due to the conceptual vagueness of the term &#x2018;responsibility,&#x2019; we decided not to ask only for explicit responsibility attributions, but also for other kinds of attributions often conceptually connected to the notion of responsibility, all belonging to the broader concept of moral culpability (see <xref ref-type="bibr" rid="ref21">Fischer and Ravizza, 1998</xref>). The 4 questions (i.e., about responsibility, causality, decision-making, and punishment) are listed in <xref ref-type="table" rid="tab3">Table 3</xref>. The participants indicated their responses on a 7 point Likert-type scale (from 1&#x2009;= <italic>not at all</italic>, to 7&#x2009;= <italic>strongly</italic>).</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Moral vignettes in different conditions (blank, intoxication, coercion, false information) and kinds of questions (responsibility, causality, punishment, decision-making) for 1st/3rd person version.</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td align="left" valign="top"><bold>Blank condition</bold><break/>1st/3rd person version<break/><italic>You (Sam) come(s) home at night to find(s) a stranger standing in your living room. You (Sam) see(s) a sharp kitchen knife on the counter, pick(s) it up and fatally stab(s) the stranger in the chest.</italic></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Intoxication condition</bold><break/>1st/ 3rd person version<break/><italic>You (Sam) come(s) home at night intoxicated from an evening of heavy drinking and find(s) a stranger standing in your living room. You (Sam) see(s) a sharp kitchen knife on the counter, drunkenly pick(s) it up and fatally stab(s) the stranger in the chest</italic>.</td>
</tr>
<tr>
<td align="left" valign="top"><bold>Coercion condition</bold><break/>1st/3rd person version<break/><italic>You (Sam) come(s) home at night to find two strangers standing in your living room. One is unarmed but the other has a gun. The one with the gun orders you (Sam) to pick up the sharp kitchen knife on the counter and stab the unarmed stranger and says that if you (Sam) fail(s) to comply you (Sam) will be shot in the head. You (Sam) pick(s) up the knife and fatally stab(s) the unarmed stranger in the chest.</italic></td>
</tr>
<tr>
<td align="left" valign="top"><bold>False information condition</bold><break/>1st/3rd person version<break/><italic>On your way home one night you (Sam) receive(s) an anonymous text message telling you (Sam) that there is a stranger in your (Sam&#x2019;s) apartment who means to kill you (Sam). When you (Sam) get(s) home there is, indeed, a stranger standing in your (Sam&#x2019;s) living room. You (Sam) see(s) a sharp kitchen knife on the counter, pick(s) it up and fatally stab(s) the stranger in the chest. However, in fact the text you (Sam) received was a lie. The stranger in your apartment meant you (Sam) no harm and was actually there seeking safety from the person who sent the text.</italic></td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="tab3">
<label>Table 3</label>
<caption>
<p>Moral vignettes in different conditions (blank, intoxication, coercion, false information) and kinds of questions (responsibility, causality, punishment, decision-making) for 1st/3rd person version.</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td align="left" valign="top">
<bold>Questions for 1st/3rd person version</bold>
</td>
</tr>
<tr>
<td align="left" valign="top"><italic>- How responsible are you (is Sam) for performing this action?</italic><break/>(responsibility question)<break/><italic>- How much did you (Sam) cause this outcome?</italic><break/>(causality question)<break/><italic>- How much should you (Sam) be punished?</italic><break/>(punishment question)<break/><italic>- Did you (Sam) decide to perform this action?</italic><break/>(decision-making question)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>In Study 1, the agent in the vignettes was presented in the 2nd person (&#x201C;you&#x201D;), asking the participant to put him/herself in the scenario in order to obtain 1<sup>st</sup> person attributions. In Study 2, the agent, for whom we chose the gender-neutral name &#x201C;Sam,&#x201D; was presented in the 3<sup>rd</sup> person.</p>
<p>To test for individual proneness to guilt and shame, we used all 16 items of the Guilt and Shame Proneness Scale (GASP) (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>). The GASP scale was built and validated in continuity with previous scales (e.g., TOSCA-3, <xref ref-type="bibr" rid="ref73">Tangney et al., 2000</xref>). However, we decided to use the GASP scale because, unlike the TOSCA (see <xref ref-type="bibr" rid="ref26">Giner-Sorolla et al., 2011</xref>), the GASP differentiates between the affective and behavioral components of each emotion, resulting in 4 subscales. Specifically, the GASP scale contains 4 items for guilt-negative behavior evaluation (Guilt-NBE), 4 items for guilt-repair (Guilt-R), 4 items for shame-negative self-evaluation (Shame-NSE) and 4 items for shame-withdraw (Shame-W). Guilt-NBE items are meant to capture a person&#x2019;s proneness to bad feelings about her actions, while Guilt-R items are concerned with one&#x2019;s proneness to intend to compensate for her actions. Meanwhile, Shame-NSE items address a person&#x2019;s proneness to feeling bad about herself after a transgression, while Shame-W has to do with proneness to intend to hide or withdraw. Our choice to keep the affective and behavioral components of guilt and shame distinct was motivated by an interest in whether or not the components differentially affect responsibility attributions. To this end, we decided to look at trait emotions rather than induced emotions since the induction of guilt and shame separately, especially the induction of their specific subtypes, would be very difficult and would imply a choice among different kinds of inductions (<xref ref-type="bibr" rid="ref49">McLatchie et al., 2016</xref>).</p>
<p>In the GASP, participants are asked to answer questions about their likelihood, on a 7 point Likert-type scale from 1 (=<italic>unlikely</italic>) to 7 (=<italic>very likely</italic>), to feel or act in a particular way, which is intended to measure their possession of characteristics corresponding to the 4 subscales (examples of the GASP items are in <xref ref-type="table" rid="tab4">Table 4</xref>).</p>
<table-wrap position="float" id="tab4">
<label>Table 4</label>
<caption>
<p>Four sample items of the GASP scale (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>), one for each subscale.</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td align="left" valign="top">Sub-scale</td>
<td align="left" valign="top">Sample items</td>
</tr>
<tr>
<td align="left" valign="top">
<bold>Guilt-NBE</bold>
</td>
<td align="left" valign="top">
<italic>After realizing you have received too much change at a store, you decide to keep it because the salesclerk does not notice. What is the likelihood that you would feel uncomfortable about keeping the money?</italic>
</td>
</tr>
<tr>
<td align="left" valign="top">
<bold>Guilt-repair</bold>
</td>
<td align="left" valign="top">
<italic>You reveal a friend&#x2019;s secret, though your friend never finds out. What is the likelihood that your failure to keep the secret would lead you to exert extra effort to keep secrets in the future?</italic>
</td>
</tr>
<tr>
<td align="left" valign="top">
<bold>Shame-NSE</bold>
</td>
<td align="left" valign="top">
<italic>You rip an article out of a journal in the library and take it with you. Your teacher discovers what you did and tells the librarian and your entire class. What is the likelihood that this would make you would feel like a bad person?</italic>
</td>
</tr>
<tr>
<td align="left" valign="top">
<bold>Shame-withdraw</bold>
</td>
<td align="left" valign="top">
<italic>After making a big mistake on an important project at work in which people were depending on you, your boss criticizes you in front of your coworkers. What is the likelihood that you would feign sickness and leave work?</italic>
</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>We tested participants using the GASP scale (Section 3, Q6&#x2013;Q21) after asking them the four types of attribution questions in response to the moral vignettes (Q2-5). We used a 7 point Likert-type scale for attributions to be consistent with the range of responses to the GASP items. We chose to present the moral vignettes before the GASP scale in order to avoid any possible influence of the GASP items. In principle, it is possible that the moral vignettes affected responses to the GASP scale. It would be useful in future work to determine whether and how the order of presentation affects the observed relationship between these two measures.</p>
<p>Demographic questions (Section 4, Q22&#x2013;Q27) were posed at the end, asking for gender, ethnic/racial background, country of residence, current religion, childhood religion, and age. Internal randomization was utilized in all 3 sections.</p>
<p>Statistical analyses were performed in Matlab and R.</p>
</sec>
<sec sec-type="results" id="sec3">
<title>Results</title>
<p>We first examined the extent to which moral culpability, characterized by the 4 types of attributions (responsibility, causality, punishment, and decision-making), is predicted by scores on the GASP&#x2019;s 4 subscales for guilt and shame (descriptive statistics for these variables are presented in <xref ref-type="table" rid="tab5">Table 5</xref>).</p>
<table-wrap position="float" id="tab5">
<label>Table 5</label>
<caption><p>A. Descriptive statistics for all independent variables (GASP subscales). B. Descriptive statistics for all dependent variables.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="top"></th>
<th>Mean</th>
<th>St. Dev.</th>
<th>Range</th>
<th>&#x03B1;</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Guilt-NBE</td>
<td align="center" valign="top">5.30</td>
<td align="center" valign="top">1.35</td>
<td align="center" valign="top">1&#x2013;7</td>
<td align="center" valign="top">0.81</td>
</tr>
<tr>
<td align="left" valign="top">Guilt-Repair</td>
<td align="center" valign="top">5.49</td>
<td align="center" valign="top">1.10</td>
<td align="center" valign="top">1&#x2013;7</td>
<td align="center" valign="top">0.73</td>
</tr>
<tr>
<td align="left" valign="top">Shame-NSE</td>
<td align="center" valign="top">5.37</td>
<td align="center" valign="top">1.27</td>
<td align="center" valign="top">1&#x2013;7</td>
<td align="center" valign="top">0.78</td>
</tr>
<tr>
<td align="left" valign="top">Shame-Withdraw</td>
<td align="center" valign="top">3.49</td>
<td align="center" valign="top">1.28</td>
<td align="center" valign="top">1&#x2013;7</td>
<td align="center" valign="top">0.65</td>
</tr>
<tr>
<td align="left" valign="top" colspan="5">&#x03B1; indicates the internal reliability of each subscale.</td>
</tr>
</tbody>
</table>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="top"></th>
<th>Mean</th>
<th>St. Dev.</th>
<th>Range</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Responsible</td>
<td align="center" valign="top">4.93</td>
<td align="center" valign="top">1.36</td>
<td align="center" valign="top">1&#x2013;7</td>
</tr>
<tr>
<td align="left" valign="top">Causal</td>
<td align="center" valign="top">4.71</td>
<td align="center" valign="top">1.38</td>
<td align="center" valign="top">1&#x2013;7</td>
</tr>
<tr>
<td align="left" valign="top">Punish</td>
<td align="center" valign="top">3.81</td>
<td align="center" valign="top">1.48</td>
<td align="center" valign="top">1&#x2013;7</td>
</tr>
<tr>
<td align="left" valign="top">Decision</td>
<td align="center" valign="top">5.16</td>
<td align="center" valign="top">1.37</td>
<td align="center" valign="top">1&#x2013;7</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>To do this, we produced a single attribution score for each participant by taking the average of all attributions made by that participant. We then performed 4 separate linear regressions, each examining the predictive capacity of 1 subscale. We followed the GASP authors&#x2019; recommendation to perform separate regression analyses in order to avoid possible multicollinearity problems and to retain any shared variance between guilt and shame that might be excluded by creating the artificial constructs of guilt-free shame and shame-free guilt (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>, p. 955). We did so as we concurred with the GASP authors in their skepticism about the &#x201C;utility of such computations given that, phenomenologically, people are unlikely to experience guilt without a hint of shame or shame without a tinge of guilt&#x201D; (<xref ref-type="bibr" rid="ref12">Cohen et al., 2011</xref>, p. 951). This decision is justified statistically by the fact that guilt and shame are shown to typically co-occur (<xref ref-type="bibr" rid="ref57">Paulhus et al., 2004</xref>).</p>
<p>Because 4 separate regressions were performed, we performed Bonferroni corrections for 4 comparisons. The results revealed that attributions were significantly predicted by the subscales for both the affective dimension of guilt (<xref ref-type="fig" rid="fig1">Figure 1A</xref>, <italic>&#x03B2;</italic>&#x2009;=&#x2009;0.28, <italic>p</italic> &#x003C;&#x2009;0.0001, Bonferroni corrected for 4 comparisons) and the behavioral dimension of guilt (<xref ref-type="fig" rid="fig1">Figure 1B</xref>, <italic>&#x03B2;</italic> =&#x2009;0.34, <italic>p</italic> &#x003C;&#x2009;0.0001, Bonferroni corrected for 4 comparisons), but only the affective dimension of shame (<xref ref-type="fig" rid="fig1">Figure 1C</xref>, <italic>&#x03B2;</italic> =&#x2009;0.24, <italic>p</italic> &#x003C;&#x2009;0.001, Bonferroni corrected for 4 comparisons). The subscale for the behavioral dimension of shame did not significantly predict attributions of any type (<xref ref-type="fig" rid="fig1">Figure 1D</xref>, <italic>&#x03B2;</italic> =&#x2009;&#x2212;0.01, <italic>p</italic> =&#x2009;0.81, uncorrected). Interestingly, this result mirrors the covariance structure reported by the scale authors, whereby the affective subscale for shame (Shame-NSE) shared more variance with the guilt subscales (i.e., Guilt-NBE and Guilt-R) than it did with the behavioral subscale for shame (Shame-W) (<italic>Ibid.</italic>, p. 950). These results are consistent with our moralizing effect hypothesis for both dimensions of guilt and the affective dimension of shame, but not the behavioral one.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>Regression models for the relationship between culpability attributions and subscales for guilt and shame. Shaded gray area represents 95% confidence intervals. <bold>(A)</bold> Affective subscale for guilt (Guilt-NBE). <bold>(B)</bold> Behavioral subscale for guilt (Guilt-R). <bold>(C)</bold> Affective subscale for shame (Shame-NSE). <bold>(D)</bold> Behavioral subscale for shame (Shame-W).</p>
</caption>
<graphic xlink:href="fnint-17-1232523-g001.tif"/>
</fig>
<p>We next examined whether this pattern was different when participants were making 1st vs. 3rd person attributions. We performed 8 separate regressions, assessing the extent to which the 4 subscales predicted attributions separately in the 1st and 3rd person conditions. We did not find any evidence to support our hypotheses regarding differences between 1st and 3rd person attributions, and, indeed, the pattern looked remarkably similar in these two conditions. In the 1st-person condition, attributions were significantly predicted by both the affective (Guilt-NBE, <italic>&#x03B2;</italic> =&#x2009;0.26, <italic>p</italic> &#x003C;&#x2009;0.05, Bonferroni corrected for 8 comparisons) and behavioral (Guilt-R, <italic>&#x03B2;</italic> =&#x2009;0.41, <italic>p</italic> &#x003C;&#x2009;0.01, Bonferroni corrected for 8 comparisons) dimensions of guilt, and by the affective dimension of shame (Shame-NSE, <italic>&#x03B2;</italic> =&#x2009;0.33, <italic>p</italic> &#x003C;&#x2009;0.05, Bonferroni corrected for 8 comparisons), but not the behavioral dimension of shame (Shame-W, <italic>&#x03B2;</italic> =&#x2009;&#x2212;0.1, <italic>p</italic> =&#x2009;0.36, uncorrected). In the 3rd-person condition, attributions were significantly predicted by both the affective (Guilt-NBE, <italic>&#x03B2;</italic> =&#x2009;0.3, <italic>p</italic> &#x003C;&#x2009;0.001, Bonferroni corrected for 8 comparisons) and behavioral (Guilt-R, <italic>&#x03B2;</italic> =&#x2009;0.3, <italic>p</italic> &#x003C;&#x2009;0.01, Bonferroni corrected for 8 comparisons) dimensions of guilt. The results were marginally significant for the affective dimension of shame, but did not pass Bonferroni corrections (Shame-NSE, <italic>&#x03B2;</italic> =&#x2009;0.18, <italic>p</italic> =&#x2009;0.0125, uncorrected), and were not significant for the behavioral dimension of shame (Shame-W, <italic>&#x03B2;</italic> =&#x2009;0.05, <italic>p</italic> =&#x2009;0.46, uncorrected). We also looked for interactions between the 4 subscales and the 1st vs. 3rd person dimension. Each regression included the one dependent variable, our average measure of culpability attributions, and three independent variables: (1) 1 of the 4 subscales for guilt and shame, (2) whether the moral attributions in question were 1st or 3rd person (coded as a dichotomous, between-subjects predictor), and (3) the interaction between variables 1 and 2. These results were Bonferroni corrected for 4 comparisons. The results revealed no significant interactions between 1st vs. 3rd person attributions and the subscales for guilt and shame, and, surprisingly, no main effect of 1st vs. 3rd person (<xref ref-type="table" rid="tab6">Table 6A</xref>). To confirm this, we performed a t-test between 1st and 3rd person attributions, which again revealed no significant effect (two-sample <italic>t</italic>-test, <italic>t</italic> =&#x2009;0.82, <italic>p</italic> =&#x2009;0.41). In sum, we did not find any evidence in support of our hypotheses regarding ways in which guilt and shame proneness might interact with 1st vs. 3rd person attributions, and instead found a pattern that was robust across these two conditions.</p>
<table-wrap position="float" id="tab6">
<label>Table 6</label>
<caption>
<p>Regression models for interactions between the subscales for guilt and shame and different contexts of culpability attribution.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="top" colspan="7">
<bold>(A)</bold>
</th>
</tr>
<tr>
<th/>
<th align="center" valign="top" colspan="2">Subscale</th>
<th align="center" valign="top" colspan="2">First/third person</th>
<th align="center" valign="top" colspan="2">Interaction</th>
</tr>
<tr>
<th/>
<th align="center" valign="top">
<italic>&#x03B2;</italic>
</th>
<th align="center" valign="top">
<italic>p</italic>
</th>
<th align="center" valign="top">
<italic>&#x03B2;</italic>
</th>
<th align="center" valign="top">
<italic>p</italic>
</th>
<th align="center" valign="top">
<italic>&#x03B2;</italic>
</th>
<th align="center" valign="top">
<italic>p</italic>
</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Guilt &#x2013; affective</td>
<td align="center" valign="top">0.26</td>
<td align="center" valign="top">&#x003C; 0.01</td>
<td align="left" valign="top">&#x2212;0.04</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">0.03</td>
<td align="center" valign="top">N.S.</td>
</tr>
<tr>
<td align="left" valign="top">Guilt &#x2013; behavioral</td>
<td align="center" valign="top">0.41</td>
<td align="center" valign="top">&#x003C; 0.001</td>
<td align="left" valign="top">0.76</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">&#x2212;0.11</td>
<td align="center" valign="top">N.S.</td>
</tr>
<tr>
<td align="left" valign="top">Shame &#x2013; affective</td>
<td align="center" valign="top">0.33</td>
<td align="center" valign="top">&#x003C; 0.01</td>
<td align="left" valign="top">0.99</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">&#x2212;0.15</td>
<td align="center" valign="top">N.S.</td>
</tr>
<tr>
<td align="left" valign="top">Shame - behavioral</td>
<td align="center" valign="top">&#x2212;0.11</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">&#x2212;0.43</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">0.16</td>
<td align="center" valign="top">N.S.</td>
</tr>
</tbody>
</table>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="center" valign="top" colspan="7">
<bold>(B)</bold>
</th>
</tr>
<tr>
<th/>
<th align="center" valign="top" colspan="2">Subscale</th>
<th align="center" valign="top" colspan="2">Mitigating factors</th>
<th align="center" valign="top" colspan="2">Interaction</th>
</tr>
<tr>
<th/>
<th align="center" valign="top">
<italic>&#x03B2;</italic>
</th>
<th align="center" valign="top">
<italic>p</italic>
</th>
<th align="center" valign="top">
<italic>&#x03B2;</italic>
</th>
<th align="center" valign="top">
<italic>p</italic>
</th>
<th align="center" valign="top">
<italic>&#x03B2;</italic>
</th>
<th align="center" valign="top">
<italic>p</italic>
</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="top">Guilt &#x2013; affective</td>
<td align="left" valign="top">0.25</td>
<td align="center" valign="top">&#x003C;0.01</td>
<td align="center" valign="top">&#x2212;0.87</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">0.04</td>
<td align="center" valign="top">N.S.</td>
</tr>
<tr>
<td align="left" valign="top">Guilt &#x2013; behavioral</td>
<td align="left" valign="top">0.38</td>
<td align="center" valign="top">&#x003C;0.0001</td>
<td align="center" valign="top">&#x2212;0.38</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">&#x2212;0.05</td>
<td align="center" valign="top">N.S.</td>
</tr>
<tr>
<td align="left" valign="top">Shame &#x2013; affective</td>
<td align="left" valign="top">0.26</td>
<td align="center" valign="top">&#x003C;0.01</td>
<td align="center" valign="top">&#x2212;0.47</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">&#x2212;0.03</td>
<td align="center" valign="top">N.S.</td>
</tr>
<tr>
<td align="left" valign="top">Shame &#x2013; behavioral</td>
<td align="left" valign="top">&#x2212;0.0004</td>
<td align="center" valign="top">N.S.</td>
<td align="center" valign="top">&#x2212;0.59</td>
<td align="center" valign="top">N.S.</td>
<td align="left" valign="top">&#x2212;0.02</td>
<td align="center" valign="top">N.S.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>P-</italic>values are Bonferroni corrected for four comparisons, unless noted otherwise. N.S. (not significant) indicates predictors with <italic>p</italic> &#x003E;&#x2009;0.05 after correction for multiple comparisons. <bold>(A)</bold> Interaction with first vs. third person attributions. <bold>(B)</bold> Interaction with mitigating factors.</p>
</table-wrap-foot>
</table-wrap>
<p>Finally, we examined the effect of factors that might mitigate culpability attributions. These included circumstances in which agents acted under conditions of coercion, intoxication, or false information, as well as a control case that did not involve mitigating factors. We found the same pattern when considering only cases that included mitigating factors. Limiting the data to these cases, we found that attributions were significantly predicted by both the affective (Guilt-NBE, <italic>&#x03B2;</italic> =&#x2009;0.3, <italic>p</italic> &#x003C;&#x2009;0.0001, Bonferroni corrected for 4 comparisons) and behavioral (Guilt-R, <italic>&#x03B2;</italic> =&#x2009;0.33, <italic>p</italic> &#x003C;&#x2009;0.0001, Bonferroni corrected for 4 comparisons) dimensions of guilt, and the affective dimension of shame (Shame-NSE, <italic>&#x03B2;</italic> =&#x2009;0.23, <italic>p</italic> &#x003C;&#x2009;0.01, Bonferroni corrected for 4 comparisons), but not the behavioral dimension of shame (Shame-W, <italic>&#x03B2;</italic> =&#x2009;&#x2212;0.02, <italic>p</italic> =&#x2009;0.76, uncorrected). We also looked for interactions between the 4 subscales and the presence of mitigating factors. We performed 4 separate multiple regressions. The dependent variable for each regression was our average measure of culpability attributions, and the independent variables were: (1) 1 of the 4 subscales for guilt and shame, (2) whether the scenario in question involved mitigating factors (dichotomous, within-subjects predictor), and (3) the interaction between variables 1 and 2. These results revealed no significant interactions between the subscales for guilt and shame and whether an attribution involved mitigating factors (<xref ref-type="table" rid="tab6">Table 6B</xref>). Overall, these analyses showed that the primary pattern of results, that attributions are predicted by both subscales of guilt, and by the affective but not behavioral dimension of shame, was robust to the presence of potentially mitigating factors.</p>
<p>Surprisingly, our analysis did not reveal a significant main effect of mitigating factors, suggesting that perhaps participants were not sensitive to these factors in making culpability attributions. To investigate further, we performed two analyses. First, we directly compared culpability attributions in cases with vs. without mitigating conditions. This analysis yielded a significant result (paired <italic>t</italic>-test, <italic>t</italic> =&#x2009;9.56, <italic>p</italic> &#x003C;&#x2009;0.0001). This result suggests that the lack of a main effect of mitigating factors is due in part to the presence of the interaction term in the regressions in <xref ref-type="table" rid="tab6">Table 6B</xref>. Without this term, the effect of mitigating factors is significant. Second, we examined each type of mitigating factor separately. We performed paired t-tests between attributions involving 1 of the 3 different kinds of potentially mitigating factors, and attributions involving no mitigating factors. Because we asked participants about scenarios involving 3 different kinds of mitigating factors, we performed Bonferroni corrections for 3 comparisons. This analysis revealed that attributions of culpability were significantly altered by scenarios involving either coercion (paired <italic>t</italic>-test, <italic>t</italic> =&#x2009;13.5, <italic>p</italic> &#x003C;&#x2009;0.0001, Bonferroni corrected for 3 comparisons) or false information (paired <italic>t</italic>-test, <italic>t</italic> =&#x2009;3.5, <italic>p</italic> &#x003C;&#x2009;0.01, Bonferroni corrected for 3 comparisons), but not intoxication (paired <italic>t</italic>-test, <italic>t</italic> =&#x2009;0.9, <italic>p</italic> =&#x2009;0.34, uncorrected). This result suggests that the lack of a main effect of mitigating factors (in the regressions reported in <xref ref-type="table" rid="tab6">Table 6B</xref>) is due in part to the fact that participants found some mitigating factors (intoxication) less exculpating than others (coercion and false information). In sum, though we do not find any evidence for an interaction between guilt/shame and the presence of mitigating factors, our data do suggest that the presence of certain mitigating factors independently affects culpability attributions.</p>
<p>As for possible demographic factors (i.e., gender, childhood religion, current religion) we found only that women tend to be more Guilt-NBE prone than men (two-sample <italic>t</italic>-test, <italic>t</italic> =&#x2009;3.1, <italic>p</italic> &#x003C;&#x2009;0.01, Bonferroni corrected for 4 comparisons). Given this disparity, we also tested a regression model that included both guilt-NBE and gender as independent variables, but only found a significant main effect of guilt-NBE (guilt-NBE, <italic>p</italic> =&#x2009;0.001; gender, <italic>p</italic> =&#x2009;0.07; interaction, <italic>p</italic> =&#x2009;0.08). We also did not find any significant differences between the different kinds of attributions (responsibility, causality, decision-making, and punishment), suggesting that these different attributions reflect a single underlying concept, moral culpability. We did not find any significant effects for any of the other tested variables. It should be emphasized however that the study was not designed specifically to test the effect of these demographic factors, and the sample size was likely not large enough to do so (particularly in the case of childhood and current religion).</p>
</sec>
<sec sec-type="discussion" id="sec4">
<title>Discussion</title>
<p>The present studies contribute to the emerging literature on guilt and shame. The Moralizing Effect shows that individual proneness to guilt-affect, guilt-behavior, and shame-affect strongly predicts the severity of culpability attributions. Across the two experiments, it was demonstrated that increased proneness to guilt and affective shame (but not behavioral shame) significantly correlates with increased severity of culpability attributions of any type (i.e., responsibility, causality, decision-making, punishment). We found that this effect was robust across possible modulating factors.</p>
<p>Moreover, presenting experimental vignettes in the first- versus the third-person had no significant impact on attributional severity. This result is at odds with previous literature on the self-serving bias (<xref ref-type="bibr" rid="ref51">Miller and Ross, 1975</xref>), which would predict more severe attributions about others than about oneself (<xref ref-type="bibr" rid="ref13">Coleman, 2011</xref>). Our findings also contradict previous results about guilt and shame and attributions of causality and blame (<xref ref-type="bibr" rid="ref70">Tangney, 1990</xref>; <xref ref-type="bibr" rid="ref79">Tangney et al., 1992a</xref>,<xref ref-type="bibr" rid="ref80">b</xref>), which would predict more severe attributions for guilt in the first person than for shame.</p>
<p>Furthermore, our results suggest that guilt- and affective shame-prone individuals are not moral hypocrites, i.e., those with a tendency to judge others more severely than themselves, as they tend to moralize in both first- and third-person culpability attributions. This result aligns with other studies showing that, even if moral hypocrisy is influenced by emotions, guilt is not among these emotions (<xref ref-type="bibr" rid="ref60">Polman and Ruttan, 2011</xref>; <xref ref-type="bibr" rid="ref18">Du et al., 2019</xref>). Our analysis also suggests that shame-affect is not linked to moral hypocrisy.</p>
<p>Finally, the introduction of factors that may mitigate culpability judgments did not influence the Moralizing Effect, despite evidence that such circumstances have historically been taken to mitigate criminal culpability in the legal domain (<xref ref-type="bibr" rid="ref32">Hart, 1968</xref>) and despite the fact that these factors independently affected culpability judgments in our own data. As previously mentioned, the existing literature on guilt and shame favors the idea that guilt contributes to morality (in terms of pro-sociality) more than shame, but our results indicate a more nuanced interpretation of this view is required. Following philosophers like John Harris, we suggest that investigating prosociality is not enough to understand fully the morality of an emotion. For one, we found that not just guilt but also the affective dimension of shame strongly correlate with severe moral judgments about culpability. It follows that analyses of the morality of guilt should also consider the morality of affective shame. Guilt and shame-affect both function as indicators of the extent to which one holds oneself or others culpable for moral transgressions, with moralizing increasing, given greater proneness to these emotions. Furthermore, on the basis of the foregoing, one may want to reconsider the nature of guilt and shame (which are typically) characterized as &#x201C;self-condemning,&#x201D; in relation to emotions such as contempt, anger, and disgust (which are typically characterized as &#x201C;other-condemning&#x201D;) (for these classical distinctions see <xref ref-type="bibr" rid="ref28">Haidt, 2003</xref>).</p>
<p>Some might argue that the moralizing effect we described is a positive sign of the morality of guilt and shame-affect prone people. This a plausible interpretation that has been suggested by previous literature so far (see <xref ref-type="bibr" rid="ref77">Tangney et al., 2007</xref>). However, it is not clear that attributing a very high degree of culpability, especially to others (for some, this is called <italic>moral condemnation</italic>, see <xref ref-type="bibr" rid="ref8">Cheng et al., 2013</xref>), is most consistent with &#x201C;moral paths in life&#x201D; as June Tangney believes. Indeed, we often speak colloquially of the vice of being too judgmental, harsh, or punitive. In other words, we tend to expect a &#x201C;moral&#x201D; agent to be measured, balanced or neutral when expressing judgments. If we think of guilt and shame in dimensional terms, we can infer that an excess of guilt and shame-affect produces outcomes we would not be willing to endorse if we want to be &#x201C;moral.&#x201D; We are open to the possibility, however, that perhaps people who are prone to guilt or shame-affect may have high moral standards for their own behavior, thus being moral with regard to themselves, while at the same time being too harsh, and therefore possibly immoral with regard to others. This interpretation would require further empirical investigation.</p>
<p>In other research domains such as, for example, disgust studies, moralization has been understood to have a negative connotation because it leads to or amplifies attitudes that we find socially undesirable (e.g., social prejudice) (see <xref ref-type="bibr" rid="ref64">Rozin, 1999</xref>; <xref ref-type="bibr" rid="ref39">Kelly, 2011</xref>). Because shame has been coupled with disgust in this literature (e.g., <xref ref-type="bibr" rid="ref25">Giner-Sorolla and Espinosa, 2011</xref>; <xref ref-type="bibr" rid="ref81">Terrizzi and Shook, 2020</xref>), it is also seen as generating negative outcomes (see also <xref ref-type="bibr" rid="ref56">Nussbaum, 2009</xref>), while guilt is not (<xref ref-type="bibr" rid="ref9">Clark and Fessler, 2015</xref>, p. 484 for a discussion). Without necessarily meaning that guilt and shame-affect make agents &#x201C;immoral,&#x201D; insofar as moralizing is a tendency towards being excessively punitive or intolerant, it is plausible to believe that they may lead to outcomes that are harmful or unjust. This means that the relationship between guilt or shame-affect and moralizing might not be a desirable one. Moralism, in fact, has been identified as a negative attitude because it contributes to making people &#x201C;uncharitable and unsympathetic&#x201D; (<xref ref-type="bibr" rid="ref2">Archer, 2018</xref>).</p>
<p>Consistent with a Nietzschean perspective, moralizing may be considered a morally contestable behavior. In <italic>Beyond Good and Evil</italic> (<xref ref-type="bibr" rid="ref54">Nietzsche, 1886/2006</xref>), Nietzsche claimed that &#x201C;Assuming that &#x2026; the oppressed, the suffering&#x2026; should moralize: what would their moral valuations have in common? Probably a pessimistic suspicion towards the whole human condition would find expression, perhaps a condemnation of man together with his condition.&#x201D; Instead of contributing to prosociality, for Nietzsche, moralization actually generates pernicious negative attitudes towards others.</p>
<p>Interestingly, proneness to shame-behavior (i.e., withdrawal), a trait that is intuitively associated with moral disentanglement or abdication of one&#x2019;s own ethical responsibility, did not correlate with these moralizing attitudes in the first or the third person. A tentative interpretation of this finding is that proneness to withdrawal involves a waiving of the self-directed judgment, also preventing the individual from moral severity towards the other. These considerations may provide reasons to reconsider the classification of emotions such as guilt and shame, and their subtypes, as either simply &#x201C;prosocial&#x201D; or &#x201C;anti-social.&#x201D; Instead, each emotion may fall under both classifications concurrently, to different degrees that vary with contextual features.</p>
</sec>
<sec id="sec5">
<title>Limitations and future considerations</title>
<p>One limitation of this study is that in the GASP scale, like in previous scales, dispositional guilt and shame are assessed by self-reported responses to imaginary experiences. We did not investigate occurrent states of guilt and shame, nor how guilt and shame impact culpability attributions when they are elicited in the moment by real situations. As such, we encourage future research that induces guilt and shame in order to study other instances in which the Moralizing Effect might occur.</p>
<p>We did not include blame, which is conceptually distinct from responsibility, explicitly in our attribution questions (i.e., desert of punishment, volition, and causality). This means that conclusions about blame specifically cannot be drawn from these results. However, we speculate that the Moralizing Effect could be extended to judgments of blame, and suggest including this dimension in future study.</p>
<p>Even if excessive guilt and shame are associated with a series of psychopathologies, we cannot make any further assumptions about the relationship of the Moralizing Effect to psychopathological forms of guilt and shame. Our studies did not have the tools to test for the possible existence of psychopathological traits in our participants, nor did we establish normative criteria for a precise threshold for what counts as excessive guilt or shame.</p>
<p>We focused on the moralizing aspects of guilt and shame-affect, but it is also worthwhile to draw attention to the fact that proneness to withdrawal (shame-affect) did not appear to be a moralizing emotion, which is an interesting issue to explore and clarify in the future.</p>
<p>Some authors in the clinical literature (<xref ref-type="bibr" rid="ref3">Basile et al., 2011</xref>; <xref ref-type="bibr" rid="ref46">Mancini and Gangemi, 2021</xref>) have argued for the existence of two sub-forms of guilt, which are differentiated on the basis of which moral goals are transgressed: namely, &#x201C;altruistic guilt&#x201D; and &#x201C;deontological guilt.&#x201D; Altruistic guilt involves failing to put someone else&#x2019;s good before one&#x2019;s own (e.g., expressed by phrases like &#x201C;How could I have hurt them so badly?&#x201D; &#x201C;How unfair! I am doing so well, while she/he is so unlucky!&#x201D;), and deontological guilt involves the violation of an internalized moral norm (e.g., expressed by phrases like &#x201C;How could I do such a thing?&#x201D; or &#x201C;How could I behave that immorally!&#x201D;). When designing our study, we did not consider incorporating these forms of guilt, which assess other relevant aspects of moral affect and reasoning. It might be interesting to expand our research work in the future so as to understand the connections this distinction might have with the four dimensions of the GASP scale, as well as to clarify if and how the moralizing effect we found would be expressed when considering altruistic and deontological aspects.</p>
<p>We expected childhood religion or current religion to affect guilt and shame, and therefore our Moralizing Effect, but there was no significant impact. This may be because our sample was not sufficiently diverse with respect to religion, and so the sample size for each individual religion was too small for substantive analysis. For future research, we suggest recruiting larger samples from different religious faiths. Similarly, our analyses did not reveal any significant gender-related effects, but such effects may be revealed in future studies given a larger sample size.</p>
<p>In investigating the interaction between subcomponents of guilt and shame with moral attributions, this preliminary study offers a tentative &#x201C;decomposition&#x201D; of the functioning of these cognitive phenomena (<xref ref-type="bibr" rid="ref5">Bechtel, 2002</xref>). From the perspective of integrative neuroscience, we hope that this may guide future neuroimaging research that explores the structures underlying these phenomena. Given the relevance of the notion of responsibility in various domains, the Moralizing Effect may have important ramifications for further areas of study and public policy. Some of these include educational and organizational psychology, regarding child development and professional responsibility, respectively; psychiatry and mental health, concerning the understanding of mental disorders; and ethics, law and politics, with their respective notions of moral, legal, and social responsibility.</p>
</sec>
<sec sec-type="conclusions" id="sec6">
<title>Conclusion</title>
<p>Evidence for the existence of The Moralizing Effect, which is the phenomenon that (both affective and behavioral) guilt and only affective (but not behavioral) shame are associated with the severity of culpability attributions of any type, is an important contribution to the psychological debate about self-directed emotions and responsibility. Contrary to the dominant narrative in psychology, which tends to favor the idea of the morality of guilt over shame, the Moralizing Effect calls into question the relationship between self-directed emotions and morality in a different way, permitting consideration of the moral/immoral character of these emotions from a dimensional perspective. The relationship we have found between moral emotions and responsibility attributions may have important ramifications for various areas of study and public policy.</p>
</sec>
<sec sec-type="data-availability" id="sec7">
<title>Data availability statement</title>
<p>The datasets presented in this study can be found in online repositories: <ext-link xlink:href="https://figshare.com/s/22f87f1eabc918559479" ext-link-type="uri">https://figshare.com/s/22f87f1eabc918559479</ext-link>. The names of the repository/repositories and accession number(s) can be found in the article/<xref ref-type="supplementary-material" rid="SM1">supplementary material</xref>.</p>
</sec>
<sec sec-type="ethics-statement" id="sec8">
<title>Ethics statement</title>
<p>The studies involving humans were approved by Institutional Review Board at the City University of New York, IRB File #2015&#x2013;1,353 issued on 11.30.2015. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.</p>
</sec>
<sec sec-type="author-contributions" id="sec9">
<title>Author contributions</title>
<p>ES conceived and designed the study, and drafted the article (except for the statistical parts). BA designed the vignettes in the study and realized the related tables. ES and JS did the data collection and organization. JS took care of permissions and communications. TW performed the statistical analyses, wrote the results section, including the realization of the relevant figures and tables. All authors together discussed, corrected and revised the design and the entire article, reviewed, discussed and together conceived the interpretation of the results, and approved the final version of the manuscript.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="sec10">
<title>Funding</title>
<p>This research was supported by Jesse Prinz&#x2019;s Experimental Philosophy Lab at the Graduate Center, City University of New York. ES received funds from the U.S.-Italy Fulbright Commission during her stay in the U.S.</p>
</sec>
<ack>
<p>The authors are very thankful to Jesse Prinz and his Experimental Philosophy Lab at the City University of New York, Graduate Center, for sponsoring, supervising and providing the most helpful feedback on this work. ES wishes also to thank S. Matthew Liao, the NYU Center for Bioethics, and the U.S.-Italy Fulbright Research Scholar Program for supporting this research; the Short-Term Mobility Program of the National Research Council of Italy and Cinzia Caporale for encouraging the very early stages of this work; Gilberto Corbellini and Massimo Marraffa for introducing her to the work of Giovanni Jervis, which inspired preliminary reflections for the study.</p>
</ack>
<sec sec-type="COI-statement" id="sec11">
<title>Conflict of interest</title>
<p>The authors declare that this research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec sec-type="supplementary-material" id="sec29">
<title>Supplementary material</title>
<p>The Supplementary material for this article can be found online at: <ext-link xlink:href="https://www.frontiersin.org/articles/10.3389/fnint.2023.1232523/full#supplementary-material" ext-link-type="uri">https://www.frontiersin.org/articles/10.3389/fnint.2023.1232523/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.ZIP" id="SM1" mimetype="application/zip" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="book"><person-group person-group-type="author"><collab id="coll1">American Psychiatric Association</collab></person-group> (<year>2013</year>). <source>Diagnostic and statistical manual of mental disorders (DSM-5)</source>. <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>American Psychiatric Publishing</publisher-name></citation></ref>
<ref id="ref2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Archer</surname> <given-names>A.</given-names></name></person-group> (<year>2018</year>). <article-title>The problem with moralism</article-title>. <source>Ratio</source> <volume>31</volume>, <fpage>342</fpage>&#x2013;<lpage>350</lpage>. doi: <pub-id pub-id-type="doi">10.1111/rati.12168</pub-id></citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Basile</surname> <given-names>B.</given-names></name> <name><surname>Mancini</surname> <given-names>F.</given-names></name> <name><surname>Macaluso</surname> <given-names>E.</given-names></name> <name><surname>Caltagirone</surname> <given-names>C.</given-names></name> <name><surname>Frackowiak</surname> <given-names>R. S.</given-names></name> <name><surname>Bozzali</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Deontological and altruistic guilt: evidence for distinct neurobiological substrates</article-title>. <source>Hum. Brain Mapp.</source> <volume>32</volume>, <fpage>229</fpage>&#x2013;<lpage>239</lpage>. doi: <pub-id pub-id-type="doi">10.1002/hbm.21009</pub-id>, PMID: <pub-id pub-id-type="pmid">20842749</pub-id></citation></ref>
<ref id="ref4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bastin</surname> <given-names>C.</given-names></name> <name><surname>Harrison</surname> <given-names>B. J.</given-names></name> <name><surname>Davey</surname> <given-names>C. G.</given-names></name> <name><surname>Moll</surname> <given-names>J.</given-names></name> <name><surname>Whittle</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Feelings of shame, embarrassment and guilt and their neural correlates: a systematic review</article-title>. <source>Neurosci. Biobehav. Rev.</source> <volume>71</volume>, <fpage>455</fpage>&#x2013;<lpage>471</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.neubiorev.2016.09.019</pub-id>, PMID: <pub-id pub-id-type="pmid">27687818</pub-id></citation></ref>
<ref id="ref5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bechtel</surname> <given-names>W.</given-names></name></person-group> (<year>2002</year>). <article-title>Decomposing the brain: a long term pursuit</article-title>. <source>Brain Mind</source> <volume>3</volume>, <fpage>229</fpage>&#x2013;<lpage>242</lpage>. doi: <pub-id pub-id-type="doi">10.1023/A:1019980423053</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Benedict</surname> <given-names>R.</given-names></name></person-group> (<year>1946</year>). <source>The chrysanthemum and the sword</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Houghton-Mifflin</publisher-name>.</citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carn&#x00EC;</surname> <given-names>S.</given-names></name> <name><surname>Petrocchi</surname> <given-names>N.</given-names></name> <name><surname>Del Miglio</surname> <given-names>C.</given-names></name> <name><surname>Mancini</surname> <given-names>F.</given-names></name> <name><surname>Couyoumdjian</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Intrapsychic and interpersonal guilt: a critical review of the recent literature</article-title>. <source>Cogn. Process.</source> <volume>14</volume>, <fpage>333</fpage>&#x2013;<lpage>346</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10339-013-0570-4</pub-id>, PMID: <pub-id pub-id-type="pmid">23732818</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname> <given-names>J. S.</given-names></name> <name><surname>Ottati</surname> <given-names>V. C.</given-names></name> <name><surname>Price</surname> <given-names>E. D.</given-names></name></person-group> (<year>2013</year>). <article-title>The arousal model of moral condemnation</article-title>. <source>J. Exp. Soc. Psychol.</source> <volume>49</volume>, <fpage>1012</fpage>&#x2013;<lpage>1018</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jesp.2013.06.006</pub-id></citation></ref>
<ref id="ref9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Clark</surname> <given-names>J. A.</given-names></name> <name><surname>Fessler</surname> <given-names>D. M.</given-names></name></person-group> (<year>2015</year>). <article-title>The role of disgust in norms, and of norms in disgust research: why liberals Shouldn&#x2019;t be morally disgusted by moral disgust</article-title>. <source>Topoi</source> <volume>34</volume>, <fpage>483</fpage>&#x2013;<lpage>498</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11245-014-9240-0</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>T. R.</given-names></name> <name><surname>Panter</surname> <given-names>A. T.</given-names></name> <name><surname>Turan</surname> <given-names>N.</given-names></name></person-group> (<year>2012</year>). <article-title>Guilt proneness and moral character</article-title>. <source>Curr. Dir. Psychol. Sci.</source> <volume>21</volume>, <fpage>355</fpage>&#x2013;<lpage>359</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0963721412454874</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>T. R.</given-names></name> <name><surname>Panter</surname> <given-names>A. T.</given-names></name> <name><surname>Turan</surname> <given-names>N.</given-names></name></person-group> (<year>2013</year>). <article-title>Predicting counterproductive work behavior from guilt proneness</article-title>. <source>J. Bus. Ethics</source> <volume>114</volume>, <fpage>45</fpage>&#x2013;<lpage>53</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s10551-012-1326-2</pub-id></citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>T. R.</given-names></name> <name><surname>Wolf</surname> <given-names>S. T.</given-names></name> <name><surname>Panter</surname> <given-names>A. T.</given-names></name> <name><surname>Insko</surname> <given-names>C. A.</given-names></name></person-group> (<year>2011</year>). <article-title>Introducing the GASP scale: a new measure of guilt and shame proneness</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>100</volume>, <fpage>947</fpage>&#x2013;<lpage>966</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0022641</pub-id>, PMID: <pub-id pub-id-type="pmid">21517196</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Coleman</surname> <given-names>M. D.</given-names></name></person-group> (<year>2011</year>). <article-title>Emotion and self-serving bias</article-title>. <source>Curr. Psychol.</source> <volume>30</volume>, <fpage>345</fpage>&#x2013;<lpage>354</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s12144-011-9121-2</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Cova</surname> <given-names>F.</given-names></name></person-group> (<year>2013</year>). <article-title>Two kinds of moral competence: moral agent, moral judge</article-title>. In <person-group person-group-type="editor"><name><surname>Musschenga</surname> <given-names>B.</given-names></name> <name><surname>Harskamp</surname> <given-names>A.</given-names><prefix>van</prefix></name></person-group> (eds.). <source>What makes us moral? On the capacities and conditions for being moral</source>. <publisher-loc>Dordrecht</publisher-loc>: <publisher-name>Springer Netherlands</publisher-name>, <fpage>117</fpage>&#x2013;<lpage>130</lpage></citation></ref>
<ref id="ref15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cushman</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <article-title>Crime and punishment: distinguishing the roles of causal and intentional analyses in moral judgment</article-title>. <source>Cognition</source> <volume>108</volume>, <fpage>353</fpage>&#x2013;<lpage>380</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cognition.2008.03.006</pub-id>, PMID: <pub-id pub-id-type="pmid">18439575</pub-id></citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Hooge</surname> <given-names>I. E.</given-names></name> <name><surname>Nelissen</surname> <given-names>R.</given-names></name> <name><surname>Breugelmans</surname> <given-names>S. M.</given-names></name> <name><surname>Zeelenberg</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>What is moral about guilt? Acting &#x201C;prosocially&#x201D; at the disadvantage of others</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>100</volume>, <fpage>462</fpage>&#x2013;<lpage>473</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0021459</pub-id>, PMID: <pub-id pub-id-type="pmid">21244173</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Deonna</surname> <given-names>J.A.</given-names></name> <name><surname>Rodogno</surname> <given-names>R.</given-names></name> <name><surname>Teroni</surname> <given-names>F.</given-names></name></person-group> (<year>2012</year>). <source>In defense of shame: Two faces of an emotion</source>. <publisher-loc>Oxford, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="ref18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Du</surname> <given-names>X.</given-names></name> <name><surname>Liu</surname> <given-names>N.</given-names></name> <name><surname>Jia</surname> <given-names>Q.</given-names></name> <name><surname>Wu</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>Guilt proneness moderates the after-effects of ego depletion on hypocrisy</article-title>. <source>Personal. Individ. Differ.</source> <volume>151</volume>:<fpage>109516</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.paid.2019.109516</pub-id></citation></ref>
<ref id="ref19"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Elgat</surname> <given-names>G.</given-names></name></person-group> (<year>2017</year>). <source>Nietzsche&#x2019;s psychology of Ressentiment, revenge and justice in on the genealogy of morals</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Routledge</publisher-name></citation></ref>
<ref id="ref20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ellemers</surname> <given-names>N.</given-names></name> <name><surname>van der Toorn</surname> <given-names>J.</given-names></name> <name><surname>Paunov</surname> <given-names>Y.</given-names></name> <name><surname>van Leeuwen</surname> <given-names>T.</given-names></name></person-group> (<year>2019</year>). <article-title>The psychology of morality: a review and analysis of empirical studies published from 1940 through 2017</article-title>. <source>Personal. Soc. Psychol. Rev.</source> <volume>23</volume>, <fpage>332</fpage>&#x2013;<lpage>366</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1088868318811759</pub-id>, PMID: <pub-id pub-id-type="pmid">30658545</pub-id></citation></ref>
<ref id="ref21"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Fischer</surname> <given-names>J.M.</given-names></name> <name><surname>Ravizza</surname> <given-names>M.</given-names></name></person-group> (<year>1998</year>) <source>Responsibility and control: a theory of moral responsibility</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name></citation></ref>
<ref id="ref22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fontenelle</surname> <given-names>L. F.</given-names></name> <name><surname>de Oliveira-Sousa</surname> <given-names>R.</given-names></name> <name><surname>Moll</surname> <given-names>J.</given-names></name></person-group> (<year>2015</year>). <article-title>The rise of moral emotions in neuropsychiatry</article-title>. <source>Dialogues Clin. Neurosci.</source> <volume>17</volume>, <fpage>411</fpage>&#x2013;<lpage>420</lpage>. doi: <pub-id pub-id-type="doi">10.31887/DCNS.2015.17.4/lfontenelle</pub-id>, PMID: <pub-id pub-id-type="pmid">26869842</pub-id></citation></ref>
<ref id="ref23"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Freud</surname> <given-names>S.</given-names></name></person-group> (<year>1923</year>). <source>The Ego and the id</source>. <publisher-name>New York, London</publisher-name>: <publisher-loc>W.W. Norton &#x0026; Company Ltd</publisher-loc>.</citation></ref>
<ref id="ref24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gilbert</surname> <given-names>P.</given-names></name> <name><surname>Basran</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>The evolution of prosocial and antisocial competitive behavior and the emergence of prosocial and antisocial leadership styles</article-title>. <source>Front. Psychol.</source> <volume>10</volume>:<fpage>610</fpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2019.00610</pub-id>, PMID: <pub-id pub-id-type="pmid">31293464</pub-id></citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Giner-Sorolla</surname> <given-names>R.</given-names></name> <name><surname>Espinosa</surname> <given-names>P.</given-names></name></person-group> (<year>2011</year>). <article-title>Social cuing of guilt by anger and of shame by disgust</article-title>. <source>Psychol. Sci.</source> <volume>22</volume>, <fpage>49</fpage>&#x2013;<lpage>53</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0956797610392925</pub-id>, PMID: <pub-id pub-id-type="pmid">21156860</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Giner-Sorolla</surname> <given-names>R.</given-names></name> <name><surname>Piazza</surname> <given-names>J.</given-names></name> <name><surname>Espinosa</surname> <given-names>P.</given-names></name></person-group> (<year>2011</year>). <article-title>What do the TOSCA guilt and shame scales really measure: affect or action?</article-title> <source>Personal. Individ. Differ.</source> <volume>51</volume>, <fpage>445</fpage>&#x2013;<lpage>450</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.paid.2011.04.010</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Greer</surname> <given-names>S.</given-names></name></person-group> (<year>2002</year>). <article-title>Freud&#x2019;s &#x2018;bad conscience&#x2019;: the case of Nietzsche&#x2019;s genealogy</article-title>. <source>J. Hist. Behav. Sci.</source> <volume>38</volume>, <fpage>303</fpage>&#x2013;<lpage>315</lpage>. doi: <pub-id pub-id-type="doi">10.1002/jhbs.10064</pub-id>, PMID: <pub-id pub-id-type="pmid">12115789</pub-id></citation></ref>
<ref id="ref28"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Haidt</surname> <given-names>J.</given-names></name></person-group> (<year>2003</year>). &#x201C;<article-title>The moral emotions</article-title>&#x201D; in <source>Handbook of affective sciences</source>. eds. <person-group person-group-type="editor"><name><surname>Davidson</surname> <given-names>R. J.</given-names></name> <name><surname>Scherer</surname> <given-names>K. R.</given-names></name> <name><surname>Goldsmith</surname> <given-names>H. H.</given-names></name></person-group> (<publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>), <fpage>852</fpage>&#x2013;<lpage>870</lpage>.</citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hare</surname> <given-names>R. D.</given-names></name></person-group> (<year>1998</year>). <article-title>The Hare PCL-R: some issues concerning its use and misuse</article-title>. <source>Leg. Criminol. Psychol.</source> <volume>3</volume>, <fpage>101</fpage>&#x2013;<lpage>122</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.2044-8333</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harris</surname> <given-names>J.</given-names></name></person-group> (<year>2016a</year>). <article-title>Moral blindness &#x2013; the gift of the god machine</article-title>. <source>Neuroethics</source> <volume>9</volume>, <fpage>269</fpage>&#x2013;<lpage>273</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s12152-016-9272-9</pub-id>, PMID: <pub-id pub-id-type="pmid">27917247</pub-id></citation></ref>
<ref id="ref31"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Harris</surname> <given-names>J.</given-names></name></person-group> (<year>2016b</year>). <source>How to be good. The possibility of moral enhancement</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name></citation></ref>
<ref id="ref32"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hart</surname> <given-names>H. L. A.</given-names></name></person-group> (<year>1968</year>). <source>Punishment and responsibility: Essays in the philosophy of law</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="ref33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hitchcock</surname> <given-names>C.</given-names></name> <name><surname>Knobe</surname> <given-names>J.</given-names></name></person-group> (<year>2009</year>). <article-title>Cause and norms</article-title>. <source>J. Philos.</source> <volume>106</volume>, <fpage>587</fpage>&#x2013;<lpage>612</lpage>. doi: <pub-id pub-id-type="doi">10.5840/jphil20091061128</pub-id></citation></ref>
<ref id="ref34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horberg</surname> <given-names>E. J.</given-names></name> <name><surname>Oveis</surname> <given-names>C.</given-names></name> <name><surname>Keltner</surname> <given-names>D.</given-names></name></person-group> (<year>2011</year>). <article-title>Emotions as moral amplifiers: an appraisal tendency to the influence of distinct emotions upon moral judgment</article-title>. <source>Emot. Rev.</source> <volume>3</volume>, <fpage>237</fpage>&#x2013;<lpage>244</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1754073911402384</pub-id></citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horberg</surname> <given-names>E. J.</given-names></name> <name><surname>Oveis</surname> <given-names>C.</given-names></name> <name><surname>Keltner</surname> <given-names>D.</given-names></name> <name><surname>Cohen</surname> <given-names>A. B.</given-names></name></person-group> (<year>2009</year>). <article-title>Disgust and the moralization of purity</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>97</volume>, <fpage>963</fpage>&#x2013;<lpage>976</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0017423</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hutchinson</surname> <given-names>G. T.</given-names></name> <name><surname>Patock-Peckham</surname> <given-names>J. A.</given-names></name> <name><surname>Cheong</surname> <given-names>J. W.</given-names></name> <name><surname>Nagoshi</surname> <given-names>C. T.</given-names></name></person-group> (<year>1998</year>). <article-title>Personality predictors of religious orientation among Protestant, Catholic, and non-religious college students</article-title>. <source>Personal. Individ. Differ.</source> <volume>24</volume>, <fpage>145</fpage>&#x2013;<lpage>151</lpage>. doi: <pub-id pub-id-type="doi">10.1016/S0191-8869(97)00164-5</pub-id></citation></ref>
<ref id="ref37"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Jervis</surname> <given-names>G.</given-names></name></person-group> (<year>1998</year>). Il Concetto di Colpa. Colpa e responsabilit&#x00E0; individuale, Interview at &#x00AB;Il Grillo&#x00BB;, Rai Educational. Available at: <ext-link xlink:href="https://www.raicultura.it/filosofia/articoli/2019/01/Giovanni-Jervis-il-concetto-di-colpa-052ceba8-6d17-4105-82de-500dda8612d3.html" ext-link-type="uri">https://www.raicultura.it/filosofia/articoli/2019/01/Giovanni-Jervis-il-concetto-di-colpa-052ceba8-6d17-4105-82de-500dda8612d3.html</ext-link></citation></ref>
<ref id="ref38"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>E. E.</given-names></name> <name><surname>Nisbett</surname> <given-names>R. E.</given-names></name></person-group> (<year>1971</year>). <source>The actor and the observer: Divergent perceptions of the causes of behavior</source>. <publisher-loc>Morristown, NJ</publisher-loc>: <publisher-name>General Learning Press</publisher-name>.</citation></ref>
<ref id="ref39"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Kelly</surname> <given-names>D. R.</given-names></name></person-group> (ed.) (<year>2011</year>). &#x201C;<article-title>Disgust and normative ethics: the irrelevance of repugnance and dangers of moralization</article-title>&#x201D; in <source>Yuck! The nature and moral significance of disgust</source> (<publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>MIT Press</publisher-name>), <fpage>137</fpage>&#x2013;<lpage>152</lpage>.</citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Keltner</surname> <given-names>D.</given-names></name> <name><surname>Buswell</surname> <given-names>B. N.</given-names></name></person-group> (<year>1996</year>). <article-title>Evidence for the distinctness of embarrassment, shame, and guilt: a study of recalled antecedents and facial expressions of emotion</article-title>. <source>Cognit. Emot.</source> <volume>10</volume>, <fpage>155</fpage>&#x2013;<lpage>172</lpage>. doi: <pub-id pub-id-type="doi">10.1080/026999396380312</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kouchaki</surname> <given-names>M.</given-names></name> <name><surname>Oveis</surname> <given-names>C.</given-names></name> <name><surname>Gino</surname> <given-names>F.</given-names></name></person-group> (<year>2014</year>). <article-title>Guilt enhances the sense of control and drives risky judgments</article-title>. <source>J. Exp. Psychol.</source> <volume>143</volume>, <fpage>2103</fpage>&#x2013;<lpage>2110</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0037932</pub-id>, PMID: <pub-id pub-id-type="pmid">25222266</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levi</surname> <given-names>N.</given-names></name> <name><surname>Bayne</surname> <given-names>T.</given-names></name></person-group> (<year>2004</year>). <article-title>Doing without deliberation: Automatism, automaticity, and moral accountability</article-title>. <source>Int. J. Geriatr. Psychiatry</source> <volume>16</volume>, <fpage>209</fpage>&#x2013;<lpage>215</lpage>. doi: <pub-id pub-id-type="doi">10.1080/09540260400003909</pub-id>, PMID: <pub-id pub-id-type="pmid">15511750</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levine</surname> <given-names>E.</given-names></name> <name><surname>Bitterly</surname> <given-names>T. B.</given-names></name> <name><surname>Cohen</surname> <given-names>T. R.</given-names></name> <name><surname>Schweitzer</surname> <given-names>M. E.</given-names></name></person-group> (<year>2018</year>). <article-title>Who is trustworthy? Predicting trustworthy intentions and behavior</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>115</volume>, <fpage>468</fpage>&#x2013;<lpage>494</lpage>. doi: <pub-id pub-id-type="doi">10.1037/pspi0000136</pub-id>, PMID: <pub-id pub-id-type="pmid">29999336</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Lewis</surname> <given-names>H. B.</given-names></name></person-group> (<year>1971</year>). <source>Shame and guilt in neurosis</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>International Universities Press</publisher-name>.</citation></ref>
<ref id="ref45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>F.</given-names></name> <name><surname>Gangemi</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Deontological guilt and obsessive compulsive disorder</article-title>. <source>J. Behav. Therapy Experiment. Psychiatry</source> <volume>49</volume>, <fpage>157</fpage>&#x2013;<lpage>163</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jbtep.2015.05.003</pub-id></citation></ref>
<ref id="ref46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>F.</given-names></name> <name><surname>Gangemi</surname> <given-names>A.</given-names></name></person-group> (<year>2021</year>). <article-title>Deontological and altruistic guilt feelings: a dualistic thesis</article-title>. <source>Front. Psychol.</source> <volume>12</volume>, <fpage>1</fpage>&#x2013;<lpage>16</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2021.651937</pub-id>, PMID: <pub-id pub-id-type="pmid">34239480</pub-id></citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>A.</given-names></name> <name><surname>Mancini</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>Do not play god: contrasting effects of deontological guilt and pride on decision-making</article-title>. <source>Front. Psychol.</source> <volume>6</volume>, <fpage>1</fpage>&#x2013;<lpage>12</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fpsyg.2015.01251</pub-id>, PMID: <pub-id pub-id-type="pmid">26379584</pub-id></citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mason</surname> <given-names>W.</given-names></name> <name><surname>Suri</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>Conducting behavioral research on Amazon's mechanical Turk</article-title>. <source>Behav. Res. Methods</source> <volume>44</volume>, <fpage>1</fpage>&#x2013;<lpage>23</lpage>. doi: <pub-id pub-id-type="doi">10.3758/s13428-011-0124-6</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>McLatchie</surname> <given-names>N.</given-names></name> <name><surname>Derbyshire</surname> <given-names>S.</given-names></name> <name><surname>Giner-Sorolla</surname> <given-names>R.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x201C;Imagined guilt&#x201D; versus &#x201C;recollected guilt&#x201D;: implications for fMRI</article-title>. <source>Soc. Cogn. Affect. Neurosci.</source> <volume>11</volume>, <fpage>703</fpage>&#x2013;<lpage>711</lpage>. doi: <pub-id pub-id-type="doi">10.1093/scan/nsw001</pub-id>, PMID: <pub-id pub-id-type="pmid">26746179</pub-id></citation></ref>
<ref id="ref50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Michl</surname> <given-names>P.</given-names></name> <name><surname>Meindl</surname> <given-names>T.</given-names></name> <name><surname>Meister</surname> <given-names>F.</given-names></name> <name><surname>Born</surname> <given-names>C.</given-names></name> <name><surname>Engel</surname> <given-names>R. R.</given-names></name> <name><surname>Reiser</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Neurobiological underpinnings of shame and guilt: a pilot fMRI study</article-title>. <source>Soc. Cogn. Affect. Neurosci.</source> <volume>9</volume>, <fpage>150</fpage>&#x2013;<lpage>157</lpage>. doi: <pub-id pub-id-type="doi">10.1093/scan/nss114</pub-id>, PMID: <pub-id pub-id-type="pmid">23051901</pub-id></citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miller</surname> <given-names>D. T.</given-names></name> <name><surname>Ross</surname> <given-names>M.</given-names></name></person-group> (<year>1975</year>). <article-title>Self-serving biases in the attribution of causality: fact or fiction?</article-title> <source>Psychol. Bull.</source> <volume>82</volume>, <fpage>213</fpage>&#x2013;<lpage>225</lpage>. doi: <pub-id pub-id-type="doi">10.1037/h0076486</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moore</surname> <given-names>M. S.</given-names></name></person-group> (<year>1996</year>). <article-title>Prima facie moral culpability</article-title>. <source>Boston University Law Rev.</source> <volume>76</volume>, <fpage>319</fpage>&#x2013;<lpage>334</lpage>.</citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nichols</surname> <given-names>S.</given-names></name> <name><surname>Knobe</surname> <given-names>J.</given-names></name></person-group> (<year>2007</year>). <article-title>Moral responsibility and determinism: the cognitive science of folk intuitions</article-title>. <source>Nous</source> <volume>41</volume>, <fpage>663</fpage>&#x2013;<lpage>685</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1468-0068.2007.00666.x</pub-id></citation></ref>
<ref id="ref54"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Nietzsche</surname> <given-names>F.</given-names></name></person-group> (<year>1886/2006</year>). &#x201C;<article-title>Beyond good and evil</article-title>&#x201D; in <source>supplementary material, Friedrich Nietzsche: On the genealogy of morality</source>. eds. <person-group person-group-type="editor"><name><surname>Ansell-Pearson</surname> <given-names>K.</given-names></name> <name><surname>Diethe</surname> <given-names>C.</given-names></name></person-group>. <edition>2nd</edition> ed (<publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>)</citation></ref>
<ref id="ref55"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Nietzsche</surname> <given-names>F.</given-names></name></person-group> (<year>1887/2006</year>). <source>On the genealogy of morality</source> (<edition>2nd ed.</edition>). <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name></citation></ref>
<ref id="ref56"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Nussbaum</surname> <given-names>M. C.</given-names></name></person-group> (<year>2009</year>). <source>Hiding from humanity: disgust, shame, and the law</source>. <publisher-loc>Princeton</publisher-loc>: <publisher-name>Princeton University Press</publisher-name></citation></ref>
<ref id="ref57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paulhus</surname> <given-names>D. L.</given-names></name> <name><surname>Robins</surname> <given-names>R. W.</given-names></name> <name><surname>Trzesniewski</surname> <given-names>K. H.</given-names></name> <name><surname>Tracy</surname> <given-names>J. L.</given-names></name></person-group> (<year>2004</year>). <article-title>Two replicable suppressor situations in personality research</article-title>. <source>Multivar. Behav. Res.</source> <volume>39</volume>, <fpage>303</fpage>&#x2013;<lpage>328</lpage>. doi: <pub-id pub-id-type="doi">10.1207/s15327906mbr3902_7</pub-id>, PMID: <pub-id pub-id-type="pmid">26804578</pub-id></citation></ref>
<ref id="ref58"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Piers</surname> <given-names>G.</given-names></name> <name><surname>Singer</surname> <given-names>A.</given-names></name></person-group> (<year>1953</year>). <source>Shame and guilt</source>. <publisher-loc>Springfield, IL</publisher-loc>: <publisher-name>Thomas</publisher-name>.</citation></ref>
<ref id="ref59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pizzarro</surname> <given-names>D.</given-names></name> <name><surname>Inbar</surname> <given-names>Y.</given-names></name> <name><surname>Helion</surname> <given-names>C.</given-names></name></person-group> (<year>2011</year>). <article-title>On disgust and moral judgment</article-title>. <source>Emot. Rev.</source> <volume>3</volume>, <fpage>267</fpage>&#x2013;<lpage>268</lpage>. doi: <pub-id pub-id-type="doi">10.1177/1754073911402394</pub-id></citation></ref>
<ref id="ref60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Polman</surname> <given-names>E.</given-names></name> <name><surname>Ruttan</surname> <given-names>R. L.</given-names></name></person-group> (<year>2011</year>). <article-title>Effects of anger, guilt, and envy on moral hypocrisy</article-title>. <source>Personal. Soc. Psychol. Bull.</source> <volume>38</volume>, <fpage>129</fpage>&#x2013;<lpage>139</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0146167211422365</pub-id>, PMID: <pub-id pub-id-type="pmid">21918064</pub-id></citation></ref>
<ref id="ref61"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Prinz</surname> <given-names>J. J.</given-names></name></person-group> (<year>2011</year>). &#x201C;<article-title>Sentimentalism and self-directed emotions</article-title>&#x201D; in <source>Self-evaluation: Affective and social grounds of intentionality</source>. eds. <person-group person-group-type="editor"><name><surname>Konzelmann Ziv</surname> <given-names>A.</given-names></name> <name><surname>Lehrer</surname> <given-names>K.</given-names></name> <name><surname>Schmid</surname> <given-names>B.</given-names></name></person-group> (<publisher-loc>Dordrecht</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>135</fpage>&#x2013;<lpage>153</lpage>.</citation></ref>
<ref id="ref62"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Riek</surname> <given-names>B. M.</given-names></name> <name><surname>Root Luna</surname> <given-names>L. M.</given-names></name> <name><surname>Schnabelrauch</surname> <given-names>C. A.</given-names></name></person-group> (<year>2014</year>). <article-title>Transgressors&#x2019; guilt and shame: a longitudinal examination of forgiveness-seeking</article-title>. <source>J. Soc. Pers. Relat.</source> <volume>31</volume>, <fpage>751</fpage>&#x2013;<lpage>772</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0265407513503595</pub-id></citation></ref>
<ref id="ref63"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Ross</surname> <given-names>L.</given-names></name></person-group> (<year>1977</year>). &#x201C;<article-title>The intuitive psychologist and his shortcomings: distortions in the attribution process</article-title>&#x201D; in <source>Advances in experimental social psychology</source>. ed. <person-group person-group-type="editor"><name><surname>Berkowitz</surname> <given-names>L.</given-names></name></person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>Academic Press</publisher-name>), <fpage>174</fpage>&#x2013;<lpage>221</lpage>.</citation></ref>
<ref id="ref64"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rozin</surname> <given-names>P.</given-names></name></person-group> (<year>1999</year>). <article-title>The process of moralization</article-title>. <source>Psychol. Sci.</source> <volume>10</volume>, <fpage>218</fpage>&#x2013;<lpage>221</lpage>. doi: <pub-id pub-id-type="doi">10.1111/1467-9280.00139</pub-id></citation></ref>
<ref id="ref65"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Rozin</surname> <given-names>P.</given-names></name> <name><surname>Haidt</surname> <given-names>J.</given-names></name> <name><surname>McCauley</surname> <given-names>C. R.</given-names></name></person-group> (<year>1999</year>). &#x201C;<article-title>Disgust: the body and soul emotion</article-title>&#x201D; in <source>Handbook of cognition and emotion</source>. eds. <person-group person-group-type="editor"><name><surname>Dalgleish</surname> <given-names>T.</given-names></name> <name><surname>Power</surname> <given-names>M. J.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Wiley</publisher-name>), <fpage>429</fpage>&#x2013;<lpage>445</lpage>.</citation></ref>
<ref id="ref66"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schaumberg</surname> <given-names>R. L.</given-names></name> <name><surname>Flynn</surname> <given-names>F. J.</given-names></name></person-group> (<year>2012</year>). <article-title>Uneasy lies the head that wears the crown: the link between guilt-proneness and leadership</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>103</volume>, <fpage>327</fpage>&#x2013;<lpage>342</lpage>. doi: <pub-id pub-id-type="doi">10.1037/a0028127</pub-id>, PMID: <pub-id pub-id-type="pmid">22545748</pub-id></citation></ref>
<ref id="ref67"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schnall</surname> <given-names>S.</given-names></name> <name><surname>Haidt</surname> <given-names>J.</given-names></name> <name><surname>Clore</surname> <given-names>G. L.</given-names></name> <name><surname>Jordan</surname> <given-names>A. H.</given-names></name></person-group> (<year>2008</year>). <article-title>Disgust as embodied moral judgment</article-title>. <source>Personal. Soc. Psychol. Bull.</source> <volume>34</volume>, <fpage>1096</fpage>&#x2013;<lpage>1109</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0146167208317771</pub-id>, PMID: <pub-id pub-id-type="pmid">18505801</pub-id></citation></ref>
<ref id="ref68"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seidel</surname> <given-names>A.</given-names></name> <name><surname>Prinz</surname> <given-names>J. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Sound morality: irritating and icky noises amplify judgments in divergent moral domains</article-title>. <source>Cognition</source> <volume>127</volume>, <fpage>1</fpage>&#x2013;<lpage>5</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.cognition.2012.11.004</pub-id>, PMID: <pub-id pub-id-type="pmid">23318349</pub-id></citation></ref>
<ref id="ref69"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Strickland</surname> <given-names>J. C.</given-names></name> <name><surname>Stoops</surname> <given-names>W. W.</given-names></name></person-group> (<year>2019</year>). <article-title>The use of crowdsourcing in addiction science research: Amazon mechanical Turk</article-title>. <source>Exp. Clin. Psychopharmacol.</source> <volume>27</volume>, <fpage>1</fpage>&#x2013;<lpage>18</lpage>. doi: <pub-id pub-id-type="doi">10.1037/pha0000235</pub-id>, PMID: <pub-id pub-id-type="pmid">30489114</pub-id></citation></ref>
<ref id="ref70"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name></person-group> (<year>1990</year>). <article-title>Assessing individual differences in proneness to shame and guilt: development of the self-conscious affect and attribution inventory</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>59</volume>, <fpage>102</fpage>&#x2013;<lpage>111</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-3514.59.1.102</pub-id>, PMID: <pub-id pub-id-type="pmid">2213483</pub-id></citation></ref>
<ref id="ref71"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name></person-group> (<year>1994</year>). &#x201C;<article-title>The mixed legacy of the super-ego: adaptive and maladaptive aspects of shame and guilt</article-title>&#x201D; in <source>Empirical perspectives on object relations theory</source>. eds. <person-group person-group-type="editor"><name><surname>Mashng</surname> <given-names>J. M.</given-names></name> <name><surname>Bornstein</surname> <given-names>R. E.</given-names></name></person-group> (<publisher-loc>Washington, DC</publisher-loc>: <publisher-name>American Psychological Association</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>28</lpage>.</citation></ref>
<ref id="ref72"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Dearing</surname> <given-names>R. L.</given-names></name></person-group>, (<year>2002</year>). <source>Shame and guilt</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Guilford Press</publisher-name>.</citation></ref>
<ref id="ref73"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Dearing</surname> <given-names>R. L.</given-names></name> <name><surname>Wagner</surname> <given-names>P. E.</given-names></name> <name><surname>Gramzow</surname> <given-names>R. H.</given-names></name></person-group> (<year>2000</year>). <source>The test of self-conscious affect&#x2013;3 (TOSCA-3)</source>. <publisher-loc>Fairfax, VA</publisher-loc>: <publisher-name>George Mason University</publisher-name>.</citation></ref>
<ref id="ref74"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Miller</surname> <given-names>R. S.</given-names></name> <name><surname>Fhcker</surname> <given-names>L.</given-names></name> <name><surname>Barlow</surname> <given-names>D. H.</given-names></name></person-group> (<year>1996</year>). <article-title>Are shame, guilt and embarrassment distinct emotions?</article-title> <source>J. Pers. Soc. Psychol.</source> <volume>70</volume>, <fpage>1256</fpage>&#x2013;<lpage>1269</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0022-3514.70.6.1256</pub-id>, PMID: <pub-id pub-id-type="pmid">8667166</pub-id></citation></ref>
<ref id="ref75"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Stuewig</surname> <given-names>J.</given-names></name> <name><surname>Hafez</surname> <given-names>L.</given-names></name></person-group> (<year>2011</year>). <article-title>Shame, guilt and remorse: implications for offender populations</article-title>. <source>J. Forensic Psychiatry Psychol.</source> <volume>22</volume>, <fpage>706</fpage>&#x2013;<lpage>723</lpage>. doi: <pub-id pub-id-type="doi">10.1080/14789949.2011.617541</pub-id>, PMID: <pub-id pub-id-type="pmid">22523475</pub-id></citation></ref>
<ref id="ref76"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Stuewig</surname> <given-names>J.</given-names></name> <name><surname>Martinez</surname> <given-names>A. G.</given-names></name></person-group> (<year>2014</year>). <article-title>Two faces of shame: the roles of shame and guilt in predicting recidivism</article-title>. <source>Psychol. Sci.</source> <volume>25</volume>, <fpage>799</fpage>&#x2013;<lpage>805</lpage>. doi: <pub-id pub-id-type="doi">10.1177/0956797613508790</pub-id>, PMID: <pub-id pub-id-type="pmid">24395738</pub-id></citation></ref>
<ref id="ref77"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Stuewig</surname> <given-names>J.</given-names></name> <name><surname>Mashek</surname> <given-names>D. J.</given-names></name></person-group> (<year>2007</year>). <article-title>Moral emotions and moral behavior</article-title>. <source>Annu. Rev. Psychol.</source> <volume>58</volume>, <fpage>345</fpage>&#x2013;<lpage>372</lpage>. doi: <pub-id pub-id-type="doi">10.1146/annurev.psych.56.091103.070145</pub-id>, PMID: <pub-id pub-id-type="pmid">16953797</pub-id></citation></ref>
<ref id="ref78"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Tracy</surname> <given-names>J. L.</given-names></name></person-group> (<year>2013</year>). &#x201C;<article-title>Self-conscious emotions</article-title>&#x201D; in <source>Handbook of self and identity</source>. eds. <person-group person-group-type="editor"><name><surname>Leary</surname> <given-names>M. R.</given-names></name> <name><surname>Tangney</surname> <given-names>J. P.</given-names></name></person-group>. <edition>2nd</edition> ed (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name>)</citation></ref>
<ref id="ref79"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Wagner</surname> <given-names>P.</given-names></name> <name><surname>Fletcher</surname> <given-names>C.</given-names></name> <name><surname>Gramzow</surname> <given-names>R.</given-names></name></person-group> (<year>1992a</year>). <article-title>Shamed into anger? The relation of shame and guilt to anger and self-reported aggression</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>62</volume>, <fpage>669</fpage>&#x2013;<lpage>675</lpage>. doi: <pub-id pub-id-type="doi">10.1037//0022-3514.62.4.669</pub-id>, PMID: <pub-id pub-id-type="pmid">1583590</pub-id></citation></ref>
<ref id="ref80"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P.</given-names></name> <name><surname>Wagner</surname> <given-names>P.</given-names></name> <name><surname>Gramzow</surname> <given-names>R.</given-names></name></person-group> (<year>1992b</year>). <article-title>Proneness to shame, proneness to guilt, and psychopathology</article-title>. <source>J. Abnorm. Psychol.</source> <volume>101</volume>, <fpage>469</fpage>&#x2013;<lpage>478</lpage>. doi: <pub-id pub-id-type="doi">10.1037/0021-843X.101.3.469</pub-id></citation></ref>
<ref id="ref81"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Terrizzi</surname> <given-names>J. A.</given-names></name> <name><surname>Shook</surname> <given-names>N. J.</given-names></name></person-group> (<year>2020</year>). <article-title>On the origin of shame: does shame emerge from an evolved disease-avoidance architecture?</article-title> <source>Front. Behav. Neurosci.</source> <volume>14</volume>, <fpage>1</fpage>&#x2013;<lpage>19</lpage>. doi: <pub-id pub-id-type="doi">10.3389/fnbeh.2020.00019</pub-id>, PMID: <pub-id pub-id-type="pmid">32132907</pub-id></citation></ref>
<ref id="ref82"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vaisey</surname> <given-names>S.</given-names></name> <name><surname>Smith</surname> <given-names>C.</given-names></name></person-group> (<year>2008</year>). <article-title>Catholic guilt among U.S. teenagers: a research note</article-title>. <source>Rev. Relig. Res.</source> <volume>49</volume>, <fpage>415</fpage>&#x2013;<lpage>426</lpage>.</citation></ref>
<ref id="ref83"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walinga</surname> <given-names>P.</given-names></name> <name><surname>Corveleyn</surname> <given-names>J.</given-names></name> <name><surname>van Saane</surname> <given-names>J.</given-names></name></person-group> (<year>2005</year>). <article-title>Guilt and religion: the influence of orthodox Protestant and orthodox Catholic conceptions of guilt on guilt-experience</article-title>. <source>Archive Psychol Religion</source> <volume>27</volume>, <fpage>113</fpage>&#x2013;<lpage>135</lpage>. doi: <pub-id pub-id-type="doi">10.1163/008467206774355330</pub-id></citation></ref>
<ref id="ref84"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wheatley</surname> <given-names>T.</given-names></name> <name><surname>Haidt</surname> <given-names>J.</given-names></name></person-group> (<year>2005</year>). <article-title>Hypnotic disgust makes moral judgments more severe</article-title>. <source>Psychol. Sci.</source> <volume>16</volume>, <fpage>780</fpage>&#x2013;<lpage>784</lpage>. doi: <pub-id pub-id-type="doi">10.1111/j.1467-9280.2005.01614.x</pub-id>, PMID: <pub-id pub-id-type="pmid">16181440</pub-id></citation></ref>
<ref id="ref85"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Yannoulidis</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <source>Mental state Defences in criminal law</source>. <publisher-loc>Farnham</publisher-loc>: <publisher-name>Ashgate</publisher-name>.</citation></ref>
</ref-list>
</back>
</article>