<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="discussion">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2023.1215737</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Opinion</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Taking methodological pluralism seriously: considerations based on the work of Norbert Groeben</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Hutmacher</surname> <given-names>Fabian</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/611033/overview"/>
</contrib>
</contrib-group>
<aff><institution>Human-Computer-Media Institute, Julius-Maximilians-University W&#x000FC;rzburg</institution>, <addr-line>W&#x000FC;rzburg</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Hamidreza Namazi, Monash University Malaysia, Malaysia</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Jack Martin, Simon Fraser University, Canada</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Fabian Hutmacher <email>fabian.hutmacher&#x00040;uni-wuerzburg.de</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>25</day>
<month>09</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>14</volume>
<elocation-id>1215737</elocation-id>
<history>
<date date-type="received">
<day>02</day>
<month>05</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>07</day>
<month>09</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Hutmacher.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Hutmacher</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license></permissions>
<kwd-group>
<kwd>methodological pluralism</kwd>
<kwd>quantitative methods</kwd>
<kwd>qualitative methods</kwd>
<kwd>replication crisis</kwd>
<kwd>Norbert Groeben</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="31"/>
<page-count count="4"/>
<word-count count="3081"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Theoretical and Philosophical Psychology</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1. Introduction</title>
<p>Rumor has it that psychology is in deep crisis. Based on the observation that many psychological studies cannot be replicated (Open Science Collaboration, <xref ref-type="bibr" rid="B20">2015</xref>; Marsman et al., <xref ref-type="bibr" rid="B16">2017</xref>), this crisis has often been termed a <italic>replication crisis</italic> (Simmons et al., <xref ref-type="bibr" rid="B24">2011</xref>; Pashler and Wagenmakers, <xref ref-type="bibr" rid="B21">2012</xref>). Most recommendations for addressing this crisis and for ensuring the quality of psychological science have either focused on improving existing statistical and quantitative-experimental methods or emphasized the importance of embracing open science practices (e.g., through preregistrations as well as sharing data and materials; Nosek et al., <xref ref-type="bibr" rid="B19">2015</xref>). At the same time, however, there are also researchers suggesting that psychology should additionally be more open to embracing cultural diversity (Henrich et al., <xref ref-type="bibr" rid="B7">2010</xref>; Apicella et al., <xref ref-type="bibr" rid="B1">2020</xref>), cross-temporal variation (Hutmacher and Mayrhofer, <xref ref-type="bibr" rid="B9">2021</xref>, <xref ref-type="bibr" rid="B10">2023</xref>; Muthukrishna et al., <xref ref-type="bibr" rid="B18">2021</xref>; Hutmacher, <xref ref-type="bibr" rid="B8">2022</xref>) as well as the insights that the psychological humanities have to offer (Teo, <xref ref-type="bibr" rid="B25">2017</xref>; Malich and Rehmann-Sutter, <xref ref-type="bibr" rid="B15">2022</xref>). Arguably, such a diversified understanding of the subject matter of psychology would also be mirrored in the application of a diversified set of research methods that could account for the complexity and multilayeredness of the phenomena under investigation (e.g., Mayrhofer and Hutmacher, <xref ref-type="bibr" rid="B17">2020</xref>; Hutmacher and Mayrhofer, <xref ref-type="bibr" rid="B9">2021</xref>).</p>
<p>While moving (Western) academic psychology toward more methodological pluralism&#x02014;in the sense that a greater range of different methods is accepted as legitimate and used for studying psychological phenomena&#x02014;may sound desirable, it is far from clear what embracing methodological pluralism would mean for everyday research practices. On the one hand, there are researchers arguing in favor of an &#x0201C;anything goes&#x0201D; attitude that allows researchers to use the methods they prefer and asks them to develop tolerance for other researchers subscribing to other methodologies (cf. Zitzmann and Loreth, <xref ref-type="bibr" rid="B31">2021</xref>). On the other hand, it has been pointed out that methodological pluralism should not be equated with such an &#x0201C;anything goes&#x0201D; attitude but has to be based on a thorough analysis of the strengths and weaknesses of the different approaches and paradigms (Yanchar and Slife, <xref ref-type="bibr" rid="B29">1997</xref>, <xref ref-type="bibr" rid="B30">2000</xref>; Healy, <xref ref-type="bibr" rid="B6">2012</xref>). In line with this, Teo (<xref ref-type="bibr" rid="B26">2021</xref>) emphasized that methods need to &#x0201C;do justice&#x0201D; to the psychological phenomena under investigation, implying that a particular method may be adequate under certain conditions but not under others. Of course, this leads to the intricate key question as to which method is appropriate for studying which phenomenon. One attempt to answer this question was made by Groeben (<xref ref-type="bibr" rid="B4">1986</xref>) in his book <italic>Handeln, Tun, Verhalten als Einheiten einer verstehend-erkl&#x000E4;renden Psychologie</italic> (<italic>Acting, Doing, Behaving as Units of an Interpretive-Explanatory Psychology</italic>). Although it is almost 40 years since the book has been published, it may still help to start thinking about what &#x0201C;doing justice&#x0201D; to psychological phenomena would entail.</p></sec>
<sec id="s2">
<title>2. How to take methodological pluralism seriously</title>
<p>Groeben distinguishes between two ways of investigating human mind and behavior that can be traced back through the entire history of academic psychology. On the one hand, those who share a natural science perspective on psychology typically approach human behavior using quantitative-experimental methods and aim at establishing covering laws that can explain this behavior. On the other hand, those who hold a perspective grounded in the humanities typically approach human behavior using hermeneutic methods and aim at describing behavior. Groeben criticizes both approaches as being incomplete. The natural science perspective is reductionist as it neglects the fact that humans are not passive objects in a pre-determined universe but rational and autonomous beings who are able to act intentionally and to communicate in meaningful ways. As Groeben sees it, the perspective grounded in the humanities, which puts great emphasis on acknowledging the subjectivity and the freedom of the individual and thus has a richer understanding of human nature, does not offer a viable alternative as it has abandoned the idea of explaining human behavior and is satisfied with merely describing it.</p>
<sec>
<title>2.1. Acting, doing, and behaving as three levels of analysis</title>
<p>In order to overcome this deadlock, Groeben tries to develop a theoretical framework that keeps the strengths and eliminates the weaknesses of both perspectives and that he labels &#x0201C;hermeneutic natural science&#x0201D; (hermeneutische Naturwissenschaft). Groeben suggests distinguishing between three basic levels of analysis: acting (&#x0201C;Handeln&#x0201D;), doing (&#x0201C;Tun&#x0201D;), and behaving (&#x0201C;Verhalten&#x0201D;). <italic>Acting</italic> is intentional, planned, meaningful, and oriented toward goals and norms. When the subjective intention and the objective motivation do not align, that is, in situations, in which humans are not fully aware of their goals and motives, they are <italic>doing</italic> things. When individuals are driven by universal hard-wired mechanisms, they <italic>behave</italic>. Groeben holds that &#x0201C;acting&#x0201D; is located on a higher level of abstraction than &#x0201C;doing,&#x0201D; and that &#x0201C;doing&#x0201D; is located on a higher level of abstraction than &#x0201C;behaving.&#x0201D; Following the idea that theories should be as parsimonious as possible, Groeben argues that researchers should start at the highest level of abstraction (i.e., acting) and that it is only allowed to step down the hierarchy to the levels of doing and behaving when it becomes clear that an analysis at a higher level of abstraction is insufficient.</p>
<p>Moreover, Groeben associates the investigation of each level of analysis with a specific methodology. For the analysis of &#x0201C;acting,&#x0201D; Groeben suggests the so-called dialogue-hermeneutic method. In short, the dialogue-hermeneutic method helps researchers and participants to reconstruct the participants&#x00027; individual cognitions in a joint effort. In a second step, it is investigated whether these reconstructions derived by the dialogue-hermeneutic method accurately map with observable behavior, that is, whether the identified intentions and goals can be considered to play a causal role in the individual&#x00027;s actions (for details, see Groeben and Scheele, <xref ref-type="bibr" rid="B5">2000</xref>). According to Groeben, combining these two steps ensures that the resulting analysis does not only describe but explain the individual&#x00027;s actions. If the reconstructions do not map with observable behavior, the researcher has encountered a case of &#x0201C;doing,&#x0201D; in response to which the researcher switches to a monolog-hermeneutic procedure. That is, the researcher develops a reconstruction of the things that an individual has <italic>done</italic> that also considers unconscious motives, goals, and intentions. In case researchers are concerned with analyzing instances of &#x0201C;behaving,&#x0201D; hermeneutic methods are skipped; instead, it is analyzed which environmental determinants drive the way an individual <italic>behaves</italic>.</p></sec>
<sec>
<title>2.2. Learning from Groeben&#x00027;s theoretical framework</title>
<p>What can be learned from Groeben&#x00027;s framework for today&#x00027;s debates about methodological pluralism and the idea of &#x0201C;doing justice&#x0201D; to psychological phenomena? First, as Groeben points out, the conflict between those researchers in psychology who hold a natural science perspective and those wo prefer a perspective grounded in the humanities is not a new one but can be traced back to the very beginnings of psychology as an academic discipline. Thus, a theoretical framework that tries to bridge the gap between these two perspectives and that provides an answer to the question as to how methodological pluralism can be put into action seems highly desirable.</p>
<p>Second, and in line with the previous point, Groeben raises awareness for the fact that the choice of research methods should be based on the kind of research question that is being asked&#x02014;and not vice versa. Importantly, Groeben demonstrates that quantitative-experimental methods may be insufficient when analyzing human behavior as the behavior of rational agents who use language as a medium of communication and of constructing meaning. This seems particularly noteworthy as many psychological researchers still limit themselves to a predetermined selection of quantitative-experimental methods, rather than considering which research method is most appropriate for their specific research question (comparable lines of critique can be found in J&#x000FC;ttemann, <xref ref-type="bibr" rid="B12">1983</xref>; Yanchar et al., <xref ref-type="bibr" rid="B28">2005</xref>; Mayrhofer and Hutmacher, <xref ref-type="bibr" rid="B17">2020</xref>; Lamiell and Slaney, <xref ref-type="bibr" rid="B14">2021</xref>). In other words, Groeben&#x00027;s framework implies that the decision to use a certain method should always be accompanied by practices of reflexivity throughout the entire research process (cf. Jamieson et al., <xref ref-type="bibr" rid="B11">2023</xref>).</p>
<p>Third, as Groeben also notes, the natural science perspective has largely dominated academic psychology throughout the twentieth century. From today&#x00027;s perspective, one may add that it continues to do so in the beginning of the twenty-first century. Emphasizing that humans have the capacity for acting autonomously and rationally and that academic psychology would benefit from shifting more attention to the &#x0201C;acting&#x0201D;-aspects of human behavior can be seen as an important reminder in this context. That is, while Groeben acknowledges that the human mind can be studied and analyzed from a wide range of different perspectives, namely perspectives derived from the natural sciences as well as perspectives derived from the humanities (for similar ideas, see, e.g., Watanabe, <xref ref-type="bibr" rid="B27">2010</xref>), he also emphasizes that the latter kind of perspectives have often been neglected. The idea that it is important to strengthen the role of the psychological humanities has been underlined in recent publications and is as relevant today as it was 40 years ago (cf. Teo, <xref ref-type="bibr" rid="B25">2017</xref>; Malich and Rehmann-Sutter, <xref ref-type="bibr" rid="B15">2022</xref>).</p></sec></sec>
<sec id="s3">
<title>3. Discussion</title>
<p>Even though Groeben&#x00027;s theoretical framework provides an interesting attempt to address the question as to how methodological pluralism can be put into action, it comes with several limitations. To begin with, it has been demonstrated that it is notoriously difficult to reconstruct the meaning of an observable behavior (cf. Shweder, <xref ref-type="bibr" rid="B23">1977</xref>), casting doubt on the possibility of determining beyond any doubt whether one is facing an instance of acting, doing, or behaving. In line with this, it appears far from clear that the three levels of analysis are as independent as postulated by Groeben and that their investigation needs to be put into a hierarchical order. Quite the contrary, it seems reasonable to assume that conscious goals and intentions, unconscious motives, and hard-wired behavior tendencies often all contribute to a specific observable behavior. If this were the case, one could still hold that contemporary psychology devotes too little attention to analyzing humans as intentional agents, that all levels need to be taken into account to arrive at an adequate understanding of psychological phenomena, and that researchers should reflect in more detail about the level of analysis at which they are operating. That is, keeping in mind the distinction between acting, doing, and behaving may help researchers to improve the conceptual clarity of their theories and the methodological rigor of their investigations (cf. Bringmann et al., <xref ref-type="bibr" rid="B2">2022</xref>). However, choosing a level of analysis would ultimately be up to the researcher&#x00027;s focus and interest.</p>
<p>Apart from that, academic psychology has developed a host of quantitative and qualitative as well as mixed methods suited for specific purposes (cf. Bryman, <xref ref-type="bibr" rid="B3">2006</xref>; Schoonenboom and Johnson, <xref ref-type="bibr" rid="B22">2017</xref>), which do not fit with the narrow set of methodological categories that Groeben has proposed. Hence, strictly adhering to the scheme proposed by Groeben may ultimately rather endanger than support a productive and methodologically diversified academic psychology. In the worst case, one runs the risk of introducing new methodological norms: That is, taking Groeben&#x00027;s framework as the last word on how researchers can &#x0201C;do justice&#x0201D; to the psychological phenomena under investigation would mean putting a premature end to a debate that is in fact still ongoing. One aspect of this debate that has not been mentioned so far and that also does not play a role in Groeben&#x00027;s framework is the complicated question whether the different perspectives on the human psyche are commensurable in the sense that different methodological approaches associated with these perspectives simply capture different aspects of the same phenomena or whether these different perspectives are linked to ontologically different phenomena (cf. Koch, <xref ref-type="bibr" rid="B13">1993</xref>). In accordance with this, Teo (<xref ref-type="bibr" rid="B26">2021</xref>) argued that a method that is &#x0201C;doing justice&#x0201D; to a certain kind of psychological phenomenon may be problematic when being applied to another kind of psychological phenomenon, suggesting that there are limits to the application of each method. Taken together, this demonstrates that implementing a version of methodological pluralism that goes beyond a mere &#x0201C;anything goes&#x0201D; attitude and that &#x0201C;does justice&#x0201D; to the psychological phenomena under investigation is not only desperately needed but also far from trivial to achieve. While Norbert Groeben may ultimately not be able to offer a viable framework, he at least offers a thought-provoking starting point for reflecting upon a version of methodological pluralism that could provide a satisfying answer to psychology&#x00027;s current crises.</p></sec>
<sec sec-type="author-contributions" id="s4">
<title>Author contributions</title>
<p>FH developed the research idea and wrote the manuscript.</p></sec>
</body>
<back>
<sec sec-type="funding-information" id="s5">
<title>Funding</title>
<p>This publication was supported by the Open Access Publication Fund of the University of W&#x000FC;rzburg.</p>
</sec>
<ack><p>I would like to thank Markus Appel for drawing my attention to Norbert Groeben&#x00027;s work.</p>
</ack>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s6">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Apicella</surname> <given-names>C.</given-names></name> <name><surname>Norenzayan</surname> <given-names>A.</given-names></name> <name><surname>Henrich</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>Beyond WEIRD: a review of the last decade and a look ahead to the global laboratory of the future</article-title>. <source>Evol. Hum. Behav.</source> <volume>41</volume>, <fpage>319</fpage>&#x02013;<lpage>329</lpage>. <pub-id pub-id-type="doi">10.1016/j.evolhumbehav.2020.07.015</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bringmann</surname> <given-names>L. F.</given-names></name> <name><surname>Elmer</surname> <given-names>T.</given-names></name> <name><surname>Eronen</surname> <given-names>M. I.</given-names></name></person-group> (<year>2022</year>). <article-title>Back to basics: the importance of conceptual clarification in psychological science</article-title>. <source>Curr. Direct. Psychologic. Sci.</source> <volume>31</volume>, <fpage>340</fpage>&#x02013;<lpage>346</lpage>. <pub-id pub-id-type="doi">10.1177/09637214221096485</pub-id></citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bryman</surname> <given-names>A.</given-names></name></person-group> (<year>2006</year>). <article-title>Integrating quantitative and qualitative research: How is it done?</article-title> <source>Qualitative Research</source> <volume>6</volume>, <fpage>97</fpage>&#x02013;<lpage>113</lpage>. <pub-id pub-id-type="doi">10.1177/1468794106058877</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Groeben</surname> <given-names>N.</given-names></name></person-group> (<year>1986</year>). <source>Handeln, Tun, Verhalten als Einheiten einer verstehend-erkl&#x000E4;renden Psychologie [Acting, doing, behaving as units of an interpretive-explanatory psychology]. Francke</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://nbn-resolving.org/urn:nbn:de:0168-ssoar-10239">https://nbn-resolving.org/urn:nbn:de:0168-ssoar-10239</ext-link></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Groeben</surname> <given-names>N.</given-names></name> <name><surname>Scheele</surname> <given-names>B.</given-names></name></person-group> (<year>2000</year>). Dialogue-hermeneutic method and the &#x0201C;Research Program Subjective Theories.&#x0201D; <italic>Forum Qualitative Sozialforschung</italic> 1, 10. <pub-id pub-id-type="doi">10.17169/fqs-1.2.1079</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Healy</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <article-title>Toward an integrative, pluralistic psychology: On the hermeneutico-dialogical conditions of the possibility for overcoming fragmentation</article-title>. <source>New Ideas Psychol.</source> <volume>30</volume>, <fpage>271</fpage>&#x02013;<lpage>280</lpage>. <pub-id pub-id-type="doi">10.1016/j.newideapsych.2011.12.005</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Henrich</surname> <given-names>J.</given-names></name> <name><surname>Heine</surname> <given-names>S. J.</given-names></name> <name><surname>Norenzayan</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>The weirdest people in the world?</article-title> <source>Behav. Brain Sci.</source> <volume>33</volume>, <fpage>61</fpage>&#x02013;<lpage>83</lpage>. <pub-id pub-id-type="doi">10.1017/S0140525X0999152X</pub-id><pub-id pub-id-type="pmid">20550733</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hutmacher</surname> <given-names>F.</given-names></name></person-group> (<year>2022</year>). <article-title>Gerd J&#x000FC;ttemann&#x00027;s &#x02018;Historical Psychology&#x00027;: why it should have succeeded, why it was ignored, and what that means for the future</article-title>. <source>Theory Psychol.</source> <volume>32</volume>, <fpage>868</fpage>&#x02013;<lpage>887</lpage>. <pub-id pub-id-type="doi">10.1177/09593543221122735</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hutmacher</surname> <given-names>F.</given-names></name> <name><surname>Mayrhofer</surname> <given-names>R.</given-names></name></person-group> (<year>2021</year>). <article-title>Die Psychologie der Jetzt-Zeit. Eine kritische Bestandsaufnahme methodischer Monokultur in der akademischen Psychologie [The psychology of the present: A critical look at the methodological monoculture in academic psychology]</article-title>. <source>psychosozial</source> <volume>44</volume>, <fpage>99</fpage>&#x02013;<lpage>108</lpage>. <pub-id pub-id-type="doi">10.30820/0171-3434-2021-3-99</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hutmacher</surname> <given-names>F.</given-names></name> <name><surname>Mayrhofer</surname> <given-names>R.</given-names></name></person-group> (<year>2023</year>). <article-title>Psychology as a historical science? theoretical assumptions, methodological considerations, and potential pitfalls</article-title>. <source>Curr. Psychol.</source> <volume>42</volume>, <fpage>18507</fpage>&#x02013;<lpage>18514</lpage>. <pub-id pub-id-type="doi">10.1007/s12144-022-03030-0</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jamieson</surname> <given-names>M. K.</given-names></name> <name><surname>Govaart</surname> <given-names>G. H.</given-names></name> <name><surname>Pownall</surname> <given-names>M.</given-names></name></person-group> (<year>2023</year>). <article-title>Reflexivity in quantitative research: A rationale and beginner&#x00027;s guide</article-title>. <source>Soc. Personal. Psychol. Compass</source> <volume>2</volume>, <fpage>12735</fpage>. <pub-id pub-id-type="doi">10.1111/spc3.12735</pub-id></citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>J&#x000FC;ttemann</surname> <given-names>G.</given-names></name></person-group> (<year>1983</year>). &#x0201C;Psychologie am Scheideweg: Teilung oder Vervollst&#x000E4;ndigung [Psychology at the crossroads: Division or completion],&#x0201D; In: <italic>Psychologie in der Ver&#x000E4;nderung. Perspektiven f&#x000FC;r eine gegenstandsangemessenere Forschungspraxis</italic> [Psychology in change: Perspectives for a research practice more appropriate for the subject matter], ed G. J&#x000FC;ttemann (pp. 30-65). Beltz.</citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koch</surname> <given-names>S.</given-names></name></person-group> (<year>1993</year>). <article-title>&#x0201C;Psychology&#x0201D; or &#x0201C;the psychological studies&#x0201D;?</article-title> <source>Am. Psychol.</source> <volume>48</volume>, <fpage>902</fpage>&#x02013;<lpage>904</lpage>. <pub-id pub-id-type="doi">10.1037/0003-066X.48.8.902</pub-id></citation>
</ref>
<ref id="B14">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lamiell</surname> <given-names>J. T.</given-names></name> <name><surname>Slaney</surname> <given-names>K. L.</given-names></name></person-group> (<year>2021</year>). <source>Scientific psychology&#x00027;s problematic research practices and inertia: History, sources, and recommended solutions.</source> <publisher-loc>London</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Malich</surname> <given-names>L.</given-names></name> <name><surname>Rehmann-Sutter</surname> <given-names>C.</given-names></name></person-group> (<year>2022</year>). <article-title>Metascience is not enough&#x02014;a plea for psychological humanities in the wake of the replication crisis</article-title>. <source>Rev. General Psychol.</source> <volume>26</volume>, <fpage>261</fpage>&#x02013;<lpage>273</lpage>. <pub-id pub-id-type="doi">10.1177/10892680221083876</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marsman</surname> <given-names>M.</given-names></name> <name><surname>Sch&#x000F6;nbrodt</surname> <given-names>F. D.</given-names></name> <name><surname>Morey</surname> <given-names>R. D.</given-names></name> <name><surname>Yao</surname> <given-names>Y.</given-names></name> <name><surname>Gelman</surname> <given-names>A.</given-names></name> <name><surname>Wagenmakers</surname> <given-names>E.-J.</given-names></name></person-group> (<year>2017</year>). A Bayesian bird&#x00027;s eye view of &#x0201C;Replications of important results in social psychology.&#x0201D; <italic>Royal Soc. Open Sci</italic>. 4, 160426. <pub-id pub-id-type="doi">10.1098/rsos.160426</pub-id><pub-id pub-id-type="pmid">28280547</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mayrhofer</surname> <given-names>R.</given-names></name> <name><surname>Hutmacher</surname> <given-names>F.</given-names></name></person-group> (<year>2020</year>). <article-title>The principle of inversion: Why the quantitative-empirical paradigm cannot serve as a unifying basis for psychology as an academic discipline</article-title>. <source>Front. Psychol.</source> <volume>11</volume>, <fpage>596425</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2020.596425</pub-id><pub-id pub-id-type="pmid">33365003</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Muthukrishna</surname> <given-names>M.</given-names></name> <name><surname>Henrich</surname> <given-names>J.</given-names></name> <name><surname>Slingerland</surname> <given-names>E.</given-names></name></person-group> (<year>2021</year>). <article-title>Psychology as a historical science</article-title>. <source>Ann. Rev. Psychol.</source> <volume>72</volume>, <fpage>717</fpage>&#x02013;<lpage>749</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-psych-082820-111436</pub-id><pub-id pub-id-type="pmid">33049160</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nosek</surname> <given-names>B. A.</given-names></name> <name><surname>Alter</surname> <given-names>G.</given-names></name> <name><surname>Banks</surname> <given-names>G. C.</given-names></name> <name><surname>Borsboom</surname> <given-names>D.</given-names></name> <name><surname>Bowman</surname> <given-names>S. D.</given-names></name> <name><surname>Breckler</surname> <given-names>S. J.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Promoting an open research culture</article-title>. <source>Science</source> <volume>348</volume>, <fpage>1422</fpage>&#x02013;<lpage>1425</lpage>. <pub-id pub-id-type="doi">10.1126/science.aab2374</pub-id><pub-id pub-id-type="pmid">26113702</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><collab>Open Science Collaboration</collab></person-group> (<year>2015</year>). <article-title>Estimating the reproducibility of psychological science</article-title>. <source>Science</source> 349, aac4716. <pub-id pub-id-type="doi">10.1126/science.aac4716</pub-id><pub-id pub-id-type="pmid">26315443</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pashler</surname> <given-names>H.</given-names></name> <name><surname>Wagenmakers</surname> <given-names>E. J.</given-names></name></person-group> (<year>2012</year>). <article-title>Editors&#x00027; introduction to the special section on replicability in psychological science: a crisis of confidence?</article-title> <source>Perspect. Psychologic. Sci.</source> <volume>7</volume>, <fpage>528</fpage>&#x02013;<lpage>530</lpage>. <pub-id pub-id-type="doi">10.1177/1745691612465253</pub-id><pub-id pub-id-type="pmid">26168108</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schoonenboom</surname> <given-names>J.</given-names></name> <name><surname>Johnson</surname> <given-names>R. B.</given-names></name></person-group> (<year>2017</year>). <article-title>How to construct a mixed methods research design</article-title>. <source>K&#x000F6;lner Zeitschrift f&#x000FC;r Soziologie und Sozialpsychologie</source> <volume>69</volume>, <fpage>107</fpage>&#x02013;<lpage>131</lpage>. <pub-id pub-id-type="doi">10.1007/s11577-017-0454-1</pub-id><pub-id pub-id-type="pmid">28989188</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shweder</surname> <given-names>R. A.</given-names></name></person-group> (<year>1977</year>). <article-title>Likeness and likelihood in everyday thought: magical thinking in judgments about personality</article-title>. <source>Current Anthropol.</source> <volume>18</volume>, <fpage>637</fpage>&#x02013;<lpage>658</lpage>. <pub-id pub-id-type="doi">10.1086/201974</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Simmons</surname> <given-names>J. P.</given-names></name> <name><surname>Nelson</surname> <given-names>L. D.</given-names></name> <name><surname>Simonsohn</surname> <given-names>U.</given-names></name></person-group> (<year>2011</year>). <article-title>False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant</article-title>. <source>Psychologic. Sci.</source> <volume>22</volume>, <fpage>1359</fpage>&#x02013;<lpage>1366</lpage>. <pub-id pub-id-type="doi">10.1177/0956797611417632</pub-id><pub-id pub-id-type="pmid">22006061</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Teo</surname> <given-names>T.</given-names></name></person-group> (<year>2017</year>). <article-title>From psychological science to the psychological humanities: building a general theory of subjectivity</article-title>. <source>Rev. General Psychol.</source> <volume>21</volume>, <fpage>281</fpage>&#x02013;<lpage>291</lpage>. <pub-id pub-id-type="doi">10.1037/gpr0000132</pub-id></citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Teo</surname> <given-names>T.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;Doing justice&#x0201D;</article-title> in psychological methodology: from science and experiments to anecdotes. <source>New Ideas Psychol.</source> <volume>61</volume>, <fpage>100854</fpage>. <pub-id pub-id-type="doi">10.1016/j.newideapsych.2021.100854</pub-id></citation>
</ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Watanabe</surname> <given-names>T.</given-names></name></person-group> (<year>2010</year>). <article-title>Metascientific foundations for pluralism in psychology</article-title>. <source>New Ideas Psychol.</source> <volume>28</volume>, <fpage>253</fpage>&#x02013;<lpage>262</lpage>. <pub-id pub-id-type="doi">10.1016/j.newideapsych.2009.09.019</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yanchar</surname> <given-names>S. C.</given-names></name> <name><surname>Gantt</surname> <given-names>E. E.</given-names></name> <name><surname>Clay</surname> <given-names>S. L.</given-names></name></person-group> (<year>2005</year>). <article-title>On the nature of a critical methodology</article-title>. <source>Theory Psychol.</source> <volume>15</volume>, <fpage>27</fpage>&#x02013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1177/0959354305049743</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yanchar</surname> <given-names>S. C.</given-names></name> <name><surname>Slife</surname> <given-names>B. D.</given-names></name></person-group> (<year>1997</year>). <article-title>Pursuing unity in a fragmented psychology: problems and prospects</article-title>. <source>Rev. General Psychol.</source> <volume>1</volume>, <fpage>235</fpage>&#x02013;<lpage>255</lpage>. <pub-id pub-id-type="doi">10.1037/1089-2680.1.3.235</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yanchar</surname> <given-names>S. C.</given-names></name> <name><surname>Slife</surname> <given-names>B. D.</given-names></name></person-group> (<year>2000</year>). <article-title>Putting it all together: toward a hermeneutic unity of psychology</article-title>. <source>J. Mind Behav.</source> <volume>21</volume>, <fpage>315</fpage>&#x02013;<lpage>326</lpage>.</citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zitzmann</surname> <given-names>S.</given-names></name> <name><surname>Loreth</surname> <given-names>L.</given-names></name></person-group> (<year>2021</year>). <article-title>Regarding an &#x0201C;almost anything goes&#x0201D; attitude toward methods in psychology</article-title>. <source>Frontiers in Psychology</source>, 12, 612570. <pub-id pub-id-type="doi">10.3389/fpsyg.2021.612570</pub-id><pub-id pub-id-type="pmid">33679527</pub-id></citation></ref>
</ref-list>
</back>
</article>