<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Polit. Sci.</journal-id>
<journal-title>Frontiers in Political Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Polit. Sci.</abbrev-journal-title>
<issn pub-type="epub">2673-3145</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">677003</article-id>
<article-id pub-id-type="doi">10.3389/fpos.2021.677003</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Political Science</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Cultural Beliefs and Stakeholder Affiliation Influence Attitudes Towards Responsible Research and Innovation Among United&#x20;States Stakeholders Involved in Biotechnology and Gene Editing</article-title>
<alt-title alt-title-type="left-running-head">Kuzma and Cummings</alt-title>
<alt-title alt-title-type="right-running-head">Responsible Innovation and Biotechnology-Stakeholder Attitudes</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Kuzma</surname>
<given-names>Jennifer</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1107676/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Cummings</surname>
<given-names>Christopher L.</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1107149/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<label>
<sup>1</sup>
</label>School of Public and International Affairs &#x26; Genetic Engineering and Society Center, NC State University, <addr-line>Raleigh</addr-line>, <addr-line>NC</addr-line>, <country>United&#x20;States</country>
</aff>
<aff id="aff2">
<label>
<sup>2</sup>
</label>Genetic Engineering and Society Center, NC State University, <addr-line>Raleigh</addr-line>, <addr-line>NC</addr-line>, <country>United&#x20;States</country>
</aff>
<aff id="aff3">
<label>
<sup>3</sup>
</label>Gene-edited Foods Project, Iowa State University, <addr-line>Ames</addr-line>, <addr-line>IA</addr-line>, <country>United&#x20;States</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1144993/overview">Michael Morrison</ext-link>, University of Oxford, United&#x20;Kingdom</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/865319/overview">Jesse L. Reynolds</ext-link>, University of California, Los Angeles, United&#x20;States</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1333605/overview">Anne M. Dijkstra</ext-link>, University of Twente, Netherlands</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Jennifer Kuzma, <email>jkuzma@ncsu.edu</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Politics of Technology, a section of the journal Frontiers in Political Science</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>24</day>
<month>06</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>3</volume>
<elocation-id>677003</elocation-id>
<history>
<date date-type="received">
<day>07</day>
<month>03</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>14</day>
<month>06</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Kuzma and Cummings.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Kuzma and Cummings</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>Biotech developers are concerned about the future of gene editing having experienced the contentious history of first-generation GM foods. They have also expressed desires to do better with public engagement in gene-editing innovation. The framework of Responsible Research and Innovation (RRI) may provide a way forward to act on their desires for greater public legitimacy. However, in the United&#x20;States, -there has also been reluctance to incorporate RRI into biotechnology innovation systems like gene editing in food and agriculture. In this article, we investigate individual- and group-level factors, including demographic, sociographic, and cultural factors, that influence attitudes towards RRI among biotechnology United&#x20;States stakeholders. Using the Advocacy Coalition Framework&#x2019;s (ACF) hierarchy of beliefs as a theoretical guide, biotechnology stakeholders (<italic>n</italic>&#x20;&#x3d; 110) were surveyed about their cultural (deep-core) beliefs and then about their attitudes towards principles (policy-core beliefs) and practices (secondary beliefs) of RRI applied to biotechnology innovation. Through statistical analysis of the results, we found significant relationships between stronger egalitarian cultural-beliefs and positive attitudes towards both the principles and practices of RRI. We also found that participants with higher levels of experience held more positive attitudes towards principles of RRI. In contrast, we found a significant inverse relationship between professional affiliation with industry or trade organizations and attitudes towards RRI practices. With these results, we present a model of factors that influence RRI attitudes for future testing. In closing, we interpret the results in the context of ACF to examine the potential for building cross-sector coalitions for practicing RRI within United&#x20;States gene-editing innovation systems.</p>
</abstract>
<kwd-group>
<kwd>responsible research and innovation</kwd>
<kwd>gene editing</kwd>
<kwd>genome editing</kwd>
<kwd>oversight</kwd>
<kwd>regulation</kwd>
<kwd>stakeholders</kwd>
<kwd>attitudes</kwd>
<kwd>advocacy coalition theory</kwd>
</kwd-group>
<contract-sponsor id="cn001">National Science Foundation<named-content content-type="fundref-id">10.13039/100000001</named-content>
</contract-sponsor>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>Scholars proposed the framework of responsible research and innovation (RRI) in the last decade to expand the governance of emerging technologies beyond traditional questions about the downstream risks of technological products to upstream questions about research and innovation processes themselves (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>). In particular, <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> notes that public controversies about science and technology &#x201c;cannot be reduced to questions of risk, but rather encompass a range of concerns relating to the purposes and motivations of research&#x201d; (p. 1569). RRI seeks to better align scientific and technological research and development with democratic processes, societal values and needs, and humility towards the future (e.g., <xref ref-type="bibr" rid="B29">Owen et&#x20;al., 2012</xref>; <xref ref-type="bibr" rid="B30">Owen et&#x20;al., 2013</xref>; <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>). RRI arose out of a longer history of work on the ethical, legal, and social implications/aspects (ELSI in the United&#x20;States or ELSA in the EU) of science and technology development (<xref ref-type="bibr" rid="B7">Felt 2018</xref>). RRI has been integrated into EU funding programs (<xref ref-type="bibr" rid="B7">Felt 2018</xref>) and has been the subject of much science and technology studies (STS) scholarship. However, it has not been significantly mainstreamed into S&#x26;T funding, research policy, or innovation systems in the United&#x20;States.</p>
<p>Around the time that RRI emerged, the biotechnology sector underwent a revolution with the advent of gene-editing methods. Biotech developers are now concerned about the future of gene-editing having experienced the contentious history of first-generation GM foods (<xref ref-type="bibr" rid="B27">Marris et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B21">Kuzma 2016</xref>; <xref ref-type="bibr" rid="B10">Hartley et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B23">Kuzma 2018</xref>). For example, consumers are purchasing more non-GM and organic products, and food companies are seeking out non-GM ingredients (<xref ref-type="bibr" rid="B26">Malcolm 2016</xref>; <xref ref-type="bibr" rid="B11">Hartman Group, 2018</xref>). At the same time, biotech developers see gene-editing, such as through the use of CRISPR, as a way to alter crops for useful purposes while potentially avoiding public backlash and cumbersome regulation (<xref ref-type="bibr" rid="B21">Kuzma 2016</xref>; <xref ref-type="bibr" rid="B20">Kuzma et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B23">Kuzma 2018</xref>). Biotech developers indicate that they want to do a better job of bringing the public along with gene-editing innovation in comparison to how they proceeded with first-generation transgenic and GM crops (<xref ref-type="bibr" rid="B18">Kokotovich and Kuzma 2014</xref>; <xref ref-type="bibr" rid="B20">Kuzma et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B23">Kuzma 2018</xref>). They see gene-editing as potentially more acceptable to consumers, as gene-edited crops do not always include the introduction of foreign DNA into the final product. Some perception studies of GM crops and foods have shown that consumers indeed have fewer adverse attitudes towards the introduction of DNA from the same species (as can be achieved through gene editing) in comparison with the introduction of DNA from distantly related species (<xref ref-type="bibr" rid="B28">Mielby et&#x20;al., 2013</xref>; <xref ref-type="bibr" rid="B36">Shew et&#x20;al., 2018</xref>). A recent cross-national study of United&#x20;States consumers concluded that people were more willing to consume CRISPR-based foods than 1<sup>st</sup> generation GM or transgenic foods, although both were viewed less positively than conventional foods (<xref ref-type="bibr" rid="B36">Shew et&#x20;al., 2018</xref>).</p>
<p>Developers see gene-edited crops as a chance to start fresh with greater inclusion of public dialogue and education to address consumer acceptance issues. For example, in one study interviewing biotech stakeholders and developers, a majority expressed the need for the public to be engaged in gene-editing governance (<xref ref-type="bibr" rid="B20">Kuzma et&#x20;al., 2016</xref>). In addition, a coalition of industry, non-profits, and trade organizations is emerging for verification of responsible practices for gene-editing in agriculture (<xref ref-type="bibr" rid="B3">Center for Food Integrity, 2020</xref>). At the same time, United&#x20;States regulatory systems for gene-editing, like gene-edited foods, are evolving in different directions. For example, in 2020, the United&#x20;States Department of Agriculture passed new regulations for GM crops which exempt many gene-edited crops from pre-market oversight (<xref ref-type="bibr" rid="B40">USDA 2020</xref>) and lack requirements for public disclosure when they enter agricultural or food systems (<xref ref-type="bibr" rid="B13">Jaffe 2019</xref>; <xref ref-type="bibr" rid="B19">Kuzma and Grieger 2020</xref>).</p>
<p>In the absence of federal mandates for public transparency and disclosure of gene-edited products, RRI principles and practices may provide a way forward for biotech developers to act on their desires for greater public engagement and legitimacy. The most cited article on RRI (according to Google Scholar) frames it according to four principles: anticipation, inclusion, reflexivity, and responsiveness (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>). <italic>Reflexivity</italic> moves governance of science and technology away from solely a risk-based approach to one that encompasses reflection on the underlying goals, motivations, limits of knowledge, assumptions, and alternative framings of problems. <italic>Anticipation</italic> incorporates considerations where potential future consequences can be analyzed and explored prior to technological development, allowing for improved consideration of downstream risks and impacts. <italic>Inclusion</italic> prioritizes opening up governance of research and innovation to incorporate the perspectives of diverse publics, which provides more varied, reflexive, and anticipatory approach than the traditional inclusion of subject-matter experts alone in governance systems. Finally, <italic>responsiveness</italic> demands the ability to alter the direction or scope of innovation given changing circumstances, new data, or emergent stakeholder and public values. The RRI framework based on these four principles is &#x201c;deemed to be characteristic of a more responsible vision of innovation&#x201d; than other frameworks centering on research ethics, diversity and inclusion in STEM fields, and interdisciplinarity and has been &#x201c;operationalized by national funding bodies&#x201d; and &#x201c;integrated in research practice&#x201d; in the EU (<xref ref-type="bibr" rid="B43">Wittrock et&#x20;al., 2021</xref>, p.&#x20;xi).</p>
<p>In previous work (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>), we developed quantitative survey questions to measure attitudes towards the four RRI principles from <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> and towards ways to put these principles into action. We found that United&#x20;States stakeholders promoting or developing biotechnology innovations--industry, trade organizations, and academics--had more negative reactions to RRI principles of inclusion and responsiveness than the RRI principles of reflexivity and anticipation in comparison to government and advocacy groups (i.e.,&#x20;consumer or environmental non-profits). These results were further explained by qualitative focus group research with these stakeholders. We found that biotech developers and their proponents (i.e.,&#x20;biotech or commodity-crop trade organizations) were wary of giving voice or choice to groups outside innovation pipelines, which contradicts RRI principles of inclusion and responsiveness (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>). Biotech developers expressed fears that these facets of RRI would slow their work down in the face of pressures to move quickly to compete for funding, capital, and national or international professional advantages (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>).</p>
<p>While this previous study observed differences in RRI attitudes among stakeholder groups and provided some insights into why stakeholder groups feel differently about RRI, it did not adequately describe what individual-level or group-level factors influence differences in attitudes for RRI among stakeholders. Thus, in this paper, we examine whether demographic, cultural, professional, or other sociographic factors affect individual and group attitudes towards RRI principles and practices. Our work is also guided by the Advocacy Coalition Framework (ACF). ACF is a theoretical framework from the policy process literature that examines how individual- and group-beliefs relate to the formation and operation of coalitions within policy arenas (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>) (see more discussion on ACF and our survey questions below in Methods). In this study, we use the ACF structure for core, policy, secondary &#x201c;beliefs&#x201d; and the principles of RRI from <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> to develop survey questions in order to gain insights into factors that influence attitudes towards RRI among United&#x20;States stakeholders in biotechnology innovation. We then use the ACF to hypothesize about the potential to form wider coalitions across United&#x20;States stakeholder groups to incorporate RRI into United&#x20;States gene-editing innovation systems.</p>
<p>To set the stage for this work, we first review key previous studies on RRI in biotechnology or related innovation systems and then turn to a deeper discussion of the ACF and how it relates to beliefs about RRI and United&#x20;States stakeholder coalitions in biotechnology innovation systems.</p>
<sec id="s1-1">
<title>Previous Work on Biotechnology and RRI</title>
<p>A few previous studies have specifically considered stakeholder attitudes towards RRI within United&#x20;States biotechnology innovation systems. Two studies used interviews with academic researchers. <xref ref-type="bibr" rid="B4">Doezema and Guston (2018)</xref> interviewed United&#x20;States biotech innovators within a single university research institute. In this study, RRI was framed according to areas of practice that could be put into place at the institute&#x2014;that is, ethics, science education, open science, societal engagement, gender equality, and diversity. The study found that although ethics was of interest to biotech researchers at this institute, RRI was conceived as traditional &#x201c;research ethics&#x201d; such as reproducibility and misconduct, rather than according the <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> RRI principles. A second study (<xref ref-type="bibr" rid="B9">Glerup et&#x20;al., 2017</xref>) interviewed eleven United&#x20;States academics working in synthetic biology and nanotechnology using a Socio-Technical Integration Research (STIR) protocol where STS researchers embed themselves in laboratories (<xref ref-type="bibr" rid="B8">Fisher and Schuurbiers 2013</xref>). They found that the researchers thought of &#x201c;responsibility&#x201d; in more traditional ways, such as producing good science and taking care of employees, rather than broader obligations and responsivity to society (<xref ref-type="bibr" rid="B9">Glerup et&#x20;al., 2017</xref>). Neither of these studies employed survey methods or empirically compared United&#x20;States biotechnology stakeholder-group attitudes as we do in this article.</p>
<p>Other reports focus on attitudes of innovators in the EU, Canada, and United&#x20;Kingdom towards RRI. <xref ref-type="bibr" rid="B27">Marris et&#x20;al., 2015</xref> identified engineers and natural scientists&#x2019; conceptions of RRI within the synthetic biology community in the United&#x20;Kingdom. They found that seeking greater public acceptance of synthetic biology was the primary motivation for RRI. Similarly, <xref ref-type="bibr" rid="B10">Hartley et&#x20;al. (2017)</xref> interviewed university researchers across STEM fields working in the United&#x20;Kingdom and found that various actors espouse different meanings of RRI, although a predominant theme was the protection of scientific research from politics. For example, several researchers felt that public inclusion and engagement would best serve to increase public understanding of science and thus garner support for GM work (<xref ref-type="bibr" rid="B10">Hartley et&#x20;al., 2017</xref>); rather than serve to give publics a &#x201c;voice&#x201d; in the conduct of GM work, like &#x201c;inclusion&#x201d; is meant to do in <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref>.</p>
<p>Along similar lines, <xref ref-type="bibr" rid="B1">Carrier and Gartzlaff, 2020</xref> interviewed 80 researchers and research executives across the EU in a variety of technological fields across social and natural sciences, humanities, and engineering to investigate their understandings of RRI. While they found a welcoming attitude towards RRI in general, the interviewees were concerned about granting societal actors influence on the direction of research and innovation given public &#x201c;ignorance and bias,&#x201d; the additional expenditures that may be required to engage societal actors, and the potential loss of autonomy for science. Another study in Canada interviewed 31 people who design, develop and commercialize health innovations about practices of RRI (<xref ref-type="bibr" rid="B32">Rivard and Lehoux 2020</xref>). The study found that although innovators generally agreed on the desirability of several principles of RRI, they were concerned about the feasibility of meaningful implementation of them. The findings in these last two studies are consistent with our previous study with United&#x20;States biotechnology stakeholders (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>), in which we found greater agreement on RRI principles (i.e.,&#x20;anticipation, responsivity, reflexivity, and inclusion) among diverse stakeholder groups than on specific RRI practices for implementing these principles.</p>
<p>RRI for biotechnology has also been investigated in multiple case studies using anthropological approaches to observation (see <xref ref-type="bibr" rid="B25">Macnaghten, 2016</xref>). For instance, <xref ref-type="bibr" rid="B25">Macnaghten, 2016</xref> used ethnographic work to identify RRI attitudes towards GM food crops in Brazil, Mexico, and India as well as among symposium attendees in the United&#x20;Kingdom and EU (<xref ref-type="bibr" rid="B2">Carro-Ripalda and Macnaghten 2015</xref>). These studies report the cultural, institutional, and social challenges to enacting RRI and provide greater identification of the practicality of enacting RRI within synthetic biology research and innovation (<xref ref-type="bibr" rid="B25">Macnaghten, 2016</xref>). In the context of GM crops, they found that in&#x20;situations where the crop was not culturally significant to the country, like soybean in Brazil, scientists had &#x201c;clear and unqualified optimism &#x2026; on the role of GM crop technologies, with little evidence of a structured and sustained debate with wider society&#x201d; (<xref ref-type="bibr" rid="B2">Carro-Ripalda and Macnaghten 2015</xref>; <xref ref-type="bibr" rid="B25">Macnaghten, 2016</xref>, p.284). In India, they heard from crop scientists who argued that India &#x201c;could not afford the risk of falling behind in the development of biotechnology&#x201d; and that anti-GM groups were &#x201c;ignorant&#x201d; (<xref ref-type="bibr" rid="B2">Carro-Ripalda and Macnaghten 2015</xref>, p 25). These results are similar to the barriers identified in our previous work with focus groups of United&#x20;States biotechnology stakeholders (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>). Here we found 1) &#x201c;cynicism&#x201d; among innovators with regard to the public&#x2019;s ability to engage in informed conversation and 2) the predominance of &#x201c;academic capitalism&#x201d; in United&#x20;States culture and institutions, through which any process such as RRI that might slow innovation down would reduce competitiveness and be seen as undesirable.</p>
<p>All the studies mentioned above used qualitative methods of inquiry, and only a few focus on United&#x20;States biotechnology innovation systems. In contrast, in this paper, we use quantitative surveys to investigate the relationships between demographic, sociographic, professional, or cultural factors and their influence on attitudes towards RRI. Furthermore, this paper breaks new ground by merging RRI scholarship and quantitative survey methods with policy process theory (namely the ACF), where we evaluate survey data with a larger sample (<italic>n</italic>&#x20;&#x3d; 110) of multi-sector stakeholders in United&#x20;States biotechnology innovation. To our knowledge, our study is unique in these regards in the field of RRI scholarship.</p>
</sec>
<sec id="s1-2">
<title>Relating RRI Attitudes to the Advocacy Coalition Framework</title>
<p>A significant challenge faced by those attempting to legitimize and implement the RRI framework is establishing processes, strategies, and norms that create shared goals, while also facilitating coordination and cooperation between actors involved with innovation processes (<xref ref-type="bibr" rid="B39">Tait, 2017</xref>). ACF is a policy process theoretical framework that describes how actors engage in the policy process to translate their belief systems, which are simplified constructs used to make sense of the world, into public policy-making and action (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>). This paper uses the theoretical lens of the ACF framework to explore whether United&#x20;States stakeholders share beliefs related to RRI and thus whether those beliefs may translate into shared policy action to implement RRI in United&#x20;States biotechnology innovation systems.</p>
<p>The ACF provides a framework for understanding how coalitions of actors within a policy subsystem (e.g., biotechnology innovation) may interact to affect change or maintain the status quo (reviewed in <xref ref-type="bibr" rid="B42">Weible et&#x20;al., 2009</xref>). The ACF provides a three&#x2013;tier structure for describing the beliefs of actors (e.g., in this study, our biotech stakeholders) within a policy subsystem (e.g., in this study, biotechnology innovation) (<xref ref-type="bibr" rid="B42">Weible et&#x20;al., 2009</xref>) (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>). <italic>Deep core beliefs</italic> are the broadest category of beliefs, represent the most stable beliefs of actors, and are mainly normative. They transcend policy subsystems, or in other words, actors hold these beliefs across multiple policy areas. For example, deep core beliefs represent liberal and conservative political beliefs, whether responsibility for progress lies with individuals or communities, and beliefs about future generations. The next level in the ACF hierarchy of beliefs are <italic>policy core beliefs</italic> which are more moderate in scope and relate to the substance of particular policy subsystems (in our case, biotechnology innovation). These beliefs are thought to be important for forming more stable coalitions in policy subsystems, and although somewhat resistant to change, they are more malleable than <italic>deep core beliefs</italic> in response to new information and experiences<italic>.</italic> Policy core beliefs include how problems are defined, the ordering of priorities, and balance between values such as economics and ethics. At the most specific level of ACF beliefs are <italic>secondary beliefs</italic> (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>). These are narrower in scope than <italic>policy core beliefs</italic> and are often formed in response to empirical information or experiences within the policy subsystem. Secondary beliefs are those related to specific public policy instruments used to achieve policy outcomes. The ACF predicts that <italic>secondary beliefs</italic> are the most changeable among coalitions and actors within them (<xref ref-type="bibr" rid="B35">Sabatier et&#x20;al., 2007</xref>).</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>ACF beliefs and relationship to stakeholder survey questions.</p>
</caption>
<graphic xlink:href="fpos-03-677003-g001.tif"/>
</fig>
<p>The advocacy coalitions that exist within a subsystem are aggregated groups of actors that coordinate to a non-trivial degree in the pursuit of policy change (<xref ref-type="bibr" rid="B35">Sabatier et&#x20;al., 2007</xref>). Under ACF, a shared set of motivations and beliefs are what bind coalitions together. Deep core beliefs, and to a lesser extent policy core beliefs, are seen under the ACF to hold advocacy coalitions together. Applying these ideas to the biotechnology policy subsystem, in this paper we wanted to see whether attitudes towards RRI principles, which relate to the ACF&#x2019;s level of policy core beliefs, and RRI practices, which relate to the ACF&#x2019;s level of secondary beliefs, were influenced by deep core beliefs and whether stakeholder groups differed in their deep core, policy core, and secondary beliefs (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>).</p>
<p>Given the importance of deep core beliefs in understanding the behavior of advocacy coalitions within a policy subsystem, ACF scholars have devised a way to conceptualize and measure deep core beliefs that captures their normative and ontological nature, while also being testable and generalizable (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). These scholars used cultural theory (<xref ref-type="bibr" rid="B5">Douglas 1970</xref>; <xref ref-type="bibr" rid="B6">Douglas and Wildavsky 1982</xref>), to structure a scale for deep core beliefs that is generalizable across multiple policy subsystems. In this scale, twelve questions place survey respondents into four cultural archetypes--egalitarian, hierarchical, individualistic, or fatalistic (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). These cultural types, which are also considered &#x201c;worldviews,&#x201d; have been previously defined by the intersection of the dimensions grid and group (<xref ref-type="bibr" rid="B5">Douglas 1970</xref>; <xref ref-type="bibr" rid="B6">Douglas and Wildavsky 1982</xref>). The grid dimension is a measure of beliefs about how society should be structured. It represents the degree to which individual behavior should be regulated by group pressure and structural constraints. The group dimension is a measure of feelings of group membership within society; for example, a high measure of group indicates that individuals have a strong feeling of association with others. In this study, we use the <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al. (2014)</xref> validated scale to probe whether our United&#x20;States biotechnology stakeholders fall into the four cultural archetypes, as a measurement of deep core beliefs according to the ACF (see Methods and <xref ref-type="table" rid="T2">Table&#x20;2</xref>).</p>
<p>In our previous study (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>), we found significant differences among stakeholder groups especially in their attitudes to <italic>secondary beliefs,</italic> or in other words, ways of implementing RRI in biotechnology innovation. Industry and trade organizations rated inclusion and responsivity practices, both which relinquish control to groups outside of biotechnology product development pipelines, less positively than government and advocacy groups. We found more agreement among stakeholder groups for the general principles of RRI, or <italic>policy core beliefs,</italic> applied to biotechnology innovation. As the ACF proposes that secondary beliefs are more flexible, and that shared policy core beliefs are important for stable coalition formation, we hypothesized that there are reasons to be optimistic about stakeholder groups in biotechnology innovation coming together to adopt RRI principles (which they share more agreement on) <italic>if</italic> better ways to implement them could be agreed upon (than those asked in the survey). However, in this prior study, we did not analyze whether <italic>deep core beliefs</italic> influence attitudes of biotechnology stakeholders towards RRI in the biotech innovation system. We also did not assess whether demographic (e.g., gender, race, age) or sociographic (e.g. income, education, experience in profession) factors influence RRI attitudes. We also did not address whether United&#x20;States stakeholder groups share deep core beliefs and whether they are important for coming to agreement on RRI. Considering these gaps, this study addresses the following key research question:</p>
<disp-quote>
<p>
<italic>What demographic, sociographic, professional, and cultural factors (deep core beliefs) best explain the variance of observed stakeholder&#x2019;s responsible innovation 1) policy core beliefs and 2) secondary beliefs?</italic>
</p>
</disp-quote>
<p>We further describe our methods for addressing this key question below, followed by our results. Finally, we discuss the meaning of our results for the possibility of implementing RRI in United&#x20;States biotechnology innovation systems.</p>
</sec>
</sec>
<sec sec-type="methods" id="s2">
<title>Methods</title>
<sec id="s2-1">
<title>Recruitment and Survey Participants</title>
<p>We used a purposive sampling approach to recruit a diverse group of study-participants comprised of a variety of biotechnology professionals from different sectors. Participants were recruited from a sample of United&#x20;States stakeholders in the greater Raleigh-Durham-Chapel Hill area (Research Triangle, NC). Recruitment was prioritized among professionals working in areas related to biotechnology in agriculture, food, or the environment. Many of the biotechnology developers recruited in the study work on emerging methods of genetic engineering, such as gene editing. The geographic region of the Research Triangle provides a host of diverse biotechnology and bioscience organizations. The Research Triangle is among the most active scientific and development regions in the United&#x20;States and ranks second behind Boston Metropolitan region for life science expertise and development (<xref ref-type="bibr" rid="B34">Rose 2015</xref>). Participants reflect a fair representation of biotech stakeholders in this highly active biotech region. However, the participants do not comprise a statistical or geographic representation of the United&#x20;States.</p>
<p>In our search we prioritized balanced representation from academe, advocacy groups (i.e.,&#x20;consumer and environmental groups), government, industry, and trade organizations (i.e.,&#x20;industry and conventional farming non-profit associations), (<xref ref-type="fig" rid="F2">Figure&#x20;2</xref>). We chose to split non-governmental organizations (NGOs) into advocacy groups and trade organizations to better reflect the abilities of each group--where advocacy groups may influence policy change and biotechnology oversight through media communications and legal precedence while trade organizations often seek change through more direct lobbying efforts on behalf of their constituencies (<xref ref-type="bibr" rid="B22">Kuzma 2013</xref>). Government representatives were engaged in biotechnology arenas related to policy-making, regulatory analysis, and risk assessment, within the topics of agriculture, food, health and the environment.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Participants in biotechnology innovation by sector.</p>
</caption>
<graphic xlink:href="fpos-03-677003-g002.tif"/>
</fig>
<p>Participants were first identified from databases and listserves collated by the Genetic Engineering and Society (GES) Center at NC State and included professionals working in the Research Triangle Area. We used this group along with other collaborators and key contacts in a snowball sampling strategy to provide more names to expand our sampling frame. We also sought out website databases for non-governmental and governmental organizations in the region whose work relates to agricultural and environmental biotechnology as the existing database was lacking in these areas. The final sampling frame including over 700 professionals. Participants for this study were first emailed by a research team member to introduce the project and outline the opportunity for participation as well and review their rights as participants following university IRB guidelines (Exempt, NC State IRB Protocol Approval &#x23;6157). A second email was sent to those who did not respond and targeted phone calls were made to fill stakeholder groups that were underrepresented in previous invitation phases. The final sample included 109 completed responses. Each participant was offered a $50 dollar gift certificate for their time although some participants accepted less money or none at all in accordance with their agency rules. All processes of this study followed the IRB agreement as exempted by the host university.</p>
<p>
<xref ref-type="table" rid="T1">Table&#x20;1</xref> reports the demographic composition of the&#x20;participant groups. Age ranged from 21 to 70&#xa0;years old (M&#x20;&#x3d; 50.23, SD &#x3d; 11.76) and professionals held a mean length of experience in their profession of 15.65&#x20;years (SD &#x3d; 10.73). 34% were female, 14% considered themselves non-white, 60% held doctoral degrees, and median household income ranged between $101,000 - $125,000. <xref ref-type="fig" rid="F2">Figure&#x20;2</xref> below also reports the sectors in which this group works. 100% of participants completed the agreed upon study and there was no apparent need for attention filter questions.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Descriptive statistics for variables.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="left">
<italic>Descriptive Statistics of Independent and Dependent Variables</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Independent variables</td>
<td align="left"/>
</tr>
<tr>
<td align="left">&#x2003;Age</td>
<td align="char" char=".">M &#x3d; 50.23; SD &#x3d; 11.76</td>
</tr>
<tr>
<td align="left">&#x2003;Gender</td>
<td align="center">34% female; 66% male</td>
</tr>
<tr>
<td align="left">&#x2003;Race</td>
<td align="center">14% non-white; 86% white or caucasian</td>
</tr>
<tr>
<td align="left">&#x2003;Education</td>
<td align="center">Median &#x201c;doctoral degree&#x201d;</td>
</tr>
<tr>
<td align="left">&#x2003;Annual income</td>
<td align="center">Median &#x201c;$101,000&#x2014;$125,000 dollars per year&#x201d;</td>
</tr>
<tr>
<td align="left">&#x2003;Sector: Industry</td>
<td align="center">27% (N &#x3d; 30)</td>
</tr>
<tr>
<td align="left">&#x2003;Sector: Academia</td>
<td align="center">22% (N &#x3d; 25)</td>
</tr>
<tr>
<td align="left">&#x2003;Sector: Government</td>
<td align="center">18% (N &#x3d; 20)</td>
</tr>
<tr>
<td align="left">&#x2003;Sector: NGO&#x2014;advocacy</td>
<td align="center">15% (N &#x3d; 16)</td>
</tr>
<tr>
<td align="left">&#x2003;Sector: NGO&#x2014;trade association</td>
<td align="center">17% (N &#x3d; 19)</td>
</tr>
<tr>
<td align="left">&#x2003;Years of experience within sector</td>
<td align="char" char=".">M &#x3d; 15.65&#xa0;years; SD &#x3d; 10.73</td>
</tr>
<tr>
<td align="left">&#x2003;Core values: Egalitarianism</td>
<td align="char" char=".">M &#x3d; 4.26, SD &#x3d; 1.36; Cronbach&#x2019;s &#x3b1; &#x3d; 0.78</td>
</tr>
<tr>
<td align="left">&#x2003;Core values: Fatalism</td>
<td align="char" char=".">M &#x3d; 3.15, SD &#x3d; 1.22; Cronbach&#x2019;s &#x3b1; &#x3d; 0.82</td>
</tr>
<tr>
<td align="left">&#x2003;Core values: Hierarchy</td>
<td align="char" char=".">M &#x3d; 3.06, SD &#x3d; 1.16; Cronbach&#x2019;s &#x3b1; &#x3d; 0.73</td>
</tr>
<tr>
<td align="left">&#x2003;Core values: Individualism</td>
<td align="char" char=".">M &#x3d; 3.43, SD &#x3d; 1.12; Cronbach&#x2019;s &#x3b1; &#x3d; 0.63</td>
</tr>
<tr>
<td align="left">Dependent variables</td>
<td align="left"/>
</tr>
<tr>
<td align="left">&#x2003;Responsible innovation policy core belief strength</td>
<td align="char" char=".">M &#x3d; 5.53; SD &#x3d; 0.92; Cronbach&#x2019;s &#x3b1; &#x3d; 0.69</td>
</tr>
<tr>
<td align="left">&#x2003;Responsible innovation secondary beliefs</td>
<td align="char" char=".">M &#x3d; 4.89, SD &#x3d; 1.26, Cronbach&#x2019;s &#x3b1; &#x3d; 0.77</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2-2">
<title>Data Collection</title>
<p>In order to assess our research question, data were collected using a pretested survey questionnaire (see <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>). Survey questions were designed based on predominant elements of RRI (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>) and the application of cultural theory to test ACF deep core beliefs (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>) as described above (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). The survey was administered online using the Qualtrics platform. Participants were asked to complete the questionnaire which included the items reported on in this analysis (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). The survey also elicited responses to open-ended qualitative questions relating to RRI, which we do not report in this paper. These qualitative results are being prepared for additional analyses.</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Survey questions to probe three tiers of ACF beliefs.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Deep core beliefs</th>
<th rowspan="3" align="left"/>
<th align="center">Policy core beliefs (principles)</th>
<th align="center">Secondary beliefs (practices)</th>
</tr>
<tr>
<th align="left">
<italic>12 questions (3 each)</italic>
</th>
<th align="center">
<italic>four questions (combined into one composite variable for RRI policy core beliefs)</italic>
</th>
<th align="center">
<italic>four questions (combined into one composite variable for RRI secondary beliefs)</italic>
</th>
</tr>
<tr>
<th align="left">
<italic>1&#x2013;7 Likert scale</italic>
</th>
<th align="center">
<italic>1&#x2013;7 Likert scale</italic>
</th>
<th align="center">
<italic>1&#x2013;7 Likert scale</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Hierarchical</td>
<td align="left">Inclusion</td>
<td align="left">Maximizing public participation leads to better biotechnology policy.</td>
<td align="left">Innovators should consult with consumers and advocacy groups during R and D in biotech.</td>
</tr>
<tr>
<td align="left">Individualistic</td>
<td align="left">Reflexivity</td>
<td align="left">Reflecting on the underlying purposes, motivations, and uncertainties that surround biotechnology products is important.</td>
<td align="left">Social scientists, environmental and health risk analysis and ethicists should be involved from the early stages of biotech innovation.</td>
</tr>
<tr>
<td align="left">Fatalistic</td>
<td align="left">Anticipation</td>
<td align="left">Considering potential environmental and social implications of biotechnology products is important in the planning stages of research.</td>
<td align="left">There should be a standard of at least 10% of public funding for research in biotechnology that goes to environmental, social, legal, and ethical implications research.</td>
</tr>
<tr>
<td align="left">Egalitarian</td>
<td align="left">Responsiveness</td>
<td align="left">The innovation process should respond to changes in public attitudes or values.</td>
<td align="left">The innovation process should respond to changes in public attitudes or values even if this means delaying, modifying or terminating the project.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>See text (Methods) for survey questions to assess Deep core beliefs according to <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al. (2014)</xref> using cultural theory archetypes Hierarchical, Individualistic, Fatalistic, or Egalitarian.</p>
</fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="s2-3">
<title>Independent Variables</title>
<p>Independent variables tested are listed in <xref ref-type="table" rid="T1">Table&#x20;1</xref>. Demographic independent variables (IVs) include age, gender, and race (white/non-white). Sociographic IVs included on the survey and tested were education and income. Professional sector variables tested were sector affiliation (Trade, Government, Advocacy, Academe, and Industry) within the biotechnology innovation system and years of experience.</p>
<p>ACF deep core beliefs were measured based on cultural theory and the previously reported and tested scale (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>) (<xref ref-type="table" rid="T2">Table&#x20;2</xref>; <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>). This independent variable represents the personal and cultural-value orientation held by individuals. We used deep core beliefs (aka cultural worldview) as an independent variable to see whether they predicted RRI attitudes&#x2014;either towards general RRI principles (policy core beliefs) or suggested RRI practices (secondary beliefs) (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). We also subsequently assess if deep core beliefs align with certain United&#x20;States stakeholder groups. ACF posits that deep core beliefs are important for tight policy coalitions and are the least malleable. Given the contentiousness of the agricultural biotechnology domain and our previous findings of differences in stakeholder attitudes towards RRI (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>), we expected to observe differences in deep core beliefs among stakeholder groups and that they would strongly influence attitudes towards&#x20;RRI.</p>
<p>Four distinct deep core value-orientations were measured based on <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al. (2014)</xref>: <italic>egalitarianism, fatalism, individualism</italic> and <italic>hierarchy</italic> (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>). Note that the questions that <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al. (2014)</xref> and we use do not directly measure group and grid dimensions from cultural theory (<xref ref-type="bibr" rid="B5">Douglas 1970</xref>; <xref ref-type="bibr" rid="B6">Douglas and Wildavsky 1982</xref>) but rather use twelve questions to place people into these four cultural types. We measured the four worldviews by asking respondents to identify their level of agreement with three 7-point Likert-scale items (1 &#x3d; &#x201c;strongly disagree,&#x201d; 7&#x20;&#x3d; &#x201c;strongly agree&#x201d;). These were subsequently transformed into composite measures as below:<list list-type="simple">
<list-item>
<p>&#x2022; <italic>Egalitarianism</italic> is the philosophical perspective which emphasizes equality and equal treatment of all people regardless of, religion, economic status, or political belief. People in this worldview seek strong group identities but prefer minimal prescriptions imposed from outside the group (high group, low grid). Consequently, they see value in more collective decision-making. The measures used to create this composite measure were: 1) What society needs is a fairness revolution to make the distribution of goods more equal, 2) Society works best if power is shared equally, and 3) It is our responsibility to reduce the differences in income between the rich and the poor (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). The three items were averaged to create a single composite measure of egalitarianism where a higher score indicated stronger identification of this philosophical belief (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; M &#x3d; 4.26, SD &#x3d; 1.36; Cronbach&#x2019;s &#x3b1;&#x3d;&#x20;0.78).</p>
</list-item>
<list-item>
<p>&#x2022; <italic>Fatalism</italic> is the perspective that people are powerless to influence the future or the consequences of their own actions and that events are determined by fate. People in this group seem themselves as subject to binding external constraints, yet they feel excluded from membership in important social groups (low group, high grid). As a result, they see little control over their lives and that one&#x2019;s fate is much more a matter of chance than choice. Similar to egalitarianism, we measured this variable asking respondents to identify their agreement with three items: 1) The most important things that take place in life happen by chance, 2) No matter how hard we try, the course of our lives is largely determined by the forces beyond our control, and 3) For the most part, succeeding in life is a matter of chance (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). From these three questions, we created a composite variable (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; M &#x3d; 3.15, SD &#x3d; 1.22; Cronbach&#x2019;s &#x3b1; &#x3d; 0.82) where higher scores indicate stronger fatalistic beliefs.</p>
</list-item>
<list-item>
<p>&#x2022; The third grouping of cultural worldviews, <italic>hierarchical</italic>, (high group, high grid) reflects high group attachments and binding external prescriptions. Accordingly, they place weight on the welfare of the group yet are keenly aware of whether other individuals are members of their own group. They prefer that organizations and relationships be stratified according to externally defined rules. Hierarchy was similarly measured with three items: 1) The best way to get ahead in life is to work hard and do what you are told to do, 2) Society is in trouble because people do not obey those in authority, and 3) Society would be much better off if we imposed strict and swift punishment on those who break the rules (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>), and from these three, a composite variable was created (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; M &#x3d; 3.06, SD &#x3d; 1.16; Cronbach&#x2019;s &#x3b1; &#x3d;&#x20;0.73).</p>
</list-item>
<list-item>
<p>&#x2022; <italic>Individualism</italic> is the philosophical belief that advocates for independence and freedom to promote one&#x2019;s goals and desires over the needs of the group or society. Individualists tend to attach little weight to group affiliation and reject externally defined prescriptions (low group, low grid). We measured individualism with three items: 1) Even if some people are at a disadvantage, it is best for society to let people succeed or fail on their own, 2) Even the disadvantaged should have to make their own way in the world, and 3) We are all better off when we compete as individuals (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>), and also created a composite variable for subsequent use (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; M &#x3d; 3.43, SD &#x3d; 1.12; Cronbach&#x2019;s &#x3b1; &#x3d;&#x20;0.63).</p>
</list-item>
</list>
</p>
</sec>
<sec id="s2-4">
<title>Dependent Variables</title>
<p>For policy core beliefs and secondary beliefs about RRI, we developed, tested, and administered our own survey questions (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>; <xref ref-type="table" rid="T2">Table&#x20;2</xref>). Our policy core beliefs questions are based on the general principles of RRI (inclusion, anticipation, responsivity, and reflexivity) from <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref>, as they apply to biotechnology innovation as the policy subsystem (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>) (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). For secondary beliefs, we designed questions to implement RRI principles according to ideas from <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref>. These represent specific policy practices that could be taken in biotechnology innovation to implement RRI (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). The survey questions in<xref ref-type="table" rid="T2">Table&#x20;2</xref> were pre-tested and used in a prior peer-reviewed study that investigated United&#x20;States biotechnology stakeholder attitudes towards the four tenets of RRI (policy core beliefs) and ways to implement them (secondary beliefs) (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>).</p>
<p>Responses to the four questions of RRI policy-core beliefs or to the four questions of RRI secondary beliefs (<xref ref-type="table" rid="T2">Table&#x20;2</xref>) were compiled into two separate composite scores, and then each composite score was used as the dependent variable to examine whether demographic, sociographic, and professional factors, or deep-core beliefs from cultural theory (independent variables&#x2014;<xref ref-type="table" rid="T1">Table&#x20;1</xref>) influenced attitudes about RRI principles or practices (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). <italic>Responsible Innovation Policy-Core Belief Strength</italic> was measured using a composite from the four items (<xref ref-type="table" rid="T2">Table&#x20;2</xref>) (each item on 7-point Likert scale). These items were averaged to form the composite index, with higher scores indicating more agreement with the tenets of responsible&#x20;innovation (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; M &#x3d; 5.53, SD &#x3d; 0.92, Cronbach&#x2019;s &#x3b1; &#x3d; 0.69). <italic>Responsible Innovation secondary beliefs</italic> were similarly measured using four items on 7-point Likert scales (<xref ref-type="table" rid="T1">Table I</xref>). A composite index was created from these items where higher score indicates more agreement with the secondary belief statements (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; M &#x3d; 4.89, SD &#x3d; 1.26, Cronbach&#x2019;s &#x3b1; &#x3d;&#x20;0.77).</p>
<p>We utilized ordinary least squares (OLS) hierarchical regression modeling, ANOVA, and Chi-squared analysis in SPSS software to test our research questions and explore relationships among the independent and dependent variables as discussed in the Results (<italic>Results</italic>).</p>
</sec>
<sec id="s2-5">
<title>Study Limitations</title>
<p>Our study is limited in the number of participants (<italic>n</italic>&#x20;&#x3d; 110) and their geographical location as we sampled from stakeholders in United&#x20;States biotechnology innovation located in the Research Triangle NC area (as discussed above in <italic>Recruitment and Survey Participants</italic>). Our study is also limited in the design of the survey questions (<xref ref-type="table" rid="T2">Table&#x20;2</xref>; <italic>Dependent Variables</italic>). All studies are limited by the choice and number of survey questions, and our study is no exception. When we designed the survey for RRI principles and practices (in 2016), to our knowledge, there were no survey instruments for assessing agreement with RRI in the literature. We focused on <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> in our survey design as it is the most highly cited paper when one searches for &#x201c;responsible innovation&#x201d; in Google Scholar. Specifically, we drew our questions from <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> textual descriptions of the four elements&#x2014;anticipation, reflexivity, inclusion, and responsiveness--for the RI principle statements (aka policy core beliefs; <xref ref-type="table" rid="T2">Table&#x20;2</xref>) and from their &#x201c;Indicative techniques and approaches&#x201d; (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>, p. 1573) for the questions about secondary beliefs or practices (<xref ref-type="table" rid="T2">Table&#x20;2</xref>). We made particular choices for both sets of questions based on our understanding of the RRI literature and experience with the field of science and technology policy and RRI (see also <xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref> for discussion of this limitation). However, across the eight total RRI questions (<xref ref-type="table" rid="T2">Table&#x20;2</xref>), we feel the set captures the spirit and expression of RRI as articulated in <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref>.</p>
<p>Regardless, other choices could have been made for the survey questions. Thus, our results are constrained by the use of <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al. (2013)</xref> to derive the principle questions and by our desire to use a reasonable set of questions for implementing RI. We mitigated this limitation by combining four questions into one construct for each dependent variable (8 questions total&#x2014;4 for policy core beliefs or principles of RRI and four for secondary beliefs or practices of RRI; <xref ref-type="table" rid="T2">Table&#x20;2</xref>). We believe this to be a reasonable set for our novel, quantitative exploration of attitudes towards RRI and their relationships to demographic and cultural factors. In addition, the two 4-question constructs are the same ones used as dependent variables for testing all relationships with the independent variables of demographics, sociographics, affiliations and cultural (core) beliefs, so the comparative results about factors that influence RRI attitudes within this exploratory study are&#x20;valid.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec id="s3-1">
<title>Regression Model for Factors That Influence RRI Beliefs</title>
<p>To investigate our research questions, we conducted two hierarchical ordinary least squares regression models. Specifically, we asked what demographic, sociographic, professional, and cultural-worldview (deep core beliefs from ACF) factors best explain the variance of observed stakeholder&#x2019;s RRI 1) policy-core beliefs and 2) secondary beliefs? For the regression models, variables were entered into the model according to their assumed causal order by separate blocks and according to our research questions. Control variables (demographic variables) were included in the first block, whereas the second and third blocks were comprised of sociographic variables (educational level, household income) and professional variables (including sector affiliation and length of professional experience). The final fourth block incorporates deep core beliefs from ACF and cultural theory (<xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). As the <xref ref-type="bibr" rid="B12">IBM SPPS guide (2009)</xref> notes, this form of regression modeling adds these blocks in order to statistically control for the other variables, allowing researchers to evaluate the variables in concert with one another to note if &#x201c;adding variables significantly improves a model&#x2019;s ability to predict the criterion variable and/or to investigate a moderating effect of a variable.&#x201d;</p>
<p>In <xref ref-type="table" rid="T3">Table&#x20;3</xref> below, Model 1 pertains to responsible innovation policy-core beliefs (RRI principles) while Model 2 provides comparison among the same factors with regards to secondary beliefs (RRI practices). The factors tested in Model 1 accounted for 29.6% of the variance in RRI principle beliefs (policy core beliefs), whereas those factors tested in Model 2 explained over 43% of the variance in RRI practice beliefs (secondary beliefs) <xref ref-type="table" rid="T3">(Table&#x20;3</xref>).</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>Quantitative regression model for predicting RRI policy core and secondary beliefs.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="left"/>
<th colspan="2" align="center">
<italic>Model 1: RRI policy core beliefs as dependent variable</italic>
<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</th>
<th colspan="2" align="center">
<italic>Model 2: RRI secondary beliefs as dependent variable</italic>
<xref ref-type="table-fn" rid="Tfn2">
<sup>b</sup>
</xref>
</th>
</tr>
<tr>
<th align="left"/>
<th align="center">
<italic>Question</italic>
</th>
<th align="center">
<italic>Stand. &#x3b2; coeff.</italic>
</th>
<th align="center">
<italic>p-value, sig</italic>
</th>
<th align="center">
<italic>Stand. &#x3b2; coeff.</italic>
</th>
<th align="center">
<italic>p-value, sig</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">
<bold>Block 1: Demographics</bold>
</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left"/>
<td align="left">Age</td>
<td align="char" char=".">&#x2212;0.125</td>
<td align="char" char=".">
<italic>0.324</italic>
</td>
<td align="char" char=".">&#x2212;0.104</td>
<td align="char" char=".">
<italic>0.356</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Gender</td>
<td align="char" char=".">&#x2b;0.039</td>
<td align="char" char=".">
<italic>0.706</italic>
</td>
<td align="char" char=".">&#x2b;0.081</td>
<td align="char" char=".">
<italic>0.378</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">White/non-White</td>
<td align="char" char=".">&#x2212;0.155</td>
<td align="char" char=".">
<italic>0.103</italic>
</td>
<td align="char" char=".">&#x2212;0.020</td>
<td align="char" char=".">
<italic>0.813</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">
<bold>Incremental <italic>R</italic>
</bold>
<sup>
<bold>2</bold>
</sup> <bold>(%)</bold>
</td>
<td colspan="2" align="char" char=".">6.0%</td>
<td colspan="2" align="char" char=".">11.7%</td>
</tr>
<tr>
<td align="left">
<bold>Block 2: Sociographics</bold>
</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left"/>
<td align="left">Highest level of education</td>
<td align="char" char=".">&#x2b;0.165</td>
<td align="char" char=".">
<italic>0.141</italic>
</td>
<td align="char" char=".">&#x2212;0.026</td>
<td align="char" char=".">
<italic>0.796</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Annual income</td>
<td align="char" char=".">&#x2212;0.039</td>
<td align="char" char=".">
<italic>0.703</italic>
</td>
<td align="char" char=".">&#x2b;0.033</td>
<td align="char" char=".">
<italic>0.716</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">
<bold>Incremental <italic>R</italic>
</bold>
<sup>
<bold>2</bold>
</sup> <bold>(%)</bold>
</td>
<td colspan="2" align="char" char=".">8.3%</td>
<td colspan="2" align="char" char=".">12.2%</td>
</tr>
<tr>
<td align="left">
<bold>Block 3: Profession-related</bold>
</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left">&#x2003;In what sector do you work?</td>
<td align="left">Industry</td>
<td align="char" char=".">&#x2212;0.676</td>
<td align="char" char=".">
<italic>0.120</italic>
</td>
<td align="char" char=".">&#x2212;0.798<xref ref-type="table-fn" rid="Tfn2">
<sup>b</sup>
</xref>
</td>
<td align="char" char=".">
<italic>0.041</italic>
<xref ref-type="table-fn" rid="Tfn2">
<sup>b</sup>
</xref>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Academia</td>
<td align="char" char=".">&#x2212;0.501</td>
<td align="char" char=".">
<italic>0.219</italic>
</td>
<td align="char" char=".">&#x2212;0.546</td>
<td align="char" char=".">
<italic>0.136</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Government</td>
<td align="char" char=".">&#x2212;0.379</td>
<td align="char" char=".">
<italic>0.333</italic>
</td>
<td align="char" char=".">&#x2212;0.440</td>
<td align="char" char=".">
<italic>0.210</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Advocacy</td>
<td align="char" char=".">&#x2212;0.213</td>
<td align="char" char=".">
<italic>0.542</italic>
</td>
<td align="char" char=".">&#x2212;0.329</td>
<td align="char" char=".">
<italic>0.294</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Trade</td>
<td align="char" char=".">&#x2212;0.451</td>
<td align="char" char=".">
<italic>0.232</italic>
</td>
<td align="char" char=".">&#x2212;0.662<xref ref-type="table-fn" rid="Tfn2">
<sup>b</sup>
</xref>
</td>
<td align="char" char=".">
<italic>0.050</italic>
<xref ref-type="table-fn" rid="Tfn2">
<sup>b</sup>
</xref>
</td>
</tr>
<tr>
<td align="left">&#x2003;Length worked in sector</td>
<td align="left">Years in sector</td>
<td align="char" char=".">&#x2b;0.223<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
<td align="char" char=".">
<italic>0.073</italic>
<xref ref-type="table-fn" rid="Tfn1">
<sup>a</sup>
</xref>
</td>
<td align="char" char=".">&#x2b;0.007</td>
<td align="char" char=".">
<italic>0.947</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">
<bold>Incremental <italic>R</italic>
</bold>
<sup>
<bold>2</bold>
</sup> <bold>(%)</bold>
</td>
<td colspan="2" align="char" char=".">18.7%</td>
<td colspan="2" align="char" char=".">29.8%</td>
</tr>
<tr>
<td align="left">
<bold>Block 4: Deep core beliefs</bold>
</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left"/>
<td align="left">Egalitarian</td>
<td align="char" char=".">&#x2b;0.321<xref ref-type="table-fn" rid="Tfn3">
<sup>c</sup>
</xref>
</td>
<td align="char" char=".">
<italic>0.006</italic>
<xref ref-type="table-fn" rid="Tfn3">
<sup>c</sup>
</xref>
</td>
<td align="char" char=".">&#x2b;0.360<xref ref-type="table-fn" rid="Tfn4">
<sup>d</sup>
</xref>
</td>
<td align="char" char=".">
<italic>0.001</italic>
<xref ref-type="table-fn" rid="Tfn4">
<sup>d</sup>
</xref>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Fatalist</td>
<td align="char" char=".">&#x2212;0.054</td>
<td align="char" char=".">
<italic>0.627</italic>
</td>
<td align="char" char=".">&#x2b;0.008</td>
<td align="char" char=".">
<italic>0.933</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Hierarchical</td>
<td align="char" char=".">&#x2212;0.090</td>
<td align="char" char=".">
<italic>0.472</italic>
</td>
<td align="char" char=".">&#x2212;0.067</td>
<td align="char" char=".">
<italic>0.552</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Individualistic</td>
<td align="char" char=".">&#x2212;0.079</td>
<td align="char" char=".">
<italic>0.535</italic>
</td>
<td align="char" char=".">&#x2212;0.084</td>
<td align="char" char=".">
<italic>0.461</italic>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">
<bold>Incremental <italic>R</italic>
</bold>
<sup>
<bold>2</bold>
</sup> <bold>(%)</bold>
</td>
<td colspan="2" align="char" char=".">29.6%</td>
<td colspan="2" align="char" char=".">43.5%</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="Tfn">
<p>Bolded text emphasizes the categories of the analyses.</p>
</fn>
<fn id="Tfn1">
<label>a</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.1.</p>
</fn>
<fn id="Tfn2">
<label>b</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.05.</p>
</fn>
<fn id="Tfn3">
<label>c</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.01.</p>
</fn>
<fn id="Tfn4">
<label>d</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.001.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>ACF theory would predict that deep core beliefs influence attitudes towards policy-core beliefs, (in our case RRI principles applied to biotech innovation), and secondary beliefs (in our case RRI practices applied to biotech innovation). In fact, as predicted, in our hierarchical regression models, deep core beliefs significantly influenced both RRI principles (Model 1) and practices (Model 2). However, only one of the four worldviews, egalitarian views, was strongly and positively associated with stronger agreement with RRI principles (policy-core beliefs) (&#xdf; &#x3d; 0.321, <italic>p</italic>&#x20;&#x3d; 0.006) and practices (secondary beliefs) (&#xdf; &#x3d; 0.360, <italic>p</italic>&#x20;&#x3d; 0.001) while the other three worldviews, fatalism, individualism, and hierarchy, did not display prominent effects on RRI principles or practices. We further evaluate and discuss the role of egalitarian views vs. the other worldviews in subsequent tests&#x20;below.</p>
<p>Professional sector-affiliation also showed significant correlation with attitudes towards RRI practices (secondary beliefs), although not with RRI principles (policy core beliefs). Participants affiliated with the biotech industry or industry-supportive trade organizations showed significantly lower agreement with the practices of RRI (secondary beliefs) <xref ref-type="table" rid="T3">(Table&#x20;3</xref>). Participants who work with trade organizations also held less favorable secondary beliefs and agreed less with RRI practices (&#xdf; <italic>&#x3d;&#x2212;0.662, p &#x3d;0.05</italic>). However, the negative effect was even more pronounced for participants working with biotech companies (&#xdf; <italic>&#x3d;&#x2212;0.798, p &#x3d; 0.041</italic>)<italic>.</italic>
</p>
<p>We also tested stakeholder group differences in RRI beliefs using ANOVA. ANOVA results confirmed the regression results, in that we did not find any significant differences among stakeholder groups regarding policy-core beliefs about RRI (RRI principles) (F &#x3d; 1.64, <italic>p</italic>&#x20;&#x3d; 0.169), but there were significant differences among stakeholder groups with regard to secondary beliefs about RRI (RRI practices) (F &#x3d; 6.39, <italic>p</italic>&#x20;&#x3c; 0.001). Industry and trade organizations held significantly more negative attitudes about RRI practices than government, academe, or advocacy groups according to ANOVA. The greatest magnitude difference was between advocacy and trade groups (mean difference &#x3d; <italic>&#x2212;</italic>1.36; <italic>p</italic>&#x20;&#x3c; 0.001) with the difference between advocacy and industry groups a close second (mean difference &#x3d; <italic>&#x2212;</italic>1.32; <italic>p</italic>&#x20;&#x3c; 0.0001). The lowest difference, yet still significant, was between academe and industry (mean difference &#x3d; <italic>&#x2212;</italic>0.83, <italic>p</italic>&#x20;&#x3c; 0.01). There were no significant differences between government, advocacy, and academic groups. These results are consistent with our prior results where a marked difference was found between two factions: industry &#x2b; trade groups vs. government &#x2b; advocacy groups, with academics affiliating with either faction depending on the specific facet of RRI (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>) (note: this previous work tested the four areas of RRI independently&#x2014;i.e.,&#x20;inclusion, anticipation, responsivity, and reflexivity&#x2014;and did not use a composite scale that combines all four like we do in this paper).</p>
<p>From the regression, we also found an association between years of professional experience and positive attitudes towards the principles of RRI (policy core beliefs) (&#xdf; <italic>&#x3d; &#x2b;0.223, p &#x3d;0.07</italic>)<italic>.</italic> However, this correlation was not significant for the practices of RRI (secondary beliefs).</p>
<p>In <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>, we present a visual model summarizing the regression results. In our model, the effect of sector affiliation on RRI secondary beliefs is about twice that of cultural beliefs (<italic>&#x2212;</italic>0.798 for industry and <italic>&#x2212;</italic>0.662 for trade, vs. &#x2b;0.369 for egalitarian) (<xref ref-type="fig" rid="F3">Figure&#x20;3</xref>). We then set out to examine the potential synergies between affiliation with biotech industry and deep core beliefs. Within industry-dominated sectors (industry or industry-supportive trade orgs), we wanted to investigate whether certain deep-core beliefs (i.e.,&#x20;non-egalitarian) could amplify negative RRI attitudes to explain these results. This would indicate both sectoral and cultural factors working together (i.e.,&#x20;not only what you belief, but also where you reside).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Regression Model for Influencers on Stakeholder Beliefs about RRI in Biotech Innovation. Regression Beta coefficients shown (see also <xref ref-type="table" rid="T3">Table&#x20;3</xref>) (<italic>p</italic>&#x20;&#x3c; 0.1&#x2a;, <italic>p</italic>&#x20;&#x3c; 0.05&#x2a;&#x2a;, <italic>p</italic>&#x20;&#x3c; 0.01&#x2a;&#x2a;&#x2a;, <italic>p</italic>&#x20;&#x3c; 0.001&#x2a;&#x2a;&#x2a;&#x2a;). Industry (company) &#x3d;&#x2212;0.798; Trade organization &#x3d;&#x2212;0.662. ACF predicts that deep core beliefs influence policy core and secondary beliefs, and that policy core beliefs influence secondary beliefs.</p>
</caption>
<graphic xlink:href="fpos-03-677003-g003.tif"/>
</fig>
</sec>
<sec id="s3-2">
<title>Relationship Between Stakeholder Groups and Cultural Beliefs</title>
<p>An association between a professional sector and certain cultural beliefs (deep core) could help to explain the strong effect on beliefs about RRI practices. If different stakeholder groups hold divergent deep-core beliefs, the ACF predicts that it would be more difficult to form stable policy coalitions transcending stakeholder groups (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). In the context of our work, coalitions of stakeholders from different sectors would be more difficult to form and maintain in order to implement RRI if those stakeholders held different cultural world views. To evaluate if different stakeholder groups hold distinct cultural beliefs, we first did descriptive statistics on deep core beliefs (cultural beliefs) by sector (<xref ref-type="table" rid="T4">Table&#x20;4</xref>; <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>). We added up survey responses for each participant from the three 1-7 Likert Scale questions for each cultural archetype (<xref ref-type="table" rid="T1">Table&#x20;1</xref>; Methods)&#x2014;Hierarchical (H), Individualistic (I), Egalitarian (E), Fatalist (F). We then averaged the results for each stakeholder group. The highest possible score would be 21 for each group average (all 7&#x2019;s for the three questions), with the lowest as 3 (all 1s for the three questions). Results are shown in <xref ref-type="table" rid="T4">Table&#x20;4</xref>; <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>. This enables us to evaluate the relationship between these independent variables and also answer if sector affiliation and deep-core beliefs work together to influence attitudes about RRI practices (secondary beliefs). Given the significant positive relationship between RRI attitudes and egalitarian beliefs and the significant negative relationship between RRI attitudes and industry or trade stakeholder-group affiliation, we wanted to see whether participants from industry and trade organizations scored lower in the egalitarian belief&#x20;scale.</p>
<table-wrap id="T4" position="float">
<label>TABLE 4</label>
<caption>
<p>Deep Core Values by Stakeholder Group--average&#x20;score.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">
<italic>Hierarchical</italic>
</th>
<th align="center">
<italic>Egalitarian</italic>
</th>
<th align="center">
<italic>Fatalistic</italic>
</th>
<th align="center">
<italic>Individualistic</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">
<italic>Industry</italic>
</td>
<td align="char" char=".">8.3 (3.8)</td>
<td align="char" char=".">11.7 (4.0)</td>
<td align="char" char=".">9.3 (4.0)</td>
<td align="char" char=".">9.7 (3.3)</td>
</tr>
<tr>
<td align="left">
<italic>Academe</italic>
</td>
<td align="char" char=".">9.5 (2.6)</td>
<td align="char" char=".">13.2 (3.3)</td>
<td align="char" char=".">9.8 (2.9)</td>
<td align="char" char=".">9.4 (2.6)</td>
</tr>
<tr>
<td align="left">
<italic>Government</italic>
</td>
<td align="char" char=".">9.1 (4.0)</td>
<td align="char" char=".">14.1 (4.5)</td>
<td align="char" char=".">9.2 (4.0)</td>
<td align="char" char=".">10.0 (3.6)</td>
</tr>
<tr>
<td align="left">
<italic>Advocacy</italic>
</td>
<td align="char" char=".">9.3 (3.2)</td>
<td align="char" char=".">13.8 (4.3)</td>
<td align="char" char=".">10.8 (3.8)</td>
<td align="char" char=".">10.8 (4.3)</td>
</tr>
<tr>
<td align="left">
<italic>Trade</italic>
</td>
<td align="char" char=".">10.2 (3.7)</td>
<td align="char" char=".">11.7 (4.2)</td>
<td align="char" char=".">8.6 (3.6)</td>
<td align="char" char=".">12.1 (2.8)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>Average (std dev) reported. Minimum possible score &#x3d; 3 and Maximum &#x3d; 21 given scale of 1&#x2013;7 for each of three questions in each cultural group (see <xref ref-type="table" rid="T1">Table&#x20;1</xref> and Methods).</p>
</fn>
</table-wrap-foot>
</table-wrap>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Sectors association with certain deep core beliefs.</p>
</caption>
<graphic xlink:href="fpos-03-677003-g004.tif"/>
</fig>
<p>Although all stakeholder groups scored relatively high on the egalitarian scale (all over 11 points), industry and trade&#x20;organizations had the two lowest scores (M &#x3d; 11.7 and M &#x3d; 11.7). The highest score for trade organizations was in the individualistic category of deep core beliefs (M &#x3d; 12.1). Individualists tend to hold free-market world views consistent with support of private industry and individual competition in innovation systems (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>), and the trade representatives came from groups supportive of biotech industry innovation. In contrast, advocacy and government groups held the strongest egalitarian views (<xref ref-type="table" rid="T4">Table&#x20;4</xref>; <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>) (M &#x3d; 13.8 and M &#x3d; 14.1 respectively). Thus, according to descriptive statistics, there appeared to be an association between stakeholder group and deep core beliefs that could explain the strong effect on RRI secondary beliefs (<xref ref-type="fig" rid="F3">Figure&#x20;3</xref>).</p>
<p>We then set out to see if these group differences in cultural world views (deep core beliefs) were statistically significant using Chi-squared analysis. However, we found no statistical differences among stakeholder groups despite the differences we observed in the descriptive statistics (<xref ref-type="fig" rid="F4">Figure&#x20;4</xref>; <xref ref-type="table" rid="T4">Table&#x20;4</xref>). This could likely be due to inadequate statistical power given the low cell size within the cross-tabulated grouping (e.g., <italic>n</italic>&#x20;&#x3d; 16&#x2013;30) (<xref ref-type="fig" rid="F2">Figure&#x20;2</xref>). Future work could be done with a higher number of participants in each stakeholder group to see if the lower egalitarianism scores we saw among our trade and industry groups is applicable in the wider United&#x20;States biotech innovation system.</p>
</sec>
<sec id="s3-3">
<title>Other Deep-Core Beliefs and RRI Attitudes</title>
<p>Next, we wanted to determine if other deep core beliefs (cultural beliefs) tended to be associated with attitudes towards RRI. Our regression model showed a strong correlation between egalitarian beliefs and positive attitudes towards RRI practices and principles. But what about the other cultural archetypes? They did not show significance in the regression model, but other variables could have masked their effect. To test if other archetypes of cultural or deep core beliefs relate to RRI attitudes, we split each participant into either a high or low score (relative to the mean) for each of the four cultural archetypes (H, E, I, F). We then conducted two-tailed independent Samples t-tests to determine if these groups differed in their attitudes towards policy core beliefs (RRI principles) or secondary beliefs (RRI practices). In other words, do individuals who are high or low on each cultural deep-core value scale hold distinct policy core or secondary beliefs?</p>
<p>For the policy core beliefs (RRI principles) we found significant relationships with deep-core beliefs for all the cultural archetypes except for fatalism (<xref ref-type="table" rid="T5">Table&#x20;5</xref>). For RRI secondary beliefs, we found significant relationships for all of the cultural archetypes (<xref ref-type="table" rid="T5">Table&#x20;5</xref>). Egalitarian beliefs continued to have a strong association with positive attitudes towards RRI principles and practices, as confirmed by the regression analysis (<xref ref-type="table" rid="T3">Table&#x20;3</xref>; <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>) and the sample <italic>t</italic>-test (<xref ref-type="table" rid="T5">Table&#x20;5</xref>). However, we were also able to uncover through the t-tests that fatalistic beliefs positively influenced beliefs about RRI practices (secondary beliefs) albeit to a lower extent. We were also able to uncover that hierarchical and individualistic beliefs had a statistically-significant negative influence on beliefs about both RRI practices (secondary beliefs) and principles (policy core beliefs) (<xref ref-type="table" rid="T5">Table&#x20;5</xref>). We note that this influence is stronger for individualistic world views than for hierarchical world&#x20;views.</p>
<table-wrap id="T5" position="float">
<label>TABLE 5</label>
<caption>
<p>Deep core beliefs influencing RRI Attitudes.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">RRI principles (policy core beliefs)</th>
<th align="left"/>
<th align="center">RRI practices (secondary beliefs)</th>
<th align="left"/>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left"/>
<td align="center">Mean difference</td>
<td align="center">Sig (2 tailed)</td>
<td align="center">Mean difference</td>
<td align="center">Sig (2 tailed)</td>
</tr>
<tr>
<td align="left">Egalitarian</td>
<td align="char" char=".">&#x2b;0.68<xref ref-type="table-fn" rid="Tfn5">
<sup>a</sup>
</xref>
</td>
<td align="char" char=".">0.000</td>
<td align="char" char=".">&#x2b;1.08<xref ref-type="table-fn" rid="Tfn5">
<sup>a</sup>
</xref>
</td>
<td align="char" char=".">0.000</td>
</tr>
<tr>
<td align="left">Fatalism</td>
<td align="char" char=".">&#x2b;0.25</td>
<td align="char" char=".">0.156</td>
<td align="char" char=".">&#x2b;0.48<xref ref-type="table-fn" rid="Tfn6">
<sup>b</sup>
</xref>
</td>
<td align="char" char=".">0.048</td>
</tr>
<tr>
<td align="left">Individualism</td>
<td align="char" char=".">&#x2212;0.47<xref ref-type="table-fn" rid="Tfn7">
<sup>c</sup>
</xref>
</td>
<td align="char" char=".">0.007</td>
<td align="char" char=".">&#x2212;0.75<xref ref-type="table-fn" rid="Tfn7">
<sup>c</sup>
</xref>
</td>
<td align="char" char=".">0.002</td>
</tr>
<tr>
<td align="left">Hierarchical</td>
<td align="char" char=".">&#x2212;0.31<xref ref-type="table-fn" rid="Tfn8">
<sup>d</sup>
</xref>
</td>
<td align="char" char=".">0.081</td>
<td align="char" char=".">&#x2212;0.50<xref ref-type="table-fn" rid="Tfn6">
<sup>b</sup>
</xref>
</td>
<td align="char" char=".">0.039</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="Tfn5">
<label>a</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.001.</p>
</fn>
<fn id="Tfn6">
<label>b</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.05.</p>
</fn>
<fn id="Tfn7">
<label>c</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.01.</p>
</fn>
<fn id="Tfn8">
<label>d</label>
<p>
<italic>p</italic>&#x20;&#x3c; 0.1.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>To summarize the results, we expand on our previous model from the regression alone (<xref ref-type="fig" rid="F3">Figure&#x20;3</xref>) to incorporate the descriptive statistics, ANOVA, and Sample <italic>t</italic>-test results (<xref ref-type="fig" rid="F5">Figure&#x20;5</xref>). We present <xref ref-type="fig" rid="F5">Figure&#x20;5</xref> as a hypothesis-generating exercise, recognizing that our limited study does not confirm these relationships. Larger numbers of stakeholders across wider geographic regions will be needed to do so. Nevertheless, we present novel findings of these empirical relationships that can provide insights into the formulation of attitudes towards RRI policies and practices in United&#x20;States biotechnology innovation systems. In closing, we now turn to a broader discussion of the model (<xref ref-type="fig" rid="F5">Figure&#x20;5</xref>) and its potential implications for building cross-stakeholder coalitions to advocate for and implement RRI principles and practices.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Proposed Model for Factors Influencing RRI Beliefs in Biotechnology Stakeholders. We present this model for further testing and hypothesis building. Plus sign near arrow denotes a positive correlation, minus denotes a negative correlation. Dashed arrows indicate relationships supported by descriptive statistics (between deep-core beliefs and sector affiliation) or ACF theory (between RRI principles and practices). Note that Industry had lower egalitarian views than the sectors to the left in the diagram, but did not have higher hierarchical and individualistic world views than those sectors (see <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>). &#x2a;Note also that fatalistic views were statistically significant for RRI secondary beliefs (RRI practices) at <italic>p</italic>&#x20;&#x3c; 0.05 and that the positive correlation was also found for RRI policy core beliefs (RRI principles) at <italic>p</italic>&#x20;&#x3d; 0.156 although this did not meet our significance criteria (see <xref ref-type="table" rid="T5">Table&#x20;5</xref>).</p>
</caption>
<graphic xlink:href="fpos-03-677003-g005.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>Our study focused on exploring demographic, sociographic, professional, and cultural factors (deep core beliefs) factors to help explain United&#x20;States biotechnology stakeholders&#x2019; attitudes to RRI. In summary, no demographic or sociographic factor was found to have a significant influence on RRI attitudes. However, professional factors of years of experience and affiliation (stakeholder group), as well as cultural or deep-core beliefs, were significant predictors of biotechnology stakeholder attitudes towards RRI. It is important to note that we used study-participants comprised of biotechnology professionals from the greater Raleigh-Durham-Chapel Hill area (Research Triangle, NC). Therefore, our study conclusions are limited to the United&#x20;States and this region. However, the Research Triangle provides a host of diverse biotechnology and bioscience organizations and is among the most active scientific and development regions in the United&#x20;States (<xref ref-type="bibr" rid="B34">Rose 2015</xref>).</p>
<p>First, we found that those with more years of experience tended to agree more with the principles of RRI. Although we do not know the underlying reasons for this correlation, one hypothesis for our observation is that early biotechnologists experienced public backlash to their work on GMOs (<xref ref-type="bibr" rid="B21">Kuzma 2016</xref>; <xref ref-type="bibr" rid="B20">Kuzma et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B23">Kuzma 2018</xref>), and seeing those conflicts, now want to do a better job of bringing the public into the discussion for this next generation of gene-editing (<xref ref-type="bibr" rid="B18">Kokotovich and Kuzma 2014</xref>; <xref ref-type="bibr" rid="B21">Kuzma 2016</xref>; <xref ref-type="bibr" rid="B20">Kuzma et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B23">Kuzma 2018</xref>). Thus, it makes sense that RRI principles like inclusion, anticipation, reflexivity and responsiveness seem to resonate with those who have more experience and lived through earlier biotechnology controversies.</p>
<p>Next, our study is the first to find through quantitative survey research that RRI attitudes, towards both principles and practices, are strongly influenced by deep-core, cultural beliefs. Cultural beliefs have been found to underpin attitudes towards other areas of technology and risk (<xref ref-type="bibr" rid="B6">Douglas and Wildavsky 1982</xref>; <xref ref-type="bibr" rid="B16">Jones and Song 2014</xref>; <xref ref-type="bibr" rid="B15">Johnson and Swedlow, 2020</xref>; <xref ref-type="bibr" rid="B17">Kiss et&#x20;al., 2020</xref>), but to our knowledge, we are the first to report this association in the context of beliefs towards RRI. (<xref ref-type="table" rid="T5">Table&#x20;5</xref>; <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>).</p>
<p>In some ways, the positive association between egalitarian beliefs and favorable RRI attitudes that we discovered is not surprising, given that several concepts of RRI originate from ideas about greater democratic participation in technological decision-making and precaution or humility towards potential technological risk (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>). Earlier studies find that people who hold egalitarian viewpoints are generally more concerned about technological and environmental risk (e.g., <xref ref-type="bibr" rid="B16">Jones and Song 2014</xref>; <xref ref-type="bibr" rid="B15">Johnson and Swedlow, 2020</xref>; <xref ref-type="bibr" rid="B17">Kiss et&#x20;al., 2020</xref>), and RRI embraces the principle of anticipating these risks during early phases of research and development. Egalitarian beliefs also include strong feelings of social cohesion and equality among group members, while they eschew authority and role differentiation between group members (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>). Therefore, egalitarian views resonate with RRI principles and practices of &#x201c;inclusion&#x201d; and &#x201c;responsivity,&#x201d; which strive for an opening-up of innovation systems to the voices and desires of diverse publics.</p>
<p>In contrast, we found that hierarchical deep-core beliefs had a negative influence on RRI attitudes (<xref ref-type="table" rid="T5">Table&#x20;5</xref>; <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>) and these results also make sense theoretically. For example, by definition, hierarchs favor defined roles prescribed by institutions and thus would tend to leave technological decision making to &#x201c;authorities&#x201d; or experts with knowledge--these beliefs seem incongruent with RRI&#x2019;s principles and practices related to public inclusion and responsivity in particular. We also saw a negative correlation between individualistic deep-core beliefs and RRI attitudes (<xref ref-type="table" rid="T5">Table&#x20;5</xref>; <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>). Individualists believe in free-marketplaces where people can compete squarely with others, without interference. Individualists may see inclusion or responsivity, and even anticipation or reflexivity, as slowing the pace of innovation or unduly influencing free-market competition. Along these lines, <xref ref-type="bibr" rid="B41">Van Oudheusden (2014)</xref> noted the tendency for RRI frameworks to favor social and ethical concerns above economic and free-market concerns. For example, incorporating practices of RRI, such as being responsive to public objections to a biotechnology product or stopping development of it, could prevent the advancement of societally beneficial applications. <xref ref-type="bibr" rid="B41">Van Oudheusden (2014)</xref> argued that RRI is not politically or culturally neutral, which is congruent with our results showing the strong association of deep-core (cultural) beliefs with attitudes towards RRI principles and practices.</p>
<p>Although the above findings make theoretical sense, we did not explicitly study underlying motivations as to <italic>why</italic> egalitarians tend to support RRI, or <italic>why</italic> other cultural groups tend to oppose it (hierarchs and individualists). For example, alternative explanations for the association between egalitarianism and favorable RRI attitudes could exist. Egalitarians might have motivations for supporting RRI that relate to a desire to slow innovation given their concerns about risk. For example, in our prior work, we found that biotech developers from industry and academe were concerned about RRI practices delaying innovation (e.g., through public participation or responsive practices), thus decreasing their ability to meet funder&#x2019;s timelines and reducing their competitiveness (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>). As egalitarians affiliate with groups often more critical of biotech products (e.g., NGO-advocacy groups), the stalling of innovation could be an underlying motivator for wanting RRI implemented. Future research could investigate the motivations of each cultural group in the context of RRI attitudes, perhaps through qualitative interviews, to better understand the relationships between cultural-groups, stakeholder-groups, and RRI attitudes that we uncovered in this&#x20;study.</p>
<p>To our knowledge this is also the first inquiry that uses ACF&#x2019;s three tiers of beliefs (deep-core, policy-core, and secondary beliefs) for exploring the potential for coalitions to form over policies and practices for RRI. For example, ACF posits that if different groups hold divergent deep-core or policy-core beliefs, it is more difficult for them to form stable policy coalitions, as coalitions work together to translate their beliefs into policy action and implementation (which are secondary beliefs) (<xref ref-type="bibr" rid="B14">Jenkins&#x2010;Smith et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B31">Ripberger et&#x20;al., 2014</xref>). We designed our survey of United&#x20;States biotechnology stakeholders and their RRI attitudes around the three-tier hierarchy of ACF beliefs. We also considered stakeholders&#x2019; affiliations in our analysis (i.e. industry, trade orgs, academe, government, advocacy groups). Our results showed two primary coalitions that form around secondary beliefs about RRI and deep-core beliefs (more on policy-core beliefs later). One coalition consisted of two stakeholder groups---trade organizations and industry groups. This coalition viewed RRI <italic>practices</italic> (secondary beliefs) less positively. The other coalition consisted of government and advocacy groups and viewed RRI practices more positively (<xref ref-type="table" rid="T3">Table&#x20;3</xref>; <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>; <xref ref-type="table" rid="T5">Table&#x20;5</xref>; <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>). Academics tended to fall somewhere in between (this was also found in our previous study when we surveyed the individual practices of the four elements of RRI--<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>). The coalition of trade-industry groups also tended to be slightly less egalitarian in cultural world views (deep core beliefs) than government, advocacy, or academic groups according to descriptive statistics (<xref ref-type="fig" rid="F4">Figure&#x20;4</xref>; <xref ref-type="table" rid="T4">Table&#x20;4</xref>). These two major coalitions disagree on RRI implementation in particular. Differences in deep core beliefs and secondary beliefs may work against the possibility that these two coalitions (trade-industry vs. government-advocacy) would form alliances to instill RRI in United&#x20;States biotechnology innovation systems.</p>
<p>It is important to note that the United&#x20;States biotechnology innovation system has historically been polarized along stakeholder-group lines similar to the ones we found from the ACF-belief analysis. Industry and trade organizations have been fighting to convince the public and advocacy groups that there are no special risks associated with biotech products (in comparison to conventional or non-biotech products), and therefore, there is no need for people to be concerned about biotechnology risks, labeling of biotech products, or whether regulatory assessments are conducted (<xref ref-type="bibr" rid="B23">Kuzma 2018</xref>). In turn, advocacy groups have been fighting for better risk assessments, more transparency, and broader public inclusion in decision-making about biotech products and innovation processes, while challenging government decisions in the courts (<xref ref-type="bibr" rid="B18">Kokotovich and Kuzma, 2014</xref>). These two major coalitions have battled for decades for the public&#x2019;s minds and hearts.</p>
<p>On the other hand, we did not find significant differences among United&#x20;States stakeholder groups with respect to policy-core beliefs, the middle tier of the ACF hierarchy (<xref ref-type="table" rid="T3">Table&#x20;3</xref>; <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>). That is, all stakeholder groups generally agreed on the principles of RRI (<xref ref-type="table" rid="T3">Table&#x20;3</xref>; <xref ref-type="fig" rid="F5">Figure&#x20;5</xref>). The two major coalitions we found seem to differ most with regard to deep-core and secondary beliefs (industry-trade vs. advocacy-government) but not RRI principles or policy-core beliefs. Some possibilities to explain these results come to&#x20;mind.</p>
<p>One might be that agreement with questions about RRI principles in <xref ref-type="table" rid="T2">Table&#x20;2</xref> arose because stakeholder groups or individuals (with potentially divergent deep-core beliefs) subscribe their own meanings to the RRI principles according to their own values or professional position. In other words, the RRI principles may be vague enough for people to interpret them to fit their own world-views. For example, the question for the RRI principle of &#x201c;inclusion&#x201d; (&#x201c;maximizing public participation&#x201d;) (<xref ref-type="table" rid="T2">Table&#x20;2</xref>) may be translated by biotechnology developers as unidirectional &#x201c;public education&#x201d; or traditional &#x201c;deficit model&#x201d; communication (<xref ref-type="bibr" rid="B38">Suldovsky 2016</xref>; see also <italic>Previous Work on Biotechnology and RRI</italic>), while social science scholars intend it as deeper public engagement in decision making and giving voice to various publics (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>). So, it follows when the RRI principles (policy-core beliefs) are translated into more specific RRI practices (secondary beliefs), the industry-trade org coalition cannot sign onto them, and differences in attitudes towards RRI practices are seen between industry-trade and advocacy-government coalitions.</p>
<p>From a more optimistic standpoint, our results indicate that at least historically opposed coalitions can agree on the general principles of RRI applied to biotechnology innovation. Thus, there may be hope for broader coalitions to come together and implement RRI in biotechnology innovation <italic>if suitable practices can be identified for doing so</italic>. Stakeholder coalitions may disagree on secondary values for RRI implementation as we articulated them in this study, but it is possible that other alternatives for RRI implementation could be formulated that would be acceptable across all coalitions and still adhere to the robust version of RRI principles (<xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>).</p>
<p>To assess the two possibilities, future studies should bring diverse United&#x20;States stakeholders together to further discuss their meanings of RRI principles (i.e.,&#x20;what are they reading into statements about RRI principles like the questions in <xref ref-type="table" rid="T2">Table&#x20;2</xref>) and articulate a broader range of potential practices for each RRI principle (i.e.,&#x20;what might be alternative practices to those proposed in <xref ref-type="table" rid="T2">Table&#x20;2</xref>). RRI practices that respect a range of cultural world views (H, I, E, F), not just egalitarian beliefs, should be considered. Translating or incentivizing RRI practices for hierarchs and individualists will be especially important given their reticence towards the socially equalizing aspects of RRI. This could be a strategy for engaging polarized coalitions in biotechnology innovation, those that may not share deep-core beliefs.</p>
<p>The significant institutional barriers to implementation will also need to be considered, although they are perhaps not completely separable from barriers due to cultural beliefs. Our previous work (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>) and the work of other scholars (see <italic>Previous Work on Biotechnology and RRI</italic>) identified barriers to RRI implementation as competition and pressures to move quickly with biotech R&#x26;D in light of funding deadlines, needs to publish first, and to gain scarce private investments. Recent work by <xref ref-type="bibr" rid="B43">Wittrock et&#x20;al. (2021)</xref> also found &#x201c;tensions between excellence criteria, premised on maximizing grants and publications on the one hand, and making room for adherence to RRI aspects on the other.&#x201d; (p ix). They also theorize that &#x201c;the RRI model does not fit well with the US&#x2019;s sociotechnical imaginary&#x201d; of the United&#x20;States science and technology innovation system which focuses more on governance by market mechanisms (p. 101). Other scholars note that RRI resistance among researchers and innovators is in part due to their feelings that the public does not have the requisite expertise or knowledge and may have irrational fears (<xref ref-type="bibr" rid="B27">Marris et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B38">Suldovsky 2016</xref>; <xref ref-type="bibr" rid="B10">Hartley et&#x20;al., 2017</xref>).</p>
<p>These previously identified barriers have relationships to our findings about cultural world-views and RRI resistance. For example, those that hold stronger hierarchical views see governance as most-appropriate by top-down expertise and this view relates to deficit-model thinking as a barrier to RRI. Those that hold stronger individualistic cultural beliefs see governance by the free-market as most appropriate, and this view relates to competition for funding and resources as a barrier to RRI. In summation, cultural beliefs color attitudes towards RRI principles and practices, and also point to both attitudinal and institutional barriers.</p>
<p>In conclusion, we present the model in <xref ref-type="fig" rid="F5">Figure&#x20;5</xref> as hypothesis testing, not confirming, and for future testing. Again, our study was limited in the numbers and geographies of participants in biotechnology innovation, and more statistical studies are needed to determine if United&#x20;States stakeholder groups really do hold different deep-core beliefs which the ACF would predict to be prohibitive of stable cross-sector coalition formation around RRI. The ACF also hypothesizes that cross-coalition learning and engagement is more likely to occur where discussions focus on secondary beliefs or policy implementation rather than on differences in core beliefs (<xref ref-type="bibr" rid="B42">Weible et&#x20;al., 2009</xref>). Although knowledge of deep-core beliefs is important for predicting long-term coalition formation, it is not as important for temporary associations of coalitions for particular short-term purposes (aka &#x201c;policy flings&#x201d; from <xref ref-type="bibr" rid="B24">Lawton and Rudd 2013</xref>). Perhaps focusing cross-sector dialogues on RRI implementation (while keeping in mind that there are differences in deep core beliefs) is a better strategy for bringing different biotechnology coalitions together to practice RRI within innovation systems. Future studies may also further the robustness of quantitative work on attitudes towards RRI practices. There is an opportunity to develop and validate a scale which measures RRI practices with greater comprehensiveness and granularity than the composite scale for RRI practices used in this study (<xref ref-type="table" rid="T2">Table&#x20;2</xref>; see <italic>Study Limitations</italic>). Surveys with a more expansive set of questions about RRI practices that are administered to a larger, and more diverse set of respondents from a variety of geographic locations, stakeholder affiliations, and science and technology arenas could replicate or expand our findings to build a more significant corpus of theoretical work in this&#x20;area.</p>
<p>Regardless, it will be a challenge to devise suitable RRI practices that 1) remain true to social science RRI principles (ala <xref ref-type="bibr" rid="B37">Stilgoe et&#x20;al., 2013</xref>); 2) consider institutional barriers that innovators face (<xref ref-type="bibr" rid="B33">Roberts et&#x20;al., 2020</xref>); and 3) respect different deep-core beliefs. Yet, we remain optimistic for RRI implementation given industry desires to better include the public in dialogue about newer gene-editing methods (<xref ref-type="bibr" rid="B20">Kuzma et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B3">Center for Food Integrity, 2020</xref>), and in light of our findings that historical opponents in the biotechnology policy subsystem agree on the broad principles associated with RRI. Given that the emerging oversight system for gene-edited products in food, agriculture and the environment is lacking in public transparency and engagement in key ways (<xref ref-type="bibr" rid="B23">Kuzma 2018</xref>; <xref ref-type="bibr" rid="B13">Jaffe 2019</xref>; <xref ref-type="bibr" rid="B19">Kuzma and Grieger 2020</xref>), it will be important for United&#x20;States biotech stakeholders to work across sectors and collaboratively construct principles and practices to be more inclusive and responsive to diverse publics and consumers in order to foster legitimacy and potentially trust. Understanding the perceptions and beliefs towards RRI across stakeholder and cultural groups is a step forward for collaborative governance, along with efforts to overcome some of the attitudinal and institutional barriers as important subsequent&#x20;steps.</p>
</sec>
</body>
<back>
<sec id="s5">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by NC State University Institutional Review Board. The patients/participants provided their written informed consent to participate in this&#x20;study.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>JK contributed to conception and design of the study and the collection of the data. CC contributed to the conduct of the statistical analyses. JK and CC interpreted the results. JK wrote the first draft of the manuscript. JK and CC wrote sections of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.</p>
</sec>
<sec id="s7">
<title>Funding</title>
<p>The research in this paper was supported by United&#x20;States National Science Foundation grant 1540244. NSF provided funds to conduct the survey work. Open Access publication fees are provided by NC State University to&#x20;JK.</p>
</sec>
<sec sec-type="COI-statement" id="s8">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<ack>
<p>The authors also appreciate the reviewers for their helpful comments. This study was reviewed by the IRB at NC State and conducted under Protocol &#x23;6157 and determined to be Exempt.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Carrier</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gartzlaff</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Responsible Research and Innovation: Hopes and Fears in the Scientific Community in Europe</article-title>. <source>J.&#x20;Responsible Innovation</source> <volume>7</volume> (<issue>2</issue>), <fpage>149</fpage>&#x2013;<lpage>169</lpage>. <pub-id pub-id-type="doi">10.1080/23299460.2019.1692571</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Carro-Ripalda</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Macnaghten</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2015</year>). &#x201c;<article-title>Global Lessons for Agricultural Sustainability from GM Crops</article-title>,&#x201d; in <source>Analyses - Africa&#xb4;s Futures: Can Biosciences Contribute?</source> Editors <person-group person-group-type="editor">
<name>
<surname>Mitton,</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Bennet</surname>
<given-names>D.</given-names>
</name>
</person-group> (<publisher-name>Cambridge: B4FA</publisher-name>), <fpage>21</fpage>&#x2013;<lpage>29</lpage>. </citation>
</ref>
<ref id="B3">
<citation citation-type="web">
<collab>Center for Food Integrity</collab> (<year>2020</year>). <article-title>Coalition for Responsible Gene Editing</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://geneediting.foodintegrity.org/">https://geneediting.foodintegrity.org/</ext-link>
</comment> (<comment>Accessed October 25, 2020)</comment>. </citation>
</ref>
<ref id="B4">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Doezema</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Guston</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>RRI-practice Report from National Case Study: United&#x20;States, D12.1/ WP12</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.rri-practice.eu/wp-content/uploads/2018/09/RRI-Practice_National_Case_Study_Report_USA.pdf">https://www.rri-practice.eu/wp-content/uploads/2018/09/RRI-Practice_National_Case_Study_Report_USA.pdf</ext-link> (Accessed March 6, 2021)</comment>. </citation>
</ref>
<ref id="B5">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Douglas</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>1970</year>). <source>Natural Symbols: Explorations in Cosmology</source>. <publisher-loc>London</publisher-loc>: <publisher-name>Barrie &#x26; Rockliff</publisher-name>.</citation>
</ref>
<ref id="B6">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Douglas</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Wildavsky</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>1982</year>). <source>Risk and Culture: An Essay on the Selection of Technological and Environmental Dangers</source>. <publisher-loc>Berkeley</publisher-loc>: <publisher-name>University of California Press</publisher-name>.</citation>
</ref>
<ref id="B7">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Felt</surname>
<given-names>U.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>Responsible Research and Innovation</article-title>,&#x201d; in <source>Handbook of Genomics, Health and Society</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Gibbon</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Prainsack</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Hilgartner</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Lamoreaux</surname>
<given-names>J.</given-names>
</name>
</person-group> (<publisher-loc>London/New York</publisher-loc>: <publisher-name>Routledge</publisher-name>). </citation>
</ref>
<ref id="B8">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Fisher</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Schuurbiers</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Socio-technical Integration Research: Collaborative Inquiry at the Midstream of Research and Development</article-title>,&#x201d; in <source>Early Engagement and New Technologies</source> (<publisher-loc>Dordrecht</publisher-loc>: <publisher-name>Opening Up The Laboratory Springer</publisher-name>), <fpage>97</fpage>&#x2013;<lpage>110</lpage>. <pub-id pub-id-type="doi">10.1007/978-94-007-7844-3_5</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Glerup</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Davies</surname>
<given-names>S. R.</given-names>
</name>
<name>
<surname>Horst</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Nothing Really Responsible Goes on Here</article-title>&#x27;<article-title>: Scientists</article-title>&#x27;<article-title> Experience and Practice of Responsibility</article-title>. <source>J.&#x20;Responsible Innovation</source> <volume>4</volume> (<issue>3</issue>), <fpage>319</fpage>&#x2013;<lpage>336</lpage>. <pub-id pub-id-type="doi">10.1080/23299460.2017.1378462</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hartley</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Pearce</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Taylor</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Against the Tide of Depoliticisation: The Politics of Research Governance</article-title>. <source>Policy Polit.</source> <volume>45</volume> (<issue>3</issue>), <fpage>361</fpage>&#x2013;<lpage>377</lpage>. <pub-id pub-id-type="doi">10.1332/030557316x14681503832036</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="web">
<collab>Hartman Group</collab> (<year>2018</year>). <article-title>Organic and Natural Foods Report Survey</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://store.hartman-group.com/content/organic-and-natural-2018-study-overview.pdf">http://store.hartman-group.com/content/organic-and-natural-2018-study-overview.pdf</ext-link> (Accessed March 5, 2021)</comment>. </citation>
</ref>
<ref id="B12">
<citation citation-type="web">
<collab>IBM SPSS</collab> (<year>2009</year>). <article-title>How-to Guide for IBM&#xae; SPSS&#xae; Statistics Software</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://methods.sagepub.com/dataset/howtoguide/hierarchical-linear-regression-prison-inmates#:%7E:text=A%20hierarchical%20linear%20regression%20is,improves%20a%20model's%20ability%20to">https://methods.sagepub.com/dataset/howtoguide/hierarchical-linear-regression-prison-inmates&#x23;:&#x223c;:text&#x3d;A%20hierarchical%20linear%20regression%20is,improves%20a%20model&#x27;s%20ability%20to</ext-link> (Accessed April 21, 2021)</comment>. </citation>
</ref>
<ref id="B13">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Jaffe</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Biotech Blog: The Final National Bioengineered Food Disclosure Standard</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://cspinet.org/news/biotech-blog-final-national-bioengineered-food-disclosure-standard">https://cspinet.org/news/biotech-blog-final-national-bioengineered-food-disclosure-standard</ext-link> (Accessed March 6, 2021)</comment>. </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jenkins&#x2010;Smith</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Silva</surname>
<given-names>C. L.</given-names>
</name>
<name>
<surname>Gupta</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Ripberger</surname>
<given-names>J.&#x20;T.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Belief System Continuity and Change in Policy Advocacy Coalitions: Using Cultural Theory to Specify Belief Systems, Coalitions, and Sources of Change</article-title>. <source>Pol. Stud. J.</source> <volume>42</volume> (<issue>4</issue>), <fpage>484</fpage>&#x2013;<lpage>508</lpage>. <pub-id pub-id-type="doi">10.1111/psj.12071</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Johnson</surname>
<given-names>B. B.</given-names>
</name>
<name>
<surname>Swedlow</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Comparing Cultural Theory and Cultural Cognition Theory Survey Measures to Each Other and as Explanations for Judged Risk</article-title>. <source>J.&#x20;Risk Res.</source> <volume>23</volume> (<issue>10</issue>), <fpage>1278</fpage>&#x2013;<lpage>1300</lpage>. <pub-id pub-id-type="doi">10.1080/13669877.2019.1646310</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jones</surname>
<given-names>M. D.</given-names>
</name>
<name>
<surname>Song</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Making Sense of Climate Change: How story Frames Shape Cognition</article-title>. <source>Polit. Psychol.</source> <volume>35</volume> (<issue>4</issue>), <fpage>447</fpage>&#x2013;<lpage>476</lpage>. <pub-id pub-id-type="doi">10.1111/pops.12057</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kiss</surname>
<given-names>S. J.</given-names>
</name>
<name>
<surname>Montpetit</surname>
<given-names>&#xc9;.</given-names>
</name>
<name>
<surname>Lachapelle</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Beyond Regions and Ideology: Using Cultural Theory to Explain Risk Perception in Canada</article-title>. <source>Can. J.&#x20;Pol. Sci.</source> <volume>53</volume> (<issue>2</issue>), <fpage>439</fpage>&#x2013;<lpage>460</lpage>. <pub-id pub-id-type="doi">10.1017/s0008423920000177</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kokotovich</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Anticipatory Governance and Contested Futures: Insights from the Next Generation of Genetic Engineering</article-title>. <source>Bull. Sci. Technology Soc.</source> <volume>34</volume> (<issue>4</issue>), <fpage>108</fpage>&#x2013;<lpage>120</lpage>. <pub-id pub-id-type="doi">10.1177/0270467614565695</pub-id> </citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Grieger</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Community-led Governance for Gene-Edited Crops</article-title>. <source>Science</source> <volume>370</volume> (<issue>6519</issue>), <fpage>916</fpage>&#x2013;<lpage>918</lpage>. <pub-id pub-id-type="doi">10.1126/science.abd1512</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kokotovich</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Kuzhabekova</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Attitudes towards Governance of Gene Editing</article-title>. <source>Asian Biotechnol. Development Rev.</source> <volume>18</volume> (<issue>1</issue>), <fpage>69</fpage>&#x2013;<lpage>92</lpage>. <comment>117028657</comment> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Policy: Reboot the Debate on Genetic Engineering</article-title>. <source>Nature</source> <volume>531</volume>, <fpage>165</fpage>&#x2013;<lpage>167</lpage>. <pub-id pub-id-type="doi">10.1038/531165a</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Properly Paced?</article-title>,&#x201d; in <source>Examining the Past and Present Governance of GMOs in the United&#x20;States</source>&#x201d; <source>in Innovative Governance Models for Emerging Technologies</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Marchant</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Abbott</surname>
<given-names>K. W.</given-names>
</name>
<name>
<surname>Allenby</surname>
<given-names>B.</given-names>
</name>
</person-group> (<publisher-loc>Cheltenham, UK</publisher-loc>: <publisher-name>Edward Elgar</publisher-name>), <fpage>176</fpage>&#x2013;<lpage>197</lpage>. </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Regulating Gene Edited Crops</article-title>. <source>Issues Sci. Technology</source> <volume>35</volume> (<issue>1</issue>), <fpage>80</fpage>&#x2013;<lpage>85</lpage>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://issues.org/regulating-gene-edited-crops/.">https://issues.org/regulating-gene-edited-crops/.</ext-link>
</comment>
</citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lawton</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Rudd</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Strange Bedfellows: Ecosystem Services, Conservation Science, and central Government in the United&#x20;Kingdom</article-title>. <source>Resources</source> <volume>2</volume> (<issue>2</issue>), <fpage>114</fpage>&#x2013;<lpage>127</lpage>. <pub-id pub-id-type="doi">10.3390/resources2020114</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Macnaghten</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Responsible Innovation and the Reshaping of Existing Technological Trajectories: the Hard Case of Genetically Modified Crops</article-title>. <source>J.&#x20;Responsible Innovation</source> <volume>3</volume>, <fpage>282</fpage>&#x2013;<lpage>289</lpage>. <pub-id pub-id-type="doi">10.1080/23299460.2016.1255700</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Malcolm</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2016</year>). <source>Non-GMO Demand Growing Despite Report that Says GMOs Are Safe</source>. <publisher-name>USA TODAY</publisher-name>. <comment>May 18</comment>.</citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Marris</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>The Construction of Imaginaries of the Public as a Threat to Synthetic Biology</article-title>. <source>Sci. as Cult.</source> <volume>24</volume>, <fpage>83</fpage>&#x2013;<lpage>98</lpage>. <pub-id pub-id-type="doi">10.1080/09505431.2014.986320</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mielby</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Sand&#xf8;e</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Lassen</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Multiple Aspects of Unnaturalness: Are Cisgenic Crops Perceived as Being More Natural and More Acceptable Than Transgenic Crops?</article-title> <source>Agric. Hum. values</source> <volume>30</volume> (<issue>3</issue>), <fpage>471</fpage>&#x2013;<lpage>480</lpage>. <pub-id pub-id-type="doi">10.1080/09505431.2014.986320</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Owen</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Macnaghten</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Stilgoe</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Responsible Research and Innovation: From Science in Society to Science for Society, with Society</article-title>. <source>Sci. Public Pol.</source> <volume>39</volume> (<issue>6</issue>), <fpage>751</fpage>&#x2013;<lpage>760</lpage>. <pub-id pub-id-type="doi">10.1093/scipol/scs093</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Owen</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Stilgoe</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Macnaghten</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Gorman</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Fisher</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Guston</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>A Framework for Responsible Innovation</article-title>,&#x201d; in <source>Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Owen</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Bessant</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Heintz</surname>
<given-names>M.</given-names>
</name>
</person-group> (<publisher-loc>London</publisher-loc>: <publisher-name>John Wiley &#x26; Sons</publisher-name>), <fpage>27</fpage>&#x2013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1002/9781118551424.ch2</pub-id> </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ripberger</surname>
<given-names>J.&#x20;T.</given-names>
</name>
<name>
<surname>Gupta</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Silva</surname>
<given-names>C. L.</given-names>
</name>
<name>
<surname>Jenkins-Smith</surname>
<given-names>H. C.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Cultural Theory and the Measurement of Deep Core Beliefs within the Advocacy Coalition Framework</article-title>. <source>Policy Stud. J.</source> <volume>42</volume> (<issue>4</issue>), <fpage>509</fpage>&#x2013;<lpage>527</lpage>. <pub-id pub-id-type="doi">10.1111/psj.12074</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rivard</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Lehoux</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>When Desirability and Feasibility Go Hand in Hand: Innovators</article-title>&#x27; <article-title>Perspectives on what Is and Is Not Responsible Innovation in Health</article-title>. <source>J.&#x20;Responsible Innovation</source> <volume>7</volume> (<issue>1</issue>), <fpage>76</fpage>&#x2013;<lpage>95</lpage>. <pub-id pub-id-type="doi">10.1080/23299460.2019.1622952</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Roberts</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Herkert</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kuzma</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Responsible Innovation in Biotechnology: Stakeholder Attitudes and Implications for Research Policy</article-title>. <source>Elementa: Sci. Anthropocene</source> <volume>8</volume> (<issue>1</issue>), <fpage>47</fpage>. <pub-id pub-id-type="doi">10.1525/elementa.446</pub-id> </citation>
</ref>
<ref id="B34">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Rose</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Top 10 Best Cities for Life Science Jobs</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.biospace.com/article/top-10-best-cities-for-life-science-jobs-/">https://www.biospace.com/article/top-10-best-cities-for-life-science-jobs-/</ext-link> (Accessed March 6, 2021)</comment>. <pub-id pub-id-type="doi">10.1093/acrefore/9780199381135.013.1702</pub-id> </citation>
</ref>
<ref id="B35">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Sabatier</surname>
<given-names>P. A.</given-names>
</name>
<name>
<surname>Weible</surname>
<given-names>C. M.</given-names>
</name>
<name>
<surname>Sabatier</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2007</year>). &#x201c;<article-title>The Advocacy Coalition Framework: Innovations and Clarifications</article-title>,&#x201d; in <source>Theories of the Policy</source>. <edition>Process&#x2014;2nd edition</edition> (<publisher-loc>Boulder, CO</publisher-loc>: <publisher-name>Westview Press</publisher-name>), <fpage>189</fpage>&#x2013;<lpage>222</lpage>. </citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shew</surname>
<given-names>A. M.</given-names>
</name>
<name>
<surname>Nalley</surname>
<given-names>L. L.</given-names>
</name>
<name>
<surname>Snell</surname>
<given-names>H. A.</given-names>
</name>
<name>
<surname>Nayga</surname>
<given-names>R. M.</given-names>
<suffix>Jr</suffix>
</name>
<name>
<surname>Dixon</surname>
<given-names>B. L.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>CRISPR versus GMOs: Public Acceptance and Valuation</article-title>. <source>Glob. Food security</source> <volume>19</volume>, <fpage>71</fpage>&#x2013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1016/j.gfs.2018.10.005</pub-id> </citation>
</ref>
<ref id="B37">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stilgoe</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Owen</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Macnaghten</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Developing a Framework for Responsible Innovation</article-title>. <source>Res. Pol.</source> <volume>42</volume>, <fpage>1568</fpage>&#x2013;<lpage>1580</lpage>. <pub-id pub-id-type="doi">10.1016/j.respol.2013.05.008</pub-id> </citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Suldovsky</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>In Science Communication, Why Does the Idea of the Public Deficit Always Return? Exploring Key Influences</article-title>. <source>Public Underst Sci.</source> <volume>25</volume>, <fpage>415</fpage>&#x2013;<lpage>426</lpage>. <pub-id pub-id-type="doi">10.1177/0963662516629750</pub-id> </citation>
</ref>
<ref id="B39">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tait</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>From Responsible Research to Responsible Innovation: Challenges in Implementation</article-title>. <source>Eng. Biol.</source> <volume>1</volume> (<issue>1</issue>), <fpage>7</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1049/enb.2017.0010</pub-id> </citation>
</ref>
<ref id="B40">
<citation citation-type="journal">
<collab>USDA</collab> (<year>2020</year>). <article-title>Movement of Certain Genetically Engineered Organisms Department of Agriculture Animal and Plant Health Inspection Service, 7 CFR Parts 330, 340, and 372. Final Rule</article-title>. <source>Fed. Regist.</source> <volume>85</volume> (<issue>96</issue>), <fpage>29790</fpage>&#x2013;<lpage>29838</lpage>. </citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Van Oudheusden</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Where Are the Politics in Responsible Innovation? European Governance, Technology Assessments, and beyond</article-title>. <source>J.&#x20;Responsible Innovation</source> <volume>1</volume> (<issue>1</issue>), <fpage>67</fpage>&#x2013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1080/23299460.2014.882097</pub-id> </citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Weible</surname>
<given-names>C. M.</given-names>
</name>
<name>
<surname>Sabatier</surname>
<given-names>P. A.</given-names>
</name>
<name>
<surname>McQueen</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Themes and Variations: Taking Stock of the Advocacy Coalition Framework</article-title>. <source>Pol. Stud. J.</source> <volume>37</volume> (<issue>1</issue>), <fpage>121</fpage>&#x2013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1111/j.1541-0072.2008.00299.x</pub-id> </citation>
</ref>
<ref id="B43">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Wittrock</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Forsberg</surname>
<given-names>E. M.</given-names>
</name>
<name>
<surname>Pols</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Macnaghten</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Ludwig</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2021</year>). <source>Implementing Responsible Research and Innovation: Organisational and National Conditions</source>. <publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>. <pub-id pub-id-type="doi">10.1007/978-3-030-54286-3</pub-id> <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-030-54286-3">CrossRef Full&#x20;Text</ext-link>
</citation>
</ref>
</ref-list>
</back>
</article>