<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2017.00598</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Establishing the Research Agenda for Increasing the Representation of Women in Engineering and Computing</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Buse</surname> <given-names>Kathleen</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/170367/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Hill</surname> <given-names>Catherine</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/340192/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Benson</surname> <given-names>Kathleen</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/332223/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Design &#x0026; Innovation, Weatherhead School of Management, Case Western Reserve University, Cleveland</institution> <country>OH, USA</country></aff>
<aff id="aff2"><sup>2</sup><institution>Research Department, American Association of University Women, Washington</institution> <country>DC, USA</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: <italic>Margaret M. Hopkins, University of Toledo, USA</italic></p></fn>
<fn fn-type="edited-by"><p>Reviewed by: <italic>Donna K. Ginther, University of Kansas, USA; Alison Sheridan, University of New England, Australia</italic></p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x002A;Correspondence: <italic>Kathleen Buse, <email>krb50@case.edu</email></italic></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Organizational Psychology, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>19</day>
<month>04</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>8</volume>
<elocation-id>598</elocation-id>
<history>
<date date-type="received">
<day>14</day>
<month>12</month>
<year>2016</year>
</date>
<date date-type="accepted">
<day>31</day>
<month>03</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2017 Buse, Hill and Benson.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Buse, Hill and Benson</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>While there is an extensive body of research on gender equity in engineering and computing, there have been few efforts to glean insight from a dialog among experts. To encourage collaboration and to develop a shared vision of the future research agenda, a 2 day workshop of 50 scholars who work on the topic of gender in engineering and computing was held at a rural conference center. The structure of the conference and the location allowed for time to reflect, dialog, and to craft an innovative research agenda aimed at increasing the representation of women in engineering and computing. This paper has been written by the conference organizers and details the ideas and recommendations from the scholars. The result is an innovative, collaborative approach to future research that focuses on identifying effective interventions. The new approach includes the creation of partnerships with stakeholders including businesses, government agencies, non-profits and academic institutions to allow a broader voice in setting research priorities. Researchers recommend incorporating multiple disciplines and methodologies, while expanding the use of data analytics, merging and mining existing databases and creating new datasets. The future research agenda is detailed and includes studies focused on socio-cultural interventions particularly on career choice, within undergraduate and graduate programs, and for women in professional careers. The outcome is a vision for future research that can be shared with researchers, practitioners and other stakeholders that will lead to gender equity in the engineering and computing professions.</p>
</abstract>
<kwd-group>
<kwd>gender equality</kwd>
<kwd>women</kwd>
<kwd>engineering</kwd>
<kwd>computing</kwd>
</kwd-group>
<contract-num rid="cn001">1420214</contract-num>
<contract-sponsor id="cn001">National Science Foundation<named-content content-type="fundref-id">10.13039/100000001</named-content></contract-sponsor>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="43"/>
<page-count count="10"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec><title>Introduction</title>
<p>In 2015 women comprised 25% of computer scientists and 12% of engineers in the USA. This is at a time when women comprise 47% of the total labor force and 52% of managers and professionals. Women&#x2019;s representation in other demanding professions belie this underrepresentation in engineering and computing as women comprise 63% of auditors and accountants, 54% of business professionals, 38% of physicians and surgeons, and 35% of lawyers (<xref ref-type="bibr" rid="B41">US Bureau of Labor Statistics, 2015</xref>).</p>
<p>The topics of science, technology, engineering, and mathematics (STEM) and &#x201C;women in STEM&#x201D; continue to attract attention in the public discourse and in academia. Women&#x2019;s under-representation in these professions has inspired an influx of research over the past four decades, as summarized in recent reports (<xref ref-type="bibr" rid="B19">Hill et al., 2010</xref>; <xref ref-type="bibr" rid="B8">Corbett and Hill, 2015</xref>). Meta-analyses (<xref ref-type="bibr" rid="B22">Kanney et al., 2014</xref>) have identified trends in research, documenting what is known and what needs to be known about gender equity in engineering and computing. Although the problem is well documented, understanding how to overcome the obstacles to women&#x2019;s full participation in the technical workforce, particularly empirical research on effective interventions, remains a challenge.</p>
<p>The purpose of this paper is to present the ideas and recommendations from a gathering of researchers who worked to create a research agenda to increase the representation of women in engineering and computing. The conference was designed to encourage collaboration among researchers and to craft an innovative research agenda to accelerate the progress of women in engineering and computing. This paper has been written by the conference organizers using detailed notes and session transcripts. The authors intend for this paper to provide the context and the specifics for a concise, prioritized research agenda to be released by the American Association of University Women (AAUW) in the spring of 2017. Together, the paper and the research agenda provide a path forward for researchers and those who depend upon research to increase the numbers of women who pursue, thrive and excel in engineering and computing professions.</p>
<p>This paper begins by explaining the motivation and logistics behind the research conference followed by a high-level overview of the research and a discussion of effective evidence-based interventions. Next the researchers&#x2019; vision for a new collaborative approach to the work is described including: the creation of an oversight group; an intentional effort to impact the depth and breadth of research studies by using multiple disciplines, multiple methods and simultaneously studying multi-levels; leveraging data, merging and mining existing data sources, using data analytics to create knowledge and providing opportunities for researchers to convene on a regular basis. Finally, a description is provided of recommended research studies contextually categorized as societal and cultural influences, undergraduate and graduate programs, and the workplace. The outcome is a path forward for researchers, practitioners and other stakeholders that will lead to gender equity in the engineering and computing professions.</p>
</sec>
<sec><title>Background</title>
<p>An extensive literature review (<xref ref-type="bibr" rid="B8">Corbett and Hill, 2015</xref>) highlighted recent research that identifies the critical factors underlying the under-representation of women in engineering and computing. These factors include stereotypes and biases embedded in society, in college curriculum, and in the workplace. The agenda for the research conference was organized around these factors.</p>
<p>Leading researchers were selected to attend the conference through an application process. Those attending worked as professors and research scientists in fields that spanned engineering, computer science, education, psychology, sociology, gender studies, management, and public policy. Others worked as administrators in higher education or directors of non-profits. All had some connection with research focused on increasing gender equality in engineering and/or computer science, with many having NSF-funded research.</p>
<p>The conference was structured to include large group sessions and small group discussions. Informal gatherings and meals allowed for continued discussion and debate. The large group sessions reviewed logistics, provided overarching goals for the smaller sessions, and the opportunity for the facilitators of the small group to share and synthesize outcomes. The small group discussions were used to create a discourse among the researchers on what we know and what we need to know in three critical areas: (1) the impact of implicit gender bias and stereotype threat on individuals in the context of career choice, persistence in undergraduate and graduate programs, and in the workplace; (2) evidence-based interventions to increase women&#x2019;s representation in engineering and computing; and (3) creating a specific research agenda. All discussions focused on how research informed, and should inform, practice by employers, policy maker, and individuals.</p>
<p>Included in the body of knowledge of the factors impacting women&#x2019;s under-representation in engineering and computing are stereotypes, a cognitive shortcut that categorizes people on the basis of characteristics such as gender, race, or age. A bias is a semi-permanent belief based on repeated exposure to stereotypes (<xref ref-type="bibr" rid="B2">Banaji and Greenwald, 2013</xref>). A meta-analysis of gender and leader stereotypes found no evidence of decreased stereotyping over time (<xref ref-type="bibr" rid="B24">Koenig et al., 2011</xref>).</p>
<p>Both men and women show biases toward women in scientific roles (<xref ref-type="bibr" rid="B35">National Research Council, 2007</xref>; <xref ref-type="bibr" rid="B19">Hill et al., 2010</xref>; <xref ref-type="bibr" rid="B31">Moss-Racusin et al., 2012</xref>; <xref ref-type="bibr" rid="B8">Corbett and Hill, 2015</xref>). While overt bias is less common today than in the past, implicit biases remain common (<xref ref-type="bibr" rid="B2">Banaji and Greenwald, 2013</xref>). Implicit, or unconscious, bias occurs when a person consciously rejects stereotypes but unconsciously makes evaluations based on stereotypes. The social psychologists Mahzarin Banaji and Anthony Greenwald introduced the concept of implicit bias in 1995, building on earlier findings showing that individuals&#x2019; actions are not always under their conscious control. <xref ref-type="bibr" rid="B2">Banaji and Greenwald (2013)</xref> believe that implicit bias often expresses itself through in-group favoritism, which can be hard to detect. For example, despite finding no evidence of an explicit preference for male or female managers, researchers found that male participants implicitly associated positive managerial characteristics (i.e., competent, executive, productive) with men. The opposite was true for female participants, who associated women with positive managerial characteristics; however, this effect was much weaker.</p>
<p>Banaji and Greenwald continued to develop understanding of implicit biases including a methodology to reveal individual implicit biases (<xref ref-type="bibr" rid="B1">Banaji, 2001</xref>; <xref ref-type="bibr" rid="B2">Banaji and Greenwald, 2013</xref>). The Implicit Attitudes Test (IAT) is an empirically sound, popular and well-known tool. Faking bias or non-bias is almost impossible as response time is used (<xref ref-type="bibr" rid="B17">Greenwald et al., 1998</xref>; <xref ref-type="bibr" rid="B1">Banaji, 2001</xref>). The IAT is available to individuals through <ext-link ext-link-type="uri" xlink:href="http://implicit.harvard.edu">implicit.harvard.edu</ext-link>.</p>
<p>A concept related to implicit bias is a <italic>stereotype threat</italic>. This arises when individuals are negatively influenced due to a stereotype within a role or activity. Negative stereotypes affect individuals&#x2019; performance when they attempt difficult tasks in the domains in which they are negatively stereotyped (<xref ref-type="bibr" rid="B28">Logel et al., 2012</xref>). Stereotype threat can reduce working memory and, because of its relationship with stress, anxiety, and disengagement, can lead to a wide variety of negative outcomes.</p>
<sec><title>Bias and Career Choice</title>
<p>Both explicit and implicit bias impacts career choice for girls (<xref ref-type="bibr" rid="B27">Lent et al., 1994</xref>; <xref ref-type="bibr" rid="B9">Correll, 2001</xref>). Biases also impact self-esteem (<xref ref-type="bibr" rid="B16">Greenwald and Banaji, 1995</xref>), self-efficacy (<xref ref-type="bibr" rid="B30">Marra et al., 2009</xref>; <xref ref-type="bibr" rid="B6">Buse et al., 2013</xref>) and stereotype threat (<xref ref-type="bibr" rid="B37">Schmader, 2002</xref>). Career choice is impacted by parents, family members and teachers (<xref ref-type="bibr" rid="B26">Lent, 2005</xref>).</p>
<p>Media and social media are central to cultural stereotypes, bias, and social norms. Gender bias is pervasive in all forms of media, especially in entertainment. While this phenomenon is well documented, in general, less attention has been paid to women and girls in mathematically demanding fields such as engineering and computing. The depiction of women as professionals, particularly in movies and television is biased because it rarely represents today&#x2019;s reality. In a study of prime time television shows no women were portrayed as engineers (<xref ref-type="bibr" rid="B15">Geena Davis Institute on Gender in Media, 2014</xref>).</p>
<p>Women are more likely to be assigned &#x201C;supportive&#x201D; roles in engineering undergraduate teams as opposed to &#x201C;technical&#x201D; roles (<xref ref-type="bibr" rid="B25">Laughlin et al., 2007</xref>). Women undertaking challenging math problems do equally as well as men but think they have performed worse (<xref ref-type="bibr" rid="B12">Forbes and Schmader, 2010</xref>). The academic performance of women students in undergraduate science class is underestimated by their male peers (<xref ref-type="bibr" rid="B18">Grunspan et al., 2016</xref>). Faculty members, both men and women, show biases in favor of male students (<xref ref-type="bibr" rid="B31">Moss-Racusin et al., 2012</xref>). Students rate male professors higher than female professors. (<xref ref-type="bibr" rid="B29">MacNell et al., 2015</xref>), and bias impacts graduation rates and persistence in engineering and computing (<xref ref-type="bibr" rid="B9">Correll, 2001</xref>; <xref ref-type="bibr" rid="B6">Buse et al., 2013</xref>).</p>
</sec>
<sec><title>Evidence-based Interventions</title>
<p>The body of research on the underrepresentation of women in engineering and computing is substantial, yet little research has been done on effective, evidence-based interventions. One area where interventions have been effective has been in recruiting, retaining and graduating women from undergraduate programs. For example, Harvey Mudd College has reached gender parity in graduation rates in their schools of engineering and computing with an intentional, focused effort (<xref ref-type="bibr" rid="B23">Klawe, 2014</xref>) and Carnegie Mellon University has increased the number and percent of women with computer science degrees (<xref ref-type="bibr" rid="B14">Frieze et al., 2012</xref>). A large Midwest university has successfully changed the admission procedures to increase the number of women recruited to their school of engineering (<xref ref-type="bibr" rid="B20">Holloway et al., 2014</xref>). Best practices have been compiled by WEPAN (<xref ref-type="bibr" rid="B43">Women in Engineering ProActive Network, 2016</xref>) and NCWIT (<xref ref-type="bibr" rid="B34">National Center for Women and Information Technology, 2016</xref>). The ADVANCE program from National Science Foundation has worked to increase the number and percent of women faculty in science and engineering programs by focusing on institutional transformation (<xref ref-type="bibr" rid="B36">National Science Foundation, 2015</xref>).</p>
</sec>
</sec>
<sec><title>Discussion: Building Capacity to Accelerate the Research</title>
<p>Gender inequality has been described by researchers as a grand challenge (<xref ref-type="bibr" rid="B21">Joshi et al., 2015</xref>). Novel insights, innovation, and a broader community to conduct research are important facets of accelerating the rate of change in women&#x2019;s representation in engineering and computing. Impacting real world outcomes was a common focus across the discussions among scholars. A number of concrete ideas to build capacity in the research community were put forward including: (1) additional effort to impact the depth and breadth of research studies by using multiple disciplines and multiple methods; (2) leveraging data, merging and mining existing data sources, using data analytics to create knowledge; and (3) providing opportunities for researchers to convene on a regular basis.</p>
</sec>
<sec><title>Expanding the Depth and Breadth of Research</title>
<p>An oversight group of researchers and practitioners is recommended to lead the new approach to increasing women&#x2019;s representation in engineering and computing. The role of the oversight group is to establish priorities, track progress, develop process metrics and outcome measurement while encouraging practitioners and researchers to collaborate. Further, the oversight group could allocate funding and seek new sources of funding. A key responsibility of the group would be to raise consciousness of those in power to understand the bias and barriers limiting women&#x2019;s achievement in engineering and computing. Since those in power are mostly men, this would include more men in the discourse. The oversight group would develop an effective method to disseminate research into practice in ways that change society, organizations, workplaces, leaders and individual women.</p>
<p>Practice-oriented groups like SIGCS (special interest group on computer science education), WEPAN (Women in Engineering Programs and Advocates Network), SWE (Society of Women Engineers), NCWIT (National Center for Women and Information Technology), Anita Borg Institute, National Academy of Sciences, Engineering and Medicine Committee on Women in Science, Engineering and Medicine, IEEE Women in Engineering and others could be part of the oversight group.</p>
<p>Stakeholders who would benefit from an increased representation of women in the engineering and computing professions are also expected to be part of this group. These stakeholders include corporations, government agencies and other institutions employing those in the engineering and computing professions. Universities that offer engineering and computing degrees and employ faculty in these areas are also important stakeholders.</p>
<sec><title>Multi-disciplinary</title>
<p>An intentional effort to include multiple disciplines while simultaneously studying multi-levels using multiple methods is essential to accelerate the rate of achievement for women in engineering and computing. The depth and breadth of the research studies will be impacted by using multiple disciplines, multiple methods and simultaneously studying multi-levels.</p>
<p>Currently, the researchers addressing the under-representation are mostly women Ph.D.s in the fields of sociology, psychology, and management. To broaden the impact and the outcomes, the researchers recommend recruiting researchers from additional disciplines. In particular, more economists, engineers, computer scientists, feminist scholars, career scholars, organizational behavior and industrial psychologists are needed in the research studies. Additional researchers who are male would offer a different framework and their participation in this research is encouraged. The role of researchers from practice should be explored as these researchers have access to women who are working in the professions.</p>
</sec>
<sec><title>Multiple Methods</title>
<p>The researchers call for studies that utilize multiple types of research methods. An overall framework should be developed, possibly by the oversight group or a specially designated group. From this overall framework multiple theories, methods, and outcome measure could be developed. Types of studies deemed to be important include qualitative, quantitative, ethnographic, meta-analyses, longitudinal, and mixed methods. Employing multiple methods can augment and explain complex or contradictory results, and provide important information on emergent and unexpected themes (<xref ref-type="bibr" rid="B10">Driscoll et al., 2007</xref>).</p>
<p>Theoretically framed studies are important so as to build upon prior knowledge and expertise of researchers. More studies should be completed within the workplace so as to understand the complexities of the under-representation of women. Workplace experiences matter as well as context matter in moving the research agenda forward.</p>
<p>Studies of women and men in the workplace are especially needed&#x2014;studies that include hundreds of firms. Researchers should make contact often and create a longitudinal database. Existing data such as personnel records and performance review can aid understanding of workplace experiences. Social media, blogs, and Facebook and Twitter posts can be used to obtain data. Longitudinal and mixed methods studies are recommended.</p>
<p>It is important that the under-representation of women in engineering and computing be framed and discussed as a societal issue. Too often it has been labeled as a &#x201C;women&#x2019;s issue.&#x201D; The oversight group should emphasize and ensure that the societal impact of women&#x2019;s equality be emphasized. For example, the problem should be framed in terms of social justice and how the role of women in engineering and computing will impact the wage gap and other social issues related to gendered careers.</p>
<p>Consciousness raising and questioning decisions made by those in power are important but not enough to enable change. The researchers recognize that those in power don&#x2019;t always understand women&#x2019;s experience in the workplace.</p>
</sec>
</sec>
<sec><title>Data, Data Mining, and Data Analytics</title>
<p>The under-representation of women in engineering and computing, like any complex problem, can only be solved with a data-driven approach. The new approach to research in this area should use the latest techniques and tools to collect and analyze data. Data, data-based approaches, and data analysis are the foundation of science and technology. The National Academy of Engineering discusses the importance of data or informatics in higher quality and more effective medical care. &#x201C;As computers have become available for all aspects of human endeavors, there is now a consensus that a systematic approach to health informatics&#x2014;the acquisition, management, and use of information in health&#x2014;can greatly enhance the quality and efficiency of medical care and the response to widespread public health emergencies&#x201D; (<xref ref-type="bibr" rid="B33">National Academy of Engineering, 2016b</xref>). The researchers believe this to be true of the work to advance women in the engineering and computing professions. The integration of data and data analysis, especially the role of &#x201C;big data&#x201D; and &#x201C;data analytics&#x201D; is important according to the researchers to solve the under-representation of women in engineering and computing.</p>
<p>There are numerous national longitudinal surveys of students, doctoral recipients, etc., that are in the area of engineering and computer science (for example, the NSF survey earned doctorates available at<sup><xref ref-type="fn" rid="fn01">1</xref></sup>). These surveys are under-utilized because (1) researchers do not know they exist, and (2) they are difficult to access. The researchers recommend that an effort be undertaken to locate and assemble all sources of data on students and workers. The effort should include making the existing data easier to find and to use. For example, the Survey of Doctoral Recipients, funded by the National Science Foundation<sup><xref ref-type="fn" rid="fn02">2</xref></sup> captures detailed demographic data longitudinally; it has no measures of psychological well-being, no measures that might indicate the impacts of bias, nor any information on future career plans. The researchers recommend adding information related to the micro-processes related to bias, adding a qualitative component and developing a method to randomize participants. This would include identifying people in particular industries, geographic areas, or parents, etc.</p>
<p><italic>Neurosynth</italic> is a platform for large-scale, automated synthesis of functional magnetic resonance imaging (fMRI) data. It takes thousands of published articles reporting the results of fMRI studies, chews on them for a bit, and then spits out images. It is recommended that a website be developed that compiles the studies on women in engineering and CS, focusing on providing specific information on interventions that enable change.</p>
<p>Data can be compiled from colleges and universities, including, but not limited to admissions offices, registrars, and career services. This data could be available to study differences between men and women, those who persist versus those who leave engineering and CS. Also, alumni offices have data on jobs and organizations of alums.</p>
<p>Corporations collect data on employees, including job progression, training and performance evaluations. Merging the corporate data with other sources could provide a rich source of knowledge on when, how and why women achieve in the workplace.</p>
<p>Specifically, the researchers recommend using and merging existing data sources, leveraging corporate, institutional and governmental databases. A common set of measure and metrics to create knowledge and accelerate change should be created. Novel technologies should be investigated including the use of biometrics and team level data, with a focus on identifying best practices and replication. The scale up from experiments to practice is important along with validity in replicating studies. The use of data mining techniques to identify those times women or girls choose to opt out is important to identify as well as how course content and social media impact achievement. Another recommendation from the researchers is to combine sources of data with micro-factors with larger factors. For example, add psychometric factors to qualitative and quantitative databases. Include demographics, such as number of children that professionals support.</p>
</sec>
<sec><title>A Conference of Researchers and Practitioners</title>
<p>The last of the recommendations on changing the approach to research is to provide opportunities for researchers to convene on a regular basis to discuss the status of research, review recent discoveries and identify gaps in knowledge. At the conference, the researchers mentioned over and over again how this was the first time they were able to meet to collaborate with multiple researchers who shared the same research focus. Formal and informal interactions engaged and enlightened the researchers. Collaborations were formed and an agreement to stay in contact were made by many and were included in the comments in the post-conference survey.</p>
<p>The use of social media is recommended as another method to connect researchers. Communities could be established within Facebook or LinkedIn to connect researchers and have an ongoing discussion. Additionally, it could be useful for researchers to intentionally share presentations and status updates. Upcoming conferences and funding opportunities can also be shared.</p>
<p>Connections are necessary with government institutions, with corporations and other stakeholder organizations. Currently, there are limited opportunities for researchers to interact or conduct research within organizations where women are employed as engineers and computing professionals. One exception is women in academic engineering and computing. The ADVANCE program is credited with institutional transformations resulting in increases in the number and percent of women in STEM faculty across the US (<xref ref-type="bibr" rid="B36">National Science Foundation, 2015</xref>). Since 2001, the National Science Foundation has awarded more than 300 grants to 200 plus institutions.</p>
<p>Funding should be made available for researchers to attend practitioner conferences and practitioners to attend scholarly conferences. Providing many opportunities for practitioners and researchers to meet and discuss progress will allow interventions to happen organically. The oversight committee can aid in removing barriers to progress.</p>
</sec>
<sec><title>Recommendations for Specific Research Studies</title>
<p>This section provides a summary of the specific studies that the researchers recommend to increase women&#x2019;s representation in engineering and computing. These projects have been grouped into the following categories: (1) Societal and cultural influences on girls and women, (2) Measuring and overcoming implicit bias, (3) Factors influencing career choice in the K-12 environment, (4) Undergraduate and graduate studies, and (5) The workplace.</p>
</sec>
<sec><title>Societal and Cultural Influences on Girls and Women</title>
<p>Research is needed to determine interventions are most likely to increase the number of girls selecting engineering and computing professions. Broad-based studies have been suggested by the researchers. These studies must address the intersectionality of gender with other factors, including but not limited to economic status, race and ethnicity, sexual orientation, differently abled and others that may influence career decisions.</p>
<p>The researchers recommended building on current understanding of the emergence of gender roles and gender identity and how these influence career decisions related to engineering and computing. The influence of institutional and organizational factors are important to study, as are non-verbal forms of communication of the gender roles and gender identity. Further, work is recommended on when and how interventions can change current perceptions of gender roles and gender identity related to career choice. For example, studies can follow middle school girls involved in maker camps or coding camps. These types of experiences are proliferating, but longitudinal research studies are necessary to determine the impact on engineering or computing as a career choice.</p>
<p>The impact of government, institutional and organizational policies and the impact of rewards (e.g., to parents, to communities or institutions) are important areas to study. The researchers are interested in understanding the factors that allow some girls to overcome cultural biases and choose engineering and computing. An outcome of this research would include recommendations on how communities can overcome cultural stereotypes related to financial independence where boys are expected to have a career, girls are expected to be mothers.</p>
<p>Researchers recommend that a large-scale effort be coordinated to change the images of engineering and computing. The focus would be to show engineering and computing as inclusive cultures that are professions that change the world. Providing recurring, positive images of engineering and computing as collaborative professions, where women can change the world will change the stereotypes.</p>
<p>The first suggestion to change the stereotypes is to work with marketing and public relations professionals to determine how best to present positive images of a diverse engineering and computer workforce. Positive images of career women portrayed in the media have been credited with an increase in non-traditional career paths. For example, the character of Abby on the television show CSI has created the &#x201C;Abby Effect&#x201D; where more girls have chosen forensic science as a career path (<xref ref-type="bibr" rid="B3">Barry, 2012</xref>). The public relations work could include additional positive media representations, such as the &#x201C;Next MacGyver&#x201D; (<xref ref-type="bibr" rid="B40">The Next MacGyver, 2015</xref>). This project is intended to have a female engineer depict the 1980&#x2019;s character &#x201C;MacGyver,&#x201D; a creative inventor and problem solver.</p>
<p>Further, the researchers suggest broad depictions of people working in engineering and computing who are changing the world with their work. For example, Facebook engineers and computing professionals have created a tool where individuals can tell their family and friends they are safe during a disaster (<xref ref-type="bibr" rid="B11">Facebook, 2014</xref>). Pre-kindergarten through middle school children can be influenced by various media including games, social media, television, and movies. It is important to ensure that these media sources will provide positive role models for both girls and boys. Because research has shown that parents have the greatest influence on their children&#x2019;s career choice (<xref ref-type="bibr" rid="B26">Lent, 2005</xref>), campaigns targeted at young parents and even at expectant parents would aid in developing a positive and realistic image of engineering and computing as a future career path for any child, whether it be a boy or a girl.</p>
</sec>
<sec><title>Measuring and Overcoming Implicit Bias</title>
<p>A limited number of studies have shown that implicit bias exists toward women in science-related careers (<xref ref-type="bibr" rid="B31">Moss-Racusin et al., 2012</xref>) and this type of bias can be measured within individuals (<xref ref-type="bibr" rid="B1">Banaji, 2001</xref>). Researchers must continue to understand the impact of implicit bias on women in engineering and computing, but a shift is recommended toward understanding how to overcome these types of subtle bias. Specifically, studies are needed on how girls and women recognize and respond to implicit bias in ways that help overcome the bias.</p>
<p>Research projects that are recommended include understanding what can be done to change implicit bias within individuals and how to reduce the impact of other people&#x2019;s implicit bias on girls and women. Specific research questions related to measuring and overcoming implicit bias include the following. What is the best way for girls and women to respond to implicit bias? Can girls and women intervene to prevent implicit bias from impacting them? Is one intervention effective, or do multiple interventions results in significant change to last a lifetime? Do these interventions need to happen in intervals? Does awareness of one&#x2019;s biases decrease one&#x2019;s level of bias? Each of these research questions can only be answered with valid and reliable measurement systems. The researchers recommend leveraging the IAT and continue the development of measurement system to recognize and reduce the impact of implicit bias in individuals and in society.</p>
</sec>
<sec><title>Factors Influencing Career Choice in the K-12 Environment</title>
<p>Studies are recommended for understanding which types of programs within the Kindergarten through Grade 12 school environment are most likely to result in more girls choosing engineering and computing. Some research questions are detailed here: Do stand-alone programs work or is it necessary to have multiple experiences throughout the K-12 years? What is the impact of role models, specifically women role models who work in engineering and computing? How best can women in the professions impact students&#x2019; career choice? What types of interactions are important to show girls that careers are compatible with women&#x2019;s lives? How and when should family members have career discussions with children? Are role models who are family members more effective than non-family members? How important is the context of the role model? For example, are family members who are role models more effective than TV characters? When and how are female role models more impactful than male role models? Is the age of role models important to middle school girls?</p>
<p>Clearly identifying pathways to the engineering and computing professions are important research studies. What are the various pathways to success in engineering and computing professions? Are there different rates of success for these different pathways? What is the impact of community colleges and technical vocation programs in high schools? Do these programs lead more girls to choose non-traditional careers in the STEM professions? How do in-school programs targeted at career choice impact the choice of profession especially for girls? How can maker spaces in schools be used to effectively impact career choices related to engineering and computing?</p>
<p>Researchers should work to define age appropriate curriculum in engineering and computing for those in kindergarten through high school. It is recommended that this curriculum include cultural sensitivity, hands-on examples, real-life applications, measurements for learning, teacher and parent guides, and role models in the school. New curriculum should include awareness of how the engineering and computing professions make an impact. An example is the work of engineers and computer scientists in the space program, or in disease detection and prevention. Studies are recommended on how to train teachers to emphasize the connections between important societal problems and the professions of engineering and computing. For example, one of the Engineering Grand Challenges is to provide access to clean water for all people (<xref ref-type="bibr" rid="B32">National Academy of Engineering, 2016a</xref>). The impact of these ideas on all children should be studied, including any benefit in attracting a more diverse population to engineering and computing.</p>
<p>Qualitative, longitudinal studies are recommended for children beginning in kindergarten with the purpose of identifying factors that increase and decrease interest in engineering and computing and if it changes over time. It is recommended that researchers study the effect of when students are taking scientific classes and how it impacts career choice. For example, in the U.S., physics is usually taken in the senior year of high school. If moved to a lower grade, would it impact the number of women in engineering?</p>
<p>The integration of engineering and computing into grade schools and the impact on career decisions for both girls and boys is important to study. The researchers recommend longitudinal studies that compare the impact on career choice for integrating engineering and computing concepts into day-to-day coursework versus schools that have separate classes teaching making or coding concepts. Comparing schools which have no programming related to engineering and computing concepts would also provide valuable information on the impact of such a program on career choice for both girls and boys.</p>
<p>Studies are recommended on the work of code.org and Hour of Code and other programs promoting engineering and computer science so as to understand if these interventions are effective in increasing the number of girls who choose engineering or computing careers. The research questions include the following. What types of interventions are most likely to increase interest for girls? How long do the interventions need to be? How can these be integrated into additional schools and communities? What are the characteristics of those interventions that result in more girls choosing engineering and CS careers?</p>
<p>A final recommendation from the researchers is based on feminist studies which hypothesize that there is really no such thing as completely objective or unbiased work. But currently, science and math are taught in ways that are objective and fact-based. The subjectivity of concepts is minimized. The researchers recommend creating a research agenda that explores how objective and fact-based curriculum impacts the success of students, particularly girls and other under-represented minorities. The study should explore methodologies where scientific work is viewed in a more subjective manner. This could be done by engaging students in a discussion of the subjectivity within the sciences and math fields. For higher level courses in computer science and engineering, research is recommended where students are taught to think more about the objectivity and subjectivity in these fields. Will this type of study open minds to the different kinds of work that can be accomplished? And will it allow students to have more ownership over their own biases as part of the way of doing the work?</p>
</sec>
<sec><title>Undergraduate and Graduate Programs</title>
<p>While there is much known about the complexity of problems facing women in undergraduate and graduate programs, research offers few practical strategies to increase the recruitment, retention, and graduation of women in engineering and computing. Beginning with the recruitment process, the impact of recruitment mailings, advertisements, emails, etc., should be assessed. Campus tours, admissions processes and other aspects of recruiting should be studied to understand biases. Instituting common metrics across all programs can aid in developing an understanding of differences. Further studies should investigate how the use of outcome measurements could be used to change institutional policies.</p>
<p>Longitudinal studies are recommended for all students, both women and men, in undergraduate and graduate programs to understand retention leading to graduation. At this time, it is not well understood when and if specific classes, projects, team projects, student groups, faculty interactions, etc., impact persistence. The studies should focus on those specific programs, experiences, networks, methodologies, and other opportunities that influence women&#x2019;s persistence in academia. Additionally, research should address understanding the factors within undergraduate and graduate programs that are linked to continued achievement in the engineering and computing workplace. Understanding how these experiences and influences are the same or different from their male classmates is important to influence the under-representation of women.</p>
<p>It has been shown that having more women as professors helps women persist (<xref ref-type="bibr" rid="B23">Klawe, 2014</xref>) but we need to better understand how all professors can differentially develop skills to enable persistence for all students. Supporting relationships have been shown to allow all undergraduates to persist, understanding how these relationships could be leveraged to achieve better outcomes for women is an important research opportunity. These relationships should include professional women or other role models, mentors and sponsors.</p>
<p>Self-efficacy (<xref ref-type="bibr" rid="B4">Betz and Hackett, 1986</xref>) and professional role confidence (<xref ref-type="bibr" rid="B7">Cech et al., 2011</xref>) have been shown to impact career choice and persistence in undergraduate programs. Researchers should focus on how women develop these individual characteristics during the undergraduate experience. An important aspect of this research is to understand the impact of other factors, including race, ethnicity, sexual orientation, income, etc., on these individual characteristics.</p>
<p>A suggestion was made to begin a large-scale randomized controlled study across universities, for example in all of the Big 10 schools and in selected smaller schools. Universities would be willing to participate as this type of study will improve the student&#x2019;s experience which may eventually increase alumni donations. This large-scale study would focus on persistence across different educational experiences&#x2014;large universities, private, and community colleges. The study can incorporate geographical differences, campus differences (for example those that have an athletic focus vs. those that do not), tuition aid, traditional vs. non-traditional students, etc. Ideas for further development include rewarding women and minorities for taking engineering and computing programs. The reward could be an internship, promise of a job post-graduation, money, grants or other tangibles.</p>
</sec>
<sec><title>The Workplace</title>
<p>Because researchers have limited access to engineering and computing workplaces, studies on professionals working in engineering and computing careers are limited. The one exception is in the academic workplace where the ADVANCE program (<xref ref-type="bibr" rid="B36">National Science Foundation, 2015</xref>) has successfully increased the participation and advancement of women in academic science and engineering careers. Future research studies are suggested that focus on women in professional engineering and computing careers so as to understand what interventions are needed to recruit, retain and advance women in these professions. Having an oversight group of practitioners and scholars would facilitate the research within workplaces.</p>
<p>Prior work shows why women leave the engineering and computing professions (<xref ref-type="bibr" rid="B38">Singh et al., 2013</xref>; <xref ref-type="bibr" rid="B13">Fouad et al., 2015</xref>) and identifies factors related to women persisting in these careers (<xref ref-type="bibr" rid="B6">Buse et al., 2013</xref>; <xref ref-type="bibr" rid="B5">Buse and Bilimoria, 2014</xref>). Moving forward, the researchers recommend that studies focus on how to make workplaces free from bias, stereotypes, and micro-aggressions. Men and women should be trained to understand how bias, barriers, and micro-aggressions manifest themselves within workplaces. Research is needed on how to minimize and/or eliminate the bias, barriers, and micro-aggressions. For example, some companies are using &#x201C;blind&#x201D; recruitment processes, where names are taken off applications and resumes. Studies are needed to understand how longer term biases can be overcome. An understanding of backlash is needed where the backlash is an adverse response to bias training and/or promotional opportunities provided to women.</p>
<p>Sponsors and mentors have been shown to be effective in the retention and advancement of women in leadership (<xref ref-type="bibr" rid="B39">Singh et al., 2006</xref>). Researchers should understand the optimal types of sponsors and mentors for women in engineering and computing. Studies show that women are more likely to persist in engineering when they are engaged with their work and find meaningfulness with their career (<xref ref-type="bibr" rid="B5">Buse and Bilimoria, 2014</xref>). These factors can be used to attract and retain women to engineering and computing. Specific studies are suggested to understand if workforce diversity is increased when workplaces recruit based on a &#x201C;change the world&#x201D; strategy and if the work actually impacts the world positively. There is an opportunity by workplaces to ensure that the job itself is linked to a higher purpose, and researchers can aid practitioners in crafting a higher purpose within organizations.</p>
<p>Researchers should examine women&#x2019;s work and men&#x2019;s work within engineering and computing to determine how work is distributed and enacted so as to overcome recent studies that show women are more likely to work in supporting and less challenging roles and do the office housework (<xref ref-type="bibr" rid="B42">Williams and Dempsey, 2014</xref>). Some disciplines like biomedical engineering attract and retain more women than other disciplines like electrical engineering. Researchers are encouraged to explore the nuances involved in the professions to better understand these phenomena. Different disciplines within engineering and computing need to be studied and compared. Within engineering and computing there is much diversity, in the type of work, in the workplace itself (e.g., oil rigs vs. offices) in the specific industries (e.g., academia vs. industry vs. government), in organization size (e.g., Google vs. start-up) etc. Researchers are encouraged to understand these sub-fields and gender distribution within the subfields. The exploration of these differences is recommended so as to discover if there is a socio-technical divide. Work is recommended to show society how and when engineering and computing professions serve the higher good. The identification of organizations, industries, and sub-fields that serve the public can help engage more individuals within the professions.</p>
<p>The researchers suggest studies on the language of engineering and computing as some disciplines have a clear male-female dynamic within the language. For example, in the chemical industry hose fittings are described as male or female. The impact of language within professions and industries and how it impacts the retention and advancement of women in various engineering disciplines, and various computing disciplines should be studied.</p>
<p>Comparative studies are recommended between other professions such as medicine and law where women have greater representations. More studies are needed to understand the differences that men and women experience within the engineering and computing workplace. These studies should focus on the specific changes that organizations can implement to integrate women into the existing workplace while implementing longer term strategies to obtain gender equity.</p>
<p>Researchers should determine the types and frequency of educational initiatives for organizational leaders on bias, barriers, and stereotypes. Organizational leaders should work with experts in implementing structural changes to increase women&#x2019;s representation in engineering and computing. Institutional and governmental policies should be identified that can be used to impact women&#x2019;s achievement in the engineering and computing professions.</p>
<p>A comparative study is recommended where researchers identify two groups of organizations: ones that have had success in retaining and advancing women in engineering and computing and other organizations that are unable to retain women. Identify the type of work, the organizational policies and practices and other factors that differentiate the two. This may include the type of professional and leadership development for the managers, team structures, and work opportunities for the women, and differences between those in powerful positions.</p>
<p>Researchers should determine how work location, work hours, work schedules, and virtual work impacts the achievement of professional women. Longitudinal studies are necessary, especially those that include the work and home interface (e.g., the role of the husband in doing housework, childcare, etc.).</p>
<p>Work is needed to bring together firms employing engineers with undergrad programs to identify what is needed in the curriculum to achieve as an engineer or in computing. Time and effort should be expended to review and update courses and curriculum to reflect today&#x2019;s work environment. This can only be done with teams of men and women from practice working with those in academia.</p>
<p>Organizations can create survival guides for women in engineering and computing. Another suggestion from the researchers is to create a ranking system for good places for women engineers and computer professions. This would be similar to the US News and World Report rankings of the best colleges. And the last recommendation is to understand how counter-spaces or work groups of the same races or ethnicity impact women&#x2019;s achievement in professional engineering and computing.</p>
</sec>
<sec><title>Limitations</title>
<p>While the conference organizers attempted to include a range of disciplines studying the under-representation of women in engineering and computing, it is clear that several fields were missed. Not included were any feminist scholars or researchers from economics.</p>
<p>Another limitation of this report is that it only includes &#x201C;what to do&#x201D; not the &#x201C;how to do&#x201D; needed to enact the research agenda. The work of the conference organizers and the researchers moving forward is to find the opportunities to establish how to implement the many suggestions identified and documented here.</p>
</sec>
<sec><title>Conclusion</title>
<p>Researchers had a unique opportunity to gather and discuss their efforts to understand the factors impacting the under-representation of women in the engineering and computing professions. The researchers agreed that a new collaborative research approach is necessary to accelerate the rate of change in women&#x2019;s representation in these important professions. Recommendations for moving forward include the creation of an oversight committee comprised of researchers, practitioners and other stakeholders, developing a network including additional disciplines applying new technologies and multiple methods to leverage data and data analytics, and to provide continuing opportunities for collaboration among multi-sector and multi-discipline stakeholders to implement effective interventions.</p>
<p>Additionally, the researchers suggested a future research agenda focusing on socio-cultural influences, measurement and intervention strategies related to girls and women at all stages of the career choice process. The under-representation of women in engineering and computing should be viewed as a complex problem that can be overcome with a collaborative strategy, appropriate resources including funding and stakeholders working together to implement effective solutions.</p>
</sec>
<sec><title>Author Contributions</title>
<p>KBu is main author. CH and KBe wrote several sections.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> Funding for this project has been provided by the National Science Foundation, Research on Gender in Science and Engineering award 1420214.</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Banaji</surname> <given-names>M. R.</given-names></name></person-group> (<year>2001</year>). <article-title>&#x201C;Implicit attitudes can be measured,&#x201D; in</article-title> <source><italic>The Nature of Remembering: Essays in Honor of Robert G. Crowder</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Roediger</surname> <given-names>H. L.</given-names></name> <name><surname>Nairne</surname> <given-names>J. S.</given-names></name> <name><surname>Neath</surname> <given-names>I.</given-names></name> <name><surname>Surprenant</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>Washington, DC</publisher-loc>: <publisher-name>American Psychological Association</publisher-name>), <fpage>117</fpage>&#x2013;<lpage>150</lpage>.</citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Banaji</surname> <given-names>M. R.</given-names></name> <name><surname>Greenwald</surname> <given-names>A. G.</given-names></name></person-group> (<year>2013</year>). <source><italic>Blindspot: The Hidden Biases of Good People</italic>.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Random House</publisher-name>.</citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barry</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). <source><italic>Abby Sciuto Has Inspired a Whole Generation of Women to Dominate Forensic Science. Jezebel.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://jezebel.com/5932049/abby-sciuto-has-inspired-a-whole-generation-of-women-to-dominate-forensic-science">http://jezebel.com/5932049/abby-sciuto-has-inspired-a-whole-generation-of-women-to-dominate-forensic-science</ext-link></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Betz</surname> <given-names>N. E.</given-names></name> <name><surname>Hackett</surname> <given-names>G.</given-names></name></person-group> (<year>1986</year>). <article-title>Applications of self-efficacy theory to understanding career choice behavior.</article-title> <source><italic>J. Soc. Clin. Psychol.</italic></source> <volume>4</volume> <fpage>279</fpage>&#x2013;<lpage>289</lpage>. <pub-id pub-id-type="doi">10.1521/jscp.1986.4.3.279</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buse</surname> <given-names>K.</given-names></name> <name><surname>Bilimoria</surname> <given-names>D.</given-names></name></person-group> (<year>2014</year>). <article-title>Personal vision: enhancing work engagement and the retention of women in the engineering profession.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>5</volume>:<issue>1400</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2014.01400</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buse</surname> <given-names>K. R.</given-names></name> <name><surname>Bilimoria</surname> <given-names>D.</given-names></name> <name><surname>Perelli</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>Why they stay: women persisting in the US Engineering Careers.</article-title> <source><italic>Career Dev. Int.</italic></source> <volume>18</volume> <fpage>139</fpage>&#x2013;<lpage>154</lpage>. <pub-id pub-id-type="doi">10.1108/CDI-11-2012-0108</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cech</surname> <given-names>E.</given-names></name> <name><surname>Rubineau</surname> <given-names>B.</given-names></name> <name><surname>Seron</surname> <given-names>C.</given-names></name></person-group> (<year>2011</year>). <article-title>Professional role confidence and gendered persistence in engineering.</article-title> <source><italic>Am. Sociol. Rev.</italic></source> <volume>76</volume> <fpage>641</fpage>&#x2013;<lpage>666</lpage>. <pub-id pub-id-type="doi">10.1177/0003122411420815</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Corbett</surname> <given-names>C.</given-names></name> <name><surname>Hill</surname> <given-names>C.</given-names></name></person-group> (<year>2015</year>). <source><italic>Solving the Equation: The Variables for Women&#x2019;s Success in Engineering and Computing</italic>.</source> <publisher-loc>Washington DC</publisher-loc>: <publisher-name>AAUW</publisher-name>.</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Correll</surname> <given-names>S. J.</given-names></name></person-group> (<year>2001</year>). <article-title>Gender and the career choice process: the role of biased self-assessments.</article-title> <source><italic>Am. J. Sociol.</italic></source> <volume>106</volume> <fpage>1691</fpage>&#x2013;<lpage>1730</lpage>. <pub-id pub-id-type="doi">10.1086/321299</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Driscoll</surname> <given-names>D. L.</given-names></name> <name><surname>Appiah-Yeboah</surname> <given-names>A.</given-names></name> <name><surname>Salib</surname> <given-names>P.</given-names></name> <name><surname>Rupert</surname> <given-names>D. J.</given-names></name></person-group> (<year>2007</year>). <article-title>Merging qualitative and quantitative data in mixed methods research: how to and why not.</article-title> <source><italic>Ecol. Environ. Anthropol.</italic></source> <volume>3</volume> <fpage>19</fpage>&#x2013;<lpage>28</lpage>.</citation></ref>
<ref id="B11"><citation citation-type="journal"><collab>Facebook</collab> (<year>2014</year>). <source><italic>Introducing Safety Check.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://newsroom.fb.com/news/2014/10/introducing-safety-check/">http://newsroom.fb.com/news/2014/10/introducing-safety-check/</ext-link></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Forbes</surname> <given-names>C. E.</given-names></name> <name><surname>Schmader</surname> <given-names>T.</given-names></name></person-group> (<year>2010</year>). <article-title>Retraining attitudes and stereotypes to affect motivation and cognitive capacity under stereotype threat.</article-title> <source><italic>J. Pers. Soc. Psychol.</italic></source> <volume>99</volume> <fpage>740</fpage>&#x2013;<lpage>754</lpage>. <pub-id pub-id-type="doi">10.1037/a0020971</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fouad</surname> <given-names>N. A.</given-names></name> <name><surname>Singh</surname> <given-names>R.</given-names></name> <name><surname>Cappaert</surname> <given-names>K.</given-names></name> <name><surname>Chang</surname> <given-names>W.</given-names></name> <name><surname>Wan</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Comparison of women engineers who persist in or depart from engineering.</article-title> <source><italic>J. Vocat. Behav.</italic></source> <volume>92</volume> <fpage>79</fpage>&#x2013;<lpage>93</lpage>. <pub-id pub-id-type="doi">10.1016/j.jvb.2015.11.002</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frieze</surname> <given-names>C.</given-names></name> <name><surname>Quesenberry</surname> <given-names>J.</given-names></name> <name><surname>Kemp</surname> <given-names>E.</given-names></name> <name><surname>Velaquez</surname> <given-names>A.</given-names></name></person-group> (<year>2012</year>). <article-title>Diversity or difference? new research supports the case for a cultural perspective on women in computing.</article-title> <source><italic>J. Sci. Educ. Technol.</italic></source> <volume>21</volume> <fpage>423</fpage>&#x2013;<lpage>439</lpage>. <pub-id pub-id-type="doi">10.1007/s10956-011-9335-y</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><collab>Geena Davis Institute on Gender in Media</collab> (<year>2014</year>). <source><italic>Gender Bias without Borders.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://seejane.org/symposiums-on-gender-in-media/gender-bias-without-borders/">http://seejane.org/symposiums-on-gender-in-media/gender-bias-without-borders/</ext-link></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Greenwald</surname> <given-names>A. G.</given-names></name> <name><surname>Banaji</surname> <given-names>M.</given-names></name></person-group> (<year>1995</year>). <article-title>Implicit social cognition: attitudes, self-esteem and stereotypes.</article-title> <source><italic>Psychol. Rev.</italic></source> <volume>102</volume> <fpage>4</fpage>&#x2013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1037/0033-295X.102.1.4</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Greenwald</surname> <given-names>A. G.</given-names></name> <name><surname>McGhee</surname> <given-names>A. G.</given-names></name> <name><surname>Schwartz</surname> <given-names>J.</given-names></name></person-group> (<year>1998</year>). <article-title>Measuring individual differences in implicit cognition.</article-title> <source><italic>J. Pers. Soc. Psychol.</italic></source> <volume>74</volume> <fpage>1464</fpage>&#x2013;<lpage>1480</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.74.6.1464</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grunspan</surname> <given-names>D. A.</given-names></name> <name><surname>Eddy</surname> <given-names>S. L.</given-names></name> <name><surname>Brownell</surname> <given-names>S. E.</given-names></name> <name><surname>Wiggins</surname> <given-names>B. L.</given-names></name> <name><surname>Crowe</surname> <given-names>A. J.</given-names></name> <name><surname>Goodreau</surname> <given-names>S. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Males under-estimate academic performance of their female peers in undergraduate biology classrooms.</article-title> <source><italic>PLoS ONE</italic></source> <volume>11</volume>:<issue>e0148405</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0148405</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hill</surname> <given-names>C.</given-names></name> <name><surname>Corbett</surname> <given-names>C.</given-names></name> <name><surname>St. Rose</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <source><italic>Why So Few? Women in Science, Technology, Engineering and Math</italic>.</source> <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>AAUW</publisher-name>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holloway</surname> <given-names>B.</given-names></name> <name><surname>Reed</surname> <given-names>T.</given-names></name> <name><surname>Imbrie</surname> <given-names>P. K.</given-names></name> <name><surname>Reid</surname> <given-names>K.</given-names></name></person-group> (<year>2014</year>). <article-title>Research-informed policy change: a retrospective on engineering admissions.</article-title> <source><italic>J. Eng. Educ.</italic></source> <volume>103</volume> <fpage>274</fpage>&#x2013;<lpage>301</lpage>. <pub-id pub-id-type="doi">10.1002/jee.20046</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Joshi</surname> <given-names>A.</given-names></name> <name><surname>Neely</surname> <given-names>B.</given-names></name> <name><surname>Emrich</surname> <given-names>C.</given-names></name> <name><surname>Griffith</surname> <given-names>D.</given-names></name> <name><surname>George</surname> <given-names>G.</given-names></name></person-group> (<year>2015</year>). <article-title>Gender research in AMJ: an overview of five decades of empirical research and calls to action, thematic issue on gender in management research.</article-title> <source><italic>Acad. Manag. J.</italic></source> <volume>58</volume> <fpage>1459</fpage>&#x2013;<lpage>1475</lpage>. <pub-id pub-id-type="doi">10.5465/amj.2015.4011</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kanney</surname> <given-names>A. M.</given-names></name> <name><surname>Sax</surname> <given-names>L. J.</given-names></name> <name><surname>Riggers-Piehl</surname> <given-names>T. A.</given-names></name></person-group> (<year>2014</year>). <article-title>Investigating forty years of STEM research: how explanations for the gender gap have evolved over time.</article-title> <source><italic>J. Women Minor. Sci. Eng.</italic></source> <volume>20</volume> <fpage>127</fpage>&#x2013;<lpage>148</lpage>. <pub-id pub-id-type="doi">10.1615/JWomenMinorScienEng.2014007246</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klawe</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <source><italic>The Science behind Graduating a Class with Majority Female Engineers. Forbes.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.forbes.com/sites/mariaklawe/2014/07/10/the-science-behind-graduating-a-class-with-majority-women-engineers/#366de2bb2fe2">http://www.forbes.com/sites/mariaklawe/2014/07/10/the-science-behind-graduating-a-class-with-majority-women-engineers/#366de2bb2fe2</ext-link></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koenig</surname> <given-names>A. M.</given-names></name> <name><surname>Eagly</surname> <given-names>A. H.</given-names></name> <name><surname>Mitchell</surname> <given-names>A. A.</given-names></name> <name><surname>Ristikari</surname> <given-names>T.</given-names></name></person-group> (<year>2011</year>). <article-title>Are leader stereotypes masculine? A meta-analysis of three research paradigms.</article-title> <source><italic>Psychol. Bull.</italic></source> <volume>137</volume> <fpage>616</fpage>&#x2013;<lpage>642</lpage>. <pub-id pub-id-type="doi">10.1037/a0023557</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Laughlin</surname> <given-names>C.</given-names></name> <name><surname>Zastavker</surname> <given-names>Y. V.</given-names></name> <name><surname>Ong</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>&#x201C;Is integration really there? Students&#x2019; perceptions of integration in their project-based curriculum,&#x201D; in</article-title> <source><italic>Proceedings of the ASEE/IEEE Frontiers in Education Conference</italic></source> (<publisher-loc>Milwaukee, WI</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>F4C19</fpage>&#x2013;<lpage>F4C25</lpage>.</citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lent</surname> <given-names>R. W.</given-names></name></person-group> (<year>2005</year>). <article-title>&#x201C;A social cognitive view of career development and counseling,&#x201D; in</article-title> <source><italic>Career Development and Counseling</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Brown</surname> <given-names>S. D.</given-names></name> <name><surname>Lent</surname> <given-names>R. W.</given-names></name></person-group> (<publisher-loc>Hoboken, NJ</publisher-loc>: <publisher-name>John Wiley &#x0026; Sons</publisher-name>), <fpage>101</fpage>&#x2013;<lpage>127</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lent</surname> <given-names>R. W.</given-names></name> <name><surname>Brown</surname> <given-names>S. D.</given-names></name> <name><surname>Hackett</surname> <given-names>G.</given-names></name></person-group> (<year>1994</year>). <article-title>Toward a unifying social cognitive theory of career and academic interest, choice, and performance.</article-title> <source><italic>J. Vocat. Behav.</italic></source> <volume>45</volume> <fpage>79</fpage>&#x2013;<lpage>122</lpage>. <pub-id pub-id-type="doi">10.1006/jvbe.1994.1027</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Logel</surname> <given-names>C. R.</given-names></name> <name><surname>Walton</surname> <given-names>G. M.</given-names></name> <name><surname>Spencer</surname> <given-names>S. J.</given-names></name> <name><surname>Peach</surname> <given-names>J.</given-names></name> <name><surname>Mark</surname> <given-names>Z. P.</given-names></name></person-group> (<year>2012</year>). <article-title>Unleashing latent ability: implications of stereotype threat for college admissions.</article-title> <source><italic>Educ. Psychol.</italic></source> <volume>47</volume> <fpage>42</fpage>&#x2013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1080/00461520.2011.611368</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacNell</surname> <given-names>L.</given-names></name> <name><surname>Driscoll</surname> <given-names>A.</given-names></name> <name><surname>Hunt</surname> <given-names>A. N.</given-names></name></person-group> (<year>2015</year>). <article-title>What&#x2019;s in a name: exposing gender bias in student ratings of teaching.</article-title> <source><italic>Innov. Higher Educ.</italic></source> <volume>40</volume> <fpage>291</fpage>&#x2013;<lpage>303</lpage>. <pub-id pub-id-type="doi">10.1007/s10755-014-9313-4</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marra</surname> <given-names>R. M.</given-names></name> <name><surname>Rodgers</surname> <given-names>K. A.</given-names></name> <name><surname>Shen</surname> <given-names>D.</given-names></name> <name><surname>Bogue</surname> <given-names>B.</given-names></name></person-group> (<year>2009</year>). <article-title>Women engineering students and self-efficacy: a multi-year, multi-institution study of women engineering student self-efficacy.</article-title> <source><italic>J. Eng. Educ.</italic></source> <volume>98</volume> <fpage>27</fpage>&#x2013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1002/j.2168-9830.2009.tb01003.x</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moss-Racusin</surname> <given-names>C. A.</given-names></name> <name><surname>Dovidio</surname> <given-names>J. F.</given-names></name> <name><surname>Brescoll</surname> <given-names>V. L.</given-names></name> <name><surname>Graham</surname> <given-names>M. J.</given-names></name> <name><surname>Handelsman</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Science faculty&#x2019;s subtle gender biases favor male students.</article-title> <source><italic>Proc. Natl. Acad. Sci. U.S.A.</italic></source> <volume>109</volume> <fpage>16474</fpage>&#x2013;<lpage>16479</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1211286109</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><collab>National Academy of Engineering</collab> (<year>2016a</year>). <source><italic>14 Grand Challenges for Engineering in the 21st Century.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.engineeringchallenges.org/challenges.aspx">http://www.engineeringchallenges.org/challenges.aspx</ext-link></citation></ref>
<ref id="B33"><citation citation-type="journal"><collab>National Academy of Engineering</collab> (<year>2016b</year>). <source><italic>Advanced Health Informatics.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.engineeringchallenges.org/challenges/informatics.aspx">http://www.engineeringchallenges.org/challenges/informatics.aspx</ext-link></citation></ref>
<ref id="B34"><citation citation-type="journal"><collab>National Center for Women and Information Technology</collab> (<year>2016</year>). <source><italic>NCWIT.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="https://www.ncwit.org/">https://www.ncwit.org/</ext-link></citation></ref>
<ref id="B35"><citation citation-type="journal"><collab>National Research Council</collab> (<year>2007</year>). <source><italic>Beyond Bias and Barriers: Fulfilling the Potential of Women in Academic Science and Engineering</italic>.</source> <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>National Academies Press</publisher-name>.</citation></ref>
<ref id="B36"><citation citation-type="journal"><collab>National Science Foundation</collab> (<year>2015</year>). <source><italic>ADVANCE Portal.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.portal.advance.vt.edu/index.php">http://www.portal.advance.vt.edu/index.php</ext-link></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmader</surname> <given-names>T.</given-names></name></person-group> (<year>2002</year>). <article-title>Gender identification moderates stereotype threat effects on women&#x2019;s math performance.</article-title> <source><italic>J. Exp. Soc. Psychol.</italic></source> <volume>38</volume> <fpage>194</fpage>&#x2013;<lpage>201</lpage>. <pub-id pub-id-type="doi">10.1177/0146167208318404</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Singh</surname> <given-names>R.</given-names></name> <name><surname>Fouad</surname> <given-names>N. A.</given-names></name> <name><surname>Fitzpatrick</surname> <given-names>M. E.</given-names></name> <name><surname>Liu</surname> <given-names>J. P.</given-names></name> <name><surname>Cappaert</surname> <given-names>K. J.</given-names></name> <name><surname>Figuereido</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <article-title>Stemming the tide: predicting women engineers&#x2019; intentions to leave.</article-title> <source><italic>J. Vocat. Behav.</italic></source> <volume>83</volume> <fpage>281</fpage>&#x2013;<lpage>294</lpage>. <pub-id pub-id-type="doi">10.1016/j.jvb.2013.05.007</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Singh</surname> <given-names>V.</given-names></name> <name><surname>Vinnicombe</surname> <given-names>S.</given-names></name> <name><surname>Kumra</surname> <given-names>S.</given-names></name></person-group> (<year>2006</year>). <article-title>Women in formal corporate networks: an organisational citizenship perspective.</article-title> <source><italic>Women Manag. Rev.</italic></source> <volume>21</volume> <fpage>458</fpage>&#x2013;<lpage>482</lpage>. <pub-id pub-id-type="doi">10.1108/09649420610683462</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><collab>The Next MacGyver</collab> (<year>2015</year>). <source><italic>Searching for the Next Great Story about Women. Engineers. Heroes.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="https://www.thenextmacgyver.com/about.html">https://www.thenextmacgyver.com/about.html</ext-link></citation></ref>
<ref id="B41"><citation citation-type="journal"><collab>US Bureau of Labor Statistics</collab> (<year>2015</year>). <source><italic>Women in the Labor Force: A Databook. Retrieved from BLS Reports</italic></source>. Available at: <ext-link ext-link-type="uri" xlink:href="https://www.bls.gov/opub/reports/womens-databook/archive/women-in-the-labor-force-a-databook-2015.pdf">https://www.bls.gov/opub/reports/womens-databook/archive/women-in-the-labor-force-a-databook-2015.pdf</ext-link></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname> <given-names>J. C.</given-names></name> <name><surname>Dempsey</surname> <given-names>R.</given-names></name></person-group> (<year>2014</year>). <source><italic>What Works for Women at Work.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>New York University Press</publisher-name>.</citation></ref>
<ref id="B43"><citation citation-type="journal"><collab>Women in Engineering ProActive Network</collab> (<year>2016</year>). <source><italic>Women in STEM Knowledge Center.</italic></source> Available at: <ext-link ext-link-type="uri" xlink:href="http://www.wskc.org/">http://www.wskc.org/</ext-link></citation></ref>
</ref-list>
<fn-group>
<fn id="fn01"><label>1</label><p><ext-link ext-link-type="uri" xlink:href="https://www.nsf.gov/statistics/2017/nsf17306/survey.cfm">https://www.nsf.gov/statistics/2017/nsf17306/survey.cfm</ext-link></p></fn>
<fn id="fn02"><label>2</label><p><ext-link ext-link-type="uri" xlink:href="https://www.nsf.gov/statistics/2017/nsf17306/survey.cfm">https://www.nsf.gov/statistics/2017/nsf17306/survey.cfm</ext-link></p></fn>
</fn-group>
</back>
</article>