<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="systematic-review">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2021.784068</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Systematic Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Relationship Between Attitude Toward Science and Academic Achievement in Science: A Three-Level Meta-Analysis</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Mao</surname> <given-names>Peipei</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1494521/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Cai</surname> <given-names>Zhihui</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1193572/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>He</surname> <given-names>Jinbo</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1420924/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Chen</surname> <given-names>Xinjie</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/603015/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Fan</surname> <given-names>Xitao</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Psychology, Central China Normal University</institution>, <addr-line>Wuhan</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>School of Humanities and Social Science, The Chinese University of Hong Kong</institution>, <addr-line>Shenzhen</addr-line>, <country>China</country></aff>
<aff id="aff3"><sup>3</sup><institution>Graduate School of Education, Stanford University</institution>, <addr-line>Stanford, CA</addr-line>, <country>United States</country></aff>
<aff id="aff4"><sup>4</sup><institution>Faculty of Education, The Chinese University of Hong Kong, Hong Kong</institution>, <addr-line>Hong Kong SAR</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: David Gonzalez-Gomez, University of Extremadura, Spain</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Michael D. Toland, University of Toledo, United States; Parul Acharya, Columbus State University, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Zhihui Cai <email>caizhihui922&#x00040;mail.ccnu.edu.cn</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Educational Psychology, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>16</day>
<month>12</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>12</volume>
<elocation-id>784068</elocation-id>
<history>
<date date-type="received">
<day>27</day>
<month>09</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>22</day>
<month>11</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2021 Mao, Cai, He, Chen and Fan.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Mao, Cai, He, Chen and Fan</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract><p>Science education is attracting increasing attention and many researchers focus on the issue about the attitude-achievement relationship in science, but there is still no consistent conclusion. By using a three-level meta-analytic approach, the aim of the current study was to investigate the relationship between attitude toward science and academic achievement in learning science among primary and secondary school students, and to explore if some study characteristics could have contributed to the inconsistent findings with regard to this relationship as observed in the research literature. A total of 37 studies with 132 effect sizes involving a total of 1,042,537 participants were identified. The meta-analytic results revealed that there was an overall positive and moderate relationship between attitude toward science and learning achievement in science (<italic>r</italic> = 0.248, <italic>p</italic> &#x0003C; 0.001). The results further found that this association was moderated by the type of attitude and larger effect sizes were shown in self-efficacy than in interest, societal relevance of attitude toward science, and mixed attitude. Moreover, the effect sizes of studies with unstandardized measure to assess science achievement were larger than those with standardized measure. Possible explanations for these findings and its implications for future research directions were also discussed in this review.</p></abstract>
<kwd-group>
<kwd>attitude toward science</kwd>
<kwd>science achievement</kwd>
<kwd>meta-analysis</kwd>
<kwd>moderator analysis</kwd>
<kwd>academic achievement in science</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="2"/>
<equation-count count="1"/>
<ref-count count="85"/>
<page-count count="12"/>
<word-count count="9404"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>Science education is an important subject area of study for students, as it is closely tied to a society&#x00027;s economic development. In addition to students&#x00027; achievement in learning science, affective outcomes related to science learning are also of concern for educators. Over the years, science education educators and researchers have been interested in understanding the relationship between students&#x00027; attitude toward science and their achievement in learning science (e.g., Abu-Hilal et al., <xref ref-type="bibr" rid="B1">2014</xref>; Darmawan, <xref ref-type="bibr" rid="B21">2020</xref>). One of the purposes of science education is to develop a positive attitude toward science and to enhance the interest of young people in pursuing scientific careers (Tai et al., <xref ref-type="bibr" rid="B77">2006</xref>; Azizoglu and &#x000C7;etin, <xref ref-type="bibr" rid="B8">2009</xref>). In recent years, the decline of students&#x00027; favorable attitude toward science and the falling number of students choosing to pursue the study of science have become a matter of considerable societal concern and debate in some regions across the world (e.g., Kennedy et al., <xref ref-type="bibr" rid="B37">2014</xref>; Potvin and Hasni, <xref ref-type="bibr" rid="B66">2014a</xref>; Cheng and Wan, <xref ref-type="bibr" rid="B16">2016</xref>). For the economic development of a society, lack of positive attitude toward science and the low interest among the young to pursue science careers pose serious threats to economic prosperity (Osborne et al., <xref ref-type="bibr" rid="B62">2003</xref>; Kennedy et al., <xref ref-type="bibr" rid="B38">2016</xref>). Therefore, it is necessary to understand how the attitude toward science and achievement in learning science are related among young learners, such that we may develop a better understanding about how this relationship may affect students&#x00027; choice of subject areas for learning.</p>
<p>Over the years, there have been many empirical studies concerning the science attitude-achievement relationship. The research literature in this area, however, has not provided consistent findings. To address this issue, some literature reviews on attitude toward science were done (Aiken and Aiken, <xref ref-type="bibr" rid="B5">1969</xref>; Gardner, <xref ref-type="bibr" rid="B29">1975</xref>; Osborne et al., <xref ref-type="bibr" rid="B62">2003</xref>), and a meta-analysis of the research literature on the attitude-achievement relationship in science was conducted several decades ago (Willson, <xref ref-type="bibr" rid="B82">1983</xref>), which reported some basic descriptive statistics (e.g., mean or median of correlation coefficients), and issues (e.g., weighted analysis by study sample size) were not considered. It has been about four decades since the last quantitative synthesis of research on this issue, and the relevance and validity of the previous findings are very much in question. Therefore, this study was designed for the purpose of providing an up-to-date quantitative synthesis of the research literature in recent decades on the relationship between attitude toward science and achievement in science learning by using the most current meta-analytic methods. More specifically, the three-level meta-analytic approach (Assink and Wibbelink, <xref ref-type="bibr" rid="B7">2016</xref>) is used, and this meta-analytic model adequately addresses multiple technical issues, including dependent effect sizes from the same study.</p>
<sec>
<title>Considerations for Attitude Toward Science</title>
<p>&#x0201C;Attitude could be considered as people&#x00027;s global evaluations of any object, such as oneself, other people, possessions, issues, abstract concepts, and so forth&#x0201D; (Petty et al., <xref ref-type="bibr" rid="B64">2003</xref>). In the area of research for studying attitude, the biggest stumbling block is often the lack of clarity about the concept under investigation. Klopfer (<xref ref-type="bibr" rid="B40">1971</xref>) made a notable contribution by proposing six dimensions regarding affective behaviors in science, namely, attitude toward scientists, scientific enquiry, science learning, science-related activities, science careers, and the adoption of &#x0201C;scientific attitudes.&#x0201D; More clarity gradually emerged across studies, as the studies became clearer in what components or measures were used for attitudes toward science (Schibeci, <xref ref-type="bibr" rid="B74">1983</xref>; Breakwell and Beardsell, <xref ref-type="bibr" rid="B12">1992</xref>; Woolnough, <xref ref-type="bibr" rid="B83">1994</xref>; Koballa, <xref ref-type="bibr" rid="B41">1995</xref>). According to Osborne et al. (<xref ref-type="bibr" rid="B62">2003</xref>), attitude toward science can be defined as &#x0201C;feelings, beliefs and values held about the enterprise of school science, and the impact of the science on society.&#x0201D; However, such definitions either consist of a single unitary construct, or consist of multiple sub-constructs. Reid (<xref ref-type="bibr" rid="B68">2006</xref>), on the other hand, holds that attitude can be divided into three components: cognitive, affective, and behavioral. In addition, Potvin and Hasni (<xref ref-type="bibr" rid="B67">2014b</xref>) argue that attitude contains a wide range of subconstructs, such as enjoyment, motivation, self-efficacy, and career aspirations. Thus, it is obvious that the conceptual frameworks of attitude are diverse.</p>
<p>One possible reason for the inconsistent findings across individual studies about the relationship between science attitudes and science achievement was that different studies might have operationalized the construct of attitude differently. Based on our review of relevant research literature in the area of attitude toward science, in this study, we drew on Savelsbergh et al. (<xref ref-type="bibr" rid="B73">2016</xref>) fine grained framework of attitude constructs and grouped different operationalization of attitude toward science across the studies into four categories: interest, self-efficacy, societal relevance of attitude toward science and mixed attitude. The interest aspect of science is represented by the emotions and feelings about learning science (e.g., Zhang and Tang, <xref ref-type="bibr" rid="B84">2017</xref>). The self-efficacy aspect of science attitude involves students&#x00027; beliefs in their own abilities to achieve good grades in science-related subject courses, to be competent in relevant science careers, and to undertake tasks in science successfully (e.g., Larson et al., <xref ref-type="bibr" rid="B43">2014</xref>). The societal relevance of attitude toward science is represented as the perceptions and judgement about the value, usefulness, social implications of science (e.g., Dowey, <xref ref-type="bibr" rid="B24">2013</xref>). Finally, some studies either focused on students&#x00027; general science attitude, or did not provide clear description or operationalization of the &#x0201C;attitudes&#x0201D; as measured in the studies, and we classified such cases as &#x0201C;mixed&#x0201D; (e.g., Oluwatelure, <xref ref-type="bibr" rid="B61">2015</xref>).</p>
</sec>
<sec>
<title>Relationship Between Attitude Toward Science and Achievement in Learning Science</title>
<p>Over the past decades, after the last synthesis on the students&#x00027; attitude -achievement relationships (Willson, <xref ref-type="bibr" rid="B82">1983</xref>), there has been a growing interest on this issue, and the studies in the recent two decades continue to provide inconsistent findings. On the one hand, many studies showed that students&#x00027; attitude toward science and their science achievement correlated positively and moderately (Nolen, <xref ref-type="bibr" rid="B58">2003</xref>; Mungin, <xref ref-type="bibr" rid="B54">2012</xref>; Ng et al., <xref ref-type="bibr" rid="B56">2012</xref>; Hacieminoglu, <xref ref-type="bibr" rid="B31">2016</xref>; Chi et al., <xref ref-type="bibr" rid="B18">2017</xref>; Wang and Liou, <xref ref-type="bibr" rid="B80">2017</xref>; Zheng et al., <xref ref-type="bibr" rid="B85">2019</xref>). For instance, based on the data from Program for International Student Assessment (Pisa et al., <xref ref-type="bibr" rid="B65">2017</xref>), the study conducted by Chi et al. (<xref ref-type="bibr" rid="B18">2017</xref>) pointed out that students&#x00027; interest, enjoyment, and the perceptions of general value in science were positively correlated with scientific competencies. Similarly, in another study with 537,170 15-year-old students, Zheng et al. (<xref ref-type="bibr" rid="B85">2019</xref>) stated that students&#x00027; interest in science was positively associated with their science achievement. Meanwhile, based on the Chinese sample of Trends in International Mathematics and Science Study (Martin et al., <xref ref-type="bibr" rid="B48">2012</xref>), Wang and Liou (<xref ref-type="bibr" rid="B80">2017</xref>) revealed that students&#x00027; perception about the intrinsic value and utility value of science had a significant positive effect on their science learning performance. Furthermore, some research studies showed a strong relationship between attitude and achievement (Mattern and Schau, <xref ref-type="bibr" rid="B50">2002</xref>; Else-Quest et al., <xref ref-type="bibr" rid="B25">2013</xref>; Oluwatelure, <xref ref-type="bibr" rid="B61">2015</xref>). For example, in the study by Oluwatelure (<xref ref-type="bibr" rid="B61">2015</xref>), a significant and strong positive correlation between science attitude and science achievement (<italic>r</italic> = 0.612) was shown. Likewise, Rennie and Punch (<xref ref-type="bibr" rid="B69">1991</xref>) documented that students&#x00027; beliefs in their performance was closely related to science achievement (<italic>r</italic> = 0.66).</p>
<p>On the other hand, however, there were other studies showing that the relationship between students&#x00027; attitude toward science and their science achievement was either quite weak, statistically non-significant, or even negative (Rennie and Punch, <xref ref-type="bibr" rid="B69">1991</xref>; Gardner, <xref ref-type="bibr" rid="B30">1995</xref>; Brooks, <xref ref-type="bibr" rid="B13">2011</xref>). For example, Brooks (<xref ref-type="bibr" rid="B13">2011</xref>) revealed that the enjoyment of science lessons, leisure interest in science activities, social implications and career in science of students were negatively associated with their science achievement. Moreover, there were also some studies that yielded contradictory results (Napier and Riley, <xref ref-type="bibr" rid="B55">1985</xref>; Diggs, <xref ref-type="bibr" rid="B23">1997</xref>; Salmi et al., <xref ref-type="bibr" rid="B72">2016</xref>). For instance, based on a sample of sixth grade students from Finland, Estonia, Latvia and Belgium, Salmi et al. (<xref ref-type="bibr" rid="B72">2016</xref>) reported that the correlation between students&#x00027; societal attitude (value of science in society) and performance was positive (<italic>r</italic> = 0.11), but the relationship between students&#x00027; engineering attitude (interest in computer design) and performance was negative (<italic>r</italic> = &#x02212;0.11).</p>
</sec>
<sec>
<title>Study Characteristics as Possible Factors for Inconsistent Findings</title>
<p>As discussed above, empirical studies have shown inconsistent findings with regard to the relationship between attitude toward science and achievement in science learning. As discussed extensively in meta-analytic research literature, some study features may have contributed to the inconsistent findings as shown in the research literature (so-called &#x0201C;moderators&#x0201D; in meta-analytic studies). In this section, we consider some possibilities in this regard.</p>
<sec>
<title>Publication Type</title>
<p>Publication type is a common moderator variable in meta-analysis that captures different types of research publications such as journal article, conference paper, or dissertation. In general, journal articles and some conference papers are peer-reviewed, whereas dissertations are not. Given the belief that studies with statistically significant findings are more likely to be published than those with statistically non-significant findings (i.e., file drawer problem, or publication bias; Rosenthal, <xref ref-type="bibr" rid="B70">1979</xref>), inconsistent findings across studies could be due to different publication types. Thus, publication type was examined as a potential moderator variable in this meta-analytic study. The studies were coded as either &#x0201C;journal article&#x0201D; or &#x0201C;dissertation&#x0201D; in this meta-analysis.</p>
</sec>
<sec>
<title>Grade</title>
<p>Relevant studies in this area involved students at different grade levels. Previous primary studies on science attitude suggested that the relationship between attitude toward science and science achievement could vary across grade levels. For example, Liou and Liu (<xref ref-type="bibr" rid="B45">2015</xref>) noted that the correlation between students&#x00027; self-concept and science scores, and that between intrinsic interest and science scores, were stronger for the eighth grade students than for the fourth grade students, based on the TIMSS 2011 Taiwanese data. Similarly, Liou et al. (<xref ref-type="bibr" rid="B46">2021</xref>) also suggested that this association was stronger for junior middle school students than for elementary school students. With such a consideration for grade level as a possible factor for inconsistent findings in the literature, in this study, we would examine the potential moderating effect of grade level on the relationship between science attitude and learning achievement in science, and we coded the grade levels of the studies as having elementary school students for grades 1&#x02013;6, middle school students for grades 7&#x02013;9, high school students for grades 10&#x02013;12, and others (mixed covering more than one grade level).</p>
</sec>
<sec>
<title>Geographical Region</title>
<p>Studies about science attitude and science learning involved participants from different geographical regions (e.g., USA, Turkey, and China). In addition, previous research indicated that there were regional differences in science achievement (Martin et al., <xref ref-type="bibr" rid="B48">2012</xref>; Bati et al., <xref ref-type="bibr" rid="B10">2019</xref>). For example, research on international students&#x00027; science achievement showed that there were differences across countries in TIMSS 2011 at the fourth grade, with some countries (e.g., Finland, Korea, Singapore) showing considerably higher level of achievement than some others (Martin et al., <xref ref-type="bibr" rid="B48">2012</xref>). Furthermore, Bati et al. (<xref ref-type="bibr" rid="B10">2019</xref>) investigated the degree to which affective characteristics could predict students&#x00027; science performance based on the results from PISA 2015, and suggested that science self-efficacy of students could significantly predict science achievement in samples from multiple countries. Thus, the strength of the association between science attitude and science learning achievement could vary across countries/regions. With this consideration, in our meta-analysis, geographical region where a study was conducted would be coded as a potential factor for the inconsistencies of findings across the studies, and the geographical regions of the studies were coded into one of two regions based on the relevant information in the included primary studies: Eastern countries (e.g., China, Singapore) and Western countries (e.g., USA, Italian).</p>
</sec>
<sec>
<title>Type of Attitude</title>
<p>As discussed above, attitude is a complex construct, and different operationalization and measurement of this construct in primary studies could have led to inconsistent findings across the studies in this area. For example, Else-Quest et al. (<xref ref-type="bibr" rid="B25">2013</xref>) examined the link between attitude toward science and science achievement, and suggested that the self-concept of ability in science showed stronger link with academic outcomes than science value did. Similarly, Chang and Cheng (<xref ref-type="bibr" rid="B15">2008</xref>) reported that students&#x00027; self-confidence was a better predictor for achievement than their interest in science in a student sample from Taiwan. In this study, type of attitude used in a study was treated as a potential factor for the inconsistent findings about the relationship between students&#x00027; attitude toward science and their science achievement in different studies. More specifically, as discussed earlier, we coded &#x0201C;attitude&#x0201D; in the primary studies into one of the four categories: interest, self-efficacy, societal relevance of attitude toward science and mixed (usually not sufficiently clear to be classified into any of the three categories before).</p>
</sec>
<sec>
<title>Measures of Achievement</title>
<p>Studies in this area used different measurements for academic achievement in science. Measures used in the studies for science achievement generally fell into one of two categories: standardized measures/tests and unstandardized assessments. Standardized measures/tests, such as those used in large-scale projects like TIMSS and PISA, are believed to have high levels of validity and reliability as a result of development efforts for these measures/tests (e.g., Hamilton, <xref ref-type="bibr" rid="B32">1982</xref>; Oliver and Simpson, <xref ref-type="bibr" rid="B59">1988</xref>; Cohen and Chang, <xref ref-type="bibr" rid="B19">2020</xref>). Unstandardized assessments may have various forms, such as school grades in science and science-related GPA, and these are typically created by teachers or researchers (e.g., Schibeci and Riley, <xref ref-type="bibr" rid="B75">1986</xref>; Freedman, <xref ref-type="bibr" rid="B28">1997</xref>; Dowey, <xref ref-type="bibr" rid="B24">2013</xref>). These two types of measures of science achievement could have some differences. Wiberg and Rolfsman (<xref ref-type="bibr" rid="B81">2019</xref>) in their study involving both the science achievement measure in TIMSS and measure of school science achievement discussed that the association between the two kinds of measures was moderate, and that the contents of TIMSS measure of science achievement were not always in accordance with the school system. Furthermore, as Jansen et al. (<xref ref-type="bibr" rid="B33">2014</xref>) demonstrated, students&#x00027; academic self-concept in science showed more pronounced relationship with their final science grades than with their scores on standardized tests. With such considerations, in our study, measures of science achievement was treated as a potential moderator, and the measures used in the studies included in this meta-analysis were grouped into either &#x0201C;standardized&#x0201D; or &#x0201C;unstandardized&#x0201D; categories.</p>
</sec>
<sec>
<title>Publication Year</title>
<p>Several decades ago, Willson (<xref ref-type="bibr" rid="B82">1983</xref>) showed that the magnitude of the relationship between attitude toward science and science achievement did not vary significantly over time. However, with more emphasis on science education in recent decades, and with the reform efforts in science education curriculum and instruction, students&#x00027; attitudes toward science and science achievement may change over time. For example, based on the data from TIMSS assessments of the fourth grade students in multiple countries, Martin et al. (<xref ref-type="bibr" rid="B48">2012</xref>) discussed that students&#x00027; performance in most countries increased during the period of 1995&#x02013;2011 period. Considering the possible changes in both student attitude toward science and learning achievement in science in recent decades, we included the final publication year of a research publication (either a journal article or a dissertation) as a potential moderator in the present study.</p>
</sec>
</sec>
<sec>
<title>Study Aims</title>
<p>This meta-analysis was planned to conduct a systematic quantitative synthesis of the empirical studies that examined the relationship between attitude toward science and learning achievement in science. This quantitative synthesis would provide an accurate, reliable, and valid summary of the research findings on this issue, and would allow us to understand if some features of the individual studies might have contributed to the inconsistent findings across the individual studies. More specifically, this study was designed to address the following two major questions:</p>
<list list-type="simple">
<list-item><p>1. What is the magnitude of the general relationship between students&#x00027; attitude toward science and their science achievement?</p></list-item>
<list-item><p>2. Does the relationship between attitude toward science and achievement in science vary due to some study features of the individual studies, such as publication type, grade level, geographical region of the sample, type of attitude, measures of achievement, and publication year?</p></list-item>
</list>
</sec>
</sec>
<sec sec-type="methods" id="s2">
<title>Methods</title>
<sec>
<title>Literature Search for Primary Studies</title>
<p>To obtain the studies to be included in this meta-analysis, ERIC, PsycINFO, SAGE, Taylor &#x00026; Francis Online, and ProQuest Dissertations &#x00026; Theses Global were used to identify studies examining the relationship between attitude toward science and academic achievement in science involving students from elementary school to high school. Key words used were: science, attitude, anxiety, interest, usefulness, value, self-efficacy, self-concept, enjoyment, achievement, and performance. Our search was conducted by using the key words either singly or in different combinations. The search covered the literatures up to October 2020. Google Scholar was also used in the follow-up search to identify additional studies that were not contained in the above databases. Reference sections from the included articles and several related review articles about the relationship between attitude toward science and science achievement were also examined to find additional research articles.</p>
</sec>
<sec>
<title>Inclusion Criteria</title>
<p>To be included in this meta-analysis, studies must meet the following criteria:</p>
<list list-type="simple">
<list-item><p>1. A study must be published or available in English;</p></list-item>
<list-item><p>2. A study must examine science attitude and science achievement simultaneously, and had operational definition of attitude toward science;</p></list-item>
<list-item><p>3. A study must report the zero-order correlation between science attitude and academic outcome in science, or reported quantitative data in sufficient detail to allow us to obtain this relationship as an effect size (e.g., <italic>t</italic>-ratio, <italic>F</italic>-ratio, etc.). We contacted the authors that did not report these correlations in their articles to request this information, and studies with no response were excluded.</p></list-item>
<list-item><p>4. A study should not include any experimental interventions on either attitude or achievement, or on both, because such intervention might have changed the relationship between the two variables (e.g., Aguilera and Perales-Palacios, <xref ref-type="bibr" rid="B4">2020b</xref>; Sahin and Yilmaz, <xref ref-type="bibr" rid="B71">2020</xref>).</p></list-item>
<list-item><p>5. Samples of the study must be students from elementary, middle and high schools; college students or other groups were excluded in the present study.</p></list-item>
</list>
</sec>
<sec>
<title>Selection Procedure</title>
<p>The PRISMA flow chart of the selection process was presented in <xref ref-type="fig" rid="F1">Figure 1</xref>. Initially, we obtained 2,408 studies after removing duplicates. Two authors read the titles and abstracts of all articles, and 172 full-text articles were obtained for possible inclusion. Then, they carefully screened these articles based on the aforementioned selection criteria and found that 135 studies did not meet the inclusion criteria. In the end, 37 primary studies were included in this meta-analysis, and these studies were published from 1982 to 2020.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>PRISMA flow chart of the selection of studies for the meta-analysis.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyg-12-784068-g0001.tif"/>
</fig>
</sec>
<sec>
<title>Coding of Study Features</title>
<p>As detailed previously, to understand what might have contributed to the inconsistent findings across the studies about the relationship between students&#x00027; science attitude and their academic achievement in science, the following study features were coded in this study: (a) publication year (year as a continuous variable); (b) publication type (published journal article or unpublished dissertation); (c) grade (four levels: elementary school students, middle school students, high school students, and others); (d) geographical region (two categories: Eastern countries and Western countries); (e) type of attitude (four categories: interest, self-efficacy, societal relevance, and mixed); (f) measures of achievement (two categories: standardized and unstandardized). In addition, the first and the second author coded 10% of the randomly selected articles and all disagreements were solved after reading the articles and discussion with the research team. Then, all primary studies were coded independently by two authors with high inter-rater reliability. The intra-class correlation coefficients of each moderator variable were respectively: publication year (ICC = 0.94), publication type (ICC = 1), grade level (ICC = 0.97), geographical region (ICC = 1), type of attitude (ICC = 0.89), and measures of achievement (ICC = 0.86).</p>
</sec>
<sec>
<title>Data Analysis Strategy</title>
<p>The zero-order correlation coefficients <italic>r</italic> between attitude toward science and academic achievement in science from the primary studies were treated as effect sizes in the present meta-analysis. Before conducting the meta-analysis, all correlation coefficients were converted to Fisher&#x00027;s <italic>z</italic>-scores, because the sampling distribution of <italic>r</italic> is skewed (Card, <xref ref-type="bibr" rid="B14">2012</xref>). The Fisher&#x00027;s <italic>z</italic>-scores were transformed back into <italic>r</italic> after performing the meta-analysis. It was important to note that most of the studies included in our meta-analysis reported multiple relevant effect sizes, since correlation coefficients <italic>r</italic> between different dimensions of attitude toward science and different measures of achievement in science could be extracted from the same study. However, the traditional meta-analytic approach assumes that the observed effect sizes should be independent of each other, which is not the case here. Therefore, for the situation of non-independent effect sizes, i.e., effect sizes nested under study, a three-level meta-analysis approach was applied to deal with the dependency of effect sizes in the current study (Assink and Wibbelink, <xref ref-type="bibr" rid="B7">2016</xref>). The models for three-level random-effect meta-analysis are expressed:</p>
<disp-formula id="E1"><mml:math id="M1"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mtext>Level&#x000A0;</mml:mtext><mml:mn>1</mml:mn><mml:mtext>&#x000A0;model</mml:mtext><mml:mo>:</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mrow><mml:mtext>y</mml:mtext></mml:mrow><mml:mrow><mml:mtext>ij</mml:mtext></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mo>=</mml:mo></mml:mtd><mml:mtd><mml:msub><mml:mrow><mml:mi>&#x003BB;</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>e</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>Level&#x000A0;</mml:mtext><mml:mn>2</mml:mn><mml:mtext>&#x000A0;model</mml:mtext><mml:mo>:</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mrow><mml:mtext>&#x003BB;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>ij</mml:mtext></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mo>=</mml:mo></mml:mtd><mml:mtd><mml:msub><mml:mrow><mml:mi>&#x003BA;</mml:mi></mml:mrow><mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003BC;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>2</mml:mn><mml:mtext>&#x000A0;</mml:mtext></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>Level&#x000A0;</mml:mtext><mml:mn>3</mml:mn><mml:mtext>&#x000A0;model</mml:mtext><mml:mo>:</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mrow><mml:mtext>&#x003BA;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>j</mml:mtext></mml:mrow></mml:msub></mml:mtd><mml:mtd><mml:mo>=</mml:mo></mml:mtd><mml:mtd><mml:msub><mml:mrow><mml:mi>&#x003B2;</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003BC;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>3</mml:mn><mml:mtext>&#x000A0;</mml:mtext></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The <italic>y</italic><sub><italic>ij</italic></sub> is the <italic>i</italic>th effect size in the <italic>j</italic>th study, &#x003BB;<sub><italic>ij</italic></sub> is the &#x0201C;true&#x0201D; effect size, Var(<italic>e</italic><sub><italic>ij</italic></sub>) is the known sampling variance in the <italic>i</italic>th effect size in the <italic>j</italic>th study, &#x003BA;<sub><italic>j</italic></sub> is the average effect in the <italic>j</italic>th study, &#x003B2;<sub>0</sub> is the average population effect, and Var<inline-formula><mml:math id="M2"><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003BC;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>2</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>2</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> and Var<inline-formula><mml:math id="M3"><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003BC;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>3</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>3</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> are the study-specific level 2 and level 3 variance, respectively (Cheung, <xref ref-type="bibr" rid="B17">2014</xref>). In the three-level random effects model, three sources of variances were distributed: sampling variance of the observed effect sizes as level 1; variance within the same study as level 2 <inline-formula><mml:math id="M4"><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msubsup><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>2</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>; variance between studies as level 3 <inline-formula><mml:math id="M5"><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msubsup><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>3</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mtext>&#x000A0;</mml:mtext></mml:math></inline-formula>(Cheung, <xref ref-type="bibr" rid="B17">2014</xref>). The maximum likelihood estimation method is used to compute the parameter estimates, including <italic>Q</italic> statistic (i.e., the homogeneity of model estimates), and <italic>I</italic><sup>2</sup> statistic (i.e., the proportion of the distribution of the total variance over level 1, level 2, and level 3). All analyses were performed by using Viechtbauer, <xref ref-type="bibr" rid="B79">2010</xref> <italic>metafor</italic> package in R version 3.5.1.</p>
</sec>
<sec>
<title>Publication Bias</title>
<p>Publication bias should be taken into account in conducting meta-analysis. Generally, studies with statistically significant results could be more likely to be published, thus included in a meta-analysis, than those with statistically non-significant results, and this was referred to as the &#x0201C;file-drawer problem&#x0201D; (Rosenthal, <xref ref-type="bibr" rid="B70">1979</xref>). In our meta-analysis, first, we used a funnel plot to assess the presence or absence of publication bias. If the funnel plot was symmetrically distributed, the absence of publication bias was supported (Borenstein et al., <xref ref-type="bibr" rid="B11">2009</xref>). Furthermore, a combined Tandem Procedure was used in publication analyses (Ferguson and Brannick, <xref ref-type="bibr" rid="B26">2012</xref>). Rosenthal&#x00027;s &#x0201C;fail-safe N&#x0201D; method, Egger&#x00027;s regression test, and Begg&#x00027;s correlation test were conducted to assess the potential publication bias. The <italic>p</italic>-values in these tests were &#x0003E;0.05, indicating that there is no enough evidence to suggest publication bias was presented.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec>
<title>Characteristics of Included Studies</title>
<p>The present meta-analysis included 37 primary studies containing 48 independent samples and 132 effect sizes, and these studies were published from 1982 to 2020 (see <xref ref-type="supplementary-material" rid="SM1">Appendix</xref>). More specifically, the number of effect sizes related to the moderator variables varied: Publication year (132 effect sizes); Publication type: <italic>journal</italic> (114 effect sizes), <italic>dissertation</italic> (18 effect sizes); Grade: <italic>elementary school students</italic> (13 effect sizes), <italic>middle school students</italic> (79 effect sizes), <italic>high school students</italic> (29 effect sizes), <italic>others</italic> (9 effect sizes); Geographical region: <italic>Eastern</italic> (42 effect sizes), <italic>Western</italic> (86 effect sizes); Type of attitude: <italic>interest</italic> (43 effect sizes), <italic>self-efficacy</italic> (43 effect sizes), <italic>societal relevance</italic> (30 effect sizes), <italic>mixed</italic> (16 effect sizes); Measures of achievement: <italic>standardized</italic> (70 effect sizes), <italic>unstandardized</italic> (62 effect sizes). In addition, the 37 included studies involved a cumulative total of 1,042,537 participants, with sample size for individual studies ranging from 21 to 537,170.</p>
</sec>
<sec>
<title>Overall Analysis</title>
<p>The overall analysis results of the association between attitude toward science and achievement in science are shown in <xref ref-type="table" rid="T1">Table 1</xref>. A statistically significant overall weighted mean correlation, <italic>r</italic> = 0.248 (<italic>p</italic> &#x0003C; 0.001), was obtained. It indicated that the relationship between attitude toward science and achievement in science of students was positive and moderate. The <italic>Q</italic> statistic was statistically significant [<italic>Q</italic><sub>(131)</sub> = 4111.714, <italic>p</italic> &#x0003C; 0.001], suggesting that the effect sizes across the studies were heterogeneous. Moreover, the results of the likelihood-ratio tests revealed that the variances within-studies (<italic>estimate</italic> = 0.011, <italic>p</italic> &#x0003C; 0.001) and variances between studies (<italic>estimate</italic> = 0.013, <italic>p</italic> &#x0003C; 0.001) were significant. In terms of the total effect size variance, the level 1, level 2 and level 3 accounted for 1.928, 44.617, and 53.456%, respectively. Taken together, moderator analyses are warranted to further explore how study features might have contributed to the inconsistencies of the effect sizes across the studies.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Results for the overall analysis of the relation between attitude toward science and science achievement.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="center"><bold>No. studies</bold></th>
<th valign="top" align="center"><bold>No. ES</bold></th>
<th valign="top" align="center"><bold>Mean <italic>z</italic> (<italic>SE</italic>)</bold></th>
<th valign="top" align="center"><bold>95% CI</bold></th>
<th valign="top" align="center"><bold><italic>t</italic>-value (sig)</bold></th>
<th valign="top" align="center"><bold>Mean <italic>r</italic></bold></th>
<th valign="top" align="center"><bold>% var. at level 1</bold></th>
<th valign="top" align="center"><bold>Level 2 variance</bold></th>
<th valign="top" align="center"><bold>% var. at level 2</bold></th>
<th valign="top" align="center"><bold>Level 3 variance</bold></th>
<th valign="top" align="center"><bold>% var. at level 3</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Overall association</td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">132</td>
<td valign="top" align="center">0.253 (0.021)</td>
<td valign="top" align="center">(0.213, 0.294)</td>
<td valign="top" align="center">12.349&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.248</td>
<td valign="top" align="center">1.928</td>
<td valign="top" align="center">0.011&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">44.617</td>
<td valign="top" align="center">0.013&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">53.456</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>No. Studies, number of studies; No. ES, number of effect sizes; Mean z, Mean effect size (Fisher&#x00027;s z); SE, standard error; CI, confidence interval; sig, significance; Mean r, Mean effect size (r); Var., variance; Level 1 variance, sampling variance of observed effect sizes; Level 2 variance, variance between effect sizes extracted from the same study; Level 3 variance, variance between studies.</italic></p> 
<p><italic>&#x0002A;&#x0002A;&#x0002A;p &#x0003C; 0.001</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Publication Bias</title>
<p>To evaluate the potential publication bias, both funnel plot, the multilevel extension of Egger&#x00027;s regression test, Begg&#x00027;s correlation test, and &#x0201C;fail-safe N&#x0201D; method, as proposed by Fern&#x000E1;ndez-Castilla et al. (<xref ref-type="bibr" rid="B27">2019</xref>), were used in the current three-level meta-analysis. As shown in <xref ref-type="fig" rid="F2">Figure 2</xref>, the funnel plot is symmetrically distributed, suggesting no evidence of publication bias subjectively. Moreover, the statistically non-significant results of Egger&#x00027;s regression test (<italic>p</italic> = 0.246) and Begg&#x00027;s correlation test (<italic>p</italic> = 0.595) also does not show enough evidence to justify the presence of a publication bias. In addition, the fail-safe <italic>N</italic> was calculated to be 518503, which is much larger than the criteria that 5<italic>k</italic> &#x0002B; 10 = 5 &#x000D7; 132 &#x0002B; 10 = 670. Overall, all of the assessment results indicated the absence of publication bias in this study.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Funnel plot for effect sizes.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyg-12-784068-g0002.tif"/>
</fig>
</sec>
<sec>
<title>Moderator Analysis</title>
<p>The results of the moderator analyses on the association between attitude toward science and science performance are presented in <xref ref-type="table" rid="T2">Table 2</xref>.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Results for the moderator analysis of the relation between attitude toward science and science achievement.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Moderator variables</bold></th>
<th valign="top" align="center"><bold>No. studies</bold></th>
<th valign="top" align="center"><bold>No. ES</bold></th>
<th valign="top" align="center"><bold>Mean <italic>z</italic> (<italic>SE</italic>)</bold></th>
<th valign="top" align="center"><bold>95% CI</bold></th>
<th valign="top" align="center"><bold><italic>t</italic>-value (sig)</bold></th>
<th valign="top" align="center"><bold>Mean <italic>r</italic></bold></th>
<th valign="top" align="center"><bold><italic>F</italic> (df<sub><bold>1</bold></sub>, df<sub><bold>2</bold></sub>)</bold></th>
<th valign="top" align="center"><bold>Level 2 variance</bold></th>
<th valign="top" align="center"><bold>Level 3 variance</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Publication type</bold></td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">132</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>F</italic><sub>(1, 130)</sub> = 3.983&#x0002A;</td>
<td valign="top" align="center">0.011</td>
<td valign="top" align="center">0.012</td>
</tr>
<tr>
<td valign="top" align="left">Journal</td>
<td valign="top" align="center">32</td>
<td valign="top" align="center">114</td>
<td valign="top" align="center">0.266 (0.021)</td>
<td valign="top" align="center">(0.224, 0.307)</td>
<td valign="top" align="center">12.610&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.260</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Dissertation</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">18</td>
<td valign="top" align="center">0.123 (0.068)</td>
<td valign="top" align="center">(&#x02212;0.013, 0.258)</td>
<td valign="top" align="center">1.791</td>
<td valign="top" align="center">0.122</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Grade</bold></td>
<td valign="top" align="center">35</td>
<td valign="top" align="center">130</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>F</italic><sub>(3, 126)</sub> = 0.602</td>
<td valign="top" align="center">0.011</td>
<td valign="top" align="center">0.014</td>
</tr>
<tr>
<td valign="top" align="left">Elementary school</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center">0.219 (0.058)</td>
<td valign="top" align="center">(0.104, 0.334)</td>
<td valign="top" align="center">3.779&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.216</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Middle school</td>
<td valign="top" align="center">24</td>
<td valign="top" align="center">79</td>
<td valign="top" align="center">0.273 (0.028)</td>
<td valign="top" align="center">(0.218, 0.329)</td>
<td valign="top" align="center">9.780&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.266</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">High school</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">0.256 (0.048)</td>
<td valign="top" align="center">(0.161, 0.352)</td>
<td valign="top" align="center">5.297&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.251</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Others</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">9</td>
<td valign="top" align="center">0.176 (0.080)</td>
<td valign="top" align="center">(0.018, 0.333)</td>
<td valign="top" align="center">2.207&#x0002A;</td>
<td valign="top" align="center">0.174</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Geographical region</bold></td>
<td valign="top" align="center">33</td>
<td valign="top" align="center">128</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>F</italic><sub>(1, 126)</sub> = 0.051</td>
<td valign="top" align="center">0.010</td>
<td valign="top" align="center">0.011</td>
</tr>
<tr>
<td valign="top" align="left">Eastern</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">42</td>
<td valign="top" align="center">0.251 (0.032)</td>
<td valign="top" align="center">(0.187, 0.314)</td>
<td valign="top" align="center">7.837&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.246</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Western</td>
<td valign="top" align="center">21</td>
<td valign="top" align="center">86</td>
<td valign="top" align="center">0.241 (0.026)</td>
<td valign="top" align="center">(0.189, 0.293)</td>
<td valign="top" align="center">9.204&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.236</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Type of attitude</bold></td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">132</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>F</italic><sub>(3, 128)</sub> = 11.560&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.009</td>
<td valign="top" align="center">0.009</td>
</tr>
<tr>
<td valign="top" align="left">Interest</td>
<td valign="top" align="center">20</td>
<td valign="top" align="center">43</td>
<td valign="top" align="center">0.208 (0.024)</td>
<td valign="top" align="center">(0.160, 0.256)</td>
<td valign="top" align="center">8.541&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.205</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Self-efficacy</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">43</td>
<td valign="top" align="center">0.325 (0.025)</td>
<td valign="top" align="center">(0.276, 0.374)</td>
<td valign="top" align="center">13.151&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.314</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Societal relevance</td>
<td valign="top" align="center">13</td>
<td valign="top" align="center">30</td>
<td valign="top" align="center">0.169 (0.028)</td>
<td valign="top" align="center">(0.113, 0.224)</td>
<td valign="top" align="center">6.019&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.167</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Mixed attitude</td>
<td valign="top" align="center">14</td>
<td valign="top" align="center">16</td>
<td valign="top" align="center">0.294 (0.035)</td>
<td valign="top" align="center">(0.226, 0.363)</td>
<td valign="top" align="center">8.487&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.286</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Measures of achievement</bold></td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">132</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>F</italic><sub>(1, 130)</sub> = 7.001&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.010</td>
<td valign="top" align="center">0.015</td>
</tr>
<tr>
<td valign="top" align="left">Standardized</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">70</td>
<td valign="top" align="center">0.214 (0.026)</td>
<td valign="top" align="center">(0.163, 0.265)</td>
<td valign="top" align="center">8.307&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.211</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Unstandardized</td>
<td valign="top" align="center">16</td>
<td valign="top" align="center">62</td>
<td valign="top" align="center">0.314 (0.031)</td>
<td valign="top" align="center">(0.252, 0.376)</td>
<td valign="top" align="center">10.083&#x0002A;&#x0002A;&#x0002A;</td>
<td valign="top" align="center">0.304</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Publication year</bold></td>
<td valign="top" align="center">37</td>
<td valign="top" align="center">132</td>
<td valign="top" align="center">0.003 (0.002)</td>
<td valign="top" align="center">(&#x02212;0.001, 0.006)</td>
<td valign="top" align="center">1.443</td>
<td valign="top" align="center">0.003</td>
<td valign="top" align="center"><italic>F</italic><sub>(1, 130)</sub> = 2.083</td>
<td valign="top" align="center">0.011</td>
<td valign="top" align="center">0.013</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>No. Studies, number of studies; No. ES, number of effect sizes; Mean z, Mean effect size (Fisher&#x00027;s z); SE, standard error; CI, confidence interval; sig, significance; Mean r, Mean effect size (r); F (df1, df2), omnibus test; Level 2 variance, variance between effect sizes extracted from the same study; Level 3 variance, variance between studies.</italic></p> 
<p><italic>&#x0002A;p &#x0003C; 0.05; &#x0002A;&#x0002A;p &#x0003C; 0.01; &#x0002A;&#x0002A;&#x0002A;p &#x0003C; 0.001</italic>.</p>
</table-wrap-foot>
</table-wrap>
<sec>
<title>Publication Type</title>
<p>There were a total of 132 effect sizes in this study, with 114 from journal articles and 18 from dissertations. We found a statistically significant amount of explained effect-size heterogeneity for the publication type moderator [<italic>F</italic><sub>(1, 130)</sub> = 3.983, <italic>p</italic> &#x0003C; 0.05] and the effect sizes of journal articles (<italic>r</italic> = 0.260) appeared to be larger than those from dissertations (<italic>r</italic> = 0.122).</p>
</sec>
<sec>
<title>Grade</title>
<p>No significant differences were observed when considering the moderator effect of grade [<italic>F</italic><sub>(3, 126)</sub> = 0.602, <italic>p</italic> = 0.615], suggesting that attitude toward science among elementary school students, middle school students, high school students and others was all positively related to their science achievement with some consistency (<italic>r</italic> = 0.216; <italic>r</italic> = 0.266; <italic>r</italic> = 0.251; <italic>r</italic> = 0.174, respectively).</p>
</sec>
<sec>
<title>Geographical Region</title>
<p>In line with the grade, the geographical region did not explain a statistically significant amount of effect-size heterogeneity [<italic>F</italic><sub>(1, 126)</sub> = 0.051, <italic>p</italic> = 0.822]. Studies with samples from Eastern countries had the mean effect size of 0.246, and 0.236 for Western countries.</p>
</sec>
<sec>
<title>Type of Attitude</title>
<p>We found a significant moderating effect of attitude types [<italic>F</italic><sub>(3, 128)</sub> = 11.560, <italic>p</italic> &#x0003C; 0.001]. More specifically, the strength of the correlation between science performance and self-efficacy about science (<italic>r</italic> = 0.314) was stronger than that of interest (<italic>r</italic> = 0.205), societal relevance of attitude toward science (<italic>r</italic> = 0.167), and mixed attitude (<italic>r</italic> = 0.286).</p>
</sec>
<sec>
<title>Measures of Achievement</title>
<p>There are various instruments to measure achievement. We mainly divided the instrument types into two groups: standardized test and unstandardized assessment. The effect of the moderator was significant [<italic>F</italic><sub>(1, 130)</sub> = 7.001, <italic>p</italic> &#x0003C; 0.01]. The effect sizes of studies with unstandardized measure were larger (<italic>r</italic> = 0.304) than those with standardized measure (<italic>r</italic> = 0.211).</p>
</sec>
<sec>
<title>Publication Year</title>
<p>Studies included in our meta-analysis were published from 1982 to 2020 and there was a long time span. Our analysis showed that the association between attitude toward science and academic achievement in science did not appear to have changed with the time, with the slop of this regression model being statistically non-significant (&#x003B2; = 0.003, <italic>p</italic> = 0.151), indicating that the magnitude of effect sizes remained stable over the time period.</p>
</sec>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>This meta-analysis systematically synthesized the findings of the studies from 1982 to 2020 on the relationship between attitude toward science and academic achievement in science, and aimed to estimate the magnitude of overall association between the two variables. In addition, the study explored if some study features (publication type, grade level, geographical region, type of attitude, measures of achievement, and publication year) could have contributed to some observed inconsistent findings about this relationship across the studies.</p>
<p>Our investigation showed that, across the studies conducted over the past several decades, the overall correlation between attitude toward science and academic achievement in science was 0.248, a moderate positive association. Similar findings had been found in previous empirical studies (e.g., Acar et al., <xref ref-type="bibr" rid="B2">2015</xref>; Li et al., <xref ref-type="bibr" rid="B44">2020</xref>; Liou et al., <xref ref-type="bibr" rid="B46">2021</xref>). This relationship suggests that enhancing students&#x00027; positive attitude toward science could be conductive to students&#x00027; learning in science. The quantitative literature synthesis by Savelsbergh et al. (<xref ref-type="bibr" rid="B73">2016</xref>) showed that some context-based teaching approaches (e.g., inquiry-based learning, technology-based learning environments, collaborative learning, and extracurricular activities) could have significant positive influence on students&#x00027; overall attitude toward science. The meta-analytic study by Aguilera and Perales-Palacios (<xref ref-type="bibr" rid="B3">2020a</xref>) showed similar findings that some teaching methods/approaches (e.g., cooperative learning, project-based instruction, context-based instruction, and technology-multimedia materials) could lead to positive change in students&#x00027; attitude toward science. In the future, these learning strategies and other emerging teaching methods, such as flipped learning, game-based learning, etc., can be used in science education to assist students to develop more positive attitude toward science.</p>
<p>In this study, a set of study features (i.e., publication type, grade, geographical region, type of attitude, measures of achievement, and publication year) were examined for their possible contributions to the inconsistent findings across individual studies. Finally, publication type, the type of attitude, and measures of achievement were shown to have moderating effects on the effect sizes of the studies. These findings, or lack thereof, were discussed below.</p>
<sec>
<title>Publication Type</title>
<p>Our analysis found that the average effect size from journal articles was larger than that from dissertations. This may be due to the small number of dissertations (only five articles) in the included studies. However, based on the fact that our previous results did not show enough evidence to justify the presence of publication bias, this finding should be interpreted with caution.</p>
</sec>
<sec>
<title>Grade</title>
<p>Our synthesis showed that there was no significant difference among students at different grade levels (e.g., elementary, middle, high school), and science attitude had a moderate positive relationship with science learning in these grade levels. An issue that students&#x00027; s attitudes toward science might decline from elementary to middle school is received with concern (Potvin and Hasni, <xref ref-type="bibr" rid="B66">2014a</xref>). This finding of our study indicated that educators should pay attention to students&#x00027; attitudes toward science at the elementary-school level and make the appropriate intervention.</p>
</sec>
<sec>
<title>Region</title>
<p>The analysis showed no significant divergence across the studies conducted in different regions (Eastern countries and Western countries). This result was in agreement with some other research showed that the general relationship between attitude toward science and knowledge of scientific facts varied little across different countries (Allum et al., <xref ref-type="bibr" rid="B6">2008</xref>). Research also suggested that this lack of difference was also observed across countries within a region (e.g., Malaysia vs. Singapore, in Ng et al., <xref ref-type="bibr" rid="B56">2012</xref>). On a somewhat different issue, however, Lam and Lau (<xref ref-type="bibr" rid="B42">2014</xref>) suggested that students of Asian countries might have high performance in science, yet low levels of self-efficacy and self-concept in science, which might be due to the emphasis on modesty and humility in Asian cultures. How could this (i.e., high level of performance in science vs. low level of self-efficacy/self-concept among Asian students) have moderated the relationship between attitude toward science and performance in science is not clear, and warrants attention in future research.</p>
</sec>
<sec>
<title>Type of Attitude</title>
<p>Our results revealed that the science self-efficacy was more strongly connected to science achievement than that of interest, societal relevance of attitude toward science, and mixed attitude. This finding was in accordance with the proposition that the effect of self-efficacy on students&#x00027; learning performance could be stronger than some other dimensions (e.g., value, interest; Lam and Lau, <xref ref-type="bibr" rid="B42">2014</xref>), and self-efficacy could significantly predict science learning (e.g., Kaya and Bozdag, <xref ref-type="bibr" rid="B36">2016</xref>; Juan et al., <xref ref-type="bibr" rid="B35">2018</xref>; Kirbulut and Uzuntiryaki-Kondakci, <xref ref-type="bibr" rid="B39">2019</xref>). A meta-analysis conducted by Sun et al. (<xref ref-type="bibr" rid="B76">2021</xref>) also showed that there was a positive correlation between students&#x00027; self-efficacy and writing achievement in a second language. That&#x00027;s not surprising because the personal beliefs of competence might influence their behavior and decisions (Bandura, <xref ref-type="bibr" rid="B9">1993</xref>). Individuals with a high level of self-efficacy are likely to put forth more mental effort to solve problems and persist in the face of difficulties (Pajares, <xref ref-type="bibr" rid="B63">1996</xref>). One notable observation in this analysis was that the association between societal relevance of attitude toward science and science achievement was notably the weakest, which was in accord with recent studies (Wang and Liou, <xref ref-type="bibr" rid="B80">2017</xref>; Cohen and Chang, <xref ref-type="bibr" rid="B19">2020</xref>).</p>
</sec>
<sec>
<title>Measures of Achievement</title>
<p>Standardized test and unstandardized assessment for measuring science achievement could significantly affect the relationship between science attitude and science achievement. In general, the effect sizes based on unstandardized assessment were descriptively higher than those based on standardized test. This finding is in accordance with that of Mason et al. (<xref ref-type="bibr" rid="B49">2013</xref>) who also found that the association between self-concept or self-efficacy and science achievement measured with unstandardized test was stronger than with standardized test in fifth, eighth, and eleventh grades. One possible explanation could be that students&#x00027; attitude toward science could be based on their performance in the process of science learning more than on their actual science competence measured by standardized tests (Jansen et al., <xref ref-type="bibr" rid="B33">2014</xref>). Future research could comprehensively examine the association between attitude toward science and science achievement with standardized and unstandardized measures.</p>
</sec>
<sec>
<title>Publication Year</title>
<p>No significant effect of publication year was found in this meta-analysis, suggesting that the association between attitude toward science and academic achievement in science does not seem to be related to the time when the studies were published. This result is consistent with that of Willson (<xref ref-type="bibr" rid="B82">1983</xref>) who showed that the strength of this correlation did not vary significantly over time. Despite the recent trend of putting more emphasis on STEM education, it appears that the strength of the relationship between attitude toward science and science achievement has been stable, as shown in both previous (Willson, <xref ref-type="bibr" rid="B82">1983</xref>) and the present meta-analyses.</p>
</sec>
</sec>
<sec id="s5">
<title>Limitations and Future Directions</title>
<p>This meta-analysis shows that there is a statistically significant and robust positive relationship between students&#x00027; attitude toward science and their academic achievement in science, and the strength of this association is stronger in self-efficacy than in interest, societal relevance, mixed attitude, which offers valuable insights into the intervention of students&#x00027; science attitude. The study has some limitations that should be noted. First, we did not examine how gender groups could be different in the relationship between science attitude and performance in science learning, due to the very small number of studies that had such relevant information. But gender difference, or lack thereof, in science learning and in attitude toward science of students is an unsettled issue. While some studies suggested that males were more positive about science and had better academic outcomes in science than females (Jones et al., <xref ref-type="bibr" rid="B34">2000</xref>; Louis and Mistele, <xref ref-type="bibr" rid="B47">2012</xref>; Oluwatelure, <xref ref-type="bibr" rid="B61">2015</xref>), some other studies indicated that gender showed no significant role in this context (Miller et al., <xref ref-type="bibr" rid="B51">2002</xref>; Dhindsa and Chung, <xref ref-type="bibr" rid="B22">2003</xref>; Oludipe, <xref ref-type="bibr" rid="B60">2012</xref>). Further research is needed on how gender groups may or may not differ on these related issues.</p>
<p>Second, with regard to attitude toward science and science learning achievement, too few studies involved elementary school students. More specifically, only 6 of 37 studies involving elementary school students were found and included in our meta-analysis. Currently, there is growing evidence that science learning at younger age (e.g., elementary school) could be beneficial in a long term (Morgan et al., <xref ref-type="bibr" rid="B53">2016</xref>; Curran and Kitchin, <xref ref-type="bibr" rid="B20">2019</xref>). For example, Curran and Kitchin (<xref ref-type="bibr" rid="B20">2019</xref>) suggested that time spent on science instruction at younger age (kindergarten, first to third grades) could positively predict later science achievement. As a result, it should be highly beneficial to conduct relevant research involving primary school students.</p>
<p>Another limitation to this study was the limited set of study features that we examined as potential moderator variables (i.e., publication year, publication type, grade, geographical region, type of attitude, measures of achievement). There could be other factors (e.g., teaching experience of teachers, sampling method) that could affect the attitude toward science and science learning (Mohammadpour, <xref ref-type="bibr" rid="B52">2012</xref>; Ulutan and Aktan, <xref ref-type="bibr" rid="B78">2019</xref>). Future research on attitude toward science and science learning achievement may consider such and other relevant variables that may influence the constructs under study. In addition, the coded information of moderator variables also needs to be carefully considered.</p>
<p>Finally, the concept of science is broad, and the studies included in this meta-analysis were concerned about the overall attitude in science, but not about specific domains under science (e.g., physics, chemistry, biology, etc.). Nissen (<xref ref-type="bibr" rid="B57">2019</xref>) showed that female high school students had lower level of self-efficacy in physics course than in other science courses, and their level of self-efficacy in physics course was substantially lower than that of their male counterparts. Hence, it should be meaningful in future research to examine this issue (i.e., relationship between attitude and achievement) in different science subjects.</p>
</sec>
<sec sec-type="data-availability" id="s6">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/<xref ref-type="supplementary-material" rid="SM1">Supplementary Material</xref>, further inquiries can be directed to the corresponding author/s.</p>
</sec>
<sec id="s7">
<title>Author Contributions</title>
<p>ZC led the study design, data collection, statistical analysis, and drafted the manuscript. PM helped to analyze the data and draft the manuscript. XC and JH helped to design the study and collect data. XF helped to draft the manuscript. All authors read and approved the final manuscript.</p>
</sec>
<sec sec-type="funding-information" id="s8">
<title>Funding</title>
<p>This research was supported by the National Natural Science Foundation of China (Grant No. 62107018), Grant CCNU20QN025 from the Fundamental Research Funds for the Central Universities, and CCNU19TD019 from the self-determined research funds of CCNU from the colleges&#x00027; basic research and operation of MOE.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec> </body>
<back>
<sec sec-type="supplementary-material" id="s10">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2021.784068/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpsyg.2021.784068/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.xlsx" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Abu-Hilal</surname> <given-names>M. M.</given-names></name> <name><surname>Abdelfattah</surname> <given-names>F. A.</given-names></name> <name><surname>Shumrani</surname> <given-names>S. A.</given-names></name> <name><surname>Dodeen</surname> <given-names>H.</given-names></name> <name><surname>Abduljabber</surname> <given-names>A. S.</given-names></name> <name><surname>Marsh</surname> <given-names>H. W.</given-names></name></person-group> (<year>2014</year>). <article-title>Mathematics and science achievements predicted by self-concept and subject value among 8th grade Saudi students: invariance across gender</article-title>. <source>Int. Perspect. Psychol. Res. Pract. Consult.</source> <volume>3</volume>, <fpage>268</fpage>&#x02013;<lpage>283</lpage>. <pub-id pub-id-type="doi">10.1037/ipp0000022</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Acar</surname> <given-names>&#x000D6;.</given-names></name> <name><surname>T&#x000FC;rkmen</surname> <given-names>L.</given-names></name> <name><surname>Bilgin</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Examination of gender differences on cognitive and motivational factors that influence 8th graders&#x00027; science achievement in Turkey</article-title>. <source>Eur. J. Math. Sci. Technol. Educ.</source> <volume>11</volume>, <fpage>1027</fpage>&#x02013;<lpage>1040</lpage>. <pub-id pub-id-type="doi">10.12973/eurasia.2015.1372a</pub-id></citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aguilera</surname> <given-names>D.</given-names></name> <name><surname>Perales-Palacios</surname> <given-names>F. J.</given-names></name></person-group> (<year>2020a</year>). <article-title>What effects do didactic interventions have on students&#x00027; attitudes towards science? A meta-analysis</article-title>. <source>Res. Sci. Educ.</source> <volume>50</volume>, <fpage>573</fpage>&#x02013;<lpage>597</lpage>. <pub-id pub-id-type="doi">10.1007/s11165-018-9702-2</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aguilera</surname> <given-names>D.</given-names></name> <name><surname>Perales-Palacios</surname> <given-names>F. J.</given-names></name></person-group> (<year>2020b</year>). <article-title>Learning biology and geology through a participative teaching approach: the effect on student attitudes towards science and academic performance</article-title>. <source>J. Biol. Educ.</source> <volume>54</volume>, <fpage>245</fpage>&#x02013;<lpage>261</lpage>. <pub-id pub-id-type="doi">10.1080/00219266.2019.1569084</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aiken</surname> <given-names>L. R.</given-names></name> <name><surname>Aiken</surname> <given-names>D. R.</given-names></name></person-group> (<year>1969</year>). <article-title>Recent research on attitudes concerning science</article-title>. <source>Sci. Educ.</source> <volume>53</volume>, <fpage>295</fpage>&#x02013;<lpage>305</lpage>. <pub-id pub-id-type="doi">10.1002/sce.3730530405</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Allum</surname> <given-names>N.</given-names></name> <name><surname>Sturgis</surname> <given-names>P.</given-names></name> <name><surname>Tabourazi</surname> <given-names>D.</given-names></name> <name><surname>Brunton-Smith</surname> <given-names>I.</given-names></name></person-group> (<year>2008</year>). <article-title>Science knowledge and attitudes across cultures: a meta-analysis</article-title>. <source>Public Understand. Sci.</source> <volume>17</volume>, <fpage>35</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1177/0963662506070159</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Assink</surname> <given-names>M.</given-names></name> <name><surname>Wibbelink</surname> <given-names>C. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Fitting three-level meta-analytic models in R: a step-by-step tutorial</article-title>. <source>Quant. Methods Psychol.</source> <volume>12</volume>, <fpage>154</fpage>&#x02013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.20982/tqmp.12.3.p154</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Azizoglu</surname> <given-names>N.</given-names></name> <name><surname>&#x000C7;etin</surname> <given-names>G.</given-names></name></person-group> (<year>2009</year>). <article-title>The effect of learning style on middle schools students&#x00027; motivation and attitudes towards science, and the relationships among these variables</article-title>. <source>Kastam. Educ. J.</source> <volume>17</volume>, <fpage>171</fpage>&#x02013;<lpage>182</lpage>.</citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A..</given-names></name></person-group> (<year>1993</year>). <article-title>Perceived self-efficacy in cognitive development and functioning</article-title>. <source>Educ. Psychol.</source> <volume>28</volume>, <fpage>117</fpage>&#x02013;<lpage>148</lpage>. <pub-id pub-id-type="doi">10.1207/s15326985ep2802_3</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bati</surname> <given-names>K.</given-names></name> <name><surname>Yeti&#x0015F;ir</surname> <given-names>M.</given-names></name> <name><surname>Gunes</surname> <given-names>G.</given-names></name></person-group> (<year>2019</year>). <article-title>A comparative analysis of the effect of students affective characteristics on their science performance between countries based on PISA 2015 data</article-title>. <source>Hacettepe Univ. J. Educ.</source> <volume>34</volume>, <fpage>999</fpage>&#x02013;<lpage>1014</lpage>. <pub-id pub-id-type="doi">10.16986/HUJE.2019050025</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Borenstein</surname> <given-names>M.</given-names></name> <name><surname>Hedges</surname> <given-names>L. V.</given-names></name> <name><surname>Higgins</surname> <given-names>J. P. T.</given-names></name> <name><surname>Rothstein</surname> <given-names>H. R.</given-names></name></person-group> (<year>2009</year>). <source>Introduction to Meta-Analysis.</source> <publisher-loc>West Sussex</publisher-loc>: <publisher-name>John Wiley &#x00026; Sons</publisher-name>. <pub-id pub-id-type="doi">10.1002/9780470743386</pub-id><pub-id pub-id-type="pmid">29218357</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Breakwell</surname> <given-names>G. M.</given-names></name> <name><surname>Beardsell</surname> <given-names>S.</given-names></name></person-group> (<year>1992</year>). <article-title>Gender, parental and peer influences upon science attitudes and activities</article-title>. <source>Public Understand. Sci.</source> <volume>1</volume>, <fpage>183</fpage>&#x02013;<lpage>197</lpage>. <pub-id pub-id-type="doi">10.1088/0963-6625/1/2/003</pub-id><pub-id pub-id-type="pmid">1439157</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="book"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Brooks</surname> <given-names>T..</given-names></name></person-group> (<year>2011</year>). <source>Effects of Single-Gender Middle School Classes on Science Achievement and Attitude.</source> (<publisher-loc>Unpublished doctoral dissertation</publisher-loc>), Walden University, Minneapolis, MA (USA).</citation>
</ref>
<ref id="B14">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Card</surname> <given-names>N. A..</given-names></name></person-group> (<year>2012</year>). <source>Applied Meta-Analysis for Social Science Research.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name>.</citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Chang</surname> <given-names>C. Y.</given-names></name> <name><surname>Cheng</surname> <given-names>W. Y.</given-names></name></person-group> (<year>2008</year>). <article-title>Science achievement and students&#x00027; self-confidence and interest in science: a Taiwanese representative sample study</article-title>. <source>Int. J. Sci. Educ.</source> <volume>30</volume>, <fpage>1183</fpage>&#x02013;<lpage>1200</lpage>. <pub-id pub-id-type="doi">10.1080/09500690701435384</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname> <given-names>M. H. M.</given-names></name> <name><surname>Wan</surname> <given-names>Z. H.</given-names></name></person-group> (<year>2016</year>). <article-title>Unpacking the paradox of Chinese science learners: insights from research into asian chinese school students&#x00027; attitudes towards learning science, science learning strategies, and scientific epistemological views.</article-title> <source>Stud. Sci. Educ.</source> <volume>52</volume>, <fpage>29</fpage>&#x02013;<lpage>62</lpage>. <pub-id pub-id-type="doi">10.1080/03057267.2015.1112471</pub-id></citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheung</surname> <given-names>M. W.-L..</given-names></name></person-group> (<year>2014</year>). <article-title>Modeling dependent effect sizes with three-level meta-analyses: a structural equation modeling approach</article-title>. <source>Psychol. Methods</source> <volume>19</volume>, <fpage>211</fpage>&#x02013;<lpage>229</lpage>. <pub-id pub-id-type="doi">10.1037/a0032968</pub-id><pub-id pub-id-type="pmid">23834422</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Chi</surname> <given-names>S.</given-names></name> <name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Liu</surname> <given-names>X.</given-names></name> <name><surname>Zhu</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>Associations among attitudes, perceived difficulty of learning science, gender, parents&#x00027; occupation and students&#x00027; scientific competencies</article-title>. <source>Int. J. Sci. Educ.</source> <volume>39</volume>, <fpage>2171</fpage>&#x02013;<lpage>2188</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2017.1366675</pub-id></citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Cohen</surname> <given-names>S. M.</given-names></name> <name><surname>Chang</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>Science achievement within the United States: a view through affective and demographic lenses</article-title>. <source>Educ. Stud.</source> <volume>46</volume>, <fpage>221</fpage>&#x02013;<lpage>239</lpage>. <pub-id pub-id-type="doi">10.1080/03055698.2018.1555455</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Curran</surname> <given-names>F. C.</given-names></name> <name><surname>Kitchin</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>Early elementary science instruction: does more time on science or science topics/skills predict science achievement in the early grades?</article-title> <source>Aera Open</source> <volume>5</volume>, <fpage>1</fpage>&#x02013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1177/2332858419861081</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Darmawan</surname> <given-names>I. G. N..</given-names></name></person-group> (<year>2020</year>). <article-title>The changes in attitudes of 15-year-old Australian students towards reading, mathematics and science and their impact on student performance</article-title>. <source>Austral. J. Educ.</source> <volume>64</volume>, <fpage>304</fpage>&#x02013;<lpage>327</lpage>. <pub-id pub-id-type="doi">10.1177/0004944120947873</pub-id></citation>
</ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dhindsa</surname> <given-names>H. S.</given-names></name> <name><surname>Chung</surname> <given-names>G.</given-names></name></person-group> (<year>2003</year>). <article-title>Attitudes and achievement of bruneian science students</article-title>. <source>Int. J. Sci. Educ.</source> <volume>25</volume>, <fpage>907</fpage>&#x02013;<lpage>922</lpage>. <pub-id pub-id-type="doi">10.1080/09500690305025</pub-id></citation>
</ref>
<ref id="B23">
<citation citation-type="book"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Diggs</surname> <given-names>L. L..</given-names></name></person-group> (<year>1997</year>). <source>Student Attitude Toward and Achievement in Science in a Problem-Based Learning Educational Experience.</source> (<publisher-loc>Unpublished doctoral dissertation</publisher-loc>), University of Missouri Columbia, Missouri, MA (USA).</citation>
</ref>
<ref id="B24">
<citation citation-type="book"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Dowey</surname> <given-names>A. L..</given-names></name></person-group> (<year>2013</year>). <source>Attitudes, Interests, and Perceived Self-Efficacy toward Science of Middle School Minority Female Students: Considerations for Their Low Achievement and Participation in STEM Disciplines</source>. (Unpublished doctoral dissertation), University of California, San Diego, CA (USA).</citation>
</ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Else-Quest</surname> <given-names>N. M.</given-names></name> <name><surname>Mineo</surname> <given-names>C. C.</given-names></name> <name><surname>Higgins</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Math and science attitudes and achievement at the intersection of gender and ethnicity</article-title>. <source>Psychol. Women Q.</source> <volume>37</volume>, <fpage>293</fpage>&#x02013;<lpage>309</lpage>. <pub-id pub-id-type="doi">10.1177/0361684313480694</pub-id></citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferguson</surname> <given-names>C. J.</given-names></name> <name><surname>Brannick</surname> <given-names>M. T.</given-names></name></person-group> (<year>2012</year>). <article-title>Publication bias in psychological science: prevalence, methods for identifying and controlling, and implications for the use of meta-analyses</article-title>. <source>Psychol. Methods</source> <volume>17</volume>, <fpage>120</fpage>&#x02013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1037/a0024445</pub-id><pub-id pub-id-type="pmid">21787082</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fern&#x000E1;ndez-Castilla</surname> <given-names>B.</given-names></name> <name><surname>Declercq</surname> <given-names>L.</given-names></name> <name><surname>Jamshidi</surname> <given-names>L.</given-names></name> <name><surname>Beretvas</surname> <given-names>S. N.</given-names></name> <name><surname>Onghena</surname> <given-names>P.</given-names></name> <name><surname>Van den Noortgate</surname> <given-names>W.</given-names></name></person-group> (<year>2019</year>). <article-title>Detecting selection bias in meta-analyses with multiple outcomes: a simulation study</article-title>. <source>J. Exp. Educ.</source> <volume>89</volume>, <fpage>125</fpage>&#x02013;<lpage>144</lpage>. <pub-id pub-id-type="doi">10.1080/00220973.2019.1582470</pub-id><pub-id pub-id-type="pmid">32720712</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Freedman</surname> <given-names>M. P..</given-names></name></person-group> (<year>1997</year>). <article-title>Relationship among laboratory instruction, attitude toward science, and achievement in science knowledge</article-title>. <source>J. Res. Sci. Teach.</source> <volume>34</volume>, <fpage>343</fpage>&#x02013;<lpage>357</lpage>. <pub-id pub-id-type="doi">10.1002/(SICI)1098-2736(199704)34:4&#x0003C;343::AID-TEA5&#x0003E;3.0.CO;2-R</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gardner</surname> <given-names>P. L..</given-names></name></person-group> (<year>1975</year>). <article-title>Attitudes to science: a review</article-title>. <source>Stud. Sci. Educ.</source> <volume>2</volume>, <fpage>1</fpage>&#x02013;<lpage>41</lpage>. <pub-id pub-id-type="doi">10.1080/03057267508559818</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gardner</surname> <given-names>P. L..</given-names></name></person-group> (<year>1995</year>). <article-title>Measuring attitudes to science: unidimensionality and internal consistency revisited</article-title>. <source>Res. Sci. Educ.</source> <volume>25</volume>, <fpage>283</fpage>&#x02013;<lpage>289</lpage>. <pub-id pub-id-type="doi">10.1007/BF02357402</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Hacieminoglu</surname> <given-names>E..</given-names></name></person-group> (<year>2016</year>). <article-title>Elementary school students&#x00027; attitude toward science and related variables</article-title>. <source>Int. J. Environ. Sci. Educ.</source> <volume>11</volume>, <fpage>35</fpage>&#x02013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.12973/ijese.2016.288a</pub-id></citation>
</ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Hamilton</surname> <given-names>M. A..</given-names></name></person-group> (<year>1982</year>). <article-title>Jamaican students&#x00027; attitude to science as it relates to achievement in external examinations</article-title>. <source>Sci. Educ.</source> <volume>66</volume>, <fpage>155</fpage>&#x02013;<lpage>169</lpage>. <pub-id pub-id-type="doi">10.1002/sce.3730660203</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jansen</surname> <given-names>M.</given-names></name> <name><surname>Schroeders</surname> <given-names>U.</given-names></name> <name><surname>L&#x000FC;dtke</surname> <given-names>O.</given-names></name></person-group> (<year>2014</year>). <article-title>Academic self-concept in science: multidimensionality, relations to achievement measures, and gender differences</article-title>. <source>Learn. Individ. Differ.</source> <volume>30</volume>, <fpage>11</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1016/j.lindif.2013.12.003</pub-id></citation>
</ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>M. G.</given-names></name> <name><surname>Howe</surname> <given-names>A.</given-names></name> <name><surname>Rua</surname> <given-names>M. J.</given-names></name></person-group> (<year>2000</year>). <article-title>Gender differences in students&#x00027; experiences, interests, and attitudes toward science and scientists</article-title>. <source>Sci. Educ.</source> <volume>84</volume>, <fpage>180</fpage>&#x02013;<lpage>192</lpage>. <pub-id pub-id-type="doi">10.1002/(SICI)1098-237X(200003)84:2&#x0003C;180::AID-SCE3&#x0003E;3.0.CO;2-X</pub-id></citation>
</ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Juan</surname> <given-names>A.</given-names></name> <name><surname>Hannan</surname> <given-names>S.</given-names></name> <name><surname>Namome</surname> <given-names>C.</given-names></name></person-group> (<year>2018</year>). <article-title>I believe I can do science: self-efficacy and science achievement of grade 9 students in South Africa</article-title>. <source>S. Afr. J. Sci.</source> <volume>114</volume>, <fpage>48</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.17159/sajs.2018/20170269</pub-id><pub-id pub-id-type="pmid">20170269</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaya</surname> <given-names>D.</given-names></name> <name><surname>Bozdag</surname> <given-names>H. C.</given-names></name></person-group> (<year>2016</year>). <article-title>Resources of mathematics self-efficacy and perception of science self-efficacy as predictors of academic achievement</article-title>. <source>Euro. J. Contemp. Educ.</source> <volume>18</volume>, <fpage>438</fpage>&#x02013;<lpage>451</lpage>. <pub-id pub-id-type="doi">10.13187/ejced.2016.18.438</pub-id></citation>
</ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kennedy</surname> <given-names>J.</given-names></name> <name><surname>Lyons</surname> <given-names>J. T.</given-names></name> <name><surname>Quinn</surname> <given-names>F.</given-names></name></person-group> (<year>2014</year>). <article-title>The continuing decline of science and mathematics enrolments in Australian high schools.</article-title> <source>Teach. Sci. J. Austral. Sci. Teach. Assoc.</source> <volume>60</volume>, <fpage>34</fpage>&#x02013;<lpage>46</lpage>.</citation>
</ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kennedy</surname> <given-names>J.</given-names></name> <name><surname>Quinn</surname> <given-names>F.</given-names></name> <name><surname>Taylor</surname> <given-names>N.</given-names></name></person-group> (<year>2016</year>). <article-title>The school science attitude survey: a new instrument for measuring attitudes towards school science</article-title>. <source>Int. J. Res. Method Educ.</source> <volume>39</volume>, <fpage>422</fpage>&#x02013;<lpage>445</lpage>. <pub-id pub-id-type="doi">10.1080/1743727X.2016.1160046</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kirbulut</surname> <given-names>Z. D.</given-names></name> <name><surname>Uzuntiryaki-Kondakci</surname> <given-names>E.</given-names></name></person-group> (<year>2019</year>). <article-title>Examining the mediating effect of science self-efficacy on the relationship between metavariables and science achievement</article-title>. <source>Int. J. Sci. Educ.</source> <volume>41</volume>, <fpage>995</fpage>&#x02013;<lpage>1014</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2019.1585594</pub-id></citation>
</ref>
<ref id="B40">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Klopfer</surname> <given-names>L. E..</given-names></name></person-group> (<year>1971</year>). <article-title>Evaluation of learning in science,</article-title> in <source>Handbook of Formative and Summative Evaluation of Student Learning</source>, eds B. S. Bloom, J. T. Hastings, and G. F. Madaus (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>McGraw-Hill</publisher-name>), <fpage>559</fpage>&#x02013;<lpage>642</lpage>.</citation>
</ref>
<ref id="B41">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Koballa</surname> <given-names>T. R. Jr..</given-names></name></person-group> (<year>1995</year>). <article-title>Children&#x00027;s attitudes toward learning science,</article-title> in <source>Learning Science in the Schools: Research Reforming Practice</source>, eds S. M. Glynn and R. Duit (<publisher-loc>Hillsdale, NJ</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates, Inc</publisher-name>), <fpage>59</fpage>&#x02013;<lpage>84</lpage>.</citation>
</ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lam</surname> <given-names>T. Y. P.</given-names></name> <name><surname>Lau</surname> <given-names>K. C.</given-names></name></person-group> (<year>2014</year>). <article-title>Examining factors affecting science achievement of Hong Kong in PISA 2006 using hierarchical linear modeling</article-title>. <source>Int. J. Sci. Educ.</source> <volume>36</volume>, <fpage>2463</fpage>&#x02013;<lpage>2480</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2013.879223</pub-id></citation>
</ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Larson</surname> <given-names>L. M.</given-names></name> <name><surname>Stephen</surname> <given-names>A.</given-names></name> <name><surname>Bonitz</surname> <given-names>V. S.</given-names></name> <name><surname>Wu</surname> <given-names>T. F.</given-names></name></person-group> (<year>2014</year>). <article-title>Predicting science achievement in India: role of gender, self-efficacy, interests, and effort</article-title>. <source>J. Car. Assess.</source> <volume>22</volume>, <fpage>89</fpage>&#x02013;<lpage>101</lpage>. <pub-id pub-id-type="doi">10.1177/1069072713487975</pub-id></citation>
</ref>
<ref id="B44">
<citation citation-type="book"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Li</surname> <given-names>S.</given-names></name> <name><surname>Liu</surname> <given-names>X.</given-names></name> <name><surname>Tripp</surname> <given-names>J.</given-names></name> <name><surname>Yang</surname> <given-names>Y.</given-names></name></person-group> (<year>2020</year>). <article-title>From ICT availability to student science achievement: mediation effects of ICT psychological need satisfactions and interest across genders</article-title>. <source>Res. Sci. Technol. Educ.</source> 1&#x02013;20. <pub-id pub-id-type="doi">10.1080/02635143.2020.1830269</pub-id></citation>
</ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Liou</surname> <given-names>P.-Y.</given-names></name> <name><surname>Liu</surname> <given-names>E. Z.-F.</given-names></name></person-group> (<year>2015</year>). <article-title>An analysis of the relationships between Taiwanese eighth and fourth graders&#x00027; motivational beliefs and science achievement in TIMSS 2011</article-title>. <source>Asia Pac. Educ. Rev.</source> <volume>16</volume>, <fpage>433</fpage>&#x02013;<lpage>445</lpage>. <pub-id pub-id-type="doi">10.1007/s12564-015-9381-x</pub-id></citation>
</ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Liou</surname> <given-names>P.-Y.</given-names></name> <name><surname>Wang</surname> <given-names>C.-L.</given-names></name> <name><surname>Lin</surname> <given-names>J. J. H.</given-names></name> <name><surname>Areepattamannil</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). <article-title>Assessing students&#x00027; motivational beliefs about learning science across grade level and gender</article-title>. <source>J. Exp. Educ.</source> <volume>89</volume>, <fpage>605</fpage>&#x02013;<lpage>624</lpage>. <pub-id pub-id-type="doi">10.1080/00220973.2020.1721413</pub-id></citation>
</ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Louis</surname> <given-names>R. A.</given-names></name> <name><surname>Mistele</surname> <given-names>J. M.</given-names></name></person-group> (<year>2012</year>). <article-title>The differences in scores and self-efficacy by student gender in mathematics and science</article-title>. <source>Int. J. Sci. Math. Educ.</source> <volume>10</volume>, <fpage>1163</fpage>&#x02013;<lpage>1190</lpage>. <pub-id pub-id-type="doi">10.1007/s10763-011-9325-9</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Martin</surname> <given-names>M. O.</given-names></name> <name><surname>Mullis</surname> <given-names>I. V.</given-names></name> <name><surname>Foy</surname> <given-names>P.</given-names></name> <name><surname>Stanco</surname> <given-names>G. M.</given-names></name></person-group> (<year>2012</year>). <source>TIMSS 2011 International Results in Science.</source> <publisher-loc>Amsterdam</publisher-loc>: <publisher-name>International Association for the Evaluation of Educational Achievement</publisher-name>.</citation>
</ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Mason</surname> <given-names>L.</given-names></name> <name><surname>Boscolo</surname> <given-names>P.</given-names></name> <name><surname>Tornatora</surname> <given-names>M. C.</given-names></name> <name><surname>Ronconi</surname> <given-names>L.</given-names></name></person-group> (<year>2013</year>). <article-title>Besides knowledge: a cross-sectional study on the relations between epistemic beliefs, achievement goals, self-beliefs, and achievement in science</article-title>. <source>Instruct. Sci.</source> <volume>41</volume>, <fpage>49</fpage>&#x02013;<lpage>79</lpage>. <pub-id pub-id-type="doi">10.1007/s11251-012-9210-0</pub-id></citation>
</ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Mattern</surname> <given-names>N.</given-names></name> <name><surname>Schau</surname> <given-names>C.</given-names></name></person-group> (<year>2002</year>). <article-title>Gender differences in science attitude-achievement relationships over time among white middle-class students</article-title>. <source>J. Res. Sci. Teach.</source> <volume>39</volume>, <fpage>324</fpage>&#x02013;<lpage>340</lpage>. <pub-id pub-id-type="doi">10.1002/tea.10024</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miller</surname> <given-names>L.</given-names></name> <name><surname>Lietz</surname> <given-names>L.</given-names></name> <name><surname>Kotte</surname> <given-names>D.</given-names></name></person-group> (<year>2002</year>). <article-title>On decreasing gender differences and attitudinal changes: factors influencing Australian and English pupils&#x00027; choice of a career in science</article-title>. <source>Psychol. Evolut. Gender</source> <volume>4</volume>, <fpage>69</fpage>&#x02013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1080/1461666021000013670</pub-id></citation>
</ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mohammadpour</surname> <given-names>E..</given-names></name></person-group> (<year>2012</year>). <article-title>A multilevel study on trends in Malaysian secondary school students&#x00027; science achievement and associated school and student predictors</article-title>. <source>Sci. Educ.</source> <volume>96</volume>, <fpage>1013</fpage>&#x02013;<lpage>1046</lpage>. <pub-id pub-id-type="doi">10.1002/sce.21028</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morgan</surname> <given-names>P. L.</given-names></name> <name><surname>Farkas</surname> <given-names>G.</given-names></name> <name><surname>Hillemeier</surname> <given-names>M. M.</given-names></name> <name><surname>Maczuga</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Science achievement gaps begin very early, persist, and are largely explained by modifiable factors</article-title>. <source>Educ. Res.</source> <volume>45</volume>, <fpage>18</fpage>&#x02013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.3102/0013189X16633182</pub-id></citation>
</ref>
<ref id="B54">
<citation citation-type="book"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Mungin</surname> <given-names>R. E..</given-names></name></person-group> (<year>2012</year>). <source>Problem-Based Learning versus Traditional Science Instruction: Achievement and Interest in Science of Middle Grades Minority Females</source>. (Unpublished doctoral dissertation), Capella University, Minneapolis, MA (USA).</citation>
</ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Napier</surname> <given-names>J. D.</given-names></name> <name><surname>Riley</surname> <given-names>J. P.</given-names></name></person-group> (<year>1985</year>). <article-title>Relationship between affective determinants and achievement in science for seventeen-year-olds</article-title>. <source>J. Res. Sci. Teach.</source> <volume>22</volume>, <fpage>365</fpage>&#x02013;<lpage>383</lpage>. <pub-id pub-id-type="doi">10.1002/tea.3660220407</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Ng</surname> <given-names>K. T.</given-names></name> <name><surname>Lay</surname> <given-names>Y. F.</given-names></name> <name><surname>Areepattamannil</surname> <given-names>S.</given-names></name> <name><surname>Treagust</surname> <given-names>D. F.</given-names></name> <name><surname>Chandrasegaran</surname> <given-names>A.</given-names></name></person-group> (<year>2012</year>). <article-title>Relationship between affect and achievement in science and mathematics in Malaysia and Singapore</article-title>. <source>Res. Sci. Technol. Educ.</source> <volume>30</volume>, <fpage>225</fpage>&#x02013;<lpage>237</lpage>. <pub-id pub-id-type="doi">10.1080/02635143.2012.708655</pub-id></citation>
</ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nissen</surname> <given-names>J. M..</given-names></name></person-group> (<year>2019</year>). <article-title>Gender differences in self-efficacy states in high school physics</article-title>. <source>Phys. Rev. Phys. Educ. Res.</source> <volume>15</volume>:<fpage>013102</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevPhysEducRes.15.013102</pub-id></citation>
</ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Nolen</surname> <given-names>S. B..</given-names></name></person-group> (<year>2003</year>). <article-title>Learning environment, motivation, and achievement in high school science</article-title>. <source>J. Res. Sci. Teach.</source> <volume>40</volume>, <fpage>347</fpage>&#x02013;<lpage>368</lpage>. <pub-id pub-id-type="doi">10.1002/tea.10080</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Oliver</surname> <given-names>J. S.</given-names></name> <name><surname>Simpson</surname> <given-names>R. D.</given-names></name></person-group> (<year>1988</year>). <article-title>Influences of attitude toward science, achievement motivation, and science self-concept on achievement in science: a longitudinal study</article-title>. <source>Sci. Educ.</source> <volume>72</volume>, <fpage>143</fpage>&#x02013;<lpage>155</lpage>. <pub-id pub-id-type="doi">10.1002/sce.3730720204</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oludipe</surname> <given-names>D..</given-names></name></person-group> (<year>2012</year>). <article-title>Gender difference in nigerian junior secondary students&#x00027; academic achievement in basic science</article-title>. <source>J. Educ. Soc. Res.</source> <volume>2</volume>, <fpage>93</fpage>&#x02013;<lpage>99</lpage>.</citation>
</ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Oluwatelure</surname> <given-names>T. A..</given-names></name></person-group> (<year>2015</year>). <article-title>Gender difference in achievement and attitude of public secondary school students towards science</article-title>. <source>J. Educ. Pract.</source> <volume>6</volume>, <fpage>87</fpage>&#x02013;<lpage>92</lpage>.</citation>
</ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Osborne</surname> <given-names>J.</given-names></name> <name><surname>Simon</surname> <given-names>S.</given-names></name> <name><surname>Collins</surname> <given-names>S.</given-names></name></person-group> (<year>2003</year>). <article-title>Attitudes towards science: a review of the literature and its implications</article-title>. <source>Int. J. Sci. Educ.</source> <volume>25</volume>, <fpage>1049</fpage>&#x02013;<lpage>1079</lpage>. <pub-id pub-id-type="doi">10.1080/0950069032000032199</pub-id></citation>
</ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pajares</surname> <given-names>F..</given-names></name></person-group> (<year>1996</year>). <article-title>Self-efficacy beliefs in academic settings</article-title>. <source>Rev. Educ. Res.</source> <volume>66</volume>, <fpage>543</fpage>&#x02013;<lpage>578</lpage>. <pub-id pub-id-type="doi">10.3102/00346543066004543</pub-id></citation>
</ref>
<ref id="B64">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Petty</surname> <given-names>R. E.</given-names></name> <name><surname>Fabrigar</surname> <given-names>L. R.</given-names></name> <name><surname>Wegener</surname> <given-names>D. T.</given-names></name></person-group> (<year>2003</year>). <article-title>Emotional factors in attitudes and persuasion,</article-title> in <source>Handbook of Affective Sciences: Series in Affective Science</source>, eds R. J. Davidson, K. R. Scherer, and H. H. Goldsmith (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>), <fpage>752</fpage>&#x02013;<lpage>772</lpage>.</citation>
</ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pisa</surname> <given-names>N.</given-names></name> <name><surname>Viviers</surname> <given-names>W.</given-names></name> <name><surname>Rossouw</surname> <given-names>R.</given-names></name></person-group> (<year>2017</year>). <article-title>Enhancing industrial cluster formation through the realistic export opportunities of the TRADE-DSM</article-title>. <source>South Afr. J. Econ.</source> <volume>85</volume>, <fpage>386</fpage>&#x02013;<lpage>404</lpage>. <pub-id pub-id-type="doi">10.1111/saje.12138</pub-id></citation>
</ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Potvin</surname> <given-names>P.</given-names></name> <name><surname>Hasni</surname> <given-names>A.</given-names></name></person-group> (<year>2014a</year>). <article-title>Analysis of the decline in interest towards school science and technology from grades 5 through 11</article-title>. <source>J. Sci. Educ. Technol.</source> <volume>23</volume>, <fpage>784</fpage>&#x02013;<lpage>802</lpage>. <pub-id pub-id-type="doi">10.1007/s10956-014-9512-x</pub-id></citation>
</ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Potvin</surname> <given-names>P.</given-names></name> <name><surname>Hasni</surname> <given-names>A.</given-names></name></person-group> (<year>2014b</year>). <article-title>Interest, motivation and attitudes toward science and technology at K-12 levels: a systematic review of 12 years of educational research</article-title>. <source>Stud. Sci. Educ.</source> <volume>50</volume>, <fpage>85</fpage>&#x02013;<lpage>129</lpage>. <pub-id pub-id-type="doi">10.1080/03057267.2014.881626</pub-id></citation>
</ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reid</surname> <given-names>N..</given-names></name></person-group> (<year>2006</year>). <article-title>Thoughts on attitude measurement</article-title>. <source>Res. Sci. Technol. Educ.</source> <volume>24</volume>, <fpage>3</fpage>&#x02013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1080/02635140500485332</pub-id></citation>
</ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Rennie</surname> <given-names>L. J.</given-names></name> <name><surname>Punch</surname> <given-names>K. F.</given-names></name></person-group> (<year>1991</year>). <article-title>The relationship between affect and achievement in science</article-title>. <source>J. Res. Sci. Teach.</source> <volume>28</volume>, <fpage>193</fpage>&#x02013;<lpage>209</lpage>. <pub-id pub-id-type="doi">10.1002/tea.3660280209</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosenthal</surname> <given-names>R..</given-names></name></person-group> (<year>1979</year>). <article-title>The file drawer problem and tolerance for null results</article-title>. <source>Psychol. Bull.</source> <volume>86</volume>, <fpage>638</fpage>&#x02013;<lpage>641</lpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.86.3.638</pub-id></citation>
</ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sahin</surname> <given-names>D.</given-names></name> <name><surname>Yilmaz</surname> <given-names>R. M.</given-names></name></person-group> (<year>2020</year>). <article-title>The effect of augmented reality technology on middle school students&#x00027; achievements and attitudes towards science education</article-title>. <source>Comput. Educ.</source> <volume>144</volume>:<fpage>103710</fpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2019.103710</pub-id></citation>
</ref>
<ref id="B72">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Salmi</surname> <given-names>H.</given-names></name> <name><surname>Thuneberg</surname> <given-names>H.</given-names></name> <name><surname>Vainikainen</surname> <given-names>M. P.</given-names></name></person-group> (<year>2016</year>). <article-title>How do engineering attitudes vary by gender and motivation? Attractiveness of outreach science exhibitions in four countries</article-title>. <source>Euro. J. Eng. Educ.</source> <volume>41</volume>, <fpage>638</fpage>&#x02013;<lpage>659</lpage>. <pub-id pub-id-type="doi">10.1080/03043797.2015.1121466</pub-id></citation>
</ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Savelsbergh</surname> <given-names>E. R.</given-names></name> <name><surname>Prins</surname> <given-names>G. T.</given-names></name> <name><surname>Rietbergen</surname> <given-names>C.</given-names></name> <name><surname>Fechner</surname> <given-names>S.</given-names></name> <name><surname>Vaessen</surname> <given-names>B. E.</given-names></name> <name><surname>Draijer</surname> <given-names>J. M.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Effects of innovative science and mathematics teaching on student attitudes and achievement: a meta-analytic study</article-title>. <source>Educ. Res. Rev.</source> <volume>19</volume>, <fpage>158</fpage>&#x02013;<lpage>172</lpage>. <pub-id pub-id-type="doi">10.1016/j.edurev.2016.07.003</pub-id></citation>
</ref>
<ref id="B74">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schibeci</surname> <given-names>R. A..</given-names></name></person-group> (<year>1983</year>). <article-title>Selecting appropriate attitudinal objectives for school science</article-title>. <source>Sci. Educ.</source> <volume>67</volume>, <fpage>595</fpage>&#x02013;<lpage>603</lpage>. <pub-id pub-id-type="doi">10.1002/sce.3730670508</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Schibeci</surname> <given-names>R. A.</given-names></name> <name><surname>Riley</surname> <given-names>J. P.</given-names></name></person-group> (<year>1986</year>). <article-title>Influence of students&#x00027; background and perceptions on science attitudes and achievement</article-title>. <source>J. Res. Sci. Teach.</source> <volume>23</volume>, <fpage>177</fpage>&#x02013;<lpage>187</lpage>. <pub-id pub-id-type="doi">10.1002/tea.3660230302</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B76">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sun</surname> <given-names>T.</given-names></name> <name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Lambert</surname> <given-names>R. G.</given-names></name> <name><surname>Liu</surname> <given-names>L.</given-names></name></person-group> (<year>2021</year>). <article-title>Relationship between second language english writing self-efficacy and achievement: a meta-regression analysis</article-title>. <source>J. Sec. Lang. Writ.</source> <volume>53</volume>:<fpage>100817</fpage>. <pub-id pub-id-type="doi">10.1016/j.jslw.2021.100817</pub-id></citation>
</ref>
<ref id="B77">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tai</surname> <given-names>R. H.</given-names></name> <name><surname>Liu</surname> <given-names>C. Q.</given-names></name> <name><surname>Maltese</surname> <given-names>A. V.</given-names></name> <name><surname>Fan</surname> <given-names>X.</given-names></name></person-group> (<year>2006</year>). <article-title>Career choice: planning early for careers in science</article-title>. <source>Science</source> <volume>312</volume>, <fpage>1143</fpage>&#x02013;<lpage>1144</lpage>. <pub-id pub-id-type="doi">10.1126/science.1128690</pub-id><pub-id pub-id-type="pmid">16728620</pub-id></citation></ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ulutan</surname> <given-names>E.</given-names></name> <name><surname>Aktan</surname> <given-names>D. C.</given-names></name></person-group> (<year>2019</year>). <article-title>Investigation of the variables affecting the students&#x00027; science achievement with multilevel regression model</article-title>. <source>J. Measure. Evaluat. Educ. Psychol.</source> <volume>10</volume>, <fpage>365</fpage>&#x02013;<lpage>377</lpage>. <pub-id pub-id-type="doi">10.21031/epod.533713</pub-id></citation>
</ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Viechtbauer</surname> <given-names>W..</given-names></name></person-group> (<year>2010</year>). <article-title>Conducting meta-analyses in R with the metafor package</article-title>. <source>J. Stat. Softw</source>. <volume>36</volume>, <fpage>1</fpage>&#x02013;<lpage>48</lpage>.<pub-id pub-id-type="doi">10.18637/jss.v036.i03</pub-id></citation>
</ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Wang</surname> <given-names>C.-L.</given-names></name> <name><surname>Liou</surname> <given-names>P.-Y.</given-names></name></person-group> (<year>2017</year>). <article-title>Students&#x00027; motivational beliefs in science learning, school motivational contexts, and science achievement in Taiwan</article-title>. <source>Int. J. Sci. Educ.</source> <volume>39</volume>, <fpage>898</fpage>&#x02013;<lpage>917</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2017.1310410</pub-id></citation>
</ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wiberg</surname> <given-names>M.</given-names></name> <name><surname>Rolfsman</surname> <given-names>E.</given-names></name></person-group> (<year>2019</year>). <article-title>The association between science achievement measures in schools and TIMSS science achievements in Sweden</article-title>. <source>Int. J. Sci. Educ.</source> <volume>41</volume>, <fpage>2218</fpage>&#x02013;<lpage>2232</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2019.1666217</pub-id></citation>
</ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Willson</surname> <given-names>V. L..</given-names></name></person-group> (<year>1983</year>). <article-title>A meta-analysis of the relationship between science achievement and science attitude: kindergarten through college</article-title>. <source>J. Res. Sci. Teach.</source> <volume>20</volume>, <fpage>839</fpage>&#x02013;<lpage>850</lpage>. <pub-id pub-id-type="doi">10.1002/tea.3660200906</pub-id><pub-id pub-id-type="pmid">25855820</pub-id></citation></ref>
<ref id="B83">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Woolnough</surname> <given-names>B. E..</given-names></name></person-group> (<year>1994</year>). <source>Effective Science Teaching. Developing Science and Technology Education</source>. <publisher-loc>Bristol</publisher-loc>: <publisher-name>Open University Press</publisher-name>.</citation>
</ref>
<ref id="B84">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>D.</given-names></name> <name><surname>Tang</surname> <given-names>X.</given-names></name></person-group> (<year>2017</year>). <article-title>The influence of extracurricular activities on middle school students&#x00027; science learning in china</article-title>. <source>Int. J. Sci. Educ.</source> <volume>39</volume>, <fpage>1381</fpage>&#x02013;<lpage>1402</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2017.1332797</pub-id></citation>
</ref>
<ref id="B85">
<citation citation-type="journal"><person-group person-group-type="author"><collab><xref ref-type="fn" rid="fn0001"><sup>&#x0002A;</sup></xref></collab><name><surname>Zheng</surname> <given-names>A.</given-names></name> <name><surname>Tucker-Drob</surname> <given-names>E. M.</given-names></name> <name><surname>Briley</surname> <given-names>D. A.</given-names></name></person-group> (<year>2019</year>). <article-title>National gross domestic product, science interest, and science achievement: a direct replication and extension of the Tucker-Drob, Cheung, and Briley (2014) study</article-title>. <source>Psychol. Sci.</source> <volume>30</volume>, <fpage>776</fpage>&#x02013;<lpage>788</lpage>. <pub-id pub-id-type="doi">10.1177/0956797619835768</pub-id><pub-id pub-id-type="pmid">30990767</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn0001"><p><sup>&#x0002A;</sup>References marked with an asterisk indicate studies included in the meta-analysis.</p></fn>
</fn-group>

</back>
</article> 