<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2017.01594</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Teacher Mindsets Concerning the Malleability of Intelligence and the Appraisal of Achievement in the Context of Feedback</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>De Kraker-Pauw</surname> <given-names>Emmy</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/382310/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Van Wesel</surname> <given-names>Floryt</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/239232/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Krabbendam</surname> <given-names>Lydia</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/54516/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Van Atteveldt</surname> <given-names>Nienke</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/6803/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Behavioural and Movement Sciences, Vrije Universiteit Amsterdam</institution> <country>Amsterdam, Netherlands</country></aff>
<aff id="aff2"><sup>2</sup><institution>Methodology and Statistics, Utrecht University</institution> <country>Utrecht, Netherlands</country></aff>
<aff id="aff3"><sup>3</sup><institution>LEARN! Interfaculty Research Institute, Vrije Universiteit Amsterdam</institution> <country>Amsterdam, Netherlands</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Layne Kalbfleisch, George Washington University, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Dimitrios Zbainos, Harokopio University, Greece; Jie Zhang, State University of New York at Brockport, United States</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Emmy De Kraker-Pauw <email>e.de.kraker-pauw&#x00040;vu.nl</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Educational Psychology, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>09</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>8</volume>
<elocation-id>1594</elocation-id>
<history>
<date date-type="received">
<day>03</day>
<month>10</month>
<year>2016</year>
</date>
<date date-type="accepted">
<day>31</day>
<month>08</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 De Kraker-Pauw, Van Wesel, Krabbendam and Van Atteveldt.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>De Kraker-Pauw, Van Wesel, Krabbendam and Van Atteveldt</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>The pedagogical beliefs (e.g., beliefs or &#x0201C;mindsets&#x0201D; concerning the malleability of intelligence) that teachers hold may have a far-reaching impact on their teaching behavior. In general, two basic mindsets can be distinguished with regard to the malleability of intelligence: fixed (entity) and growth (incremental). In this article, we present two studies investigating the associations between teachers&#x00027; mindset and (1) their appraisal of students&#x00027; achievements and (2) the feedback they provide. Study 1 focuses on the associations between mindset and appraisal. The findings reveal an association between growth mindset and the appraisal of increasing student achievements. Study 2 investigates the impact of teachers&#x00027; mindset on the amount and type of oral feedback they provide to their students. Contrarily to expectations, the findings reveal a significant negative correlation between mindset and the amount of feedback.</p></abstract>
<kwd-group>
<kwd>teacher beliefs</kwd>
<kwd>malleability of intelligence</kwd>
<kwd>mindset</kwd>
<kwd>appraisal of achievement</kwd>
<kwd>feedback</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="82"/>
<page-count count="13"/>
<word-count count="11577"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>According to an increasing number of studies, the beliefs that teachers hold influence both their pedagogical decisions and their classroom behavior (Stipek et al., <xref ref-type="bibr" rid="B73">2001</xref>; Cross, <xref ref-type="bibr" rid="B10">2009</xref>; Jordan et al., <xref ref-type="bibr" rid="B31">2010</xref>). Studies have addressed such aspects as the expectations that teachers have of students, their ratings of written and oral achievements and the feedback that they provide to students (Li, <xref ref-type="bibr" rid="B40">1999</xref>; Andersson, <xref ref-type="bibr" rid="B2">2012</xref>). Pedagogical beliefs can vary greatly, even amongst teachers within the same educational setting or school. One area in which differences in pedagogical beliefs could potentially have far-reaching effects has to do with the malleability of human attributes (e.g., intelligence; Howard-Jones, <xref ref-type="bibr" rid="B29">2014</xref>). Such beliefs have also been referred to as mindsets concerning malleability (Dweck, <xref ref-type="bibr" rid="B14">1999</xref>). The primary aim of our study is to investigate the association between teachers&#x00027; mindset and their appraisal of students&#x00027; achievements. The second aim is to investigate the association between mindset and the feedback teachers provide during real classroom lessons. Additionally, the role of the teacher characteristics gender and teaching domain are explored within these two main aims.</p>
<sec>
<title>Mindsets: is intelligence fixed or malleable?</title>
<p>In general, two basic mindsets can be distinguished with regard to the malleability of intelligence: the entity (fixed) mindset and the incremental (growth) mindset (Dweck, <xref ref-type="bibr" rid="B14">1999</xref>, <xref ref-type="bibr" rid="B15">2006</xref>). Some people believe that intelligence is a fixed trait: a person has a certain amount of intelligence, and it cannot be changed. The fixed mindset has been associated with performance goals and with helplessness-oriented strategies in response to failure and setbacks (Blackwell et al., <xref ref-type="bibr" rid="B7">2007</xref>; Burnette et al., <xref ref-type="bibr" rid="B9">2013</xref>), as errors are seen as confirming an individual&#x00027;s inability. Others believe that intelligence is malleable. In other words, intelligence can be changed through effort and persistence. This growth mindset is associated with learning goals, mastery-oriented strategies and beliefs in positive effort (Blackwell et al., <xref ref-type="bibr" rid="B7">2007</xref>; Burnette et al., <xref ref-type="bibr" rid="B9">2013</xref>).</p>
<p>To date, studies investigating the role of mindset in academic performance have focused largely on the mindsets of students with regard to their own intelligence. In this study, we address the mindsets of <italic>teachers</italic> concerning their general belief about the malleability of intelligence. The teachers&#x00027; evaluation of students&#x00027; achievements has consequences for the student&#x00027;s achievement motivation (Rheinberg, <xref ref-type="bibr" rid="B56">1980</xref>, <xref ref-type="bibr" rid="B57">1983</xref>, <xref ref-type="bibr" rid="B58">2001</xref>). Teachers who compared students&#x00027; learning outcomes with other students social reference norm (SRN), tended to attribute those academic achievements more often to stable characteristics of the student such as &#x0201C;ability.&#x0201D; Teachers who preferred intra-individual comparisons [the individual reference norm (IRN)] attributed academic achievements to highly variable causes such as &#x0201C;effort,&#x0201D; learning strategies and task characteristics. Dweck referred to these observations when she coined the terms fixed and growth mindset to describe the underlying beliefs people have about learning and intelligence (Dweck, <xref ref-type="bibr" rid="B15">2006</xref>).</p>
<p>In the above mentioned study of Rheinberg (<xref ref-type="bibr" rid="B56">1980</xref>) on the influence of teacher&#x00027;s preferred reference norm on learning outcomes, he measured the following variables: students&#x00027; achievement motive, IQ, and causal attribution of one&#x00027;s own academic success and failure at the beginning and at the end of the scholastic year. Additionally, at the end of the scholastic year, students rated the growth of their own academic competence during the year. Results showed that for teachers with an IRN low achievers at the beginning of the school year ended the year as moderate or even high achievers (Rheinberg, <xref ref-type="bibr" rid="B56">1980</xref>). Contrarily, more than half of the students of teachers with SRN, who were low achievers at the beginning of the school year ended up as low achievers at the end of the school year.</p>
<p>Although it is important to note that definitions of the concept <italic>intelligence</italic> have been inconsistent and subject to change throughout the past century, the conceptualization of intelligence is not the subject of our current investigation.</p>
</sec>
<sec>
<title>Appraisal of achievement and feedback</title>
<p>In this study, we hypothesize that the mindsets of teachers concerning the malleability of intelligence influences their appraisals of student achievement and the feedback they give. These two aspects of the classroom behavior of teachers (i.e., appraisal and feedback) might bear an influence on the learning outcomes and behavior of their students.</p>
<p>In this study, we understand &#x0201C;appraisal of achievement&#x0201D; as referring to the actual assessment of learning outcomes, which can be either preceded or followed by teacher feedback. Beliefs about ability and beliefs about effort are both important within the context of appraisal and feedback (Kaplan and Swart, <xref ref-type="bibr" rid="B34">1973</xref>). <italic>Feedback</italic> can be defined in many different ways (Smith and Smith, <xref ref-type="bibr" rid="B70">2015</xref>). In this study, we understand it as &#x0201C;information (provided by the teacher) on the performance of the learner, in which both the process and the result are important, in order to promote learning and maintain or increase motivation&#x0201D; (Brown, <xref ref-type="bibr" rid="B8">2004</xref>). We discuss these concepts in greater detail in the introductions to the two studies.</p>
</sec>
<sec>
<title>Teacher characteristics</title>
<p>Previous studies have suggested possible associations between the gender of teachers and their pedagogical behavior and beliefs (Nosek et al., <xref ref-type="bibr" rid="B50">2002</xref>; Almutawa, <xref ref-type="bibr" rid="B1">2005</xref>). For example, previous studies of teacher behavior have indicated that female teachers tend to stimulate collaboration and class discussion, in addition to being be more student-centered, indirect and supportive of students than is the case for their male colleagues (Li, <xref ref-type="bibr" rid="B40">1999</xref>). Gender differences can also be observed in teacher feedback. A previous study has demonstrated that female teachers provide more supportive and more expressive feedback (in equal amounts to boys and girls), as compared to male teachers (Duffy et al., <xref ref-type="bibr" rid="B13">2001</xref>). In another study, female teachers gave more compliments and used less directive forms of feedback than male teachers did (Rashidi and Naderi, <xref ref-type="bibr" rid="B54">2012</xref>). Gender has further been shown to affect teachers&#x00027; beliefs on, for example, the nature of particular school subjects, the curriculum and conceptions of the teaching role (Li, <xref ref-type="bibr" rid="B40">1999</xref>). Less is known, however, about the effects of teacher gender on beliefs concerning the malleability of intelligence, and the appraisal of achievement and feedback.</p>
<p>A second teacher characteristic, <italic>teaching domain</italic>, is likely to be related to mindset, given the tendency of people to assume that success in some domains (e.g., science, technology, engineering, and mathematics&#x02014;STEM&#x02014;subjects) depends upon innate ability, even more so than on dedication and perseverance. Women tend to be stereotyped as lacking such ability (Leslie et al., <xref ref-type="bibr" rid="B38">2015</xref>). Characteristic &#x0201C;teaching domain&#x0201D; had to be taken into account for several reasons, such as the gender-specific character of some school subject (Vassilou, <xref ref-type="bibr" rid="B76">2010</xref>), low proportions of women entering the STEM domain (Meelissen and Drent, <xref ref-type="bibr" rid="B46">2009</xref>; Michels et al., <xref ref-type="bibr" rid="B47">2014</xref>) and the presence of strong gender science stereotypes in men dominated science fields specifically (Leslie et al., <xref ref-type="bibr" rid="B38">2015</xref>). Additional reasons to take domain into account are the more reported negativity in interactions between STEM teachers and their students (Watt et al., <xref ref-type="bibr" rid="B79">2013</xref>) and the negative motivation of STEM teachers to choose teaching as a fallback career (fallback career: second choice career, when one has &#x0201C;failed to be accepted into the career of choice or otherwise unable to pursue their first-choice career,&#x0201D; Watt et al., <xref ref-type="bibr" rid="B79">2013</xref>).</p>
</sec>
<sec>
<title>Overview of the article</title>
<p>The primary aim of the article is to investigate how mindset influences (1) the appraisal of student achievement (study 1) and (2) the frequency and type of oral feedback that teachers provide in the classroom (study 2). Additionally, the effects of gender and teaching domain on appraisal of achievement and feedback are explored.</p>
</sec>
</sec>
<sec id="s2">
<title>Study 1</title>
<sec>
<title>Background: appraisal of achievement</title>
<p>The ways in which teachers evaluate and appraise the achievements of their students might depend upon the reference norms (e.g., individual vs. social comparisons) they prefer to apply when evaluating learning outcomes. As established by Rheinberg (<xref ref-type="bibr" rid="B56">1980</xref>), the concept of <italic>teacher reference norm orientation</italic> (RNO) is defined as &#x0201C;a standard to which individual achievements are compared.&#x0201D; Such standards can be based on any of the various frames of reference that teachers can adopt. The reference norm can be seen as an effect of a teacher&#x00027;s mindset concerning malleability. According to Heckhausen (<xref ref-type="bibr" rid="B26">1974</xref>) three frames of reference have been distinguished: the SRN, the IRN and the criterial reference norm (CRN). When applying the SRN, teachers compare the achievements of a given student to those of fellow students. Teachers adopting the SRN believe that differences in ability amongst students are highly stable across time. Their appraisals are strongly dependent upon whether the learning outcomes of a given student are above or below the class average (Rheinberg and Engeser, <xref ref-type="bibr" rid="B59">2010</xref>).</p>
<p>When applying the IRN, teachers compare the achievements of individual students to their prior achievements. Teachers adopting the IRN emphasize improvement, effort and learning, with a focus on the individual process of learning. The application of this reference norm has been shown to decrease fear of failure in students and brought many low achievers up into the high achieving range (Rheinberg and Engeser, <xref ref-type="bibr" rid="B59">2010</xref>). When applying the third type of reference norm, the CRN, task-inherent properties are taken as the standard of comparison. In a study of Martinez et al. (<xref ref-type="bibr" rid="B44">2009</xref>) it was found that teachers evaluated student performances not in absolute terms but relative to other students in the school (SRN) and that they might adjust their grading for some students, perhaps with basis on perceived differences in needs and/or abilities.</p>
<p>Based on a recent study of teachers working with students with learning disabilities and otherwise academically-challenged students, Wilbert and Gr&#x000FA;nke (<xref ref-type="bibr" rid="B81">2010</xref>) report that the reference norms used by teachers can affect the achievements and motivation of their students, with the INR having a positive effect on learning and the SNR inhibiting learning.</p>
</sec>
<sec>
<title>Specific aim and hypotheses</title>
<p>The current study addresses a gap in the research literature with regard to the relation between mindsets of teachers concerning the malleability of intelligence, teacher characteristics gender and teaching domain, and their appraisal of achievement. The IRN as mentioned above is growth-oriented. Teachers with an IRN appraise improvement, effort and learning, similar to growth-oriented teachers. We expect growth- oriented teachers to value increasing achievements positively, independent from the end marks students achieve. This in contrast to fixed oriented teachers; we expect them to value sufficient end marks, and we expect them to have less appraisal for students&#x00027; personal increasing improvements. Therefore, we tested the main hypothesis that teachers with a more growth- oriented mindset are more positive in their appraisal of students&#x00027; increasing achievements than those with a more fixed oriented mindset.</p>
<p>In addition, the effects of teacher characteristics &#x0201C;gender&#x0201D; and &#x0201C;teaching domain&#x0201D; on their appraisal of achievement were explored.</p>
</sec>
<sec>
<title>Method</title>
<sec>
<title>Participants</title>
<p>The study was presented in a meeting for managers from 11 secondary schools in the southwest of the Netherlands. Ten of these schools expressed their willingness to participate in the study. The manager of each school received a letter containing an explanation of the study, along with a description of its aims and a global timeline. A presentation was given to the delegates of the school teams. In addition, all participants received a letter containing information on the study. To guarantee that participation of teacher participants was always on a fully informed and voluntary basis, we obtained active informed consent from them prior to onset of the studies. Dutch legislation lays down procedures for the ethical review of medical research involving human subjects. However, this study does not fall under the current definition of medical research and therefore formal approval by an ethics committee is not legally required. The ethics committee of the Faculty of Behavioral and Movement Sciences at Vrije Universiteit Amsterdam has issued guidelines to foster the adherence to ethical principles for the non-medical behavioral research within the faculty, and the current study has been conducted in strict accordance with these guidelines.</p>
<p>In all, 106 teachers participated in the study. The participating teachers worked primarily with second-year students (13&#x02013;15 years of age) in schools for preparatory secondary vocational education.</p>
<p>We investigated the association between mindset on malleability of intelligence and appraisal of achievement and the two factors 1) gender: male (<italic>n</italic> &#x0003D; 63) vs. female (<italic>n</italic> &#x0003D; 43), and 2) teaching domain: STEM (<italic>n</italic> &#x0003D; 27) vs. non-STEM (<italic>n</italic> &#x0003D; 79). The teachers ranged in age from 22 to 61 years (<italic>M</italic> &#x0003D; 42.03, <italic>SD</italic> &#x0003D; 11.76), with teaching experience varying between 1 and 40 years. Of all participating teachers, 65% were working in public schools, while 34% were working in religious (Christian) schools. For 1% of the participants, the type of school was unknown.</p>
</sec>
<sec>
<title>Instruments</title>
<p>Each participant completed two online questionnaires, which they accessed through an anonymous survey link. The first instrument was the Theory of Intelligence Questionnaire (TOI), which is designed to measure implicit beliefs about the malleability of intelligence. The questionnaire consists of three &#x0201C;entity theory&#x0201D; statements and three &#x0201C;incremental theory&#x0201D; statements (Dweck, <xref ref-type="bibr" rid="B16">2007</xref>).</p>
<p>All items were scored along a Likert-6 scale ranging from &#x0201C;completely agree&#x0201D; to &#x0201C;completely disagree.&#x0201D; The incremental items were reverse-scored, such that low scores represent a &#x0201C;fixed&#x0201D; mindset and high scores represent a &#x0201C;growth&#x0201D; mindset on all six items. The internal consistency of this questionnaire for the current sample was high, with a Cronbach&#x00027;s alpha value of 0.90.</p>
<p>The second questionnaire was the Rheinberg&#x00027;s Reference Norm Orientation Test (Rheinberg, <xref ref-type="bibr" rid="B56">1980</xref>). In its original version, three sequential test results from nine fictional students are presented. The students&#x00027; test scores in the original Reference Norm Orientation Test were either increasing, stable of decreasing. The teacher&#x00027;s task is to evaluate the result each student had in the third test. If he evaluates a result as &#x0201C;good achievement,&#x0201D; he can mark between one and five plus signs into the five boxes coordinated on the right side. If the teacher evaluates a result as &#x0201C;poor achievement,&#x0201D; he can mark between one and five minus signs into the five boxes. No signs means a neutral evaluation. The way the teachers evaluate the final test score reflects to what extent they emphasize individual improvement (IRN) vs. a comparison to fellow students (SRN). We made several adaptations to the test, to make it better suited to our goal of investigating the appraisal of increasing achievement (even if the last test score was an insufficient mark). A positive appraisal of increasing achievement is predicted to be associated with a growth mindset. Our adaptations included the elimination of one set of scores because it resembled another set and the addition of four new sets of scores with larger intervals between the three marks in order to generate more pronounced increasing or non-increasing scores (see Appendix <xref ref-type="supplementary-material" rid="SM1">1</xref>, Figure <xref ref-type="supplementary-material" rid="SM1">1</xref>).</p>
<p>The instrument used in the current study thus distinguished three types of individual achievement: (a) increasing marks, (b) non-increasing, insufficient mark (&#x0003C;5.5), and c) non-increasing, sufficient mark (&#x02265;5.5). Participants could rate the last test score on a scale (&#x02212; &#x02212;. &#x02212;, &#x000B1;, &#x0002B;, &#x0002B;&#x0002B;) from &#x02212; &#x02212; (poor achievement) to &#x0002B;&#x0002B; (good achievement) with &#x000B1; indicating a neutral evaluation. Reliability analysis in our sample resulted in a Cronbach&#x00027;s alpha value of 0.81 for the increasing marks, a value of 0.76 for non-increasing sufficient marks and 0.66 for non-increasing insufficient marks.</p>
</sec>
<sec>
<title>Data analysis</title>
<p>We used the Statistical Package for the Social Sciences (SPSS) version 20.0 for Windows in all data analyses. We calculated the score on the Theory of Intelligence Questionnaire (TOI) for each individual by taking the sum of the scores on all six items (incremental items were reverse-scored). The Reference Norm Orientation (RNO) scores were calculated by recoding the appraisal of achievement scores for all items (&#x02212;&#x02212; &#x0003D; 1; &#x02212; &#x0003D; 2; &#x000B1; &#x0003D; 3; &#x0002B; &#x0003D; 4; &#x0002B;&#x0002B; &#x0003D; 5). We then calculated mean scores for the three subscales: (a) increasing marks, (b) non-increasing sufficient mark, and (c) non-increasing insufficient mark.</p>
<p>To examine the relationship between mindset and the appraisal of achievement, we first present descriptive statistics. Furthermore, we present the bivariate correlations between the mindset sum score and each subscale of the appraisal of achievement test, as well as it&#x00027;s relation with gender and teaching domain. Second, we investigated our main hypothesis by using multiple linear regressions to test the effect of mindset (sum scores) on the increasing scale of appraisal of achievement, while also taking gender and teaching domain into account.</p>
</sec>
</sec>
<sec>
<title>Results</title>
<sec>
<title>Descriptive statistics including bivariate relations</title>
<p>In Table <xref ref-type="table" rid="T1">1</xref>, the means and standard deviations of the three RNO subscales are presented for male (<italic>n</italic> &#x0003D; 63), female (<italic>n</italic> &#x0003D; 43), STEM (<italic>n</italic> &#x0003D; 27) and non-STEM (<italic>n</italic> &#x0003D; 79) participants and the total scores for increasing (<italic>M</italic> &#x0003D; 3.71, <italic>SD</italic> &#x0003D; 0.60), non-increasing sufficient (<italic>M</italic> &#x0003D; 3.53, <italic>SD</italic> &#x0003D; 0.54) and non-increasing insufficient marks (<italic>M</italic> &#x0003D; 2.20, <italic>SD</italic> &#x0003D; 0.45).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Means and standard deviation for Mindset (<italic>n</italic> &#x0003D; 115), Appraisal of Achievement (<italic>n</italic> &#x0003D; 106), broken down for male, female, STEM and non-STEM participants.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="center" colspan="5" style="border-bottom: thin solid #000000;"><bold>Theory of intelligence</bold></th>
<th valign="top" align="center" colspan="13" style="border-bottom: thin solid #000000;"><bold>Appraisal of student achievement</bold></th>
</tr>
<tr>
<th/>
<th/>
<th/>
<th/>
<th/>
<th/>
<th/>
<th valign="top" align="center" colspan="4" style="border-bottom: thin solid #000000;"><bold>Increasing</bold></th>
<th valign="top" align="center" colspan="4" style="border-bottom: thin solid #000000;"><bold>Non-increasing sufficient</bold></th>
<th valign="top" align="center" colspan="4" style="border-bottom: thin solid #000000;"><bold>Non-increasing insufficient</bold></th>
</tr>
<tr>
<th/>
<th valign="top" align="center"><bold>n</bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
<th valign="top" align="center"><bold>n</bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">65</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">19.52</td>
<td valign="top" align="center">6.02</td>
<td valign="top" align="center">63</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.54<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="center">2.00</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.56</td>
<td valign="top" align="center">0.57</td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">3.00</td>
<td valign="top" align="center">2.15</td>
<td valign="top" align="center">0.47</td>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">50</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">30</td>
<td valign="top" align="center">21.76</td>
<td valign="top" align="center">4.70</td>
<td valign="top" align="center">43</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.95<xref ref-type="table-fn" rid="TN1"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.51</td>
<td valign="top" align="center">2.50</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.48</td>
<td valign="top" align="center">0.51</td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">3.25</td>
<td valign="top" align="center">2.27</td>
<td valign="top" align="center">0.41</td>
</tr>
<tr>
<td valign="top" align="left">STEM</td>
<td valign="top" align="center">28</td>
<td valign="top" align="center">12</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">20.14</td>
<td valign="top" align="center">6.08</td>
<td valign="top" align="center">27</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.73</td>
<td valign="top" align="center">0.58</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.53</td>
<td valign="top" align="center">0.55</td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">3.00</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">0.46</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left">Non-STEM</td>
<td valign="top" align="center">87</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">20.61</td>
<td valign="top" align="center">5.43</td>
<td valign="top" align="center">79</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">4.50</td>
<td valign="top" align="center">3.70</td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="center">2.00</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.53</td>
<td valign="top" align="center">0.54</td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">3.25</td>
<td valign="top" align="center">2.18</td>
<td valign="top" align="center">0.45</td>
</tr> <tr>
<td valign="top" align="left">Total</td>
<td valign="top" align="center">115</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">36</td>
<td valign="top" align="center">20.50</td>
<td valign="top" align="center">5.57</td>
<td valign="top" align="center">106</td>
<td valign="top" align="center">2.25</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.71</td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="center">2.00</td>
<td valign="top" align="center">4.75</td>
<td valign="top" align="center">3.53</td>
<td valign="top" align="center">0.54</td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">3.25</td>
<td valign="top" align="center">2.20</td>
<td valign="top" align="center">0.45</td>
</tr>
<tr>
<td valign="top" align="left">Mindset</td>
<td/>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">106</td>
<td/>
<td/>
<td valign="top" align="center"><italic>r</italic> &#x0003D; 0.24 <italic>p</italic> &#x0003D; 0.01</td>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>r</italic> &#x0003D; &#x02212;0.06 <italic>p</italic> &#x0003D; 0.52</td>
<td/>
<td/>
<td/>
<td valign="top" align="center"><italic>r</italic> &#x0003D; 0.09 <italic>p</italic> &#x0003D; 0.36</td>
<td/>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>The bottom row indicates the correlation with mindset sum scores</italic>.</p>
<fn id="TN1">
<label>&#x0002A;</label>
<p><italic>p &#x0003C; 0.05. Significance of t-test comparing gender or domain</italic>.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>We calculated a Pearson product-moment correlation coefficient to determine the association between mindset (<italic>M</italic> &#x0003D; 20.50, <italic>SD</italic> &#x0003D; 5.57) and the appraisal of achievement for the increasing, non-increasing sufficient and non-increasing insufficient marks (see final row of Table <xref ref-type="table" rid="T1">1</xref>). For increasing marks (<italic>r</italic> &#x0003D; 0.24, <italic>n</italic> &#x0003D; 106, <italic>p</italic> &#x0003D; 0.013) there was a significant, albeit weak, positive correlation between the two variables. This positive correlation indicated that higher scores on mindset (more growth-oriented) were associated with a higher appraisal of increasing marks. No significant correlations were found between mindset and the appraisal of achievement for the non-increasing sufficient marks (<italic>r</italic> &#x0003D; &#x02212;0.06, <italic>n</italic> &#x0003D; 106, <italic>p</italic> &#x0003D; 0.52) or the non-increasing insufficient marks (<italic>r</italic> &#x0003D; 0.09, <italic>n</italic> &#x0003D; 106, <italic>p</italic> &#x0003D; 0.36<italic>)</italic>.</p>
<p>Additionally, Table <xref ref-type="table" rid="T1">1</xref> shows results of <italic>t</italic>-tests comparing RNO scores (appraisal) between male and female teachers and STEM and non-STEM teachers. As can be seen in this table, female teachers showed higher scores on increasing marks (<italic>M</italic> &#x0003D; 3.95, <italic>SD</italic> &#x0003D; 0.51) than male teachers did (<italic>M</italic> &#x0003D; 3.54, <italic>SD</italic> &#x0003D; 0.60). This difference was significant (<italic>t</italic> &#x0003D; &#x02212;3.59, <italic>df</italic> &#x0003D; 104, <italic>p</italic> &#x0003C; 0.001). Differences between female and male teachers on non-increasing sufficient and non-increasing insufficient marks were not significant (<italic>t</italic> &#x0003D; 0.77, <italic>df</italic> &#x0003D; 104, <italic>p</italic> &#x0003D; 0.44 and <italic>t</italic> &#x0003D; &#x02212;1.37, <italic>df</italic> &#x0003D; 104, <italic>p</italic> &#x0003D; 0.18 respectively).</p>
<p>Results showed no significant differences on increasing marks between STEM and non-STEM teachers (<italic>t</italic> &#x0003D; &#x02212;0.24, <italic>df</italic> &#x0003D; 104, <italic>p</italic> &#x0003D; 0.81), no significant differences on non-increasing sufficient marks (<italic>t</italic> &#x0003D; &#x02212;0.02, <italic>df</italic> &#x0003D; 104, <italic>p</italic> &#x0003D; 0.98<italic>)</italic>, nor on the non-increasing insufficient marks (<italic>t</italic> &#x0003D; &#x02212;0.73, <italic>df</italic> &#x0003D; 104, <italic>p</italic> &#x0003D; 0.47).</p>
</sec>
<sec>
<title>Hypothesis testing: the effect of mindset, gender and domain on the appraisal of achievement</title>
<p>In order to test the main hypothesis, the effect of mindset (sum scores) on the increasing scale of appraisal of achievement, while also taking gender and teaching domain into account, we conducted a multiple linear regression analysis. This analysis showed that gender (&#x003B2; &#x0003D; 0.32, <italic>t</italic> &#x0003D; 3.396, <italic>p</italic> &#x0003C; 0.001) and mindset (&#x003B2; &#x0003D; 0.19, <italic>t</italic> &#x0003D; 2.034, <italic>p</italic> &#x0003D; 0.05) were significant predictors, with female teachers and teachers with a more growth-oriented mindset giving higher appreciations. The association with domain was non-significant (&#x003B2; &#x0003D; 0.10, <italic>t</italic> &#x0003D; 1.033, <italic>p</italic> &#x0003D; 0.30).</p>
</sec>
</sec>
<sec>
<title>Discussion</title>
<p>In this study, we investigate the association between the mindsets of teachers and their appraisal of student achievements. In line with our hypothesis, the results reveal a positive correlation between mindset and the appraisal of achievement for the increasing marks but not for non-increasing marks. Attention for increasing student achievements has been demonstrated to be of importance for students&#x00027; motivation (Meece et al., <xref ref-type="bibr" rid="B45">2006</xref>; Rheinberg and Engeser, <xref ref-type="bibr" rid="B59">2010</xref>; Wilbert and Gr&#x000FA;nke, <xref ref-type="bibr" rid="B81">2010</xref>). In addition, we found that gender is associated with the appraisal of increasing marks, with women valuing these achievements slightly higher than men. In the following section, we present Study 2, exploring how mindset is related to the type and amount of feedback that teachers provide to their students in daily classroom situations.</p>
</sec>
</sec>
<sec id="s3">
<title>Study 2</title>
<p>Study 2 focuses on the oral feedback provided by teachers in classroom interactions, with the goal of identifying possible associations between the general mindset that teachers have concerning the malleability of intelligence and the feedback interventions that they use.</p>
<sec>
<title>Feedback: growth and fixed</title>
<p>In classroom situations, teachers generally <italic>provide</italic> feedback, to which students <italic>respond</italic>. The feedback that teachers provide to their students affects their learning behavior and learning outcomes (Hattie and Timperley, <xref ref-type="bibr" rid="B25">2007</xref>; Lipnevich and Smith, <xref ref-type="bibr" rid="B41">2009</xref>; Geyskens et al., <xref ref-type="bibr" rid="B21">2012</xref>), and it has a powerful influence on motivation (Hattie and Timperley, <xref ref-type="bibr" rid="B25">2007</xref>; Wilbert et al., <xref ref-type="bibr" rid="B80">2010</xref>).</p>
<p>The literature contains a variety of classifications regarding types and descriptions of feedback. We highlight several of these classifications in the context of our study. One classification has to do with the forms, objects, descriptions, opinions, views, effects and goals of feedback (Sol and Stokking, <xref ref-type="bibr" rid="B72">2009</xref>). In their scoring form for the Observation of Teacher Feedback Behavior, Sol and Stokking (<xref ref-type="bibr" rid="B72">2009</xref>) list result-oriented, process-oriented, instruction-oriented and &#x0201C;other&#x0201D; feedback. Emphasizing that it is important for students to <italic>understand</italic> the information they receive, Hattie and Timperley (<xref ref-type="bibr" rid="B25">2007</xref>) distinguish four levels of feedback: task, process, self-regulation and self-level.</p>
<p>Beliefs in general influence behavior (Cross, <xref ref-type="bibr" rid="B10">2009</xref>). Earlier research shows that feedback both regulates and is regulated by motivational beliefs. External feedback has been shown to influence how students feel about themselves (positively or negatively), and what and how they learn (Dweck, <xref ref-type="bibr" rid="B14">1999</xref>).</p>
<p>To monitor the progress of and the reflection on the students&#x00027; learning process, teachers should provide formative feedback. This type of feedback provides information on performance to improve and accelerate learning (Sadler, <xref ref-type="bibr" rid="B64">1998</xref>) and to adjust teachers&#x00027; educational activities (Sluijsmans et al., <xref ref-type="bibr" rid="B69">2013</xref>). The research on formative assessment and feedback was reinterpreted by Nicol and Macfarlane-Dick (<xref ref-type="bibr" rid="B49">2006</xref>) to show how these processes could help students take control of their own learning, i.e., become self-regulated learners. In this way, feedback not only contributes to the teaching process, but also to the learning process and the improvement of achievements (Arts et al., <xref ref-type="bibr" rid="B3">2016</xref>; Schildkamp et al., <xref ref-type="bibr" rid="B66">2016</xref>). In some countries high-ranking on PISA scores (e.g., Finland), self-regulating skills and the continuous providence of formative feedback to students is central to the learning process (Hill, <xref ref-type="bibr" rid="B27">2011</xref>).</p>
<p>Feedback is closely related to assessment: earlier studies showed that tests focused on certification and selection, without forms of informative feedback were negative for the process of learning. Without informative feedback those tests diminished student&#x00027;s responsibility and motivation for learning (Sluijsmans et al., <xref ref-type="bibr" rid="B69">2013</xref>).</p>
<p>Corresponding to the description of a growth mindset, growth-oriented feedback has been described as feedback that guides and motivates students, enhances their learning (Voerman, <xref ref-type="bibr" rid="B77">2014</xref>), and keeps them persistent, resilient and focused on the process of learning. It provides specific information (Voerman, <xref ref-type="bibr" rid="B77">2014</xref>) about the progress (and results) of students. Corresponding to the description of a fixed mindset, fixed feedback emphasizes basic qualities (e.g., intelligence or talent) and characteristics as fixed traits (Kamins and Dweck, <xref ref-type="bibr" rid="B32">1999</xref>). It provides information about the results as such, and not about the process of learning.</p>
<p>In conclusion, and consistent with the conclusions of Hattie and Timperley (<xref ref-type="bibr" rid="B25">2007</xref>) and of Shute (<xref ref-type="bibr" rid="B67">2008</xref>), we regard feedback as information provided by the teacher concerning the performance of the learner, with both process and result being important, in order to promote learning and to maintain or increase motivation (Brown, <xref ref-type="bibr" rid="B8">2004</xref>).</p>
<p>Based on the literature above, we distinguish between two dimensions of oral feedback: growth-oriented feedback and fixed feedback.</p>
<p>Growth-oriented feedback:</p>
<list list-type="simple">
<list-item><p>- Personal praise and criticism for <italic>doing</italic> (&#x0201C;well done, you tried very hard&#x0201D;), for efforts made or strategies chosen.</p></list-item>
<list-item><p>- Process-oriented: Comments on <italic>how</italic> results have been achieved and can be improved.</p></list-item>
<list-item><p>- questions regarding strategies, efforts, possible improvements, alternatives for choices (Kamins and Dweck, <xref ref-type="bibr" rid="B33">2012</xref>), hints, cues, dividing in small steps, prompts, suggestions for improvement and monitoring the process (Sol and Stokking, <xref ref-type="bibr" rid="B72">2009</xref>).</p></list-item>
</list>
<p>Fixed feedback:</p>
<list list-type="simple">
<list-item><p>- Personal praise and criticism for <italic>being</italic> smart, quick, stupid (&#x0201C;you are a very intelligent person&#x0201D;), feedback directed to traits, characteristics or abilities.</p></list-item>
<list-item><p>- Results-oriented: Comments on <italic>what</italic> results have been achieved: correct or wrong answers, giving the correct answer and indicating <italic>what</italic> is missing.</p></list-item>
</list>
</sec>
<sec>
<title>Specific aims and hypotheses</title>
<p>Study 2 focuses on the oral feedback provided by teachers in relation to their mindsets. First we investigated which types of feedback interventions teachers generally provide in their classrooms (based on the Observation of Teacher Feedback Behavior instrument (Sol and Stokking, <xref ref-type="bibr" rid="B71">2008</xref>) and our definition of growth and fixed feedback as described above. Then we hypothesized that teachers with a growth mindset would overall provide <italic>more</italic> feedback than teachers with a fixed mindset would (Hypothesis 2a), given that those with a growth mindset believe that feedback on efforts and strategies <italic>during the learning process is essential</italic> to the learning and achievement of students. For the same reason, we hypothesized that the growth- oriented teachers would provide more growth-oriented feedback (Hypothesis 2b) than fixed feedback.</p>
<p>Furthermore, we investigated the effects of two teacher characteristics, gender and teaching domain, with regard to the type and amount of feedback provided.</p>
</sec>
<sec>
<title>Method</title>
<sec>
<title>Participants</title>
<p>A subgroup of 23 teachers (12 male, 11 female) from the sample used in Study 1, all teachers teaching the second-years students (13&#x02013;15 years old), in mathematics (<italic>n</italic> &#x0003D; 11) or Dutch (12), took part in classroom observations (video recorded). The length of their teaching experience varied from 1 to 40 years. The video recordings of one teacher could not be used, due to technical failures.</p>
<p>Comparison of this sample (<italic>n</italic> &#x0003D; 23) to the original sample (<italic>n</italic> &#x0003D; 106) revealed no significant differences with regard to mindset scores or the appraisal of achievement.</p>
</sec>
<sec>
<title>Procedure</title>
<p>All participants were informed about the video procedure in a personal conversation, during which the date and time of the video observations were agreed upon. Each school had a video protocol that required parental permission for any video recordings in classrooms. Next, parents were asked for permission to let their children participate in the research through an informed consent form. The teachers were able to identify the students whose parents had not given permission for the video observations, and these students were not included in the video recordings. The participants were encouraged to teach as &#x0201C;normally as possible,&#x0201D; and no special educational situations were created. Two video cameras were used: one was placed on a stand (permanent position), and one was used by the researcher to make close-up recordings of feedback moments. To guarantee that participation of teacher participants was always on a fully informed and voluntary basis, we obtained active informed consent from participants prior to onset of the studies (in strict accordance with the guidelines to ethical principles of Vrije Universiteit Amsterdam, see also Section Participants). Teacher participants received a letter with specific information about the research and ethical procedures such as the storage of the audio and video material (saved in a locked cabinet) and data, the confidentiality of personal information, and the report of results and conclusions afterwards.</p>
</sec>
<sec>
<title>Instruments</title>
<p>The video observations were conducted during mathematics or Dutch lessons in schools of preparatory secondary vocational education. The ages of the students ranged from 13 to 15 years. All lessons were taped in their entirety and transcribed verbatim. Some lessons started or ended with a brief conversation or announcement by the teacher. These interactions were not considered further, thus leading to variation in the length of the video fragments (see Appendix <xref ref-type="supplementary-material" rid="SM2">2</xref>, Table <xref ref-type="supplementary-material" rid="SM2">1</xref>).</p>
<p>The current study required an instrument that would allow us to code growth feedback and fixed feedback. Based on the literature above, we selected the scoring form for the Observation of Teacher Feedback Behavior (Appendix <xref ref-type="supplementary-material" rid="SM2">2</xref>, Figure <xref ref-type="supplementary-material" rid="SM1">1</xref>) developed by Sol and Stokking (<xref ref-type="bibr" rid="B71">2008</xref>) in order to score the feedback. This form distinguishes four categories of feedback for classifying and counting all feedback interventions: result-oriented (RO), process-oriented (PO), instruction-oriented (IO) and &#x0201C;other&#x0201D; (Cronbach&#x00027;s alpha &#x0003D; 0.77). This form came close to what we needed in order to score the growth feedback and fixed feedback provided by the participants, but two aspects were lacking. For this reason, we made two additions. First, two researchers independently assessed all comments expressing personal praise and criticism for <italic>doing</italic> (&#x0201C;well done, you tried very hard&#x0201D;) and <italic>being</italic> (&#x0201C;you are a very intelligent person&#x0201D;) from the transcriptions. The researchers then independently labeled each transcribed personal feedback comment as either growth or fixed praise/criticism. In 93.9% of these interventions, the two researchers assigned similar scores (Krippendorff&#x00027;s alpha &#x0003D; 0.92).</p>
<p>In a second step, we analyzed growth feedback reflecting the assessment of <italic>how</italic> results had been achieved. To this end, we used 8 of the 10 items from the category of <italic>process-oriented</italic> feedback from the original Teacher Feedback Behavior scoring form (Sol and Stokking, <xref ref-type="bibr" rid="B71">2008</xref>), see Appendix <xref ref-type="supplementary-material" rid="SM2">2</xref>, Figure <xref ref-type="supplementary-material" rid="SM2">2</xref>. Two items from the original scoring form (&#x0201C;asking questions about knowledge&#x0201D; and &#x0201C;asking the question Do you understand?&#x0201D;) did not represent growth feedback. We therefore re-labeled these two items as &#x0201C;other process.&#x0201D;</p>
<p>For the fixed comments regarding <italic>what</italic> results had been achieved, we used all items of the category of &#x0201C;result-oriented&#x0201D; feedback from the original scoring form.</p>
<p>To establish inter-rate reliability in comments concerning &#x0201C;how&#x0201D; (growth) or &#x0201C;what&#x0201D; (fixed) results were achieved, two researchers scored the first 10 min of the video recordings of four teachers (selected at random), using the adapted version of the scoring form (see Appendix <xref ref-type="supplementary-material" rid="SM2">2</xref>, Sol and Stokking, <xref ref-type="bibr" rid="B71">2008</xref>; inter-rater reliability: Krippendorff&#x00027;s alpha &#x0003D; 0.88). Thereafter, one researcher scored 13 recordings, and the other scored 9.</p>
</sec>
<sec>
<title>Data analysis</title>
<p>To examine the relationship between mindset and the feedback, we first present descriptive statistics of types of feedback interventions teachers generally provide in their classrooms (based on the Observation of Teacher Feedback Behavior instrument, Sol and Stokking, <xref ref-type="bibr" rid="B71">2008</xref>) and our definition of growth and fixed feedback as described above.</p>
<p>The variable &#x0201C;total feedback interventions&#x0201D; was created for each teacher by taking the sum of all feedback interventions provided by that teacher: feedback on instructions, behavior, fixed (personal praise/criticism and result interventions), growth (personal praise/criticism and process interventions) and other (questions about knowledge such as &#x0201C;do you understand&#x0201D;?) feedback (see Table <xref ref-type="table" rid="T2">2</xref>). The variables &#x0201C;growth&#x0201D; and &#x0201C;fixed&#x0201D; feedback were created as follows: The growth feedback interventions include the personal praise/criticism for doing as well as the process growth interventions. The fixed feedback includes the personal praise/criticism for being as well as the fixed result interventions. Next, we calculated the <italic>proportion</italic> of fixed and growth feedback interventions as dependent variable in our analyses: the number of fixed or growth interventions teacher x/ total number of feedback interventions teacher x. This gives the relative amount of fixed or growth feedback interventions provided by a teacher as a proportion of the total amount of provided feedback by that same teacher, and thereby corrects for individual differences between teachers with regard to how much feedback they provide overall.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Frequencies of oral feedback interventions, personal growth and fixed praise/criticism, growth-oriented with regard to &#x0201C;how,&#x0201D; fixed with regard to &#x0201C;what,&#x0201D; other process-oriented, and other behavior from 22 teachers (as observed on video).</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Feedback interventions</bold></th>
<th valign="top" align="center"><bold>Frequency</bold></th>
<th valign="top" align="center"><bold>Percentage of total feedback interventions</bold></th>
<th valign="top" align="center"><bold>Number of teachers</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Personal growth praise/criticism on &#x0201C;<italic>doing&#x0201D;</italic></td>
<td valign="top" align="center">23</td>
<td valign="top" align="center">1.26</td>
<td valign="top" align="center">12</td>
</tr>
<tr>
<td valign="top" align="left">Personal fixed praise/criticism on &#x0201C;<italic>being&#x0201D;</italic></td>
<td valign="top" align="center">23</td>
<td valign="top" align="center">1.26</td>
<td valign="top" align="center">9</td>
</tr>
<tr>
<td valign="top" align="left">Growth-oriented feedback on <italic>how</italic> results were achieved</td>
<td valign="top" align="center">483</td>
<td valign="top" align="center">26.5</td>
<td valign="top" align="center">22</td>
</tr>
<tr>
<td valign="top" align="left">Fixed feedback on <italic>what</italic> results were achieved</td>
<td valign="top" align="center">503</td>
<td valign="top" align="center">27.6</td>
<td valign="top" align="center">22</td>
</tr>
<tr>
<td valign="top" align="left">Instruction-oriented</td>
<td valign="top" align="center">72</td>
<td valign="top" align="center">3.9</td>
<td valign="top" align="center">17</td>
</tr>
<tr>
<td valign="top" align="left">Other process-oriented Asking questions about knowledge Asking questions like, &#x0201C;Do you understand&#x0201D;?</td>
<td valign="top" align="center">279</td>
<td valign="top" align="center">15.0</td>
<td valign="top" align="center">19</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left">Other behavior</td>
<td valign="top" align="center">442</td>
<td valign="top" align="center">24.2</td>
<td valign="top" align="center">22</td>
</tr> <tr>
<td valign="top" align="left">Total</td>
<td valign="top" align="center">1,824</td>
<td valign="top" align="center">100</td>
<td/>
</tr>
</tbody>
</table>
</table-wrap>
<p>Next, we address our hypotheses by reporting the bivariate correlations (Pearson&#x00027;s product-moment correlation coefficient) between mindset scores and the total number of feedback interventions (Hypothesis 2a) and between mindset scores and the two specific types of feedback (growth and fixed) (Hypothesis 2b). For testing hypothesis 2a we used the (sum of) the total feedback interventions as dependent variable.</p>
<p>For testing hypothesis 2b we used the <italic>proportion</italic> of fixed and growth feedback interventions as dependent variable in our analyses.</p>
<p>Furthermore, we investigate the effect of the teacher characteristics gender and domain on total amount of feedback and the proportions fixed and growth using independent sample <italic>t</italic>-tests.</p>
</sec>
</sec>
<sec>
<title>Results</title>
<sec>
<title>Descriptive statistics</title>
<p>In all 22 video-taped lessons together (11 male teachers, 11 STEM-teachers, with mean mindset sum score <italic>M</italic> &#x0003D; 21.45) we identified a total of 1,824 oral feedback interventions. Table <xref ref-type="table" rid="T2">2</xref> presents the frequencies of the types of these oral feedback interventions from the 22 teachers (as observed on video).</p>
<p>The median of the total feedback interventions was 80.00. Total feedback interventions included feedback on instructions, behavior, fixed (personal praise/criticism and result interventions), growth (personal praise/criticism and process intervention) and &#x0201C;other process&#x0201D; (questions about knowledge such as &#x0201C;do you understand&#x0201D;?) feedback. 483 of all oral feedback interventions were categorized as growth feedback concerning <italic>how</italic> results had been achieved (remarks on strategies, efforts etc., for example &#x0201C;Can you tell me how you discovered the solution?&#x0201D;; &#x0201C;That&#x00027;s an interesting idea&#x02026;.let&#x00027;s try&#x0201D;; &#x0201C;You don&#x00027;t have to do it immediately right&#x0201D;; &#x0201C;What strategy can you use to &#x02026;&#x02026;?&#x0201D;; &#x0201C;Aaah, how did you find this answer?&#x0201D;; &#x0201C;What do you need first?&#x0201D;). All 223 teachers provided this type of feedback with a median 17.50 times per teacher. Only 23 of the total number of interventions could be categorized as growth-oriented personal praise (18)/criticism (5) for <italic>doing</italic> (persistence and effort). Twelve teachers provided this type of feedback. So, taken together the personal praise/criticism for doing and process-feedback, 27.8% of all feedback provided by the teachers was identified as growth feedback.</p>
<p>Of the 1,824 oral feedback interventions observed, 503 interventions could be categorized as fixed feedback regarding <italic>what</italic> results had been achieved (e.g., &#x0201C;That&#x00027;s just not good&#x0201D;; &#x0201C;No, wrong&#x0201D;; &#x0201C;Yes, the right answer is 70%&#x0201D;; Yes, ok, that word ends with a &#x0201C;d&#x0201D;). All 22 teachers provided this type of feedback with a median of 21.50. Of all oral feedback interventions, 21 were fixed personal praise interventions (for <italic>being</italic> smart, quick etc., for example: &#x0201C;student: &#x0201C;what if I am just smart?&#x0201D; teacher: yes, you are smart&#x0201D;), and 2 were fixed criticism interventions (for <italic>being</italic> slow, stupid etc.). 9 teachers provided this type of feedback. Taking together the personal fixed comments and the result oriented feedback, 28.8% of all feedback interventions were categorized as fixed feedback. All participants provided this type of feedback (see Table <xref ref-type="table" rid="T2">2</xref>). 442 interventions were categorized as feedback on behavior, 72 on instruction. Table <xref ref-type="table" rid="T3">3</xref> presents means and standard deviations for the total number of feedback interventions, and for the proportions of fixed and growth feedback, including means and standard deviations for these proportions for gender and domain separately.</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Means and standard deviation, minimum and maximum for total feedback interventions, proportion growth feedback, proportion fixed feedback and broken down for male, female, STEM, non-STEM teachers.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th/>
<th valign="top" align="center" colspan="4" style="border-bottom: thin solid #000000;"><bold>Total feedback interventions</bold></th>
<th valign="top" align="center" colspan="4" style="border-bottom: thin solid #000000;"><bold>Proportion growth feedback</bold></th>
<th valign="top" align="center" colspan="4" style="border-bottom: thin solid #000000;"><bold>Proportion fixed feedback</bold></th>
</tr>
<tr>
<th/>
<th valign="top" align="center"><bold>n</bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
<th valign="top" align="center"><bold>Min</bold>.</th>
<th valign="top" align="center"><bold>Max</bold>.</th>
<th valign="top" align="center"><bold>M</bold></th>
<th valign="top" align="center"><bold><italic>SD</italic></bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">162</td>
<td valign="top" align="center">82.36</td>
<td valign="top" align="center">53.29</td>
<td valign="top" align="center">0.09</td>
<td valign="top" align="center">0.53</td>
<td valign="top" align="center">0.31<xref ref-type="table-fn" rid="TN2"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.14</td>
<td valign="top" align="center">0.05</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">0.34</td>
<td valign="top" align="center">0.18</td>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">138</td>
<td valign="top" align="center">79.27</td>
<td valign="top" align="center">29.89</td>
<td valign="top" align="center">0.13</td>
<td valign="top" align="center">0.35</td>
<td valign="top" align="center">0.21<xref ref-type="table-fn" rid="TN2"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.07</td>
<td valign="top" align="center">0.17</td>
<td valign="top" align="center">0.66</td>
<td valign="top" align="center">0.36</td>
<td valign="top" align="center">0.15</td>
</tr>
<tr>
<td valign="top" align="left">STEM</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">162</td>
<td valign="top" align="center">89.55</td>
<td valign="top" align="center">40.07</td>
<td valign="top" align="center">0.15</td>
<td valign="top" align="center">0.53</td>
<td valign="top" align="center">0.32<xref ref-type="table-fn" rid="TN2"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.11</td>
<td valign="top" align="center">0.05</td>
<td valign="top" align="center">0.43</td>
<td valign="top" align="center">0.29</td>
<td valign="top" align="center">0.12</td>
</tr>
<tr>
<td valign="top" align="left">Non-STEM</td>
<td valign="top" align="center">11</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">157</td>
<td valign="top" align="center">72.09</td>
<td valign="top" align="center">44.33</td>
<td valign="top" align="center">0.09</td>
<td valign="top" align="center">0.46</td>
<td valign="top" align="center">0.21<xref ref-type="table-fn" rid="TN2"><sup>&#x0002A;</sup></xref></td>
<td valign="top" align="center">0.10</td>
<td valign="top" align="center">0.17</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">0.40</td>
<td valign="top" align="center">0.18</td>
</tr>
<tr>
<td valign="top" align="left">Total</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">162</td>
<td valign="top" align="center">80.82</td>
<td valign="top" align="center">42.19</td>
<td valign="top" align="center">0.09</td>
<td valign="top" align="center">0.53</td>
<td valign="top" align="center">0.26</td>
<td valign="top" align="center">0.12</td>
<td valign="top" align="center">0.05</td>
<td valign="top" align="center">0.73</td>
<td valign="top" align="center">0.35</td>
<td valign="top" align="center">0.16</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="TN2">
<label>&#x0002A;</label>
<p><italic>p &#x02264; 0.05. Significance of t-test comparing gender or domain</italic>.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Hypothesis testing (bivariate correlations and t-tests)</title>
<p>We calculated bivariate correlations (Pearson product-moment correlation coefficient) to determine the association between mindset and the total number of feedback interventions (Hypothesis 2a) and the two different types of feedback (proportion growth and proportion fixed) (Hypothesis 2b). A significant negative correlation was found between mindset score and the total feedback interventions (<italic>r</italic> &#x0003D; &#x02212;0.43, <italic>p</italic> &#x0003D; 0.05<italic>)</italic> (see Figure <xref ref-type="fig" rid="F1">1</xref>) indicating that the more teachers&#x00027; mindsets were growth-oriented, the less feedback they provided. With regard to the proportion of the two types of feedback (growth-oriented or fixed oriented) the analysis showed no significant correlations (<italic>r</italic> &#x0003D; &#x02212;0.37, <italic>p</italic> &#x0003D; 0.09 and <italic>r</italic> &#x0003D; 0.24, <italic>p</italic> &#x0003D; 0.28 respectively). Additionally, Table <xref ref-type="table" rid="T3">3</xref> shows results of <italic>t</italic>-tests comparing the total number and the proportions for specific feedback types between male and female teachers and STEM and non-STEM teachers.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Scatterplot correlation between total feedback interventions and mindset score.</p></caption>
<graphic xlink:href="fpsyg-08-01594-g0001.tif"/>
</fig>
<p>No significant differences were found between male and female teachers with regard to the total number of feedback interventions (<italic>t</italic> &#x0003D; 0.168, <italic>df</italic> &#x0003D; 20, <italic>p</italic> &#x0003D; 0.87) nor between STEM and non-STEM teachers (<italic>t</italic> &#x0003D; &#x02212;0.969, <italic>df</italic> &#x0003D; 20, <italic>p</italic> &#x0003D; 0.34). However, male teachers provided a significantly higher proportion of growth feedback than female teachers did (<italic>t</italic> &#x0003D; 2.129, <italic>df</italic> &#x0003D; 20, <italic>p</italic> &#x0003D; 0.05). Furthermore, significant differences were found between STEM and non-STEM teachers with regard to the growth feedback (<italic>t</italic> &#x0003D; &#x02212;2.304, <italic>df</italic> &#x0003D; 20, <italic>p</italic> &#x0003D; 0.03) indicating that STEM teachers provide a higher proportion of growth feedback then non-STEM teachers. Note that gender and domain are related in the current sample (<italic>Chi</italic><sup><italic>2</italic></sup> &#x0003D; 4.54, <italic>df</italic> &#x0003D; 1, <italic>p</italic> &#x0003D; 0.03) such that there are more male teachers in the STEM and more female teachers in the non-STEM domain.</p>
</sec>
</sec>
<sec>
<title>Discussion</title>
<p>The second study was designed to investigate the link between the mindsets of teachers and the amount and type of feedback they provided in classroom situations. Personal praise or criticism (growth and fixed) was used in only 2.5% of all oral feedback interactions. Feedback concerning <italic>how</italic> (growth) and <italic>what</italic> (fixed) was provided in almost equal amounts (26.5 and 27.6% respectively). Growth-oriented and fixed feedback together comprised roughly half of all of the feedback interventions observed (with the other half being related to instruction or behavior). Contrary to our hypothesis, we found a significant negative correlation between mindset score and the total amount of feedback. In other words, teachers with a more growth- oriented mindset provided less feedback than teachers with a more fixed oriented mindset. Furthermore, we found an indication that male and/or STEM-teachers provided more growth feedback compared to female/non-STEM teachers. In the general discussion below, we address our findings from Studies 1 and 2 in an integral manner.</p>
</sec>
</sec>
<sec id="s4">
<title>General discussion</title>
<p>The two studies presented aimed to investigate the relationship between the mindsets of teachers and their appraisal of student achievements (Study 1) and between mindset and the amount and type of feedback provided (Study 2). In addition to teachers&#x00027; mindset, we also explored how specific teacher characteristics (i.e., gender, teaching domain) are associated with their appraisal of achievements and the feedback provided to students.</p>
<p>The relationship between beliefs and practices is complex and controversial (Savasci-Acikalin, <xref ref-type="bibr" rid="B65">2009</xref>). The complexity of the relationship might be at least partly due to variety of belief definitions in literature (Bingimlas and Hanrahan, <xref ref-type="bibr" rid="B5">2010</xref>), various pedagogical subjects or domain specificity. The findings have not been consistent (Fang, <xref ref-type="bibr" rid="B19">1996</xref>; OECD, <xref ref-type="bibr" rid="B52">2009</xref>; Bingimlas and Hanrahan, <xref ref-type="bibr" rid="B5">2010</xref>; Saad and Boujaoude, <xref ref-type="bibr" rid="B63">2012</xref>; Mansour, <xref ref-type="bibr" rid="B43">2013</xref>). For example, regarding beliefs and practices in mathematics, some researchers reported consistencies (Stipek et al., <xref ref-type="bibr" rid="B73">2001</xref>; Kuzborska, <xref ref-type="bibr" rid="B36">2011</xref>; Ertmer et al., <xref ref-type="bibr" rid="B18">2012</xref>; Zakaria and Maat, <xref ref-type="bibr" rid="B82">2012</xref>; Polly et al., <xref ref-type="bibr" rid="B53">2013</xref>) whereas others reported inconsistencies between teachers&#x00027; beliefs and educational practices (Beswick, <xref ref-type="bibr" rid="B4">2004</xref>; Kynigos and Argyris, <xref ref-type="bibr" rid="B37">2004</xref>; Li and Yu, <xref ref-type="bibr" rid="B39">2010</xref>).</p>
<p>To the best of our knowledge there are no results of previous research regarding the association between teachers&#x00027; beliefs about malleability of intelligence (growth or fixed mindset) and the feedback behavior they provide to their students. The current study investigates the associations between beliefs and behavior through an appraisal of achievement test and classroom observations to fill existing gaps in the literature: First, beliefs about the nature of intelligence might have far-reaching effects (Howard-Jones, <xref ref-type="bibr" rid="B29">2014</xref>). Second, direct observation of lessons and of teachers&#x00027; decision-making and goals may be instrumental to understand their beliefs (Bingimlas and Hanrahan, <xref ref-type="bibr" rid="B5">2010</xref>). Third, teachers&#x00027; self-evaluations on teaching practices, might not reflect actual classroom practices (Ertmer et al., <xref ref-type="bibr" rid="B18">2012</xref>).</p>
<sec>
<title>Appraisal of achievement</title>
<p>In study 1 we found a relation between mindset and appraisal of achievement, indicative for the influence of teacher&#x00027;s mindset on how they think about students. The results of our study indicate that overall growth-oriented teachers appreciate increasing marks more than fixed oriented teachers. This is an important finding, given that focusing on increasing achievement has been demonstrated to motivate students (Rheinberg and Engeser, <xref ref-type="bibr" rid="B59">2010</xref>). Focusing on improvement can underscore a student&#x00027;s feelings of competence, which combine with feelings of autonomy and relatedness to form the foundation for intrinsic motivation (Ryan and Deci, <xref ref-type="bibr" rid="B62">2000</xref>). In line with the conclusion of Wilbert and Gr&#x000FA;nke (<xref ref-type="bibr" rid="B81">2010</xref>), our results indicate the necessity of pointing out improvements. This is especially true for students in the pre-vocational track of secondary education, as they are more likely to be academically challenged and less motivated in school than are students in other tracks. The Dutch system of secondary education has a classification system consisting of several different tracks: pre-vocational education (VMBO), higher general secondary education (HAVO) and pre-university secondary education (VWO). Students in the pre-vocational track exhibit large differences in learning rate, learning style and motivation (Harskamp et al., <xref ref-type="bibr" rid="B24">2000</xref>). Although our results cannot be generalized to all students in this track, they do suggest that, compared to students from the other two tracks, these students tend to be more practical and application-oriented, to prefer educational methods involving concrete rather than theoretical techniques and working forms, and to encounter frequent difficulty in managing their own learning processes (e.g., planning, monitoring, executing/implementing, and evaluating; see Hamstra and Van den Ende, <xref ref-type="bibr" rid="B23">2006</xref>). In combination with self-confidence with regard to ability and motivation, the ability to regulate and control one&#x00027;s own learning process is particularly likely to generate optimal learning outcomes (OECD, <xref ref-type="bibr" rid="B51">2003</xref>). Focussing on growth is therefore of particular importance for students in the pre-vocational track, who generally tend to be less motivated than other students are.</p>
</sec>
<sec>
<title>Feedback</title>
<p>Study 2 focused on the association between mindset and feedback. Feedback has been shown to influence the learning behavior and outcomes of students (Hattie and Timperley, <xref ref-type="bibr" rid="B25">2007</xref>; Lipnevich and Smith, <xref ref-type="bibr" rid="B41">2009</xref>; Geyskens et al., <xref ref-type="bibr" rid="B21">2012</xref>).</p>
<p>Teacher feedback that focuses more on final results (i.e., whether they are sufficient or insufficient) and less on the learning process (i.e., whether there is improvement) might be less effective (Black and Wiliam, <xref ref-type="bibr" rid="B6">1998</xref>; Hattie and Timperley, <xref ref-type="bibr" rid="B25">2007</xref>; Shute, <xref ref-type="bibr" rid="B67">2008</xref>), thus potentially decreasing the results and motivation of students. The literature provides increasing evidence for the importance of such growth-oriented feedback (Mueller and Dweck, <xref ref-type="bibr" rid="B48">1998</xref>; Dweck, <xref ref-type="bibr" rid="B15">2006</xref>; Skipper and Douglas, <xref ref-type="bibr" rid="B68">2012</xref>; Gunderson et al., <xref ref-type="bibr" rid="B22">2013</xref>). Given the frequent occurrence of feedback, their impact is likely to be important, thus underscoring to the importance of providing effective feedback. 26.5% of all feedback interventions were growth-oriented (e.g., pointing out learning questions and hints regarding strategies, possible improvements and alternatives for the choices that students had made) and surprisingly only 2.5% of the oral feedback interventions observed in our study contained comments reflecting personal praise/criticism <italic>on doing (</italic>e.g., &#x0201C;you tried very hard&#x0201D;). Contrary to earlier findings indicating that only half of teachers provide specific feedback (Voerman et al., <xref ref-type="bibr" rid="B78">2012</xref>; Voerman, <xref ref-type="bibr" rid="B77">2014</xref>), all of the teachers in our study (regardless of gender or teaching domain) provided one or more forms of such specific growth-oriented feedback. This discrepancy does not seem to be explained by differences in the definitions used, as Voerman&#x00027;s definition and examples of specific feedback (i.e., &#x0201C;provides information about the learning goal with reference to the task, the processing of the task, or self-regulation, while not being overly elaborate&#x0201D;) largely corresponds to with the concept of growth-oriented feedback. Our overall findings with regard to feedback suggest that teachers use growth feedback to only a limited extent (27.8% of all feedback provided by the teachers was identified as growth feedback).</p>
<p>Given the fact that for example in the educational field formative assessment, closely related to growth feedback, is on the rise (Kneyber and Sluijsmans, <xref ref-type="bibr" rid="B35">2016</xref>), this in an important finding. Formative assessment can only be implemented successfully when teachers are able to provide growth process-oriented feedback.</p>
<p>Contrary to our hypothesis, teachers with a growth mindset generally provided <italic>less</italic> feedback. The results from our sample do not suggest that teachers with a fixed mindset do not guide their students during the process. On the contrary, they provide more feedback overall. Rattan et al. (<xref ref-type="bibr" rid="B55">2012</xref>) reported that teachers who believed math-intelligence to be fixed, tended to express their support and encouragement in unproductive ways. They found that those teachers&#x00027; tended to express both support and encouragement (growth-oriented feedback) in a &#x0201C;comfort-oriented&#x0201D; manner, sending the implicit message: Its&#x00027; ok- Not everyone can be good at math&#x0201D; (fixed oriented feedback). Contrarily to Rattan, our findings do not suggest that fixed mindset teachers provide support in this comfort-oriented manner. However, in future studies it will be important to explore to which extent such confusing messages occur and to explore the impact of this type of feedback. Not only Rattan, but also Rubie-Davies (<xref ref-type="bibr" rid="B61">2010</xref>) reported that teachers might send confusing messages. In her study, some teachers provided messages about positive student characteristics (e.g., trying hard, behaving well, relating well to others) while being negative about their expectations with regard to achievement. This could unintentionally decrease the students&#x00027; motivation and causing them to have lower expectations regarding their own performance. When teachers report a growth mindset, but do not put their beliefs in action (that is provide growth feedback), students could become demotivated and have lower expectations for their own achievements (Rattan et al., <xref ref-type="bibr" rid="B55">2012</xref>). The teachers in our sample with a growth mindset provided less feedback than those with a fixed mindset. One explanation could be that teachers with a growth mindset are less inclined to urge their students to achieve more or better, being more likely to appreciate their students&#x00027; efforts as such. Furthermore, self-reported mindset and feedback behavior might be incongruent. This corresponds well to the concept of a &#x0201C;false growth mindset,&#x0201D; in which teachers might claim to have a growth mindset, but do not reflect it in their words or actions (Dweck, <xref ref-type="bibr" rid="B17">2015</xref>).</p>
<p>As indicated by the results from Study 1, teachers with a growth mindset tend to value scores that reflect improvement more highly than teachers with a more fixed mindset. For the growth- oriented teachers, it is not the outcome but the process that is the most important. At the same time, school-based education aims to ensure teaching and learning processes lead to the achievement of certain goals in terms of academic achievement (Rijksoverheid, <xref ref-type="bibr" rid="B60">1963</xref>; Darnon et al., <xref ref-type="bibr" rid="B12">2012</xref>). Therefore the focus of growth-oriented feedback, should include interventions on both process and result.</p>
<p>In our study, we measured the mindset as a general belief, we did not distinguish teacher&#x00027;s mindset in specific situations or toward individual students. Another explanation for the finding that teachers with a more growth-oriented mindset do not provide more growth-oriented feedback, might be that the type of feedback is dependent on both the mindset of the teacher and the characteristics of the individual student. Jager and Denessen (<xref ref-type="bibr" rid="B30">2015</xref>) reported that teacher beliefs and their causal attributions toward different low achieving students showed a large within-subject variance. Causal attributions such as attention, effort and interest were described inconsistently for different low-achieving students. Jager and Denessen suggested that attributions are not mere teacher variables but should be studied at the student-specific level.</p>
<p>The relationship between mindset and feedback is even more intricate, however, as students with different mindsets (i.e., growth and fixed) may respond differently to feedback. Compared to the fixed mindset, the growth mindset has been associated with a more effective response to feedback regarding an occasional failure (Dweck, <xref ref-type="bibr" rid="B16">2007</xref>). It might be important to make teachers more explicitly aware of their mindsets, their feedback styles and students&#x00027; mindsets. If teachers are aware of their own mindsets concerning intelligence, and if they are provided with information on how to provide growth-oriented feedback, this is likely to enhance the effectiveness of their students&#x00027; learning processes.</p>
</sec>
<sec>
<title>Teacher characteristics</title>
<p>The <italic>gender</italic> of teachers has been shown to be associated with several aspects of their classroom behavior and feedback (Li, <xref ref-type="bibr" rid="B40">1999</xref>; Duffy et al., <xref ref-type="bibr" rid="B13">2001</xref>; Rashidi and Naderi, <xref ref-type="bibr" rid="B54">2012</xref>). The current results indicate that male and female teachers differ in terms of the <italic>appraisal of achievement</italic>, with women tending to value increasing achievements slightly more than men do. However, our findings suggest that female (vs. male) teachers provide a significant smaller proportion of growth-oriented feedback.</p>
<p>Based on the belief that success in some domains (e.g., STEM subjects) depends upon innate ability (Meelissen and Drent, <xref ref-type="bibr" rid="B46">2009</xref>; Michels et al., <xref ref-type="bibr" rid="B47">2014</xref>; Leslie et al., <xref ref-type="bibr" rid="B38">2015</xref>), we predicted that teachers working in such domains would be more oriented toward a fixed mindset. In our study, we found no associations between teaching domain and appraisal of achievements, but contrary to our expectations, we found that STEM teachers provide a higher proportion of growth-oriented feedback then non-STEM teachers. Possibly, the type and amount of feedback needed is domain specific. In the STEM-domain more process feedback might be needed due to the nature of the STEM-domain, regardless of the teachers&#x00027; (mindset) beliefs. It should be noted that the associations between gender, domain and feedback should be interpreted with caution, as gender and domain overlap in the current sample.</p>
</sec>
<sec>
<title>Limitations</title>
<p>Several limitations of the study should be mentioned. One has to do with the limited sample size in Study 2. However, this sample did not differ from the larger sample regarding the key characteristics appraisal of achievement and mindset on malleability of intelligence. Because of the small sample (<italic>N</italic> &#x0003D; 22) and the number of predictive variables (mindset, gender and domain) it was not feasible to conduct multiple regression analyses.</p>
<p>In addition, our research was conducted on teachers working in one particular track of the Dutch educational system (i.e., pre-vocational secondary education, or VMBO), which includes 55% of all secondary students in the Netherlands (Van Schaik, <xref ref-type="bibr" rid="B75">2013</xref>). Teachers in the pre-vocational track work with students with specific learning characteristics, and they must therefore comply with specific demands with regard to capability, including practice-oriented learning, attention to vocational subjects, integration of several subjects, attention to the learning processes of individual students, a student-oriented approach, customization, and attention to social and emotional development (Van der Rijst et al., <xref ref-type="bibr" rid="B74">2011</xref>). Such demands, especially those having to do with the necessity of attending and customizing instruction to the learning processes of individual students, might be particularly attractive to teachers who believe in growth.</p>
<p>Furthermore, the Theory of Intelligence Questionnaire (Dweck, <xref ref-type="bibr" rid="B15">2006</xref>) is an explicit, self-report measurement. There might therefore be a discrepancy between the responses that teachers entered on this instrument and their actual behavior in the classroom. The participants might have been unwilling or unable to report on their beliefs (Cunningham et al., <xref ref-type="bibr" rid="B11">2001</xref>; Gawronski and De Houwer, <xref ref-type="bibr" rid="B20">2014</xref>), or they might have been biased by a tendency toward socially desirable responses (Hornstra et al., <xref ref-type="bibr" rid="B28">2010</xref>). A different or additional method of measuring mindsets might help to diminish the risk that the results reflect a false growth mindset. Finally, Jager and Denessen (<xref ref-type="bibr" rid="B30">2015</xref>) reported that teacher beliefs and causal attributions toward different low achieving students showed a large within-subject variance. A limitation in our study was the absence of mindset of individual students, although results from study 1 suggested that teacher&#x00027;s mindset impacted feedback behavior.</p>
</sec>
</sec>
<sec id="s5">
<title>Conclusions and suggestions for future research</title>
<p>Our results indicate that female teachers and teachers with a more growth-oriented mindset appreciate increasing achievements higher then male teachers or teachers with a more fixed mindset. Our finding highlights the need to pay attention to the mindset of teacher, for example in relation to the increasing use of formative assessment in education. The focus of formative assessment is more on the process than on the result. If formative assessment is on the rise, it is important to be aware that a growth-oriented mindset of the teacher does not necessarily translate into more process-oriented feedback in the classroom. Further investigations are needed to examine the impact of both gender and mindset on appraisal of achievements in the light of the growing importance of process-oriented guidance, assessment and feedback. Our results indicate that teachers use growth feedback in roughly 25% of their feedback interventions. If teachers could be made more explicitly aware of their own mindsets and feedback styles, they might increase the amount of growth feedback that they provide. It would also be helpful for teachers to be aware of the mindsets of their students. The ways in which students react to feedback is likely to depend upon their own mindsets and related emotions. For example, a fixed mindset could lead to maladaptive responses to feedback (Mangels et al., <xref ref-type="bibr" rid="B42">2006</xref>). Future research should include the effect of the mindsets of students on the ways in which they react to feedback and, conversely, how the feedback provided by teachers affects the mindsets of their students.</p>
<p>The overall findings with regard to feedback suggest that although all teachers in our sample provided growth-oriented feedback, they did so only to a limited extent. Furthermore, we showed a negative correlation between mindset (through a self-reported questionnaire) and the amount of feedback: A more growth-oriented mindset is no guarantee for more growth-oriented feedback. These are important findings for teaching practice, given the impact of feedback on the learning outcomes and motivation of students. Although motivation was not the focus of this study, it is closely related to feedback (Mueller and Dweck, <xref ref-type="bibr" rid="B48">1998</xref>). Future investigations are needed in order to examine the effects of several types of feedback on motivation and emotions. Additional investigation in other educational tracks is needed in order to broaden the existing knowledge concerning the mindsets of teachers and their use of feedback, in addition to examining whether the current results are specific to the pre-vocational track or whether they can be generalized to all teachers.</p>
</sec>
<sec id="s6">
<title>Ethics statement</title>
<p>All of the procedures of the study were in strict compliance with the ethical guidelines of the faculty of the VU university. Participants were asked to provide informed consent before taking part. In schools there was a video-protocol: when their children enter secondary school, parents are asked to provide written consent for video/audio recording. If they did not provide this written consent, the students were excluded from video-taping.</p>
</sec>
<sec id="s7">
<title>Author contributions</title>
<p>EdKP, FvW, and LK conceptualized the studies, EdKP acquired the data, all authors contributed to the data analysis approach, EdKP and FvW performed the data analysis, EdKP wrote the manuscript with contributions from all other authors.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<sec sec-type="supplementary-material" id="s8">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="http://journal.frontiersin.org/article/10.3389/fpsyg.2017.01594/full#supplementary-material">http://journal.frontiersin.org/article/10.3389/fpsyg.2017.01594/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Appendix1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Appendix2.pdf" id="SM2" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="other"><person-group person-group-type="author"><name><surname>Almutawa</surname> <given-names>F.</given-names></name></person-group> (<year>2005</year>). <source>Beliefs of Pre-service Teachers at the University of Pittsburgh about Gender Roles and the Role of Teachers in Relation to Gender Differences.</source> Doctoral dissertation, University of Pittsburgh.</citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Andersson</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x0201C;It&#x00027;s funny that we don&#x00027;t see the similarities when that&#x00027;s what we&#x00027;re aiming for&#x0201D;&#x02013;visualizing and challenging teachers&#x00027; stereotypes of gender and science</article-title>. <source>Res. Sci. Educ.</source> <volume>42</volume>, <fpage>281</fpage>&#x02013;<lpage>302</lpage>. <pub-id pub-id-type="doi">10.1007/s11165-010-9200-7</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arts</surname> <given-names>J. G.</given-names></name> <name><surname>Jaspers</surname> <given-names>M.</given-names></name> <name><surname>Joosten-ten Brinke</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>A case study on written comments as a form of feedback in teacher education: so much to gain</article-title>. <source>Eur. J. Teacher Educ.</source> <volume>39</volume>, <fpage>159</fpage>&#x02013;<lpage>173</lpage>. <pub-id pub-id-type="doi">10.1080/02619768.2015.1116513</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Beswick</surname> <given-names>K.</given-names></name></person-group> (<year>2004</year>). <article-title>The impact of teachers&#x00027; perceptions of student characteristics on the enactment of their beliefs</article-title>, in <source>Proceedings of the 28th PME International Conference</source>, <volume>Vol. 2</volume>, eds <person-group person-group-type="editor"><name><surname>Hoines</surname> <given-names>M. J.</given-names></name> <name><surname>Fuglestad</surname> <given-names>A. B.</given-names></name></person-group> (<publisher-loc>Bergen</publisher-loc>: <publisher-name>University College</publisher-name>), <fpage>111</fpage>&#x02013;<lpage>118</lpage>.</citation></ref>
<ref id="B5">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Bingimlas</surname> <given-names>K.</given-names></name> <name><surname>Hanrahan</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>The relationship between teachers&#x00027; beliefs and their practice: how the literature can inform science education reformers and researchers</article-title>, in <source>Contempary Science Education Research: International Perspectives</source>, eds <person-group person-group-type="editor"><name><surname>Ta&#x0015F;ar</surname> <given-names>M. F.</given-names></name> <name><surname>C&#x00323;akmakci</surname> <given-names>G.</given-names></name></person-group> (<publisher-loc>Ankara</publisher-loc>: <publisher-name>Pegem Akademi</publisher-name>), <fpage>415</fpage>&#x02013;<lpage>422</lpage>.</citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Black</surname> <given-names>P.</given-names></name> <name><surname>Wiliam</surname> <given-names>D.</given-names></name></person-group> (<year>1998</year>). <article-title>Inside the black box: raising standards through classroom assessment</article-title>. <source>Phi Delta Kappan</source> <volume>80</volume>, <fpage>139</fpage>&#x02013;<lpage>148</lpage>.</citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blackwell</surname> <given-names>L. S.</given-names></name> <name><surname>Trzesniewski</surname> <given-names>K. H.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2007</year>). <article-title>Implicit theories of intelligence predict achievement across an adolescent transition: a longitudinal study and an intervention</article-title>. <source>Child Dev.</source> <volume>78</volume>, <fpage>246</fpage>&#x02013;<lpage>263</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-8624.2007.00995.x</pub-id><pub-id pub-id-type="pmid">17328703</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>S.</given-names></name></person-group> (<year>2004</year>). <article-title>Assessment for learning</article-title>. <source>Learn. Teach. Higher Educ.</source> <volume>1</volume>, <fpage>81</fpage>&#x02013;<lpage>89</lpage>. <pub-id pub-id-type="pmid">1344321</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Burnette</surname> <given-names>J. L.</given-names></name> <name><surname>O&#x00027;Boyle</surname> <given-names>E. H.</given-names></name> <name><surname>Van Epps</surname> <given-names>E. M.</given-names></name> <name><surname>Pollack</surname> <given-names>J. M.</given-names></name> <name><surname>Finkel</surname> <given-names>E. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Mind-sets matter: a meta-analytic review of implicit theories and self-regulation</article-title>. <source>Psychol. Bull.</source> <volume>139</volume>, <fpage>655</fpage>&#x02013;<lpage>701</lpage>. <pub-id pub-id-type="doi">10.1037/a0029531</pub-id><pub-id pub-id-type="pmid">22866678</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cross</surname> <given-names>D. I.</given-names></name></person-group> (<year>2009</year>). <article-title>Alignment, cohesion and change: examining mathematics teachers&#x00027; belief structures and their influence on instructional practises</article-title>. <source>Math. Teacher Educ.</source> <volume>12</volume>, <fpage>325</fpage>&#x02013;<lpage>346</lpage>. <pub-id pub-id-type="doi">10.1007/s10857-009-9120-5</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cunningham</surname> <given-names>W. A.</given-names></name> <name><surname>Preacher</surname> <given-names>K. J.</given-names></name> <name><surname>Banaji</surname> <given-names>M. R.</given-names></name></person-group> (<year>2001</year>). <article-title>Implicit attitude measures: consistency, stability, and convergent validity</article-title>. <source>Psychol. Sci.</source> <volume>12</volume>, <fpage>163</fpage>&#x02013;<lpage>170</lpage>. <pub-id pub-id-type="doi">10.1111/1467-9280.00328</pub-id><pub-id pub-id-type="pmid">11340927</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Darnon</surname> <given-names>C.</given-names></name> <name><surname>Dompnier</surname> <given-names>B.</given-names></name> <name><surname>Poortvliet</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>Achievement goals in educational contexts: a social psychology perspective</article-title>. <source>Soc. Pers. Psychol. Compass</source> <volume>6</volume>, <fpage>760</fpage>&#x02013;<lpage>771</lpage>. <pub-id pub-id-type="doi">10.1111/j.1751-9004.2012.00457.x</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duffy</surname> <given-names>J.</given-names></name> <name><surname>Warren</surname> <given-names>K.</given-names></name> <name><surname>Walsh</surname> <given-names>M.</given-names></name></person-group> (<year>2001</year>). <article-title>Classroom interactions: gender of teacher, gender of student, and classroom subject</article-title>. <source>Sex Roles</source> <volume>45</volume>, <fpage>579</fpage>&#x02013;<lpage>593</lpage>. <pub-id pub-id-type="doi">10.1023/A:1014892408105</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dweck</surname> <given-names>C.</given-names></name></person-group> (<year>1999</year>). <source>Self-Theories: Their Role in Motivation, Personality and Development</source>. <publisher-loc>Philadelphia</publisher-loc>: <publisher-name>Psychology Press</publisher-name>. <pub-id pub-id-type="pmid">2130257</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2006</year>). <source>Mindset: The New Psychology of Success</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Random House</publisher-name>.</citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2007</year>). <article-title>Messages that motivate and boost achievement</article-title>. <source>Educ. Can.</source> <volume>47</volume>, <fpage>6</fpage>&#x02013;<lpage>10</lpage>.</citation></ref>
<ref id="B17">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2015</year>). Availabe online at: <ext-link ext-link-type="uri" xlink:href="http://www.edweek.org/ew/articles/2015/09/23/carol-dweck-revisits-the-growth-mindset.html?qs=dweck">http://www.edweek.org/ew/articles/2015/09/23/carol-dweck-revisits-the-growth-mindset.html?qs=dweck</ext-link></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ertmer</surname> <given-names>P. A.</given-names></name> <name><surname>Ottenbreit-Leftwich</surname> <given-names>A. T.</given-names></name> <name><surname>Sadik</surname> <given-names>O.</given-names></name> <name><surname>Sendurur</surname> <given-names>E.</given-names></name> <name><surname>Sendurur</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <article-title>Teacher beliefs and technology integration practices: a critical relationship</article-title>. <source>Comput. Educ.</source> <volume>59</volume>, <fpage>423</fpage>&#x02013;<lpage>435</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2012.02.001</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fang</surname> <given-names>Z.</given-names></name></person-group> (<year>1996</year>). <article-title>A review of research on teacher beliefs and practices</article-title>. <source>Educ. Res.</source> <volume>38</volume>, <fpage>47</fpage>&#x02013;<lpage>65</lpage>. <pub-id pub-id-type="doi">10.1080/0013188960380104</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gawronski</surname> <given-names>B.</given-names></name> <name><surname>De Houwer</surname> <given-names>J.</given-names></name></person-group> (<year>2014</year>). <article-title>Implicit measures in social and personality psychology</article-title>, in <source>Handbook of Research Methods in Social and Personality Psychology, 2nd Edn</source>., eds <person-group person-group-type="editor"><name><surname>Reis</surname> <given-names>H. T.</given-names></name> <name><surname>Judd</surname> <given-names>C. M.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>), <fpage>283</fpage>&#x02013;<lpage>310</lpage>.</citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Geyskens</surname> <given-names>J.</given-names></name> <name><surname>Donche</surname> <given-names>V.</given-names></name> <name><surname>Van Petegem</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <article-title>Towards effective feedback in higher education: bridging theory and practice</article-title>. <source>Reflect. Educ.</source> <volume>8</volume>, <fpage>132</fpage>&#x02013;<lpage>147</lpage>.</citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gunderson</surname> <given-names>E. A.</given-names></name> <name><surname>Gripshover</surname> <given-names>S. J.</given-names></name> <name><surname>Romero</surname> <given-names>C.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name> <name><surname>Golding-Meadow</surname> <given-names>S.</given-names></name> <name><surname>Levine</surname> <given-names>S. C.</given-names></name></person-group> (<year>2013</year>). <article-title>Parent Praise to 1- to 3- Year- olds predicts children&#x00027;s motivational frameworks 5 years later</article-title>. <source>Child Dev.</source> <volume>84</volume>, <fpage>1526</fpage>&#x02013;<lpage>1541</lpage>. <pub-id pub-id-type="doi">10.1111/cdev.12064</pub-id><pub-id pub-id-type="pmid">23397904</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hamstra</surname> <given-names>D. G.</given-names></name> <name><surname>Van den Ende</surname> <given-names>J.</given-names></name></person-group> (<year>2006</year>). <source>De vmbo-leerling. Onderwijspedagogische- en ontwikkelingspsychologische theorie&#x000EB;n [The pre-Vocational Student. Educational Pedagogical and Psychological Development Theories</source>]. <publisher-loc>Amersfoort</publisher-loc>: <publisher-name>CPS</publisher-name>.</citation></ref>
<ref id="B24">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Harskamp</surname> <given-names>E.</given-names></name> <name><surname>Suhre</surname> <given-names>C.</given-names></name> <name><surname>Tjeerdema</surname> <given-names>S.</given-names></name></person-group> (<year>2000</year>). <source>Onderzoek zelfstandig leren en leermotivatie in het VMBO [Study Independent Learning and Learning Motivation in the Pre-vocational Education]</source>. <publisher-loc>Groningen</publisher-loc>: <publisher-name>GION</publisher-name>.</citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hattie</surname> <given-names>J.</given-names></name> <name><surname>Timperley</surname> <given-names>H.</given-names></name></person-group> (<year>2007</year>). <article-title>The power of feedback</article-title>. <source>Rev. Educ. Res.</source> <volume>77</volume>, <fpage>81</fpage>&#x02013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.3102/003465430298487</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Heckhausen</surname> <given-names>H.</given-names></name></person-group> (<year>1974</year>). <source>Leistung und Chancegleichheit [Performance and Equal Opportunities]</source>. <publisher-loc>G&#x000F6;ttingen</publisher-loc>: <publisher-name>Hogrefe</publisher-name>.</citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hill</surname> <given-names>M. F.</given-names></name></person-group> (<year>2011</year>). <article-title>&#x0201C;Getting traction&#x0201D;: enablers and barriers to implementing Assessment for Learning in secondary schools</article-title>. <source>Assess. Educ.</source> <volume>18</volume>, <fpage>347</fpage>&#x02013;<lpage>364</lpage>. <pub-id pub-id-type="doi">10.1080/0969594X.2011.600247</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hornstra</surname> <given-names>L.</given-names></name> <name><surname>Denessen</surname> <given-names>E.</given-names></name> <name><surname>Bakker</surname> <given-names>J.</given-names></name> <name><surname>Van den Bergh</surname> <given-names>L.</given-names></name> <name><surname>Voeten</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Teacher attitudes toward dyslexia: effects on teacher expectations and the academic achievement of students with dyslexia</article-title>. <source>J. Learn. Disabil.</source> <volume>43</volume>, <fpage>515</fpage>&#x02013;<lpage>529</lpage>. <pub-id pub-id-type="doi">10.1177/0022219409355479</pub-id><pub-id pub-id-type="pmid">20445201</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Howard-Jones</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). <article-title>Neuroscience and education: myths and messages</article-title>. <source>Nat. Rev. Neurosci.</source> <volume>15</volume>, <fpage>817</fpage>&#x02013;<lpage>824</lpage>. <pub-id pub-id-type="doi">10.1038/nrn3817</pub-id><pub-id pub-id-type="pmid">25315391</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jager</surname> <given-names>L.</given-names></name> <name><surname>Denessen</surname> <given-names>E.</given-names></name></person-group> (<year>2015</year>). <article-title>Within-teacher variation of causal attributions of low achieving students</article-title>. <source>Soc. Psychol. Educ.</source> <volume>18</volume>, <fpage>517</fpage>&#x02013;<lpage>530</lpage>. <pub-id pub-id-type="doi">10.1007/s11218-015-9295-9</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jordan</surname> <given-names>A.</given-names></name> <name><surname>Glenn</surname> <given-names>C. h.</given-names></name> <name><surname>McGhie-Richmond</surname> <given-names>D.</given-names></name></person-group> (<year>2010</year>). <article-title>The supporting effective teaching (SET) project: the relationship of inclusive teaching practices to teachers&#x00027; beliefs about disability and ability, and about their roles as teachers</article-title>. <source>Teach. Teach. Educ.</source> <volume>26</volume>, <fpage>259</fpage>&#x02013;<lpage>266</lpage>. <pub-id pub-id-type="doi">10.1016/j.tate.2009.03.005</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kamins</surname> <given-names>M. L.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>1999</year>). <article-title>Person versus process praise and criticism: implications for contingent self-worth and coping</article-title>. <source>Dev. Psychol.</source> <volume>35</volume>, <fpage>835</fpage>&#x02013;<lpage>847</lpage>. <pub-id pub-id-type="doi">10.1037/0012-1649.35.3.835</pub-id><pub-id pub-id-type="pmid">10380873</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Kamins</surname> <given-names>M. L.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2012</year>). <source>Mindset Works Educator Kit - Tool for Teachers</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.mindsetworks.com">www.mindsetworks.com</ext-link>.</citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaplan</surname> <given-names>R. M.</given-names></name> <name><surname>Swart</surname> <given-names>S. G.</given-names></name></person-group> (<year>1973</year>). <article-title>Reward characteristics in appraisal of achievement behavior</article-title>. <source>Represent. Res. Soc. Psychol.</source> <volume>4</volume>, <fpage>11</fpage>&#x02013;<lpage>17</lpage>.</citation></ref>
<ref id="B35">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kneyber</surname> <given-names>R.</given-names></name> <name><surname>Sluijsmans</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <source>Toetsrevolutie. Naar een feedbackcultuur in het voortgezet onderwijs [Assessment Revolution. Towards a Feedbackculture in Secondary.]</source> <publisher-loc>Culemborg</publisher-loc>: <publisher-name>Uitgeverij Phronese</publisher-name>.</citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kuzborska</surname> <given-names>I.</given-names></name></person-group> (<year>2011</year>). <article-title>Links between teachers&#x00027; beliefs and practices and research on reading</article-title>. <source>Read. Foreign Lang.</source> <volume>23</volume>, <fpage>102</fpage>&#x02013;<lpage>128</lpage>.</citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kynigos</surname> <given-names>C.</given-names></name> <name><surname>Argyris</surname> <given-names>M.</given-names></name></person-group> (<year>2004</year>). <article-title>Teacher beliefs and practices formed during an innovation with computer-based exploratory mathematics in the classroom</article-title>. <source>Teach. Teach.</source> <volume>10</volume>, <fpage>247</fpage>&#x02013;<lpage>273</lpage>. <pub-id pub-id-type="doi">10.1080/1354060042000204414</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leslie</surname> <given-names>S.</given-names></name> <name><surname>Cimpian</surname> <given-names>A.</given-names></name> <name><surname>Meyer</surname> <given-names>M.</given-names></name> <name><surname>Freeland</surname> <given-names>E.</given-names></name></person-group> (<year>2015</year>). <article-title>Expectations of brilliance underlie gender distributions across academic disciplines</article-title>. <source>Science</source> <volume>347</volume>, <fpage>262</fpage>&#x02013;<lpage>265</lpage>. <pub-id pub-id-type="doi">10.1126/science.1261375</pub-id><pub-id pub-id-type="pmid">25593183</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>M.</given-names></name> <name><surname>Yu</surname> <given-names>P.</given-names></name></person-group> (<year>2010</year>). <article-title>Study on the inconsistency between a pre-serice teacher&#x00027;s mathematics education beliefs and mathematic teaching practice</article-title>. <source>J. Math.</source> <volume>3</volume>, <fpage>40</fpage>&#x02013;<lpage>57</lpage>.</citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>Q.</given-names></name></person-group> (<year>1999</year>). <article-title>Teachers; beliefs and gender differences in mathematics: a review</article-title>. <source>Educ. Res.</source> <volume>41</volume>, <fpage>63</fpage>&#x02013;<lpage>76</lpage>. <pub-id pub-id-type="doi">10.1080/0013188990410106</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lipnevich</surname> <given-names>A. A.</given-names></name> <name><surname>Smith</surname> <given-names>J. K.</given-names></name></person-group> (<year>2009</year>). <article-title>Effects of differential feedback on students&#x00027; examination performance</article-title>. <source>J. Exp. Psychol. Appl.</source> <volume>15</volume>, <fpage>319</fpage>&#x02013;<lpage>333</lpage>. <pub-id pub-id-type="doi">10.1037/a0017841</pub-id><pub-id pub-id-type="pmid">20025418</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mangels</surname> <given-names>J. A.</given-names></name> <name><surname>Butterfiels</surname> <given-names>B.</given-names></name> <name><surname>Lamb</surname> <given-names>J.</given-names></name> <name><surname>Good</surname> <given-names>C.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2006</year>). <article-title>Why do beliefs about intelligence influence learning success? A social cognitive neuroscience model</article-title>. <source>Soc. Cogn. Affect. Neurosci.</source> <volume>1</volume>, <fpage>75</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1093/scan/nsl013</pub-id><pub-id pub-id-type="pmid">17392928</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mansour</surname> <given-names>N.</given-names></name></person-group> (<year>2013</year>). <article-title>Consistencies and inconsistencies between science teachers&#x00027; beliefs and practices</article-title>. <source>Int. J. Sci. Educ.</source> <volume>35</volume>, <fpage>1230</fpage>&#x02013;<lpage>1275</lpage>. <pub-id pub-id-type="doi">10.1080/09500693.2012.743196</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Martinez</surname> <given-names>J. F.</given-names></name> <name><surname>Stecher</surname> <given-names>B.</given-names></name> <name><surname>Borko</surname> <given-names>H.</given-names></name></person-group> (<year>2009</year>). <article-title>Classroom assessment practices, teacher judgments, and student achievement in mathematics: evidence from the ECLS</article-title>. <source>Educ. Assess.</source> <volume>14</volume>, <fpage>78</fpage>&#x02013;<lpage>102</lpage>. <pub-id pub-id-type="doi">10.1080/10627190903039429</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meece</surname> <given-names>J. L.</given-names></name> <name><surname>Anderman</surname> <given-names>E. M.</given-names></name> <name><surname>Anderman</surname> <given-names>L. H.</given-names></name></person-group> (<year>2006</year>). <article-title>Classroom goal structure, student motivation, and academic achievement</article-title>. <source>Annu. Rev. Psychol.</source> <volume>57</volume>, <fpage>487</fpage>&#x02013;<lpage>503</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.psych.56.091103.070258</pub-id><pub-id pub-id-type="pmid">16318604</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Meelissen</surname> <given-names>M. R. M.</given-names></name> <name><surname>Drent</surname> <given-names>M.</given-names></name></person-group> (<year>2009</year>). <source>Nederland in TIMSS-advanced: Leerprestaties van 6 vwo-leerlingen in wiskunde B en natuurkunde. [Learning Outcomes of Pre-university Secondary Education Students in Mathematics and Science]</source>. <publisher-loc>Enschede</publisher-loc>: <publisher-name>Universiteit Twente</publisher-name>.</citation></ref>
<ref id="B47">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Michels</surname> <given-names>B.</given-names></name> <name><surname>Bruning</surname> <given-names>L.</given-names></name> <name><surname>Folmer</surname> <given-names>E.</given-names></name> <name><surname>Ottevanger</surname> <given-names>W.</given-names></name></person-group> (<year>2014</year>). <source>Monitoring en evaluatie invoering b&#x000E8;tavernieuwing. Nulmeting docenten en leerlingen 2012-2013 [Monitoring and Evaluation Introduction New STEM Education. Baseline Measurement Teachers and Students 2012-2013]</source>. <publisher-loc>Enschede</publisher-loc>: <publisher-name>SLO</publisher-name>.</citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mueller</surname> <given-names>C. M.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>1998</year>). <article-title>Praise for intelligence can undermine children&#x00027;s motivation and performance</article-title>. <source>J. Pers. Soc. Psychol.</source> <volume>75</volume>, <fpage>35</fpage>&#x02013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.75.1.33</pub-id><pub-id pub-id-type="pmid">9686450</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nicol</surname> <given-names>D. J.</given-names></name> <name><surname>Macfarlane-Dick</surname> <given-names>D.</given-names></name></person-group> (<year>2006</year>). <article-title>Formative assessment and selfregulated learning: a model and seven principles of good feedback practice</article-title>. <source>Stud. Higher Educ.</source> <volume>31</volume>, <fpage>199</fpage>&#x02013;<lpage>218</lpage>. <pub-id pub-id-type="doi">10.1080/03075070600572090</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nosek</surname> <given-names>B. A.</given-names></name> <name><surname>Greenwald</surname> <given-names>A. G.</given-names></name> <name><surname>Banaji</surname> <given-names>M. R.</given-names></name></person-group> (<year>2002</year>). <article-title>Harvesting implicit group attitudes and beliefs from a demonstration web site</article-title>. <source>Group Dyn. Theory Res. Practice</source> <volume>6</volume>, <fpage>101</fpage>&#x02013;<lpage>115</lpage>. <pub-id pub-id-type="doi">10.1037/1089-2699.6.1.101</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="book"><person-group person-group-type="author"><collab>OECD</collab></person-group> (<year>2003</year>). <source>Learners for Life Student Approaches to Learning, Results from PISA 2000</source>. <publisher-loc>Paris</publisher-loc>: <publisher-name>Organisation for Economic Co-operation and Development</publisher-name>.</citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><collab>OECD</collab></person-group> (<year>2009</year>). <article-title>Creating Effective Teaching and Learning Environments: First Results from TALIS</article-title>. <publisher-loc>Paris</publisher-loc>: <publisher-name>OECD Publishing</publisher-name>.</citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Polly</surname> <given-names>D.</given-names></name> <name><surname>McGee</surname> <given-names>J. R.</given-names></name> <name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Lambert</surname> <given-names>R. G.</given-names></name> <name><surname>Pugalee</surname> <given-names>D. K.</given-names></name> <name><surname>Johnson</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>The association between teachers&#x00027; beliefs, enacted practices, and student learning in mathematics</article-title>. <source>Math. Educ.</source> <volume>22</volume>, <fpage>11</fpage>&#x02013;<lpage>30</lpage>.</citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rashidi</surname> <given-names>N.</given-names></name> <name><surname>Naderi</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>The effect of gender on the patterns of classroom interaction</article-title>. <source>Education</source> <volume>2</volume>, <fpage>30</fpage>&#x02013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.5923/j.edu.20120203.02</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rattan</surname> <given-names>A.</given-names></name> <name><surname>Good</surname> <given-names>C.</given-names></name> <name><surname>Dweck</surname> <given-names>C. S.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x0201C;It&#x00027;s ok &#x02014; Not everyone can be good at math&#x0201D;: instructors with an entity theory comfort (and demotivate) students</article-title>. <source>J. Exp. Soc. Psychol.</source> <volume>48</volume>, <fpage>731</fpage>&#x02013;<lpage>737</lpage>. <pub-id pub-id-type="doi">10.1016/j.jesp.2011.12.012</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Rheinberg</surname> <given-names>F.</given-names></name></person-group> (<year>1980</year>). <source>Leistungsbewertung und Lernmotivation</source>. <publisher-loc>Gottingen</publisher-loc>: <publisher-name>Hogrefe</publisher-name>.</citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rheinberg</surname> <given-names>F.</given-names></name></person-group> (<year>1983</year>). <article-title>Achievement evaluation: a fundamental difference and its motivational consequences</article-title>. <source>Stud. Educ. Eval.</source> <volume>9</volume>, <fpage>185</fpage>&#x02013;<lpage>194</lpage>. <pub-id pub-id-type="doi">10.1016/0191-491X(83)90026-3</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Rheinberg</surname> <given-names>F.</given-names></name></person-group> (<year>2001</year>). <article-title>Bezugsnormen und schulische Leistungsbeurteilung [Reference norm and assessement of achievement]</article-title>, in <source>Leistungsmessung in Schulen</source>, ed <person-group person-group-type="editor"><name><surname>Weinert</surname> <given-names>F. E.</given-names></name></person-group> (<publisher-loc>Weinheim</publisher-loc>: <publisher-name>Beltz</publisher-name>), <fpage>59</fpage>&#x02013;<lpage>71</lpage>.</citation></ref>
<ref id="B59">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Rheinberg</surname> <given-names>F.</given-names></name> <name><surname>Engeser</surname> <given-names>S.</given-names></name></person-group> (<year>2010</year>). <article-title>Motive, training and motivational competence</article-title>, in <source>Implicit Motives</source>, eds <person-group person-group-type="editor"><name><surname>Schultheiss</surname> <given-names>O. C.</given-names></name> <name><surname>Brunstein</surname> <given-names>J. C.</given-names></name></person-group> (<publisher-loc>Oxford</publisher-loc>: <publisher-name>University Press</publisher-name>), <fpage>510</fpage>&#x02013;<lpage>549</lpage>.</citation></ref>
<ref id="B60">
<citation citation-type="web"><person-group person-group-type="author"><collab>Rijksoverheid</collab></person-group> (<year>1963</year>). <source>Wet op het voortgezet onderwijs [Law on Secondary Education]</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://wetten.overheid.nl/BWBR0002399/volledig/geldigheidsdatum_03-11-2015&#x00023;">http://wetten.overheid.nl/BWBR0002399/volledig/geldigheidsdatum_03-11-2015&#x00023;</ext-link>.</citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rubie-Davies</surname> <given-names>C. M.</given-names></name></person-group> (<year>2010</year>). <article-title>Teachers&#x00027; expectations and perceptions of students&#x00027; attributes: is there a relationship?</article-title> <source>Br. J. Educ. Psychol.</source> <volume>80</volume>, <fpage>121</fpage>&#x02013;<lpage>135</lpage>. <pub-id pub-id-type="doi">10.1348/000709909X466334</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ryan</surname> <given-names>R. M.</given-names></name> <name><surname>Deci</surname> <given-names>E. L.</given-names></name></person-group> (<year>2000</year>). <article-title>Intrinsic and extrinsic motivations: classic definitions and new directions</article-title>. <source>Contemp. Educ. Psychol.</source> <volume>25</volume>, <fpage>54</fpage>&#x02013;<lpage>67</lpage>. <pub-id pub-id-type="doi">10.1006/ceps.1999.1020</pub-id><pub-id pub-id-type="pmid">10620381</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saad</surname> <given-names>R.</given-names></name> <name><surname>Boujaoude</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>The relationship between teachers&#x00027; knowledge and beliefs about science and inquiry and their classroom practices</article-title>. <source>Eur. J. Math. Sci. Technol. Educ.</source> <volume>8</volume>, <fpage>113</fpage>&#x02013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.12973/eurasia.2012.825a</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sadler</surname> <given-names>D. R.</given-names></name></person-group> (<year>1998</year>). <article-title>Formative assessment: revisiting the territory</article-title>. <source>Assess. Educ.</source> <volume>5</volume>, <fpage>77</fpage>&#x02013;<lpage>84</lpage>. <pub-id pub-id-type="doi">10.1080/0969595980050104</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Savasci-Acikalin</surname> <given-names>F.</given-names></name></person-group> (<year>2009</year>). <article-title>Teacher beliefs and practice in science education</article-title>. <source>Asia Pac. Forum Sci. Learn. Teach.</source> <volume>10</volume>, <fpage>1</fpage>&#x02013;<lpage>14</lpage>.</citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schildkamp</surname> <given-names>K.</given-names></name> <name><surname>Kippers</surname> <given-names>W.</given-names></name> <name><surname>Wolterinck</surname> <given-names>C.</given-names></name> <name><surname>Poortman</surname> <given-names>C.</given-names></name></person-group> (<year>2016</year>). <article-title>Formatief toetsen kan beter [Formative assessment can improve; publication in Dutch]</article-title>. <source>Didactief</source> <volume>46</volume>:<fpage>21</fpage>.</citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shute</surname> <given-names>V. J.</given-names></name></person-group> (<year>2008</year>). <article-title>Focus on formative feedback</article-title>. <source>Rev. Educ. Res.</source> <volume>78</volume>, <fpage>153</fpage>&#x02013;<lpage>189</lpage>. <pub-id pub-id-type="doi">10.3102/0034654307313795</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Skipper</surname> <given-names>Y.</given-names></name> <name><surname>Douglas</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>Is no praise good praise? Effects of positive feedback on childrens&#x00027; and university students&#x00027; responses to subsequent failures</article-title>. <source>Br. J. Edu. Psychol.</source> <volume>82</volume>, <fpage>327</fpage>&#x02013;<lpage>339</lpage>. <pub-id pub-id-type="doi">10.1111/j.2044-8279.2011.02028.x</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="other"><person-group person-group-type="author"><name><surname>Sluijsmans</surname> <given-names>D.</given-names></name> <name><surname>Joosten-ten brinke</surname> <given-names>D.</given-names></name> <name><surname>Van der Vleuten</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <source>Toetsen met Leerwaarde. Een Reviewstudie Naar de Effectieve Kenmerken van Formatief Toetsen [Assessment with Value for Learning. A Reviewstudy of Effective Characteristics of Formative Assessment]</source>. Research Report 411-11-697, NWO-PROO.</citation></ref>
<ref id="B70">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>J. R.</given-names></name> <name><surname>Smith</surname> <given-names>R. L.</given-names></name></person-group> (<year>2015</year>). <source>Evaluating Instructional Leadership. Recognized Practices for Success</source>. <publisher-loc>California, CA</publisher-loc>: <publisher-name>Sage Publication Inc</publisher-name>.</citation></ref>
<ref id="B71">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Sol</surname> <given-names>Y. B.</given-names></name> <name><surname>Stokking</surname> <given-names>K. M.</given-names></name></person-group> (<year>2008</year>). <article-title>Scoringsformulier observatie feedbackgedrag (Scoring form observation feedback behaviour)</article-title>, in <source>Mondelinge Feedback bij Zelfstandig Werken [Oral Feedback on Independent Learning]</source>, eds <person-group person-group-type="editor"><name><surname>Sol</surname> <given-names>Y. B.</given-names></name> <name><surname>Stokking</surname> <given-names>K. M.</given-names></name></person-group> (<publisher-loc>Utrecht</publisher-loc>: <publisher-name>IVlos &#x00026; Utrecht University</publisher-name>), <fpage>168</fpage>.</citation></ref>
<ref id="B72">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Sol</surname> <given-names>Y. B.</given-names></name> <name><surname>Stokking</surname> <given-names>K. M.</given-names></name></person-group> (<year>2009</year>). <source>Mondelinge feedback bij zelfstandig werken. Interactie tussen docenten en leerlingen in het VO [Verbal Feedback, Interaction between Teachers and Students in Secondary Education] (ISOR No. 09.01)</source>. <publisher-loc>Utrecht</publisher-loc>: <publisher-name>Ivlos Universiteit Utrecht</publisher-name>.</citation></ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stipek</surname> <given-names>D. J.</given-names></name> <name><surname>Givvin</surname> <given-names>K. B.</given-names></name> <name><surname>Salmon</surname> <given-names>J. M.</given-names></name> <name><surname>MacGyvers</surname> <given-names>V. L.</given-names></name></person-group> (<year>2001</year>). <article-title>Teachers&#x00027; beliefs and practices related to mathematics instruction</article-title>. <source>Teach. Teacher Educ.</source> <volume>17</volume>, <fpage>213</fpage>&#x02013;<lpage>226</lpage>. <pub-id pub-id-type="doi">10.1016/S0742-051X(00)00052-4</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Van der Rijst</surname> <given-names>R. M.</given-names></name> <name><surname>van Duijn</surname> <given-names>G.</given-names></name> <name><surname>Nedermeijer</surname> <given-names>J.</given-names></name></person-group> (<year>2011</year>). <source>Hoe goed leiden wij (v)mbo docenten op? Aansluiting van opleiding op de actuele onderwijspraktijk [How Well Do We Train VMBO-Teachers? Relationship between Training and Actual Educational Practise]</source>. Report number 206, <publisher-loc>Leiden</publisher-loc>: <publisher-name>University Leiden</publisher-name>.</citation></ref>
<ref id="B75">
<citation citation-type="other"><person-group person-group-type="author"><name><surname>Van Schaik</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <source>Wat doen (goede) vmbo-docenten goed? Wat werkt volgens onderzoek. [What Do Good VMBO-Teachers Well? What Works Well, According to Investigation?]</source>. Paper presented at Symposium &#x0201C;the VMBO-nearby, appreciation of in practise teaching,&#x0201D;. Education Research Days, Brussels.</citation></ref>
<ref id="B76">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Vassilou</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <source>Gender Differences in Educational Outcomes: Study on the Measures Taken and the Current Situation in Europe</source>. <publisher-loc>Brussels</publisher-loc>: <publisher-name>Education, Audiovisual and Culture Executive Agency (EACEA P9 Eurydice)</publisher-name>.</citation></ref>
<ref id="B77">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Voerman</surname> <given-names>L.</given-names></name></person-group> (<year>2014</year>). <source>Teacher Feedback in the Classroom. Analyzing and Developing Teachers&#x00027; Feedback Behaviour in Secondary Education</source>. Doctoral dissertation, <publisher-loc>Utrecht</publisher-loc>: <publisher-name>Utrecht University</publisher-name>.</citation></ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Voerman</surname> <given-names>L.</given-names></name> <name><surname>Meijer</surname> <given-names>C. P.</given-names></name> <name><surname>Korthagen</surname> <given-names>F. A. J.</given-names></name> <name><surname>Simons</surname> <given-names>R. J.</given-names></name></person-group> (<year>2012</year>). <article-title>Types and frequencies of feedback interventions in classroom interaction secondary education</article-title>. <source>Teach. Teach. Educ.</source> <volume>28</volume>, <fpage>1107</fpage>&#x02013;<lpage>1115</lpage>. <pub-id pub-id-type="doi">10.1016/j.tate.2012.06.006</pub-id></citation></ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Watt</surname> <given-names>H. M. G.</given-names></name> <name><surname>Richardson</surname> <given-names>P. W.</given-names></name> <name><surname>Devos</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <article-title>How does gender matter in the choice of a STEM teaching career and later teaching behaviours?</article-title> <source>Int. J. Gender Sci. Technol.</source> <volume>5</volume>, <fpage>187</fpage>&#x02013;<lpage>206</lpage>.</citation></ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wilbert</surname> <given-names>J.</given-names></name> <name><surname>Grosche</surname> <given-names>M.</given-names></name> <name><surname>Gerdes</surname> <given-names>H.</given-names></name></person-group> (<year>2010</year>). <article-title>Effects of evaluative feedback on rate of learning and task motivation: an analogue experiment</article-title>. <source>Learn. Disabil.A Contemp. J.</source> <volume>8</volume>, <fpage>43</fpage>&#x02013;<lpage>52</lpage>.</citation></ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wilbert</surname> <given-names>J.</given-names></name> <name><surname>Gr&#x000FA;nke</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Norms and goals of appraisal of German teachers for students with learning disabilities</article-title>. <source>Learn. Disabil. A Contemp. J.</source> <volume>8</volume>, <fpage>19</fpage>&#x02013;<lpage>30</lpage>.</citation></ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zakaria</surname> <given-names>E.</given-names></name> <name><surname>Maat</surname> <given-names>S. M.</given-names></name></person-group> (<year>2012</year>). <article-title>Mathematics teachers&#x00027; beliefs and teaching practices</article-title>. <source>J. Math. Stat.</source> <volume>8</volume>, <fpage>191</fpage>&#x02013;<lpage>194</lpage>. <pub-id pub-id-type="doi">10.3844/jmssp.2012.191.194</pub-id></citation></ref>
</ref-list>
</back>
</article>