<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Educ.</journal-id>
<journal-title>Frontiers in Education</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Educ.</abbrev-journal-title>
<issn pub-type="epub">2504-284X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/feduc.2022.889116</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Education</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Developing Preschool Teachers&#x2019; Computational Thinking Knowledge, Attitudes, Beliefs, and Teaching Self-Efficacies: A Curriculum-Based Professional Development Program</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Saxena</surname> <given-names>Anika</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1560002/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Chiu</surname> <given-names>Ming Ming</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1033609/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Early Childhood Education, The Education University of Hong Kong</institution>, <addr-line>Hong Kong</addr-line>, <country>Hong Kong SAR, China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Special Education and Counseling, Analytics\Assessment Research Center, The Education University of Hong Kong</institution>, <addr-line>Hong Kong</addr-line>, <country>Hong Kong SAR, China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Hui Li, Shanghai Normal University, China</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Nicole D. Anderson, MacEwan University, Canada; Lawrence Jun Zhang, University of Auckland, New Zealand</p></fn>
<corresp id="c001">&#x002A;Correspondence: Anika Saxena, <email>asaxena@eduhk.hk</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Educational Psychology, a section of the journal Frontiers in Education</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>30</day>
<month>05</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>7</volume>
<elocation-id>889116</elocation-id>
<history>
<date date-type="received">
<day>03</day>
<month>03</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>04</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Saxena and Chiu.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Saxena and Chiu</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Grounded in transformative teacher development through the curriculum-based professional learning (CBPL) approach to teaching-learning, this exploratory study surveyed the computational thinking (CT) views of 25 in-service teachers before and after their CT professional development programme workshops. <italic>Multivariate outcome multilevel cross-classification analysis</italic> showed that after their workshops, these teachers changed their CT knowledge, CT attitudes, CT beliefs, and CT teaching self-efficacy. Teachers reporting greater CT knowledge than others felt greater overall CT teaching self-efficacy, including for both plugged and unplugged CT activities. Moreover, teachers who reported a school culture of sharing and teamwork or sufficient school resources for CT activities were more likely than other teachers to have greater teaching self-efficacy for plugged CT activities or CT activities overall. These results highlight the importance of school culture, school technology resources, and teachers&#x2019; reported CT knowledge to their CT teaching self-efficacy.</p>
</abstract>
<kwd-group>
<kwd>computational thinking</kwd>
<kwd>curriculum-based professional learning</kwd>
<kwd>learning design</kwd>
<kwd>preschool teachers</kwd>
<kwd>early childhood education</kwd>
<kwd>attitudes</kwd>
<kwd>beliefs</kwd>
<kwd>teaching self-efficacy</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="6"/>
<equation-count count="3"/>
<ref-count count="53"/>
<page-count count="15"/>
<word-count count="9501"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="intro">
<title>Introduction</title>
<p>As computational thinking (CT) become increasingly important to more jobs (<xref ref-type="bibr" rid="B19">Bull et al., 2020</xref>), more countries are incorporating CT into their school curricula often mandatory (<xref ref-type="bibr" rid="B28">Gretter and Yadav, 2016</xref>; <xref ref-type="bibr" rid="B48">Sands et al., 2018</xref>; <xref ref-type="bibr" rid="B40">Li et al., 2020</xref>). However, early childhood education (ECE) research on CT is still in its infancy (<xref ref-type="bibr" rid="B2">Angeli et al., 2016</xref>), with no consensus on the definition of CT or how to teach it in ECE. Still, educators generally agree that professional development is crucial to helping teachers teach with CT activities (<xref ref-type="bibr" rid="B7">Barr and Stephenson, 2011</xref>; <xref ref-type="bibr" rid="B16">Bower et al., 2017</xref>; <xref ref-type="bibr" rid="B53">Yadav et al., 2017</xref>).</p>
<p>Past studies show that teacher professional development programs (PDP) for CT can help teachers gain an understanding of the subject and foster favorable attitudes toward teaching with CT activities (<xref ref-type="bibr" rid="B29">Hestness et al., 2018</xref>; <xref ref-type="bibr" rid="B34">Ketelhut et al., 2020</xref>; <xref ref-type="bibr" rid="B46">Rich et al., 2021a</xref>), but teachers without prior CT experience acquired only superficial CT understanding (<xref ref-type="bibr" rid="B16">Bower et al., 2017</xref>). However, short PDPs (50 min to 6 h) did not increase teachers&#x2019; beliefs in their ability to plan and execute actions to achieve specified goals (<italic>self-efficacy</italic>, <xref ref-type="bibr" rid="B5">Bandura, 1977</xref>), change their negative beliefs about CT (<xref ref-type="bibr" rid="B46">Rich et al., 2021a</xref>), or adequately prepare teachers to teach with CT activities (<xref ref-type="bibr" rid="B16">Bower et al., 2017</xref>). Hence, teacher PDP to help them develop both CT knowledge and CT teaching effectiveness requires (a) alignment to their CT curriculum (<xref ref-type="bibr" rid="B23">Darling-Hammond and Richardson, 2009</xref>), (b) embedding into their teaching (e.g., learn-by-doing, apply CT activities into their teaching; <xref ref-type="bibr" rid="B8">Bayar, 2014</xref>; <xref ref-type="bibr" rid="B23">Darling-Hammond and Richardson, 2009</xref> (c) peer support (<xref ref-type="bibr" rid="B51">Villegas-Reimers, 2003</xref>; <xref ref-type="bibr" rid="B23">Darling-Hammond and Richardson, 2009</xref>; <xref ref-type="bibr" rid="B8">Bayar, 2014</xref>), and (d) longer, intensive, ongoing, systematic training (<xref ref-type="bibr" rid="B24">Dori and Herscovitz, 2005</xref>; <xref ref-type="bibr" rid="B23">Darling-Hammond and Richardson, 2009</xref>). Furthermore, a supportive school culture for the PDP enhances its effectiveness (<xref ref-type="bibr" rid="B3">Avalos, 2011</xref>).</p>
<p>Considering these findings from past studies, we proposed, designed and implemented curriculum-based professional learning (CBPL) (<xref ref-type="bibr" rid="B50">Short and Hirsh, 2020</xref>), PDP to help 25 teachers integrate CT into their curriculum and teaching (not a stand-alone CT subject). This study explores the impact of this PDP on 25 participating teachers&#x2019; CT knowledge, attitudes, beliefs, and CT teaching self-efficacy.</p>
</sec>
<sec id="S2">
<title>Curriculum-Based Professional Learning Program</title>
<p>We begin with the theoretical framework undergirding the CBPL program. Then, we specify its implementation.</p>
<sec id="S2.SS1">
<title>CBPL Theoretical Framework</title>
<p>According to the CBPL approach, high-quality curricular resources and active instruction experiences help teachers improve their knowledge, attitudes, beliefs, and teaching to improve their students&#x2019; learning outcomes (<xref ref-type="bibr" rid="B50">Short and Hirsh, 2020</xref>). Curriculum-driven professional development is more focused and intentional than otherwise (<xref ref-type="bibr" rid="B52">Wong and Tsui, 2007</xref>). Mutually supportive schools, districts, and professional development providers can further improve teachers&#x2019; teaching (<xref ref-type="bibr" rid="B1">Akinyemi and Nkonki, 2020</xref>).</p>
<p>Curriculum-based professional learning includes four design features: core, functional, structural and essential (<xref ref-type="bibr" rid="B50">Short and Hirsh, 2020</xref>). Following <xref ref-type="bibr" rid="B44">Mishra and Koehler&#x2019;s (2006)</xref> <italic>technological pedagogical content knowledge</italic> (TPACK) framework for teacher knowledge, <italic>core design features</italic> (curriculum, transformative learning, equity) develop preschool teachers&#x2019; shared understanding of CT concepts and their relevance to daily life, pedagogical content teaching skills, and diverse lesson activities (both plugged and unplugged). Transformative learning experiences introduce new teaching materials (e.g., videos) that teachers use during the PDP and then with young learners in class, thereby helping teachers enhance their perceptions, beliefs, and self-efficacies. To promote equity, the PDP uses culturally and developmentally appropriate integration of CT into ECE.</p>
<p><italic>Functional design features</italic> of PDP includes learning designs, reflection/feedback, beliefs, and change management. The learning designs introduce CT integrated curriculum with peer teachers, who implement and mirror pedagogical strategies with digital tools to teach CT. Reflection and feedback enhances teachers&#x2019; practical skills with these tools. As teachers&#x2019; competences grow, PDP cultivates change in their teaching beliefs. PDP also helps teachers become change agents and manage their changes to enhance their CT integrated classroom practices and scaffold student learning.</p>
<p><italic>Structural design</italic> provide regularity and increase consolidation of learning. Grounded in constructionist learning theory (<xref ref-type="bibr" rid="B22">Csizmadia et al., 2019</xref>), teachers collaborate to plan, implement, and assess new CT teaching materials and lessons for effectiveness and sustainability. Over time, they adapt their teaching practices to their students&#x2019; needs.</p>
<p><italic>Essential elements</italic> are leadership, coherence, and resources. PDP helps groups of leaders and teachers develop a shared, long-term vision for school-wide CT integration. Furthermore, they build networks with other schools implementing CT for mutual sharing and support. With sufficient resources, they can build sufficient material (e.g., Beebots) and staff capacity for CT implementation.</p>
</sec>
<sec id="S2.SS2">
<title>CBPL Implementation</title>
<p>The CBPL training course includes six workshops across 6 months and a summer training institute for participants to apply their workshop ideas to teaching students. The <italic>first</italic> workshop helps teachers understand the critical dimensions of <xref ref-type="bibr" rid="B18">Brennan and Resnick&#x2019;s (2012)</xref> CT framework: key ideas (e.g., iteration, parallelism; <italic>computational concepts</italic>), computer scientist actions (e.g., debugging projects; <italic>computational practices</italic>), and computer scientist views of the world (<italic>computational perspectives</italic>). In this workshop, teachers learned about CT components <italic>via</italic> daily life problem-solving activities and a related short video. They learned terms such as &#x201C;loops,&#x201D; &#x201C;conditionals,&#x201D; and &#x201C;variables&#x201D; within simple computer program structures. Then, they explored links between CT components and the ECE curriculum <italic>via</italic> brainstorming and discussion. Next, they reflected on CT&#x2019;s educational purposes and made recommendations for excellent CT instruction. We encouraged their use of CT within a suitable educational philosophy and ECE learning environment. The first workshop promoted open discussion around questions such as these (rather than simply giving answers):</p>
<list list-type="simple">
<list-item>
<label>1).</label>
<p>Does young children&#x2019;s involvement in CT activities imply that the ECE learning environment should include CT?</p>
</list-item>
<list-item>
<label>2).</label>
<p>If children engage in plugged or unplugged CT-related activities, can we presume that are excited to learn more?</p>
</list-item>
</list>
<p>These teachers considered five CT uses.</p>
<list list-type="simple">
<list-item>
<label>1.</label>
<p>CT to learn recent technological developments (e.g., use CT to teach technology and robotics principles, such as computer programming);</p>
</list-item>
<list-item>
<label>2.</label>
<p>Integrated view of CT (e.g., use CT to consolidate understanding in other curriculum areas, such as language, digital literacy, mathematics);</p>
</list-item>
<list-item>
<label>3.</label>
<p>Challenge students&#x2019; thinking (e.g., use CT to strengthen children&#x2019;s capacity to solve problems and plan strategies);</p>
</list-item>
<list-item>
<label>4.</label>
<p>Use CT to develop metacognition (e.g., use CT to increase children&#x2019;s capacity to reflect on their learning and extend their scientific inquiry);</p>
</list-item>
<list-item>
<label>5.</label>
<p>Address psychological and motivational needs (e.g., use CT as a learning environment to reduce anxiety and fear of mistakes; increase motivation and self-esteem).</p>
</list-item>
</list>
<p>The <italic>second</italic> workshop enhanced teachers&#x2019; pedagogical understanding of computational concepts, practices, and perspectives <italic>via</italic> hands-on practice. Teachers examined data practices, modeling, simulation practices, computational problem-solving practices, and systems thinking activities. To understand and apply these practices to ECE, they collaborated in groups to solve CT problems involving the programming of Beebots, Cubetto, Robo_Wunderland, and ScratchJr (<italic>artifact-based learning, <xref ref-type="bibr" rid="B4">Bairaktarova et al., 2012</xref></italic>).</p>
<p>These teachers also developed &#x201C;activities &#x2026; to engage a variety of audiences with great ideas from computer science and CT, without learning coding, programming or even using a digital device&#x201D; (<italic>unplugged CT</italic>, <xref ref-type="bibr" rid="B10">Bell and Vahrenhold, 2018</xref>, p. 497; T. <xref ref-type="bibr" rid="B11">Bell et al., 1998</xref>). These activities incorporate games, puzzles, stories, challenges, and rich sensory experiences (see examples at Hello Ruby; <ext-link ext-link-type="uri" xlink:href="https://code.org">code.org</ext-link>; ACARA; CS Unplugged, <xref ref-type="bibr" rid="B9">Bell, 2021</xref>). Unplugged activities are inexpensive, accessible, and require few resources (<xref ref-type="bibr" rid="B39">Lee and Recker, 2018</xref>). Unplugged CT promotes its development by complementing programming, integrating it into other topics, and scaffolding teachers and students, serving as a &#x201C;priming phase&#x201D; before programming to increase students&#x2019; awareness of algorithmic stages (<xref ref-type="bibr" rid="B31">Huang and Looi, 2021</xref>). By using familiar materials and concepts, unplugged CT such as paper circuitry activities &#x201C;provide multiple entry points for students less familiar with computational thinking concepts&#x201D; to learn algorithmic thinking, conditional logic, debugging, etc. (<xref ref-type="bibr" rid="B39">Lee and Recker, 2018</xref>). Lastly, these teachers wrote reflections on how their understanding and teaching of CT changed.</p>
<p>The third workshop cultivates teacher beliefs to support their CT teaching <italic>via</italic> group exploration and application. As participating teachers discuss, understand, implement, and assess CT teaching practices, they appreciate their effectiveness and sustainability, which enhances their beliefs and attitudes about effective CT teaching (<xref ref-type="bibr" rid="B16">Bower et al., 2017</xref>; <xref ref-type="bibr" rid="B53">Yadav et al., 2017</xref>; <xref ref-type="bibr" rid="B20">Corradini et al., 2018</xref>). Notably, they increase their belief in their capacity to act and accomplish teaching goals (<italic>teaching self-efficacy</italic>, <xref ref-type="bibr" rid="B6">Bandura, 2000</xref>). They created a bank of design scenarios and resources for teaching and assessing the CT learning of young children. Challenged to develop suitable CT activities for ECE, these teachers created compelling practical application scenarios.</p>
<p>We encouraged these teachers to use a scientific approach to these activities that encourages students to identify a problem, present a hypothesis, conduct an experiment, analyze the results, discuss their perspectives, generalize the findings, and revise accordingly (<xref ref-type="bibr" rid="B43">Merrill, 2002</xref>). Below are examples for various age groups based on their usefulness, availability, affordability, and variety in the local market (not tied to any one robotic platform):</p>
<list list-type="simple">
<list-item><p>Pre-nursery (2&#x2013;3 years): Unplugged CT.</p>
</list-item>
<list-item><p>K1 (3&#x2013;4 years): Unplugged CT, and Robotics.</p>
</list-item>
<list-item><p>K2 (4&#x2013;5 years): Unplugged CT, Robotics, and Digital apps.</p>
</list-item>
<list-item><p>K3 (5&#x2013;6 years): Unplugged CT, Robotics, Digital apps, and ScratchJr.</p>
</list-item>
</list>
<p>Rather than prescribe best practices, our course sought to equip teachers with tools to identify best resources and practices for each plugged or unplugged activity. For example, we revised Kemp&#x2019;s model of instructional design (<xref ref-type="bibr" rid="B32">Kemp, 1985</xref>) to highlight nine key elements in each activity&#x2019;s development:</p>
<list list-type="simple">
<list-item>
<label>1)</label>
<p>Determine specific learning objectives and concerns related to CT.</p>
</list-item>
<list-item>
<label>2)</label>
<p>Determine the key features and needs of students to consider while planning CT learning experiences.</p>
</list-item>
<list-item>
<label>3)</label>
<p>Develop a clear understanding of the CT lesson content and examine the proposed activity components for CT learning goals.</p>
</list-item>
<list-item>
<label>4)</label>
<p>Specify the CT instructional objectives and expected outcomes to design suitable CT activities.</p>
</list-item>
<list-item>
<label>5)</label>
<p>Logically present the CT content for each instructional element.</p>
</list-item>
<list-item>
<label>6)</label>
<p>Develop CT instructional strategies that facilitate students&#x2019; attainment of learning objectives and enhance their proficiency.</p>
</list-item>
<list-item>
<label>7)</label>
<p>Construct the CT instructional materials and choose the most effective delivery.</p>
</list-item>
<list-item>
<label>8)</label>
<p>Develop CT instruments to assess students&#x2019; progress toward objectives.</p>
</list-item>
<list-item>
<label>9)</label>
<p>Select appropriate CT resources (time, materials, and class organization for the activities) to aid in teaching and learning processes.</p>
</list-item>
</list>
<p>In the fourth and fifth workshops, groups of teachers collaborated to iteratively design shared CT curricula and lessons for ECE based on their school&#x2019;s available resources and culture; and the capabilities, dispositions, and predispositions of both teachers and students (<xref ref-type="bibr" rid="B49">Seow et al., 2019</xref>; <xref ref-type="bibr" rid="B37">Kotsopoulos et al., 2021</xref>). In this iterative design, they clarified their representative modeling, CT processes and errors, and students&#x2019; errors, and then used this information to improve their lessons and curricula (<xref ref-type="bibr" rid="B25">Fields et al., 2019</xref>). Based on <xref ref-type="bibr" rid="B32">Kemp&#x2019;s (1985)</xref> framework, we designed the CT integration resource bank so that its structure emphasizes the critical CT components for a lesson, including suitable in-house plugged, unplugged and web resources. Teachers in the same grade level collaboratively created lesson plans for CT integration; they identified supportive resources for the CT content, designed a lesson plan, used available materials, and presented it to other teachers (with videos, PowerPoint presentations, documents, and photographs). These complex lesson plans:</p>
<list list-type="simple">
<list-item>
<label>&#x2022;</label>
<p>Specified lesson topic/title and grade level of students.</p>
</list-item>
<list-item>
<label>&#x2022;</label>
<p>Described the background and rationale.</p>
</list-item>
<list-item>
<label>&#x2022;</label>
<p>Identified of the objectives and evaluation methods for CT integration.</p>
</list-item>
<list-item>
<label>&#x2022;</label>
<p>Specified the needed resources and timeline.</p>
</list-item>
<list-item>
<label>&#x2022;</label>
<p>Described the use of unplugged or plugged resources.</p>
</list-item>
<list-item>
<label>&#x2022;</label>
<p>Described its implementation.</p>
</list-item>
</list>
<p>The fourth and fifth sessions prepared teachers to design a CT instructional project following theoretical orientation (workshop 1), practical training (workshop 2) and exploration (workshop 3). The research team evaluated and analyzed each project, and gave the teachers feedback to help them reflect on possible improvements.</p>
<p>The sixth workshop focused on teacher feedback and a CT integrated curriculum. Specifically, teachers discussed key obstacles to creating and teaching an effective lesson plan. They shared CT teaching experiences, practical examples, and results for young children at various ages.</p>
<p>Using a bottom-up approach, teams of teacher representatives led the other participants to create a CT integrated curriculum (<xref ref-type="bibr" rid="B38">Lassonde and Israel, 2009</xref>) and institutionalize it. Teacher representatives developed further learning and teaching resources (plugged and unplugged) to enrich 2 to 6-year-old students&#x2019; learning activities, conduct reviews of activities associated with age-appropriate CT integration (<xref ref-type="bibr" rid="B13">Bers et al., 2014</xref>), shared best practices (<xref ref-type="bibr" rid="B42">Melasalmi and Husu, 2016</xref>), and enhanced professional development for colleagues (<xref ref-type="bibr" rid="B35">Kermani and Aldemir (2015)</xref>. Also, they expanded their teacher networks within and across schools, and strengthened partnerships with community key players to attract support and additional resources for long-term planning (<xref ref-type="bibr" rid="B45">Palts and Pedaste, 2020</xref>).</p>
<p>As a result of these CBPL workshops, we expect teachers to improve their CT knowledge, beliefs, attitudes and self-efficacies.</p>
</sec>
</sec>
<sec id="S3">
<title>Method</title>
<p>In this study, 25 kindergarten teachers participated in a CT PDP and completed a pre-PDP survey and post-PDP survey. We used a multivariate outcome, multilevel cross-classification to analyze their survey responses: (a) for significant differences across pre-and post-surveys, and (b) to test an explanatory model of their CT teaching self-efficacy.</p>
<sec id="S3.SS1">
<title>Participants</title>
<p>We used a convenience sample. Of the eight invited kindergartens, five kindergartens consented to conduct this PDP. Due to COVID-19 delay, only two kindergartens participated in this 6-month, school-site training programme at different times (February&#x2013;July 2021: 13 teachers, 1 principal, 1 curriculum coordinator; June&#x2013;December 2021: 13 teachers, 1 principal, 1 curriculum coordinator). Both kindergartens served 2.2 to 6-year-old students. <xref ref-type="fig" rid="F1">Figure 1</xref> explains our participant recruitment strategy and study protocol.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Recruitment strategy and study protocol.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="feduc-07-889116-g001.tif"/>
</fig>
<p>All 25 teachers are qualified and registered ECE teachers in Hong Kong (see demographics in <xref ref-type="table" rid="T1">Table 1</xref>) and consented to participate in this research.</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Participant&#x2019;s demographics (<italic>N</italic> = 25).</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Variable</td>
<td valign="top" align="center">%</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Gender</bold></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">84</td>
</tr>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">16</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Age (years)</bold></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">21&#x2013;30</td>
<td valign="top" align="center">32</td>
</tr>
<tr>
<td valign="top" align="left">31&#x2013;40</td>
<td valign="top" align="center">36</td>
</tr>
<tr>
<td valign="top" align="left">41&#x2013;50</td>
<td valign="top" align="center">20</td>
</tr>
<tr>
<td valign="top" align="left">&#x003E;50</td>
<td valign="top" align="center">12</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Schooling</bold></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">University degree</td>
<td valign="top" align="center">68</td>
</tr>
<tr>
<td valign="top" align="left">Certificate course</td>
<td valign="top" align="center">32</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Years of teaching experience</bold></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">&#x003C;5 years</td>
<td valign="top" align="center">20</td>
</tr>
<tr>
<td valign="top" align="left">6&#x2013;10 years</td>
<td valign="top" align="center">32</td>
</tr>
<tr>
<td valign="top" align="left">11&#x2013;15 years</td>
<td valign="top" align="center">32</td>
</tr>
<tr>
<td valign="top" align="left">1620 years</td>
<td valign="top" align="center">12</td>
</tr>
<tr>
<td valign="top" align="left">&#x003E;21 years</td>
<td valign="top" align="center">4</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Current students</bold></td>
<td/>
</tr>
<tr>
<td valign="top" align="left">PN (2.2&#x2013;3 years)</td>
<td valign="top" align="center">24</td>
</tr>
<tr>
<td valign="top" align="left">K1 (3&#x2013;4 years)</td>
<td valign="top" align="center">32</td>
</tr>
<tr>
<td valign="top" align="left">K2 (4&#x2013;5 years)</td>
<td valign="top" align="center">24</td>
</tr>
<tr>
<td valign="top" align="left">K3 (5&#x2013;6 years)</td>
<td valign="top" align="center">20</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="S3.SS2">
<title>Procedure</title>
<p>All 25 teachers participated in six, 2-h CT PDP workshop sessions, and then taught CT to students aged two to 6 years during either a 6-week summer school or a 2-week camp. All of them wrote reflections at the end of each workshop. All participants confirmed that they did not engage in other workshops during this time. All teachers responded to pre-workshop surveys, and 21 of them completed the post-workshop survey. All teachers were interviewed after the sixth workshop.</p>
</sec>
<sec id="S3.SS3">
<title>Data</title>
<p>Statistical power differs across levels. For &#x03B1; = 0.05 and an effect size of 0.4, statistical power for 25 people is 0.52 and for 46 survey completions across time is 0.80 (<xref ref-type="bibr" rid="B36">Konstantopoulos, 2008</xref>). As this small sample has low statistical power, false negatives are likely, but significant results remain valid.</p>
<sec id="S3.SS3.SSS1">
<title>Survey</title>
<p>The pre-workshop survey included the following fourteen definitions and thirty-three knowledge altogether forty-seven items.</p>
<p>Teacher beliefs about Computers and Computational Thinking (<xref ref-type="bibr" rid="B46">Rich et al., 2021a</xref>) has three subscales: (a) <italic>value beliefs (CT belief</italic>, 2 items; e.g., All students should learn CT); (b) <italic>value beliefs for teaching coding (CT attitude</italic>, 3 items; e.g., Interest in teaching with CT/want to continually improve teaching with CT) and (c) <italic>CT self-efficacy</italic> (7 items; e.g., I am ready to teach plugged/unplugged CT activities). All items had 5 point Likert-type scales, unless indicated otherwise. CT value belief response options ranged from &#x201C;1-Strongly disagree&#x201D; to &#x201C;5-Strongly agree.&#x201D; CT self-efficacy items response options ranged from &#x201C;1- extremely unconfident&#x201D; to &#x201C;5-extremely confident.&#x201D;</p>
<p>The post-workshop survey was identical to the pre-workshop survey, except for these additional open-ended questions:</p>
<list list-type="simple">
<list-item>
<label>1.</label>
<p>Define computational thinking in your own words.</p>
</list-item>
<list-item>
<label>2.</label>
<p>Is it possible to integrate computational thinking into the ECE classroom? Yes/No.</p>
<list list-type="simple">
<list-item>
<label>(a)</label>
<p>How would you incorporate computational thinking into your ECE classroom if you answered yes?</p>
</list-item>
<list-item>
<label>(b)</label>
<p>If not, why is it so difficult to integrate computational thinking into the classroom?</p>
</list-item>
</list>
</list-item>
</list>
<p><italic>Post</italic> is a dichotomous variable that indicates whether the data are from the post-survey (value = 1; otherwise 0 for pre-survey).</p>
</sec>
<sec id="S3.SS3.SSS2">
<title>Reflections</title>
<p>In the last 30 min of workshops, 2, 3, 5, and 6, participants were prompted to write a short reflection (200&#x2013;300 words) about their: (1) understanding of CT developed in this phase, (2) CT integration in ECE and (3) how they perceived the workshop activities as helping (or not contributing) to their understanding after that phase.</p>
</sec>
<sec id="S3.SS3.SSS3">
<title>Semi-Structured Interviews</title>
<p>After the last workshop, each teacher individually participated in 30 min, semi-structured interviews with a project leader who asked the following questions:</p>
<list list-type="simple">
<list-item>
<label>1)</label>
<p>What does CT mean to you?</p>
</list-item>
<list-item>
<label>2)</label>
<p>What are your pedagogical strategies for developing ECE students&#x2019; CT?</p>
</list-item>
<list-item>
<label>3)</label>
<p>What technologies can be used to develop Kindergarten students&#x2019; CT?</p>
</list-item>
<list-item>
<label>4)</label>
<p>What prevents you from developing your students&#x2019; CT?</p>
</list-item>
<list-item>
<label>5)</label>
<p>What could help you develop your students&#x2019; CT?</p>
</list-item>
<list-item>
<label>6)</label>
<p>How did participation in these workshops change your view about integrating CT in ECE?</p>
</list-item>
</list>
</sec>
</sec>
</sec>
<sec id="S4">
<title>Analysis</title>
<sec id="S4.SS1">
<title>Survey Analytic Issues and Statistics Strategies</title>
<p>Accurate analyses of these data must address issues involving outcomes and explanatory variables (see <xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Statistics strategies to address each analytic difficulty.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Analytic difficulty</td>
<td valign="top" align="left">Statistics strategy</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Outcome variables</bold></td>
<td valign="top" align="left"/></tr>
<tr>
<td valign="top" align="left">&#x2022; Differences across teachers<break/> &#x2022; Differences across time</td>
<td valign="top" align="left">&#x2022; Multilevel cross-classification (<xref ref-type="bibr" rid="B27">Goldstein, 2011</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">&#x2022; Discrete variable (yes/no)</td>
<td valign="top" align="left">&#x2022; Logit / Probit and odds ratios (<xref ref-type="bibr" rid="B33">Kennedy, 2008</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">&#x2022; Multiple outcomes (Y<sub>1</sub>, Y<sub>2, &#x2026;</sub>)</td>
<td valign="top" align="left">&#x2022; Multivariate outcome multilevel analysis (<xref ref-type="bibr" rid="B30">Hox et al., 2017</xref>)</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Explanatory variables</bold></td>
<td valign="top" align="left"/></tr>
<tr>
<td valign="top" align="left">&#x2022; Indirect, multi-level mediation<break/> effects (X &#x2192;M&#x2192;Y)</td>
<td valign="top" align="left">&#x2022; Multilevel <italic>M-test</italic> (<xref ref-type="bibr" rid="B41">MacKinnon et al., 2004</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">&#x2022; Cross-level interactions<break/> (Time &#x00D7; Teacher)</td>
<td valign="top" align="left">&#x2022; Random effects model (<xref ref-type="bibr" rid="B30">Hox et al., 2017</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">&#x2022; Many hypotheses&#x2019; false positives</td>
<td valign="top" align="left">&#x2022; Two-stage linear step-up procedure (<xref ref-type="bibr" rid="B12">Benjamini et al., 2006</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">&#x2022; Compare effect sizes (&#x03B2;<sub>1 </sub>&#x003E; &#x03B2;<sub>2</sub>?)</td>
<td valign="top" align="left">&#x2022; Lagrange multiplier tests (<xref ref-type="bibr" rid="B14">Bertsekas, 2014</xref>)</td>
</tr>
<tr>
<td valign="top" align="left">&#x2022; Consistency of results<break/> across data sets (Robustness)</td>
<td valign="top" align="left">&#x2022; Separate multilevel, single outcome models<break/> &#x2022; Analyses of subsets of the data (<xref ref-type="bibr" rid="B33">Kennedy, 2008</xref>)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Outcome issues include differences across teachers or across time, discrete outcomes and multiple outcomes. As completed surveys at the same time or by the same teacher likely resemble one another more than those completed at different times or by different teachers (<italic>cross-classified data</italic>), an ordinary least squares regression underestimates the <italic>standard errors</italic>, so we use a <italic>multilevel cross-classification analysis</italic> (<xref ref-type="bibr" rid="B27">Goldstein, 2011</xref>). For ordered discrete outcomes (e.g., ratings), ordinary least squares regressions can bias the standard errors, so we use an <italic>ordered Logit regression</italic> (<xref ref-type="bibr" rid="B33">Kennedy, 2008</xref>). To aid understanding of these results, we report the <italic>odds ratio</italic> of the regression coefficient, namely the percentage increase or decrease in the likelihood of the outcome (<xref ref-type="bibr" rid="B33">Kennedy, 2008</xref>). Multiple outcomes can have correlated residuals that underestimate standard errors, so we use <italic>multivariate outcome multilevel analysis</italic> (<xref ref-type="bibr" rid="B30">Hox et al., 2017</xref>).</p>
<p>Explanatory variable issues include omitted variable bias, indirect effects, cross-level interactions, many hypotheses&#x2019; false positives, effect size comparisons, and robustness. As unspecified, omitted explanatory variables can cause <italic>omitted variable bias</italic> (<xref ref-type="bibr" rid="B33">Kennedy, 2008</xref>), we use a <italic>difference-in-differences analysis</italic> of participants at different times to reduce this bias (<xref ref-type="bibr" rid="B15">Bertrand et al., 2004</xref>). Separate, single-level tests of indirect mediation effects on cross-classified data can bias results, so we test for simultaneous multi-level mediation effects with a <italic>multilevel M-test</italic> (<xref ref-type="bibr" rid="B41">MacKinnon et al., 2004</xref>).</p>
<p>With cross-classified data, incorrectly modeling interaction effects across levels (e.g., survey response &#x00D7; teacher) can bias the results, so we use a <italic>random effects</italic> model (<xref ref-type="bibr" rid="B30">Hox et al., 2017</xref>). If an explanatory variable&#x2019;s regression coefficient (e.g., &#x03B2;<sub>yvj</sub> = &#x03B2;<sub>yv0</sub> + g<sub>yvj</sub>) differs across levels (g<sub>yvj</sub> &#x2260; 0?), then we model the possible cross-level moderation with structural variables (e.g., teacher).</p>
<p>As testing many hypotheses can cause false positives, we reduce them <italic>via</italic> the <italic>two-stage linear step-up procedure</italic>; it outperformed 13 other methods in computer simulations (<xref ref-type="bibr" rid="B12">Benjamini et al., 2006</xref>). When testing whether effect sizes differ, <italic>Wald</italic> and <italic>likelihood ratio</italic> tests do not apply at boundary points, so we use <italic>Lagrange multiplier tests</italic>, which also have more statistical power for small deviations from the null hypothesis (<xref ref-type="bibr" rid="B14">Bertsekas, 2014</xref>).</p>
<p>Lastly, we test whether the results remain stable (<italic>robust</italic>) despite small data or analytic differences (<xref ref-type="bibr" rid="B33">Kennedy, 2008</xref>). As any mis-specified equation in a multiple outcome model can introduce errors into otherwise correct equations, we model each outcome variable separately. Then, we separately run subsets of the data.</p>
<sec id="S4.SS1.SSS1">
<title>Pre- vs. Post-workshops Differences</title>
<p>We model each survey response to a question with a <italic>multivariate outcome, multilevel cross-classification</italic> analysis (<xref ref-type="bibr" rid="B30">Hox et al., 2017</xref>).</p>
<disp-formula id="S4.E1"><label>(1)</label><mml:math id="M1"><mml:mrow><mml:mpadded width="+3.3pt"><mml:msub><mml:mtext mathvariant="bold">Response</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mpadded><mml:mo rspace="5.8pt">=</mml:mo><mml:mrow><mml:mpadded width="+3.3pt"><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>y</mml:mtext></mml:mrow></mml:msub></mml:mpadded><mml:mo rspace="5.8pt">+</mml:mo><mml:mpadded width="+3.3pt"><mml:msub><mml:mi>e</mml:mi><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mpadded><mml:mo rspace="5.8pt">+</mml:mo><mml:mpadded width="+3.3pt"><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mtext>yt</mml:mtext></mml:mrow></mml:msub></mml:mpadded><mml:mo rspace="5.8pt">+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yx</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">Post</mml:mtext><mml:mrow><mml:mtext>yt</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mrow></mml:mrow></mml:math></disp-formula>
<p>In the vector of variables Response, the outcome variable (response to survey question) <italic>y</italic> by teacher <italic>i</italic> at time <italic>t</italic> has a centered intercept &#x03B2;<sub>y</sub> with unexplained components (<italic>residuals</italic>) at the response- and time-levels (<italic>e</italic><sub>yit</sub>, <italic>f</italic><sub>yt</sub>). Possible Response outcomes <italic>y</italic> include define CT (<italic>algorithm, analytic ability, solve as computer scientist, logical, problem solve</italic>), CT knowledge (<italic>know CT, teach CT, teach CT to children, teach unplugged CT</italic>), beliefs (<italic>all learn CT, effective teaching helps students learn CT</italic>), attitude (<italic>interest, improve, attend training</italic>), self-efficacy (<italic>overall CT teaching, plugged CT teaching, unplugged CT teaching</italic>). Then, we test whether teacher responses to questions on the pre-workshops and post-workshops surveys differ, as indicated by the significance of the regression coefficient of Post, namely &#x03B2;<sub>yx</sub> (see summary statistics <xref ref-type="table" rid="T3">Table 3</xref> and the results in <xref ref-type="table" rid="T4">Table 4</xref>).</p>
<table-wrap position="float" id="T3">
<label>TABLE 3</label>
<caption><p>Summary statistics (<italic>N</italic> = 46).</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Variable</td>
<td valign="top" align="center">Mean</td>
<td valign="top" align="center">SD</td>
<td valign="top" align="center">Min</td>
<td valign="top" align="center">Median</td>
<td valign="top" align="center">Max</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Define computational thinking (CT)</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Algorithm</td>
<td valign="top" align="center">5.652</td>
<td valign="top" align="center">1.233</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Analysis ability</td>
<td valign="top" align="center">5.522</td>
<td valign="top" align="center">1.130</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Computer program</td>
<td valign="top" align="center">5.326</td>
<td valign="top" align="center">1.367</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Computer scientist solving process</td>
<td valign="top" align="center">5.413</td>
<td valign="top" align="center">1.343</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Digital literacy</td>
<td valign="top" align="center">4.913</td>
<td valign="top" align="center">1.208</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6</td>
</tr>
<tr>
<td valign="top" align="left">Digital skills</td>
<td valign="top" align="center">4.913</td>
<td valign="top" align="center">1.208</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6</td>
</tr>
<tr>
<td valign="top" align="left">Know computer operations</td>
<td valign="top" align="center">5.130</td>
<td valign="top" align="center">1.240</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Logically organize and analyze</td>
<td valign="top" align="center">5.196</td>
<td valign="top" align="center">1.408</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Logical problem solve</td>
<td valign="top" align="center">5.870</td>
<td valign="top" align="center">1.185</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Mathematical thinking</td>
<td valign="top" align="center">4.761</td>
<td valign="top" align="center">1.139</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6</td>
</tr>
<tr>
<td valign="top" align="left">Number computations</td>
<td valign="top" align="center">5.130</td>
<td valign="top" align="center">1.222</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Solve with a computer</td>
<td valign="top" align="center">5.174</td>
<td valign="top" align="center">1.768</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Systemic thinking</td>
<td valign="top" align="center">5.065</td>
<td valign="top" align="center">1.357</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5.5</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left"><bold>CT Belief</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">All students should learn CT</td>
<td valign="top" align="center">3.957</td>
<td valign="top" align="center">0.759</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left">Effective teaching improves student learning</td>
<td valign="top" align="center">3.913</td>
<td valign="top" align="center">0.812</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left"><bold>CT attitude</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Interest in teaching with CT</td>
<td valign="top" align="center">3.978</td>
<td valign="top" align="center">0.830</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left">Want to continually improve teaching with CT</td>
<td valign="top" align="center">3.870</td>
<td valign="top" align="center">0.778</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left">Want more teacher training</td>
<td valign="top" align="center">4.109</td>
<td valign="top" align="center">0.737</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left"><bold>CT knowledge</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Know CT</td>
<td valign="top" align="center">4.739</td>
<td valign="top" align="center">1.782</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Know how to teach with CT</td>
<td valign="top" align="center">3.478</td>
<td valign="top" align="center">0.888</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left">Know how to teach with CT in early childhood lessons</td>
<td valign="top" align="center">3.652</td>
<td valign="top" align="center">0.900</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left">Know how to teach with unplugged CT</td>
<td valign="top" align="center">3.652</td>
<td valign="top" align="center">0.948</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Teach CT</bold></td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Ready to teach CT activities</td>
<td valign="top" align="center">4.783</td>
<td valign="top" align="center">1.725</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Ready to teach plugged CT activities</td>
<td valign="top" align="center">4.413</td>
<td valign="top" align="center">1.614</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">7</td>
</tr>
<tr>
<td valign="top" align="left">Ready to teach unplugged CT activities</td>
<td valign="top" align="center">4.717</td>
<td valign="top" align="center">1.721</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">7</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap position="float" id="T4">
<label>TABLE 4</label>
<caption><p>Multilevel cross-classification differences analysis.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Explanatory variable<hr/></td>
<td/>
<td/>
<td valign="top" align="center">Odds<hr/></td>
<td valign="top" align="center">Explained<hr/></td>
</tr>
<tr>
<td valign="top" align="left">Definition of CT</td>
<td valign="top" align="center">b (SE)</td>
<td/>
<td valign="top" align="center">ratio</td>
<td valign="top" align="center">Variance (Time)</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Algorithmic solution of a problem</td>
<td valign="top" align="center">4.867</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">47%</td>
<td valign="top" align="center">0.381</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.239)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Analytic ability</td>
<td valign="top" align="center">4.423</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">49%</td>
<td valign="top" align="center">0.273</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(1.123)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Solving problems as a computer scientist</td>
<td valign="top" align="center">3.969</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">48%</td>
<td valign="top" align="center">0.231</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.880)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Logical problem solving</td>
<td valign="top" align="center">4.527</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">49%</td>
<td valign="top" align="center">0.315</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.967)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Problem solving</td>
<td valign="top" align="center">3.380</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">47%</td>
<td valign="top" align="center">0.222</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.778)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Knowledge of CT</bold></td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Know what CT is</td>
<td valign="top" align="center">2.750</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">44%</td>
<td valign="top" align="center">0.125</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.660)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Know steps for teaching CT effectively</td>
<td valign="top" align="center">1.783</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">36%</td>
<td valign="top" align="center">0.201</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.410)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Know CT enough to teach it to young children</td>
<td valign="top" align="center">3.706</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">48%</td>
<td valign="top" align="center">0.245</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.874)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Know unplugged CT enough to teach it</td>
<td valign="top" align="center">4.650</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">49%</td>
<td valign="top" align="center">0.301</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(1.138)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Beliefs about CT</bold></td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">All students should learn CT</td>
<td valign="top" align="center">3.995</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">48%</td>
<td valign="top" align="center">0.278</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(1.102)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Effective teaching helps students learn CT</td>
<td valign="top" align="center">1.743</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">35%</td>
<td valign="top" align="center">0.082</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.619)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>Attitude toward CT</bold></td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Interested in CT teaching</td>
<td valign="top" align="center">(4.452)</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">49%</td>
<td valign="top" align="center">0.338</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">1.118</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Continually find better ways to teach CT</td>
<td valign="top" align="center">(3.901)</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">48%</td>
<td valign="top" align="center">0.251</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">1.098</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Want to attend training about teaching practices</td>
<td valign="top" align="center">(1.571)</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">33%</td>
<td valign="top" align="center">0.185</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">0.394</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left"><bold>CT Self-efficacy</bold></td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Overall CT teaching self-efficacy</td>
<td valign="top" align="center">2.812</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">44%</td>
<td valign="top" align="center">0.143</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.674)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Plugged CT teaching self-efficacy</td>
<td valign="top" align="center">3.443</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">47%</td>
<td valign="top" align="center">0.180</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.742)</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Unplugged CT teaching self-efficacy</td>
<td valign="top" align="center">2.503</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t4fns3">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">42%</td>
<td valign="top" align="center">0.122</td>
</tr>
<tr>
<td/>
<td valign="top" align="center">(0.634)</td>
<td/>
<td/>
<td/>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t4fns3"><p><italic>&#x002A;&#x002A;&#x002A;p &#x003C; 0.001.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S4.SS1.SSS2">
<title>CT Teaching Self-Efficacies</title>
<p>Next, we test whether school attributes or teacher characteristics are linked to CT_Teaching_Self-efficacy.</p>
<disp-formula id="S4.E2"><label>(2)</label><mml:math id="M2"><mml:mrow><mml:mrow><mml:mrow><mml:mtext mathvariant="bold">CT</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">Teaching</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">Self</mml:mtext></mml:mrow><mml:mo>-</mml:mo><mml:mpadded width="+3.3pt"><mml:msub><mml:mtext mathvariant="bold">efficacy</mml:mtext><mml:mrow><mml:mi>y</mml:mi><mml:mo>&#x2062;</mml:mo><mml:mi>i</mml:mi><mml:mo>&#x2062;</mml:mo><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mpadded></mml:mrow><mml:mo rspace="5.8pt">=</mml:mo><mml:mrow><mml:mpadded width="+3.3pt"><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>y</mml:mtext></mml:mrow></mml:msub></mml:mpadded><mml:mo rspace="5.8pt">+</mml:mo><mml:mpadded width="+3.3pt"><mml:msub><mml:mi>e</mml:mi><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mpadded><mml:mo rspace="5.8pt">+</mml:mo><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mtext>yt</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mrow></mml:math></disp-formula>
<p>In the vector CT_Teaching_Self-efficacy, the outcome variable <italic>y</italic> (<italic>overall CT teaching self-efficacy, plugged CT teaching self-efficacy, unplugged CT teaching self-efficacy</italic>) by teacher <italic>i</italic> at time <italic>t</italic> has a centered intercept &#x03B2;<sub>y</sub> with residuals at the response- and time-levels (<italic>e</italic><sub>yit</sub>, <italic>f</italic><sub>yt</sub>).</p>
<p>First, we add School variables: <italic>leadership, school culture of sharing and teamwork, sufficient CT resources, technology classrooms</italic>, and <italic>resources for technology training</italic>. Then, we added a time variable: Post. Next, we added teacher beliefs (T_Belief): <italic>all students should learn CT</italic>, and <italic>effective teaching helps students learn CT</italic>. Afterward, we added teacher attitudes (T_Attitude): <italic>interested in teaching with CT</italic>, <italic>continually find better ways to teach CT</italic>, <italic>want more teaching training</italic>. Then, we add teacher knowledge (T_Knowledge): <italic>know CT, know steps for teaching CT, know CT for teaching ECE</italic>, and <italic>know unplugged CT</italic>. Lastly, we added Interaction terms among significant explanatory variables.</p>
<disp-formula id="S4.Ex1"><mml:math id="M3"><mml:mrow><mml:mrow><mml:mtext mathvariant="bold">CT</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">Teaching</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">Self</mml:mtext></mml:mrow><mml:mo>-</mml:mo><mml:msub><mml:mtext mathvariant="bold">efficacy</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:math></disp-formula>
<disp-formula id="S4.Ex2"><mml:math id="M4"><mml:mrow><mml:mi/><mml:mo rspace="5.8pt">=</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>y</mml:mtext></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi>e</mml:mi><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mtext>yt</mml:mtext></mml:mrow></mml:msub><mml:mo>+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yis</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">School</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow><mml:mo>+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yiu</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">Post</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow><mml:mo>+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yiv</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">T</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">Belief</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mrow></mml:mrow></mml:math></disp-formula>
<disp-formula id="S4.Ex3"><mml:math id="M5"><mml:mrow><mml:mrow><mml:mo>+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yiw</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">T</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">Attitude</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mrow><mml:mo>+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yix</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:mtext mathvariant="bold">T</mml:mtext><mml:mo>&#x2062;</mml:mo><mml:mi mathvariant="normal">_</mml:mi><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">Knowledge</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mrow></mml:math></disp-formula>
<disp-formula id="S4.E3"><label>(3)</label><mml:math id="M6"><mml:mrow><mml:mo>+</mml:mo><mml:mrow><mml:msub><mml:mi mathvariant="normal">&#x03B2;</mml:mi><mml:mrow><mml:mtext>yiz</mml:mtext></mml:mrow></mml:msub><mml:mo>&#x2062;</mml:mo><mml:msub><mml:mtext mathvariant="bold">Interaction</mml:mtext><mml:mrow><mml:mtext>yit</mml:mtext></mml:mrow></mml:msub></mml:mrow></mml:mrow></mml:math></disp-formula>
<p>We use an alpha level of 0.05. We also analyze residuals for influential outliers.</p>
</sec>
</sec>
<sec id="S4.SS2">
<title>Analysis of Written Reflections and Individual Interviews</title>
<p>We conducted thematic analysis of the written reflections, applying initial coding, axial coding and theoretical coding to identify major patterns and themes (<xref ref-type="bibr" rid="B17">Braun and Clarke, 2006</xref>). In the initial coding, data were coded by keywords or phrases (e.g., algorithm, if-then). In the axial coding, the data were coded into categories (e.g., beliefs) and sub-categories (all children should learn CT; only technically-inclined children should learn CT). In the theoretical coding, data were compared with pre-existing models of PDP effects on CT knowledge, beliefs, attitudes, and teaching self-efficacies (e.g., <xref ref-type="bibr" rid="B47">Rich et al., 2021b</xref>).</p>
<p>We analyzed the semi-structured interviews (<xref ref-type="bibr" rid="B26">Fraenkel et al., 2015</xref>) with <xref ref-type="bibr" rid="B21">Creswell&#x2019;s (2012)</xref> six-step method. First, we anonymized and converted all interview transcripts to text. Then, the lead author read the interview transcripts several times to understand the interviewees&#x2019; ideas and tone. Initial codes were developed and then iteratively refined (<xref ref-type="bibr" rid="B26">Fraenkel et al., 2015</xref>). Next, the codes were evaluated, and some were merged while others were deleted. Then, themes were developed and organized into a hierarchy of codes. Tables and figures were created to illustrate the findings. Finally, findings were examined, and thick description and inter-coder reliability tested the trustworthiness of the interpretations.</p>
</sec>
</sec>
<sec id="S5">
<title>Findings</title>
<p>The summary statistics generally showed moderate to high levels of CT knowledge, beliefs, attitudes, and teaching self-efficacies (See <xref ref-type="table" rid="T3">Table 3</xref>), especially on the post-workshop surveys (as shown in the next section). The <italic>multivariate outcome, multilevel cross-classification</italic> results below show significant differences in pre- vs. post-workshops responses, and a path analysis modeling antecedents of CT teaching self-efficacies.</p>
<sec id="S5.SS1">
<title>Pre- vs. Post-workshops Differences</title>
<p>These teachers&#x2019; survey responses regarding CT definition, beliefs, attitudes, knowledge, and CT teaching self-efficacies showed vast differences before vs. after the workshops. After the workshops, these teachers were far more likely) to define CT as including algorithmic solution of a problem, analytic ability, solving problems as a computer scientist, logical problem solving, or problem solving (+47% or higher odds ratio for each, see <xref ref-type="table" rid="T4">Table 4</xref>). After the workshops, these teachers were much more likely to know what CT is (+44%), know steps to teach CT effectively (+36%), know CT enough to teach it to young children (+48%), and know unplugged CT enough to teach it (+49%). After the workshops, these teachers were also far more likely to believe that all students should learn CT (+48%) and that effective teaching helps students learn CT (+35%). Their following attitudes also vastly improved after the workshops: interest in integrating CT into their teaching (+49%), continually find better ways to teach CT (+48%), and want to attend more training about teaching practices (+33%). After the workshops, teachers reported greater overall CT teaching self-efficacy (+44%), plugged CT teaching self-efficacy (+47%), and unplugged CT teaching self-efficacy (+42%).</p>
</sec>
<sec id="S5.SS2">
<title>CT Teaching Self-Efficacy</title>
<p>CT teaching self-efficacy often differed more across teachers (teach with CTA overall: 62%; teach with plugged CTA: 64%; teach with unplugged CTA: 50%) than across time (overall CTA: 38%; plugged CTA: 36%; unplugged CTA: 50%; see <xref ref-type="table" rid="T5">Table 5</xref>). (See <xref ref-type="app" rid="A1">Appendix Table A1</xref> for <italic>correlation-variance-covariance matrices</italic>). All results discussed below describe first entry into the regression, controlling for all previously included variables. Ancillary regressions and statistical tests are available upon request.</p>
<table-wrap position="float" id="T5">
<label>TABLE 5</label>
<caption><p>Summary of multilevel cross-classification analyses of overall / plugged / unplugged computational thinking teaching self-efficacy.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center" colspan="16">Computational thinking teaching self-efficacy<hr/></td>
</tr>
<tr>
<td valign="top" align="left">Explanatory variable</td>
<td valign="top" align="center" colspan="6">Overall</td>
<td valign="top" align="center" colspan="6">Plugged</td>
<td valign="top" align="center" colspan="4">Unplugged</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">School culture of sharing</td>
<td valign="top" align="center">2.04</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">1.79</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">1.57</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">1.95</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">1.89</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">1.27</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;</xref></td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">And teamwork</td>
<td valign="top" align="center">(0.39)</td>
<td valign="top" align="center">+39%</td>
<td valign="top" align="center">(0.47)</td>
<td valign="top" align="center">+36%</td>
<td valign="top" align="center">(0.47)</td>
<td valign="top" align="center">+33%</td>
<td valign="top" align="center">(0.40)</td>
<td valign="top" align="center">+38%</td>
<td valign="top" align="center">(0.42)</td>
<td valign="top" align="center">+37%</td>
<td valign="top" align="center">(0.44)</td>
<td valign="top" align="center">+28%</td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">School has sufficient</td>
<td/>
<td/>
<td valign="top" align="center">1.55</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">0.97</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td/>
<td/>
<td valign="top" align="center">0.79</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td valign="top" align="center">0.82</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Resources to support CTA</td>
<td/>
<td/>
<td valign="top" align="center">(0.35)</td>
<td valign="top" align="center">+32%</td>
<td valign="top" align="center">(0.42)</td>
<td valign="top" align="center">+23%</td>
<td/>
<td/>
<td valign="top" align="center">(0.35)</td>
<td valign="top" align="center">+19%</td>
<td valign="top" align="center">(0.38)</td>
<td valign="top" align="center">+19%</td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">Post-workshops</td>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">3.44</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td valign="top" align="center">2.16</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;</xref></td>
</tr>
<tr>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">(0.74)</td>
<td valign="top" align="center">+47%</td>
<td valign="top" align="center">(0.83)</td>
<td valign="top" align="center">+40%</td>
</tr>
<tr>
<td valign="top" align="left">Know computational</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">1.12</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;</xref></td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">1.04</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
<td/>
<td/>
<td valign="top" align="center">1.98</td>
<td valign="top" align="center"><xref ref-type="table-fn" rid="t5fns1">&#x002A;&#x002A;&#x002A;</xref></td>
</tr>
<tr>
<td valign="top" align="left">Thinking</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">(0.46)</td>
<td valign="top" align="center">+25%</td>
<td/>
<td/>
<td/>
<td/>
<td valign="top" align="center">(0.31)</td>
<td valign="top" align="center">+24%</td>
<td/>
<td/>
<td valign="top" align="center">(0.40)</td>
<td valign="top" align="center">+38%</td>
</tr>
<tr>
<td valign="top" align="left" colspan="17"><bold>% Variance at each level</bold></td>
</tr>
<tr>
<td valign="top" align="left">Teacher</td>
<td valign="top" align="center">62</td>
<td/>
<td valign="top" align="center">62</td>
<td/>
<td valign="top" align="center">62</td>
<td/>
<td valign="top" align="center">64</td>
<td/>
<td valign="top" align="center">64</td>
<td/>
<td valign="top" align="center">64</td>
<td/>
<td valign="top" align="center">50</td>
<td/>
<td valign="top" align="center">50</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">Time</td>
<td valign="top" align="center">38</td>
<td/>
<td valign="top" align="center">38</td>
<td/>
<td valign="top" align="center">38</td>
<td/>
<td valign="top" align="center">36</td>
<td/>
<td valign="top" align="center">36</td>
<td/>
<td valign="top" align="center">36</td>
<td/>
<td valign="top" align="center">50</td>
<td/>
<td valign="top" align="center">50</td>
<td/>
</tr>
<tr>
<td valign="top" align="left" colspan="17"><bold>Explained variance at each level</bold></td>
</tr>
<tr>
<td valign="top" align="left">Teacher</td>
<td valign="top" align="center">0.49</td>
<td/>
<td valign="top" align="center">0.80</td>
<td/>
<td valign="top" align="center">0.86</td>
<td/>
<td valign="top" align="center">0.42</td>
<td/>
<td valign="top" align="center">0.48</td>
<td/>
<td valign="top" align="center">0.53</td>
<td/>
<td valign="top" align="center">0.26</td>
<td/>
<td valign="top" align="center">0.61</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">Time</td>
<td valign="top" align="center">0.00</td>
<td/>
<td valign="top" align="center">0.00</td>
<td/>
<td valign="top" align="center">0.01</td>
<td/>
<td valign="top" align="center">0.00</td>
<td/>
<td valign="top" align="center">0.00</td>
<td/>
<td valign="top" align="center">0.39</td>
<td/>
<td valign="top" align="center">0.00</td>
<td/>
<td valign="top" align="center">0.95</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">Total explained variance</td>
<td valign="top" align="center">0.30</td>
<td/>
<td valign="top" align="center">0.50</td>
<td/>
<td valign="top" align="center">0.54</td>
<td/>
<td valign="top" align="center">0.27</td>
<td/>
<td valign="top" align="center">0.31</td>
<td/>
<td valign="top" align="center">0.48</td>
<td/>
<td valign="top" align="center">0.13</td>
<td/>
<td valign="top" align="center">0.78</td>
<td/>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="t5fns1"><p><italic>CTA, computational thinking activities. &#x002A;p &#x003C; 0.05, &#x002A;&#x002A;p &#x003C; 0.01, &#x002A;&#x002A;&#x002A;p &#x003C; 0.001.</italic></p></fn>
</table-wrap-foot>
</table-wrap>
<sec id="S5.SS2.SSS1">
<title>Teachers&#x2019; Overall CT Teaching Self-Efficacy</title>
<p>School attributes and teachers&#x2019; perceived knowledge accounted for differences in teachers&#x2019; overall CT teaching self-efficacy (see <xref ref-type="table" rid="T5">Table 5</xref> and <xref ref-type="fig" rid="F2">Figure 2</xref>). Teachers in schools with a culture of sharing and teamwork, in schools with perceived sufficient resources to support CTA, or who viewed themselves as knowing CT were more likely than other teachers to report greater overall CT teaching self-efficacy (respectively, +39%, +32%, +25%).</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Path analysis of antecedents of overall / plugged / unplugged computational thinking (CT) teaching self-efficacy. Thicker arrows indicate larger effect sizes. &#x002A;<italic>p</italic> &#x003C; 0.05, <sup>&#x002A;&#x002A;</sup><italic>p</italic> &#x003C; 0.01, <sup>&#x002A;&#x002A;&#x002A;</sup><italic>p</italic> &#x003C; 0.001 5.2 Written Reflections and Interviews.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="feduc-07-889116-g002.tif"/>
</fig>
<p>These results showed significant mediation effects. Teachers in the school with a culture of greater sharing and teamwork were 27% more likely than those in the other school to have sufficient resources to support CTA, which in turn was linked to 32% greater overall CT teaching self-efficacy (12% mediation; <italic>z</italic> = 3.15; <italic>p</italic> = 0.002). In the school with a culture of greater sharing and teamwork, teachers were 27% more likely than those in the other school to view themselves as knowing CT, which in turn was linked to 32% greater overall CT teaching self-efficacy (12% mediation, <italic>z</italic> = 2.11, <italic>p</italic> = 0.035). In the school with greater sufficiency of resources to support CTA, teachers were 21% more likely to view themselves as knowing CT, which in turn was linked to 25% greater overall CT teaching self-efficacy (37% mediation, <italic>z</italic> = 2.36, <italic>p</italic> = 0.018). The final explanatory model accounted for 54% of the differences in overall CT teaching self-efficacy.</p>
</sec>
<sec id="S5.SS2.SSS2">
<title>Teachers&#x2019; Plugged CT Teaching Self-Efficacy</title>
<p>School attributes and teachers&#x2019; perceived knowledge also accounted for differences in teachers&#x2019; plugged CT teaching self-efficacy. Teachers in the school with a culture of greater sharing and teamwork or perceived sufficient resources to support CTA, or who viewed themselves as knowing CT were also more likely than other teachers to have greater plugged CT teaching self-efficacy (respectively, +38%, +19%, +24%).</p>
<p>These results also showed significant mediation effects. In the school with a culture of greater sharing and teamwork, teachers were 27% more likely than teachers in the other school to view themselves as knowing CT, which in turn was linked to 24% greater plugged CT teaching self-efficacy (33% mediation, <italic>z</italic> = 2.692, <italic>p</italic> = 0.007). The final explanatory model accounted for 48% of the variance in plugged CT teaching self-efficacy.</p>
</sec>
<sec id="S5.SS2.SSS3">
<title>Teachers&#x2019; Unplugged CT Teaching Self-Efficacy</title>
<p>Lastly, workshop completion and teachers&#x2019; perceived knowledge accounted for differences in teachers&#x2019; unplugged CT teaching self-efficacy. Teachers who completed the workshops or viewed themselves as knowing CT were more likely than other teachers to have greater unplugged CT teaching self-efficacy (respectively, +47%, +38%).</p>
<p>These results also showed significant mediation effects. Teachers who completed the workshops were 44% more likely than other teachers to view themselves as knowing CT, and in turn were 38% more likely than other teachers to have greater unplugged CT teaching self-efficacy (37% mediation, <italic>z</italic> = 3.204, <italic>p</italic> = 0.001). The final explanatory model accounted for 78% of the variance in unplugged CT teaching self-efficacy.</p>
<p>All other explanatory variables and interactions were not significant. Analysis of residuals showed no substantial outliers. Robustness tests on data subsets and single outcomes showed similar results.</p>
<p>Our thematic analysis of participants&#x2019; written reflections and interviews identified important PDP learning components and need for further support.</p>
</sec>
<sec id="S5.SS2.SSS4">
<title>Valuable PDP Components</title>
<p>Participants identified six valuable PDP components: (a) poor initial CT knowledge, (b) consequent importance of concrete CT experiences, (c) educational resources, (d) collaborative planning, (e) student involvement, and (f) spacing between workshops. Most of these teachers reported no formal training in computers, and many teachers shared teacher T-13&#x2019;s understanding of CT.</p>
<disp-quote>
<p>I have never heard about the word &#x201C;computational thinking&#x201D; before attending these workshops.</p>
</disp-quote>
<disp-quote>
<p>(Teacher-13&#x2032;s Reflection after the 2nd workshop, T-13-R2).</p>
</disp-quote>
<p>Like T13, most of these participants had no knowledge of CT.</p>
<p>As a result, many participants like T-17 and T-12 appreciated the informal learning activities.</p>
<disp-quote>
<p>Hands-on participation in these PDP workshops made me confident, aware of my own ability to decompose real-world problems. T-17-I(interview) require concrete experience to build the conceptual understanding of CT. T-12-R3.</p>
</disp-quote>
<disp-quote>
<p>These teachers explained how their hands-on activities and concrete experiences helped them develop their CT understanding and skills and apply them (e.g., decompose real-world problems).</p>
</disp-quote>
<p>These teachers&#x2019; low initial CT competence inclined them toward teaching with unplugged CT activities. For example, T-11 said I love the concept that CT can be implemented through unplugged activities and I am very confident with unplugged pedagogy of teaching CT concepts T-11-I.</p>
<disp-quote>
<p>I am going to apply unplugged CT in my class with 3-4-year-old students. T-12-R2.</p>
</disp-quote>
<p>Like many of these teachers, T-19 and T-12 enthusiastically embraced teaching CT to their young students with unplugged activities. As indicated in the above statistics, teachers reported greater CT teaching self-efficacy for using unplugged rather than plugged activities.</p>
<p>Hence, collaborative planning and the introduction of new education materials and technologies were critical to some teachers using them to teach their students <italic>via</italic> plugged activities. For example, T-9 said:</p>
<disp-quote>
<p>Collaborative planning enhanced our collective knowledge of CT and in the future, it will help us to enhance our CT practice through collaborative efforts such as planning, development of resources, assessments etc. T-9-I.</p>
</disp-quote>
<p>T-9 argued that the collaborative planning both improved their understanding of CT and aids their subsequent CT teaching practices. T-4 explained how she used the provided technologies to teach her students.</p>
<disp-quote>
<p>Happy-Map activities are very good when it comes to teaching CT concepts to my K1s, I used Happy-Map step by step guide and next week I introduced the same CT conceptual understanding to find treasure map using Beebots. Students were able to apply the understanding learned through Happy-Map. T-4-R3.</p>
</disp-quote>
<p>T-4 appreciated the PDP-provided teaching resources (Happy-Map) and technologies (Beebots), using them in her school lessons to help her students learn CT concepts.</p>
<p>T-2-I added:</p>
<disp-quote>
<p>The supplied and developed educational material during collaborative planning will help me use the websites etc. to develop my skills further after this training programme.</p>
</disp-quote>
<p>T-2 reported that the PDP educational material was not only immediately useful but also valuable for her continuing education after completing the PDP.</p>
<p>Like T-4, T-17 and T-24 valued the opportunities to apply their new CT knowledge and teaching skills directly to student lessons to help them learn.</p>
<disp-quote>
<p>This is not only to enhance their logical thinking but also to give them opportunities to develop higher-order thinking skills through CT. For example, when I asked one of my K3 students using Cubetto, what to do when we finish our command buttons. The student replied start using numbers for the commands that need to repeat so that we can reach treasure without losing command buttons. It was exactly the &#x201C;loop&#x201D; conceptual understanding of CT. T-17-I.</p>
</disp-quote>
<p>T-17 appreciated how her students developed higher-order thinking skills <italic>via</italic> CT activities with Cubetto, as illustrated <italic>via</italic> her students&#x2019; loop <italic>understanding</italic> and <italic>application</italic>.</p>
<p>T-24 highlighted the importance of such opportunities between workshops.</p>
<disp-quote>
<p>I have learned more and clarified my concepts as I get a chance to use the learned new knowledge through workshops in practice for a couple of weeks after workshops. This has given me a chance to reflect on practice and ask for clarification to consolidate my understanding before the next workshop. T-24-R6.</p>
</disp-quote>
<p>The long spacing between workshops offered these teachers the opportunities to apply their CT teaching to their students, reflect on the results, ask for help and consolidate their understanding before additional learning in the next workshop.</p>
</sec>
<sec id="S5.SS2.SSS5">
<title>Need for Further Support</title>
<p>Still, these teachers highlighted the need for additional support, including time, management, resources, networking across schools, and parent understanding. T-9 highlighted the importance of time.</p>
<disp-quote>
<p>Time for planning and execution is the most crucial aspect as we lack experience and understanding required to execute CT. After implementation of CT integrated activities in short summer camp will help us to enhance our practice. T-9-R5.</p>
</disp-quote>
<p>T-9 appreciated the valuable time used for planning and implementing lessons during summer camp, especially as novices.</p>
<p>T-16 noted the importance of management and resources.</p>
<disp-quote>
<p>It is necessary to have management onboard to provide us budgetary solutions as our school lacks robots and digital devices to develop plugged CT. T-16-R6.</p>
</disp-quote>
<p>As T-16 notes, supportive managers can provide budget funding to buy needed CT resources such as robots and digital devices.</p>
<p>Also, T-2 argues for the importance of networking.</p>
<disp-quote>
<p>Networking support with other kindergartens integrating CT in practice will be an additional way for continues development of CT enhanced curriculum. T-2-I.</p>
</disp-quote>
<p>Specifically, T-2 noted that networking with other schools teaching CT can support their continuing CT development, especially of their curricula.</p>
<p>Outside school, T-23 pointed out the importance of parents.</p>
<disp-quote>
<p>Development of parental understanding alongside with teacher development is equally important. We will be bringing parents onboard for CT enhanced practices. T-23-I.</p>
</disp-quote>
<p>T-23 highlighted the value of parental support, and will engage them to back their CT teaching.</p>
</sec>
</sec>
</sec>
<sec id="S6" sec-type="discussion">
<title>Discussion</title>
<p>This exploratory study examined the effects of a curriculum-based professional learning (CBPL) professional development program on 25 in-service teachers&#x2019; views of computational thinking (CT). After the workshops, their CT understanding, CT beliefs, CT attitudes, and CT self-efficacies improved both significantly and substantially. Among these teachers, those who reported a stronger school culture of sharing and teamwork, or sufficient school resources for CT activities showed greater CT self-efficacies. Teachers reporting greater CT knowledge had greater CT self-efficacies.</p>
<sec id="S6.SS1">
<title>Pre- vs. Post-workshop Differences</title>
<p>The result suggest that these workshops changed not only these teachers&#x2019; CT knowledge and CT attitudes but also their CT beliefs and CT teaching self-efficacies.</p>
<sec id="S6.SS1.SSS1">
<title>CT Knowledge</title>
<p>After completing the workshops, these teachers were far more likely to define CT as including an algorithmic solution of a problem, analytic ability, solving problems as a computer scientist, logical problem solving, or general problem-solving. So, after the workshops, these teachers were much more likely to believe that they knew (a) what CT is, (b) steps for teaching CT effectively, (c) CT well enough to teach it to young children, and (d) unplugged CT well enough to teach it. These large differences support those of past studies showing that PDPs can help teachers learn about CT (e.g., <xref ref-type="bibr" rid="B34">Ketelhut et al., 2020</xref>; <xref ref-type="bibr" rid="B47">Rich et al., 2021b</xref>). Unlike past studies of shorter PDP, this study showed that after this longer PDP, these teachers were more likely than before to view themselves as having enough knowledge of CT and CT pedagogy to teach to young children. Together, these studies indicate that PDPs can effectively help teachers learn CT knowledge and pedagogy, suggesting that educators can use effective PDPs for in-service teachers&#x2019; training regarding CT knowledge.</p>
</sec>
<sec id="S6.SS1.SSS2">
<title>CT Attitudes</title>
<p>After these workshops, these teachers reported better attitudes toward teaching than before, especially regarding CT teaching. Specifically, they reported greater interest in CT teaching, a desire to continually find better ways to teach CT, and a desire to attend training about teaching practices. These results cohere with those of past studies showing that PDPs can improve teachers&#x2019; attitudes toward CT teaching (e.g., <xref ref-type="bibr" rid="B16">Bower et al., 2017</xref>; <xref ref-type="bibr" rid="B29">Hestness et al., 2018</xref>; <xref ref-type="bibr" rid="B47">Rich et al., 2021b</xref>). Together, these results suggest that educators can use effective PDPs to improve teacher attitudes toward CT teaching.</p>
</sec>
<sec id="S6.SS1.SSS3">
<title>CT Beliefs</title>
<p>After completing these workshops, these teachers were more likely to have beliefs supporting CT teaching than before. Specifically, they were more likely to believe that (a) all students should learn CT and (b) effective teaching helps students learn CT. Unlike past studies of shorter PDPs that failed to change teachers&#x2019; CT beliefs (<xref ref-type="bibr" rid="B47">Rich et al., 2021b</xref>), this study showed that after this longer PDP, these teachers espoused supportive beliefs of CT teaching. If future studies replicate this result, they would suggest that educators can use effective PDPs to foster supportive teacher beliefs toward CT teaching.</p>
</sec>
<sec id="S6.SS1.SSS4">
<title>CT Teaching Self-Efficacies</title>
<p>After these workshops, these teachers reported greater CT teaching self-efficacies than before. Specifically, they reported greater overall CT teaching self-efficacy, plugged CT teaching self-efficacy, and unplugged CT teaching self-efficacy than before., this study showed that after this longer PDP, teachers reported greater CT teaching self-efficacies. If future studies support this result, they would suggest that educators can use effective PDPs to increase teachers&#x2019; CT teaching self-efficacies.</p>
</sec>
</sec>
<sec id="S6.SS2">
<title>Explanatory Model of CT Teaching Self-Efficacies</title>
<p>School, workshop completion and teacher&#x2019;s CT knowledge were all linked to CT teaching self-efficacies. In the school with a greater sharing and teamwork culture or sufficient resources to support CT teaching, teachers reported greater overall and plugged CT teaching self-efficacies. These results suggest the importance of school culture and resources for supporting CT teaching. Also, workshop completion was linked to greater unplugged CT teaching self-efficacy. Unlike past studies of shorter PDPs (<xref ref-type="bibr" rid="B47">Rich et al., 2021b</xref>), this longer PDP increased teachers&#x2019; unplugged CT self-efficacy. Lastly, teachers who reported greater CT knowledge reported greater overall, plugged, and unplugged CT teaching self-efficacies, cohering with past studies regarding the importance of teacher CT knowledge for CT teaching self-efficacy (<xref ref-type="bibr" rid="B47">Rich et al., 2021b</xref>).</p>
<sec id="S6.SS2.SSS1">
<title>Insight Into Future PDP Design Choices</title>
<p>These teachers shared several insights regarding effective PDP and further needs. As many of them knew little CT, they appreciated the importance of concrete activities, educational resources, collaboration, teaching CT with unplugged activities, and enough time between workshops to apply CT. First, the concrete activities, educational resources, and collaboration helped these teachers learn an alien topic, CT. The collaborative planning helped them develop and apply CT teaching activities to their own students, especially the transitional instruction of teaching CT with unplugged activities to their students before doing so with plugged activities. Suitable spacing between workshops also enabled these teachers to apply their CT, ask for help and consolidate before the next workshop. Hence, future PDPs can consider including concrete activities, educational resources, collaboration, transitional instruction, and suitable spacing between workshops.</p>
<p>These teachers highlighted the need for additional support regarding time, management, resources, networking, and parents. Sufficient time allowed teachers to collaboratively learn, plan, implement and assess their newly learned CT. Furthermore, management support can provide them with such time and needed resources (technology, staff) to teach CT well. Beyond their school walls, networking with other schools teaching CT (, with researchers) and with parents can build broad community support and understanding of CT and CT instruction.</p>
</sec>
</sec>
</sec>
<sec id="S7">
<title>Limitations and Future Research</title>
<p>Our study is limited by its small, unrepresentative, convenience sample of Hong Kong ECE teachers and its absence of a control group. The small sample limits our statistical power to detect smaller effect sizes. Furthermore, this study only included 2 schools, so we need studies with many more schools to determine whether these school differences are idiosyncratic or occur more broadly. Also, our unrepresentative sample of only ECE teachers in Hong Kong limits the potential of this study to generalize to the broader population of ECE teachers. Hence, future studies can include larger, representative samples of ECE teachers in more schools in more countries. Also, this study lacked a control group, which limits causal claims, so future studies can employ <italic>randomized, controlled trials</italic> to support stronger causal claims.</p>
</sec>
<sec id="S8" sec-type="conclusion">
<title>Conclusion</title>
<p>This exploratory study showed that a curriculum-based professional learning professional development program changed these in-service teachers&#x2019; views of computational thinking (CT). After the workshops, their CT understanding changed significantly. After completing the workshops, these teachers were more likely than before to define CT as including the algorithmic solution of a problem, analytic ability, solving problems as a computer scientist, logical problem solving, or general problem-solving. After these workshops, these teachers were more likely than before to believe that they knew (a) what CT is, (b) steps for teaching CT effectively, (c) CT well enough to teach it to young children, and (d) unplugged CT well enough to teach it.</p>
<p>These workshops also changed their CT beliefs, CT attitudes, and CT self-efficacies. After these workshops, these teachers reported better attitudes toward teaching than before: greater interest in CT teaching, greater desire to continually find better ways to teach CT, and greater desire to attend training about teaching practices. Compared to before these workshops, these teachers were more likely than before to have beliefs supporting CT teaching: (a) all students should learn CT and (b) effective teaching helps students learn CT. After these workshops, these teachers reported greater overall, plugged, and unplugged CT teaching self-efficacies.</p>
<p>School, workshop completion and teacher&#x2019;s CT knowledge were all linked to CT teaching self-efficacies. In the school with a greater sharing and teamwork culture or sufficient resources to support CT teaching, teachers reported greater overall and plugged CT teaching self-efficacies. Also, teachers who reported greater CT knowledge reported greater overall, plugged, and unplugged CT teaching self-efficacies.</p>
</sec>
<sec id="S9" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.</p>
</sec>
<sec id="S10">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by The Education University of Hong Kong. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="S11">
<title>Author Contributions</title>
<p>AS contributed to the conception and design of the study and wrote the first draft of the manuscript. MC performed the statistical analysis. Both authors organized the database, wrote sections of the manuscript, and contributed to the manuscript revision, read, and approved the submitted version.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="pudiscl1" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<app-group>
<app id="A1">
<title>Appendix A: Ancillary Results</title>
<table-wrap position="float" id="T6">
<label>APPENDIX TABLE A1</label>
<caption><p>Correlations, variances, and covariances of outcomes and significant explanatory variables in the lower left, diagonal and upper right matrices.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Variable</td>
<td valign="top" align="center">1</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">3</td>
<td valign="top" align="center">4</td>
<td valign="top" align="center">5</td>
<td valign="top" align="center">6</td>
<td valign="top" align="center">7</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. Overall computational thinking (CT) self-efficacy</td>
<td valign="top" align="center"><bold>2.91</bold></td>
<td valign="top" align="center">2.42</td>
<td valign="top" align="center">2.57</td>
<td valign="top" align="center">1.76</td>
<td valign="top" align="center">2.53</td>
<td valign="top" align="center">0.53</td>
<td valign="top" align="center">2.62</td>
</tr>
<tr>
<td valign="top" align="left">2. Plugged CT self-efficacy</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center"><bold>2.55</bold></td>
<td valign="top" align="center">2.55</td>
<td valign="top" align="center">1.56</td>
<td valign="top" align="center">2.22</td>
<td valign="top" align="center">0.49</td>
<td valign="top" align="center">2.19</td>
</tr>
<tr>
<td valign="top" align="left">3. Unplugged CT self-efficacy</td>
<td valign="top" align="center">0.88</td>
<td valign="top" align="center">0.94</td>
<td valign="top" align="center"><bold>2.90</bold></td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">2.47</td>
<td valign="top" align="center">0.61</td>
<td valign="top" align="center">2.56</td>
</tr>
<tr>
<td valign="top" align="left">4. School culture of sharing and teamwork</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">0.75</td>
<td valign="top" align="center">0.68</td>
<td valign="top" align="center"><bold>1.67</bold></td>
<td valign="top" align="center">1.46</td>
<td valign="top" align="center">0.39</td>
<td valign="top" align="center">1.52</td>
</tr>
<tr>
<td valign="top" align="left">5. School has sufficient resources to support teaching CT</td>
<td valign="top" align="center">0.86</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">0.83</td>
<td valign="top" align="center">0.65</td>
<td valign="top" align="center"><bold>3.02</bold></td>
<td valign="top" align="center">0.53</td>
<td valign="top" align="center">2.72</td>
</tr>
<tr>
<td valign="top" align="left">6. After workshops</td>
<td valign="top" align="center">0.63</td>
<td valign="top" align="center">0.61</td>
<td valign="top" align="center">0.72</td>
<td valign="top" align="center">0.60</td>
<td valign="top" align="center">0.62</td>
<td valign="top" align="center"><bold>0.25</bold></td>
<td valign="top" align="center">0.55</td>
</tr>
<tr>
<td valign="top" align="left">7. Know computational thinking</td>
<td valign="top" align="center">0.87</td>
<td valign="top" align="center">0.78</td>
<td valign="top" align="center">0.85</td>
<td valign="top" align="center">0.66</td>
<td valign="top" align="center">0.89</td>
<td valign="top" align="center">0.63</td>
<td valign="top" align="center"><bold>3.11</bold></td>
</tr>
</tbody>
</table>
</table-wrap>
</app>
</app-group>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Akinyemi</surname> <given-names>A. F.</given-names></name> <name><surname>Nkonki</surname> <given-names>V.</given-names></name></person-group> (<year>2020</year>). <article-title>Partnership in communities of practice towards teachers&#x2019; professional development.</article-title> <source><italic>Acad. J. Interdiscip. Stud.</italic></source> <volume>9</volume> <fpage>34</fpage>&#x2013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.36941/ajis-2020-0109</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Angeli</surname> <given-names>C.</given-names></name> <name><surname>Voogt</surname> <given-names>J.</given-names></name> <name><surname>Fluck</surname> <given-names>A.</given-names></name> <name><surname>Webb</surname> <given-names>M.</given-names></name> <name><surname>Cox</surname> <given-names>M.</given-names></name> <name><surname>Malyn-Smith</surname> <given-names>J.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>A K-6 computational thinking curriculum framework: implications for teacher knowledge.</article-title> <source><italic>J. Educ. Technol. Soc.</italic></source> <volume>19</volume> <fpage>47</fpage>&#x2013;<lpage>57</lpage>.</citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Avalos</surname> <given-names>B.</given-names></name></person-group> (<year>2011</year>). <article-title>Teacher professional development in teaching and teacher education over ten years.</article-title> <source><italic>Teach. Teach. Educ.</italic></source> <volume>27</volume> <fpage>10</fpage>&#x2013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1016/j.tate.2010.08.007</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bairaktarova</surname> <given-names>D.</given-names></name> <name><surname>Evangelou</surname> <given-names>D.</given-names></name> <name><surname>Bagiati</surname> <given-names>A.</given-names></name> <name><surname>Dobbs-Oates</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). &#x201C;<article-title>The role of classroom artifacts in developmental engineering</article-title>,&#x201D; in <source><italic>Proceedings of 2012 ASEE Annual Conference &#x0026; Exposition</italic></source>, (<publisher-loc>San Antonio, TX</publisher-loc>), <fpage>25</fpage>&#x2013;<lpage>1338</lpage>.</citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>1977</year>). <article-title>Self-efficacy: toward a unifying theory of behavioural change.</article-title> <source><italic>Psychol. Rev.</italic></source> <volume>84</volume>:<fpage>191</fpage>. <pub-id pub-id-type="doi">10.1037//0033-295x.84.2.191</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandura</surname> <given-names>A.</given-names></name></person-group> (<year>2000</year>). <article-title>Exercise of human agency through collective efficacy.</article-title> <source><italic>Curr. Dir. Psychol. Sci.</italic></source> <volume>9</volume> <fpage>75</fpage>&#x2013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.1111/1467-8721.00064</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barr</surname> <given-names>V.</given-names></name> <name><surname>Stephenson</surname> <given-names>C.</given-names></name></person-group> (<year>2011</year>). <article-title>Bringing computational thinking to K-12: what is involved and what is the role of the computer science education community?</article-title> <source><italic>ACM Inroads</italic></source> <volume>2</volume> <fpage>48</fpage>&#x2013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1145/1929887.1929905</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bayar</surname> <given-names>A.</given-names></name></person-group> (<year>2014</year>). <article-title>The components of effective professional development activities in terms of teachers&#x2019; perspective.</article-title> <source><italic>Online Submission</italic></source> <volume>6</volume> <fpage>319</fpage>&#x2013;<lpage>327</lpage>. Google Scholar,</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bell</surname> <given-names>T.</given-names></name></person-group> (<year>2021</year>). <article-title>CS unplugged or coding classes?</article-title> <source><italic>Commun. ACM</italic></source> <volume>64</volume> <fpage>25</fpage>&#x2013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1145/3457195</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bell</surname> <given-names>T.</given-names></name> <name><surname>Vahrenhold</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>CS unplugged&#x2014;how is it used, and does it work?</article-title>,&#x201D; in <source><italic>Adventures between Lower Bounds and Higher Altitudes</italic></source>, (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>497</fpage>&#x2013;<lpage>521</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-98355-4_29</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bell</surname> <given-names>T.</given-names></name> <name><surname>Witten</surname> <given-names>I. H.</given-names></name> <name><surname>Fellows</surname> <given-names>M.</given-names></name></person-group> (<year>1998</year>). <source><italic>Computer Science Unplugged: Off-line Activities and Games for All Ages.</italic></source> <publisher-name>Computer Science Unplugged.</publisher-name> Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.csunplugged.org/en/">https://www.csunplugged.org/en/</ext-link></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Benjamini</surname> <given-names>Y.</given-names></name> <name><surname>Krieger</surname> <given-names>A. M.</given-names></name> <name><surname>Yekutieli</surname> <given-names>D.</given-names></name></person-group> (<year>2006</year>). <article-title>Adaptive linear step-up procedures that control the false discovery rate.</article-title> <source><italic>Biometrika</italic></source> <volume>93</volume> <fpage>491</fpage>&#x2013;<lpage>507</lpage>. <pub-id pub-id-type="doi">10.1093/biomet/93.3.491</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bers</surname> <given-names>M. U.</given-names></name> <name><surname>Flannery</surname> <given-names>L.</given-names></name> <name><surname>Kazakoff</surname> <given-names>E. R.</given-names></name> <name><surname>Sullivan</surname> <given-names>A.</given-names></name></person-group> (<year>2014</year>). <article-title>Computational thinking and tinkering: exploration of an early childhood robotics curriculum.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>72</volume> <fpage>145</fpage>&#x2013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2013.10.020</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bertsekas</surname> <given-names>D. P.</given-names></name></person-group> (<year>2014</year>). <source><italic>Constrained Optimization and Lagrange Multiplier Methods.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Academic</publisher-name>.</citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bertrand</surname> <given-names>M.</given-names></name> <name><surname>Duflo</surname> <given-names>E.</given-names></name> <name><surname>Mullainathan</surname> <given-names>S.</given-names></name></person-group> (<year>2004</year>). <article-title>How much should we trust differences-in- differences estimates?</article-title> <source><italic>Quart. J. Econ.</italic></source> <volume>119</volume> <fpage>249</fpage>&#x2013;<lpage>275</lpage>. <pub-id pub-id-type="doi">10.1162/003355304772839588</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bower</surname> <given-names>M.</given-names></name> <name><surname>Wood</surname> <given-names>L. N.</given-names></name> <name><surname>Lai</surname> <given-names>J. W.</given-names></name> <name><surname>Highfield</surname> <given-names>K.</given-names></name> <name><surname>Veal</surname> <given-names>J.</given-names></name> <name><surname>Howe</surname> <given-names>C.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Improving the computational thinking pedagogical capabilities of school teachers.</article-title> <source><italic>Aust. J. Teach. Educ.</italic></source> <volume>42</volume> <fpage>53</fpage>&#x2013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.14221/ajte.2017v42n3.4</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Braun</surname> <given-names>V.</given-names></name> <name><surname>Clarke</surname> <given-names>V.</given-names></name></person-group> (<year>2006</year>). <article-title>Using thematic analysis in psychology.</article-title> <source><italic>Qual. Res. Psychol.</italic></source> <volume>3</volume> <fpage>77</fpage>&#x2013;<lpage>101</lpage>. <pub-id pub-id-type="doi">10.1191/1478088706qp063oa</pub-id> <pub-id pub-id-type="pmid">32100154</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brennan</surname> <given-names>K.</given-names></name> <name><surname>Resnick</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). &#x201C;<article-title>New frameworks for studying and assessing the development of computational thinking</article-title>,&#x201D; in <source><italic>Proceedings of the 2012 Annual Meeting of the American Educational Research Association</italic></source>, <volume>Vol. 1</volume> (<publisher-loc>Vancouver, BC</publisher-loc>), <fpage>25</fpage> <publisher-name>Google Scholar.</publisher-name></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bull</surname> <given-names>G.</given-names></name> <name><surname>Garofalo</surname> <given-names>J.</given-names></name> <name><surname>Hguyen</surname> <given-names>N. R.</given-names></name></person-group> (<year>2020</year>). <article-title>Thinking about computational thinking: origins of computational thinking in educational computing</article-title>. <source><italic>J. Digit. Learn. Teach. Educ.</italic></source> <volume>36</volume>, <fpage>6</fpage>&#x2013;<lpage>18</lpage>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Corradini</surname> <given-names>I.</given-names></name> <name><surname>Lodi</surname> <given-names>M.</given-names></name> <name><surname>Nardelli</surname> <given-names>E.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>An investigation of italian primary school teachers&#x2019; views on coding and programming</article-title>,&#x201D; in <source><italic>In Proceeedings of International Conference on Informatics in Schools: Situation, Evolution, and Perspectives</italic></source>, (<publisher-loc>Petersburg</publisher-loc>), <fpage>228</fpage>&#x2013;<lpage>243</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-02750-6_18</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Creswell</surname> <given-names>J. W.</given-names></name></person-group> (<year>2012</year>). <source><italic>Educational Research: Planning, Conducting and Evaluating Quiantitative and Qualitative Research</italic></source>, <edition>4th Editio Edn</edition>. <publisher-loc>London</publisher-loc>: <publisher-name>Pearson</publisher-name>.</citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Csizmadia</surname> <given-names>A.</given-names></name> <name><surname>Standl</surname> <given-names>B.</given-names></name> <name><surname>Waite</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>Integrating the constructionist learning theory with computational thinking classroom activities.</article-title> <source><italic>Inform. Educ.</italic></source> <volume>18</volume> <fpage>41</fpage>&#x2013;<lpage>67</lpage>. <pub-id pub-id-type="doi">10.15388/infedu.2019.03</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Darling-Hammond</surname> <given-names>L.</given-names></name> <name><surname>Richardson</surname> <given-names>N.</given-names></name></person-group> (<year>2009</year>). <article-title>Research review/teacher learning: what matters.</article-title> <source><italic>Educ. Leadersh.</italic></source> <volume>66</volume> <fpage>46</fpage>&#x2013;<lpage>53</lpage>. Google Scholar,</citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dori</surname> <given-names>Y. J.</given-names></name> <name><surname>Herscovitz</surname> <given-names>O.</given-names></name></person-group> (<year>2005</year>). <article-title>Case-based long-term professional development of science teachers.</article-title> <source><italic>Int. J. Sci. Educ.</italic></source> <volume>27</volume> <fpage>1413</fpage>&#x2013;<lpage>1446</lpage>. <pub-id pub-id-type="doi">10.1080/09500690500102946</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fields</surname> <given-names>D. A.</given-names></name> <name><surname>Lui</surname> <given-names>D.</given-names></name> <name><surname>Kafai</surname> <given-names>Y. B.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Teaching computational thinking with electronic textiles: modeling iterative practices and supporting personal projects in exploring computer science</article-title>,&#x201D; in <source><italic>Computational Thinking Education</italic></source>, (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>279</fpage>&#x2013;<lpage>294</lpage>. <pub-id pub-id-type="doi">10.1007/978-981-13-6528-7</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fraenkel</surname> <given-names>J. R.</given-names></name> <name><surname>Wallen</surname> <given-names>N. E.</given-names></name> <name><surname>Hyun</surname> <given-names>H. H.</given-names></name></person-group> (<year>2015</year>). &#x201C;<article-title>The nature of research</article-title>,&#x201D; in <source><italic>How to Design and Evaluate Research in Education</italic></source>, (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>McGraw-Hill Education</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>26</lpage>.</citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goldstein</surname> <given-names>H.</given-names></name></person-group> (<year>2011</year>). <source><italic>Multilevel Statistical Models.</italic></source> <publisher-loc>Sydney</publisher-loc>: <publisher-name>Edward Arnold</publisher-name>.</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gretter</surname> <given-names>S.</given-names></name> <name><surname>Yadav</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). <article-title>Computational thinking and media &#x0026; information literacy: an integrated approach to teaching twenty-first-century skills.</article-title> <source><italic>TechTrends</italic></source> <volume>60</volume> <fpage>510</fpage>&#x2013;<lpage>516</lpage>. <pub-id pub-id-type="doi">10.1007/s11528-016-0098-4</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hestness</surname> <given-names>E.</given-names></name> <name><surname>Ketelhut</surname> <given-names>D. J.</given-names></name> <name><surname>McGinnis</surname> <given-names>J. R.</given-names></name> <name><surname>Plane</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>Professional knowledge building within an elementary teacher professional development experience on computational thinking in science education.</article-title> <source><italic>J. Technol. Teach. Educ.</italic></source> <volume>26</volume> <fpage>411</fpage>&#x2013;<lpage>435</lpage>. <pub-id pub-id-type="doi">10.1186/s12913-016-1423-5</pub-id> <pub-id pub-id-type="pmid">27409075</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hox</surname> <given-names>J. J.</given-names></name> <name><surname>Moerbeek</surname> <given-names>M.</given-names></name> <name><surname>Van de Schoot</surname> <given-names>R.</given-names></name></person-group> (<year>2017</year>). <source><italic>Multilevel Analysis: Techniques and applications.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>W.</given-names></name> <name><surname>Looi</surname> <given-names>C. K.</given-names></name></person-group> (<year>2021</year>). <article-title>A critical review of literature on &#x201C;unplugged&#x201D; pedagogies in K-12 computer science and computational thinking education.</article-title> <source><italic>Comput. Sci. Educ.</italic></source> <volume>31</volume> <fpage>83</fpage>&#x2013;<lpage>111</lpage>. <pub-id pub-id-type="doi">10.1080/08993408.2020.1789411</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kemp</surname> <given-names>J. E.</given-names></name></person-group> (<year>1985</year>). <source><italic>The Instructional Design Process.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Harpercollins College Division</publisher-name>.</citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kennedy</surname> <given-names>P.</given-names></name></person-group> (<year>2008</year>). <source><italic>Guide to Econometrics.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Wiley-Blackwell</publisher-name>.</citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ketelhut</surname> <given-names>D. J.</given-names></name> <name><surname>Mills</surname> <given-names>K.</given-names></name> <name><surname>Hestness</surname> <given-names>E.</given-names></name> <name><surname>Cabrera</surname> <given-names>L.</given-names></name> <name><surname>Plane</surname> <given-names>J.</given-names></name> <name><surname>McGinnis</surname> <given-names>J. R.</given-names></name></person-group> (<year>2020</year>). <article-title>Teacherthinking into elementary science.</article-title> <source><italic>J. Sci.Educ. Technol.</italic></source> <volume>29</volume> <fpage>174</fpage>&#x2013;<lpage>188</lpage>. <pub-id pub-id-type="doi">10.1007/s10956-019-09798-4</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kermani</surname> <given-names>H.</given-names></name> <name><surname>Aldemir</surname> <given-names>J.</given-names></name></person-group> (<year>2015</year>). <article-title>Preparing children for success: integrating science, math, and technology in early childhood classroom.</article-title> <source><italic>Early Child. Dev. Care</italic></source> <volume>185</volume> <fpage>1504</fpage>&#x2013;<lpage>1527</lpage>. <pub-id pub-id-type="doi">10.1080/03004430.2015.1007371</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Konstantopoulos</surname> <given-names>S.</given-names></name></person-group> (<year>2008</year>). <article-title>The power of the test in three-level cluster-randomized designs.</article-title> <source><italic>J. Res. Educ. Eff.</italic></source> <volume>1</volume> <fpage>66</fpage>&#x2013;<lpage>88</lpage>. <pub-id pub-id-type="doi">10.1080/19345740701692522</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kotsopoulos</surname> <given-names>D.</given-names></name> <name><surname>Floyd</surname> <given-names>L.</given-names></name> <name><surname>Dickson</surname> <given-names>B. A.</given-names></name> <name><surname>Nelson</surname> <given-names>V.</given-names></name> <name><surname>Makosz</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). <article-title>Noticing and naming computational thinking during play.</article-title> <source><italic>Early Child. Educ. J.</italic></source> <volume>50</volume> <fpage>1</fpage>&#x2013;<lpage>10</lpage>.</citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lassonde</surname> <given-names>C. A.</given-names></name> <name><surname>Israel</surname> <given-names>S. E.</given-names></name></person-group> (<year>2009</year>). <source><italic>Teacher Collaboration for Professional Learning: Facilitating Study, Research, and Inquiry Communities.</italic></source> <publisher-loc>New Jersey, NJ</publisher-loc>: <publisher-name>John Wiley &#x0026; Sons</publisher-name>, <pub-id pub-id-type="doi">10.1002/9781118269442</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>V. R.</given-names></name> <name><surname>Recker</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Paper circuits: a tangible, low threshold, low-cost entry to computational thinking.</article-title> <source><italic>TechTrends</italic></source> <volume>62</volume> <fpage>197</fpage>&#x2013;<lpage>203</lpage>. <pub-id pub-id-type="doi">10.1007/s11528-017-0248-3</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>Y.</given-names></name> <name><surname>Schoenfeld</surname> <given-names>A. H.</given-names></name> <name><surname>Graesser</surname> <given-names>A. C.</given-names></name> <name><surname>Benson</surname> <given-names>L. C.</given-names></name> <name><surname>English</surname> <given-names>L. D.</given-names></name> <name><surname>Duschl</surname> <given-names>R. A.</given-names></name></person-group> (<year>2020</year>). <article-title>On computational thinking and STEM education.</article-title> <source><italic>J. STEM Educ. Res.</italic></source> <volume>3</volume> <fpage>147</fpage>&#x2013;<lpage>166</lpage>. <pub-id pub-id-type="doi">10.1007/s41979-020-00044-w</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacKinnon</surname> <given-names>D. P.</given-names></name> <name><surname>Lockwood</surname> <given-names>C. M.</given-names></name> <name><surname>Williams</surname> <given-names>J.</given-names></name></person-group> (<year>2004</year>). <article-title>Confidence limits for the indirect effect: distribution of the product and resampling methods.</article-title> <source><italic>Multivariate Behav. Res.</italic></source> <volume>39</volume> <fpage>99</fpage>&#x2013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1207/s15327906mbr3901_4</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Melasalmi</surname> <given-names>A.</given-names></name> <name><surname>Husu</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>The content and implementation of shared professional knowledge in early childhood education.</article-title> <source><italic>Early Years</italic></source> <volume>36</volume> <fpage>426</fpage>&#x2013;<lpage>439</lpage>.</citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Merrill</surname> <given-names>M. D.</given-names></name></person-group> (<year>2002</year>). <article-title>First principles of instruction.</article-title> <source><italic>Educ. Tech. Res. Dev.</italic></source> <volume>50</volume> <fpage>43</fpage>&#x2013;<lpage>59</lpage>.</citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mishra</surname> <given-names>P.</given-names></name> <name><surname>Koehler</surname> <given-names>M. J.</given-names></name></person-group> (<year>2006</year>). <article-title>Technological pedagogical content knowledge: a framework for teacher knowledge.</article-title> <source><italic>Teach. Coll. Rec.</italic></source> <volume>108</volume> <fpage>1017</fpage>&#x2013;<lpage>1054</lpage>.</citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Palts</surname> <given-names>T.</given-names></name> <name><surname>Pedaste</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>A model for developing computational thinking skills.</article-title> <source><italic>Inf. Educ.</italic></source> <volume>19</volume> <fpage>113</fpage>&#x2013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.15388/infedu.2020.06</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rich</surname> <given-names>P. J.</given-names></name> <name><surname>Larsen</surname> <given-names>R. A.</given-names></name> <name><surname>Mason</surname> <given-names>S. L.</given-names></name></person-group> (<year>2021a</year>). <article-title>Measuring teacher beliefs about coding and computational thinking.</article-title> <source><italic>J. Res.Technol. Educ.</italic></source> <volume>53</volume> <fpage>296</fpage>&#x2013;<lpage>316</lpage>.</citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rich</surname> <given-names>P. J.</given-names></name> <name><surname>Mason</surname> <given-names>S. L.</given-names></name> <name><surname>O&#x2019;Leary</surname> <given-names>J.</given-names></name></person-group> (<year>2021b</year>). <article-title>Measuring the effect of continuous professional development on elementary teachers&#x2019; self-efficacy to teach coding and computational thinking.</article-title> <source><italic>Comput. Educ.</italic></source> <volume>168</volume>:<fpage>104196</fpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2021.104196</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sands</surname> <given-names>P.</given-names></name> <name><surname>Yadav</surname> <given-names>A.</given-names></name> <name><surname>Good</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>Computational thinking in K-12</article-title>,&#x201D; in <source><italic>Service Teacher Perceptions Of Computational Thinking. In Computational Thinking in the STEM Disciplines</italic></source>, <role>ed.</role> <person-group person-group-type="editor"><name><surname>Khine</surname> <given-names>M. S.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>151</fpage>&#x2013;<lpage>164</lpage>. <publisher-name>Google Scholar.</publisher-name> <pub-id pub-id-type="doi">10.1007/978-3-319-93566-9_8</pub-id></citation></ref>
<ref id="B49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seow</surname> <given-names>P.</given-names></name> <name><surname>Looi</surname> <given-names>C.</given-names></name> <name><surname>How</surname> <given-names>M.</given-names></name> <name><surname>Wadhwa</surname> <given-names>B.</given-names></name> <name><surname>Wu</surname> <given-names>L.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Educational policy and implementation of computational thinking and programming: case study of Singapore</article-title>,&#x201D; in <source><italic>Computational Thinking Education</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Kong</surname> <given-names>S. C.</given-names></name> <name><surname>Abelson</surname> <given-names>H.</given-names></name></person-group> (<publisher-loc>Singapore</publisher-loc>: <publisher-name>Springer Open</publisher-name>), <fpage>345</fpage>&#x2013;<lpage>362</lpage>.</citation></ref>
<ref id="B50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Short</surname> <given-names>J.</given-names></name> <name><surname>Hirsh</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <source><italic>The Elements: Transforming Teaching through Curriculum-Based Professional Learning.</italic></source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Carnegie Corporation of New York</publisher-name>. Web Copy.</citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Villegas-Reimers</surname> <given-names>E.</given-names></name></person-group> (<year>2003</year>). <source><italic>Teacher Professional Development: An International Review of the Literature.</italic></source> <publisher-loc>Paris</publisher-loc>: <publisher-name>International Institute for Educational Planning</publisher-name>. Google Scholar.</citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wong</surname> <given-names>J. L.</given-names></name> <name><surname>Tsui</surname> <given-names>A. B.</given-names></name></person-group> (<year>2007</year>). <article-title>How do teachers view the effects of school-based in-service learning activities? a case study in China.</article-title> <source><italic>J. Educ. Teach.</italic></source> <volume>33</volume> <fpage>457</fpage>&#x2013;<lpage>470</lpage>. <pub-id pub-id-type="doi">10.1080/02607470701603290</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yadav</surname> <given-names>A.</given-names></name> <name><surname>Gretter</surname> <given-names>S.</given-names></name> <name><surname>Good</surname> <given-names>J.</given-names></name> <name><surname>McLean</surname> <given-names>T.</given-names></name></person-group> (<year>2017</year>). &#x201C;<article-title>Computational thinking in teacher education</article-title>,&#x201D; in <source><italic>Emerging Research, Practice, and Policy on Computational Thinking</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Rich</surname> <given-names>P. J.</given-names></name> <name><surname>Hodges</surname> <given-names>C. B.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>205</fpage>&#x2013;<lpage>220</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-52691-1_13</pub-id></citation></ref>
</ref-list>
</back>
</article>