<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Robot. AI</journal-id>
<journal-title>Frontiers in Robotics and AI</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Robot. AI</abbrev-journal-title>
<issn pub-type="epub">2296-9144</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">673730</article-id>
<article-id pub-id-type="doi">10.3389/frobt.2021.673730</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Robotics and AI</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Social Robots as Creativity Eliciting Agents</article-title>
<alt-title alt-title-type="left-running-head">Ali et&#x20;al.</alt-title>
<alt-title alt-title-type="right-running-head">Social Robots for Supporting Creativity</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Ali</surname>
<given-names>Safinah</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1070759/overview"/>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Devasia</surname>
<given-names>Nisha</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1290701/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Park</surname>
<given-names>Hae Won</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/304652/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Breazeal</surname>
<given-names>Cynthia</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/124661/overview"/>
</contrib>
</contrib-group>
<aff>MIT Media Lab, Massachusetts Institute of Technology, <addr-line>Cambridge</addr-line>, <addr-line>MA</addr-line>, <country>United&#x20;States</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/413637/overview">Patricia Alves-Oliveira</ext-link>, University of Washington, United&#x20;States</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/585921/overview">Kerstin Fischer</ext-link>, University of Southern Denmark, Denmark</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1116969/overview">Sangseok You</ext-link>, HEC Paris, France</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Safinah Ali, <email>safinah@media.mit.edu</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Human-Robot Interaction, a section of the journal Frontiers in Robotics and&#x20;AI</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>13</day>
<month>09</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>8</volume>
<elocation-id>673730</elocation-id>
<history>
<date date-type="received">
<day>28</day>
<month>02</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>11</day>
<month>08</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Ali, Devasia, Park and Breazeal.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Ali, Devasia, Park and Breazeal</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>Can robots help children be more creative? In this work, we posit social robots as <italic>creativity support tools</italic> for children in collaborative interactions. Children learn creative expressions and behaviors through social interactions with others during playful and collaborative tasks, and socially emulate their peers&#x2019; and teachers&#x2019; creativity. Social robots have a unique ability to engage in social and emotional interactions with children that can be leveraged to foster creative expression. We focus on two types of social interactions: <italic>creativity demonstration</italic>, where the robot exhibits creative behaviors, and <italic>creativity scaffolding</italic>, where the robot poses challenges, suggests ideas, provides positive reinforcement, and asks questions to scaffold children&#x2019;s creativity. We situate our research in three playful and collaborative tasks - the Droodle Creativity game (that affords verbal creativity), the MagicDraw game (that affords figural creativity), and the WeDo construction task (that affords constructional creativity), that children play with Jibo, a social robot. To evaluate the efficacy of the robot&#x2019;s social behaviors in enhancing creative behavior and expression in children, we ran three randomized controlled trials with 169 children in the 5&#x2013;10&#xa0;yr old age group. In the first two tasks, the robot exhibited creativity demonstration behaviors. We found that children who interacted with the robot exhibiting high verbal creativity in the Droodle game and high figural creativity in the MagicDraw game also exhibited significantly higher creativity than a control group of participants who interacted with a robot that did not express creativity (<italic>p</italic>&#x20;&#x3c; 0.05&#x2a;). In the WeDo construction task, children who interacted with the robot that expressed creative scaffolding behaviors (asking reflective questions, generating ideas and challenges, and providing positive reinforcement) demonstrated higher creativity than participants in the control group by expressing a greater number of ideas, more original ideas, and more varied use of available materials (<italic>p</italic>&#x20;&#x3c; 0.05&#x2a;). We found that both creativity demonstration and creativity scaffolding can be leveraged as social mechanisms for eliciting creativity in children using a social robot. From our findings, we suggest design guidelines for pedagogical tools and social agent interactions to better support children&#x2019;s creativity.</p>
</abstract>
<kwd-group>
<kwd>creativity</kwd>
<kwd>social robots</kwd>
<kwd>emulation</kwd>
<kwd>scaffolding</kwd>
<kwd>creativity support tools</kwd>
<kwd>child-robot interaction</kwd>
<kwd>collaboration</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>Children&#x2019;s creativity&#x2013;their ability to generate novel, surprising, and valuable ideas&#x2013;is known to contribute to their learning outcomes, personal growth, and well-being. Creativity facilitates children&#x2019;s problem solving, adaptability, self-expression and health (<xref ref-type="bibr" rid="B21">Carterette et&#x20;al., 1994</xref>). Even though the benefits of creativity are widely recognized, classrooms are not able to sufficiently support children&#x2019;s creative development. <xref ref-type="bibr" rid="B33">Gardner and Art, 1982</xref> posited that children start to show creative abilities as early as preschool, and <xref ref-type="bibr" rid="B87">Smith and Carlsson (1983)</xref> found that the level of developmental maturity necessary for creative expression occurs around 5&#x2013;6&#xa0;yr of age. However, as they enter elementary school, children&#x2019;s creativity slumps, especially around the fourth grade (<xref ref-type="bibr" rid="B99">Torrance, 1966</xref>, <xref ref-type="bibr" rid="B98">1968</xref>; <xref ref-type="bibr" rid="B96">Claxton, 2005</xref>). As school curricula become more structured, children lose the aspect of creative play that is a significant part of kindergarten. To be successful in our AI-powered world, where mechanical and repetitive jobs are becoming automated, we must empower children to generate new artifacts and solve complex problems, which will require imaginative and novel thought.</p>
<p>In classrooms, social interaction plays a key role in children&#x2019;s creative growth. Children learn creativity from teachers and peers who act as models for creative expression. They can scaffold children&#x2019;s creativity through social interactions such as collaborating, posing challenges, asking questions, providing positive reinforcement, and generating ideas. Participating in collaborative tasks is one of the most effective external influencers of creativity (<xref ref-type="bibr" rid="B51">Kafai et&#x20;al., 1995</xref>). In addition, classrooms today see increasing numbers of digital pedagogical tools and learning aids that have proven to be beneficial for cognitive learning due to their ability to personalize instruction for every student. Games and play-based learning approaches have been successful in fostering creative expression in children (<xref ref-type="bibr" rid="B44">Henriksen, 2006</xref>; <xref ref-type="bibr" rid="B20">Bowman et&#x20;al., 2015</xref>). However, most educational technologies do not have the ability to foster social interaction with students. Exceptions include socially interactive AI agents such as conversational agents and social robots, which are highly effective in promoting learning and engagement (<xref ref-type="bibr" rid="B23">Chen et&#x20;al., 2020</xref>). Previous work has demonstrated how social robots can influence children&#x2019;s learning behaviors such as curiosity, growth mindset, and empathy through social emulation (<xref ref-type="bibr" rid="B37">Gordon et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B68">Park et&#x20;al., 2017</xref>). Notably, the presence of a social robot can also affect adults&#x2019; creativity (<xref ref-type="bibr" rid="B53">Kahn et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B8">Alves-Oliveira et&#x20;al., 2019</xref>). In this work, we explore how social robots can foster creativity in young children through collaborative, playful interactions.</p>
<p>Social robots are increasingly being used as learning peers and tutors (<xref ref-type="bibr" rid="B1">Adamson et&#x20;al., 2021</xref>), and their unique ability to socially interact with children while being co-located has situated them well as creativity support tools (CST). Previous work has shown that robots are more effective than other mediums used for CSTs, such as screen-based interfaces (<xref ref-type="bibr" rid="B53">Kahn et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B2">Ali, 2019</xref>). We do not seek to compare robots to other mediums of CSTs in this work; rather, we intend to demonstrate the efficacy of creativity stimulating interactions designed for social robots. Furthermore, while social interaction is not a prerequisite for creativity, creativity literature informs us that social interactions with peers and tutors can foster creativity in children. Previous work has shown how situating the robot as a collaborative peer that offers ideas or helps with the creative process have benefitted creative expression (<xref ref-type="bibr" rid="B62">Louis and Peter, 2015</xref>; <xref ref-type="bibr" rid="B75">Rond et&#x20;al., 2019</xref>). In this work, we explore whether a social robot&#x2019;s capability for social interaction patterns can stimulate children&#x2019;s creativity, while acknowledging that there are other stimulants of creativity. Learning from the effect of sociality on creativity in classrooms, we explore whether the effect can be replicated in pedagogical tools, specifically social robots. We suggest two interaction patterns in which intelligent embodied agents can help children think more creatively: <italic>1</italic>) creativity modeling, where the social robot models or demonstrates desired creative behaviors, and <italic>2</italic>) creativity scaffolding, where the robot offers scaffolding to the child in the form of asking reflective questions, validating novel ideas, and engaging in creative conflict. The robot used in this work is Jibo -- a child-friendly, tabletop, socially expressive&#x20;robot.</p>
<p>We position our research in three playful and collaborative tasks, where children and the robot collaborate to create artifacts. These one-on-one interactions afford different forms of creative expression.</p>
<p>In the first two tasks, outlined in our previous research (<xref ref-type="bibr" rid="B3">Ali et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B5">Ali et&#x20;al., 2020</xref>), we designed the behavior of the robot to artificially emulate human creativity:<list list-type="simple">
<list-item>
<p>1. The Droodle Creativity game, where children and the robot generate humorous titles for abstract images to express verbal creativity.</p>
</list-item>
<list-item>
<p>2. The Magic Draw game, where children and the robot co-create drawings on a tablet screen to express figural creativity.</p>
</list-item>
</list>
</p>
<p>In this work, we introduce the third task, where the robot scaffolds children&#x2019;s creative thinking by asking questions, validating novel ideas, and engaging in creative conflict:<list list-type="simple">
<list-item>
<p>3. The WeDo Construction activity, where children and the robot co-create WeDo LEGO models to encourage constructional creativity.</p>
</list-item>
</list>
</p>
<p>We outline previous research, where we demonstrated that children can emulate a social robotic peer&#x2019;s creative expression during collaborative gameplay. We ran two randomized controlled trials with 126 children: verbal creativity (<italic>n</italic>&#x20;&#x3d; 48) and figural creativity (<italic>n</italic>&#x20;&#x3d; 78) in the 5&#x2013;10&#xa0;yr old age group. Participants in the intervention group interacted with the robot exhibiting creative behaviors and participants in the control group interacted with the robot that did not exhibit these behaviors. We observed that children who interacted with the robot exhibiting high verbal creativity (in the Droodle Creativity game) and high figural creativity (in the MagicDraw game) exhibited higher verbal and figural creativity themselves. We then introduce our third study, where the robot offers creativity scaffolding behaviors in the WeDo Construction task. We ran a randomized controlled trial with 42 students in the 6&#x2013;10&#xa0;yr old age group. We observed that when the robot offered creativity scaffolding in the construction task, children expressed higher creativity.</p>
<p>In sum, we provide consistent evidence that the performance of creativity inducing behaviors by social robots can foster creativity in young children. Further, in all three studies, children in the high creative robot conditions perceived the robot as more creative and fun as compared to the low creative conditions. By showing that a social robot can successfully foster different kinds of creative expression, we are able to articulate more generalized social mechanisms that can be leveraged to support creativity in children. We contribute novel design guidelines and new methods for designing interactions with social agents that aim to promote creative thinking. With new developments in generative modeling techniques, robots can participate in several co-creative tasks with children, and can be leveraged as creativity support tools in a wide range of creative activities. We discuss implications for the field of HRI, digital creativity support tools, co-creative agents, and transformative&#x20;games.</p>
</sec>
<sec id="s2">
<title>BackGround</title>
<sec id="s2-1">
<title>Creativity</title>
<p>Creativity is often referred to as the ability to generate artifacts or ideas that are both novel and appropriate to the problem at hand (<xref ref-type="bibr" rid="B21">Carterette et&#x20;al., 1994</xref>). Novelty is the ability to generate ideas that are different from one&#x2019;s own ideas, and different from the group&#x2019;s ideas. The appropriateness of a solution refers to solving problems using the least amount of time and resources. The definition of creativity has evolved from a function of the individual to an interaction between aptitude, environment, and process by which an individual produces a tangible product (<xref ref-type="bibr" rid="B69">Plucker et&#x20;al., 2004</xref>). Depending on the nature of the task and the medium of creative expression, creativity presents itself in different forms; for example, figural creativity (drawing, painting, sketching) and verbal creativity (writing, storytelling, composition, discourse) (<xref ref-type="bibr" rid="B39">Guilford, 1957</xref>). In addition, construction (building, tinkering) is described as a form of creativity in which students can draw their own conclusions through creative experimentation and the creation of artifacts (<xref ref-type="bibr" rid="B43">Harel and Papert, 1991</xref>). A common means for fostering creative learning in classrooms is through construction and maker based activities, which we refer to as constructional creativity in this&#x20;work.</p>
<p>Early creativity researchers defined creativity as the embodiment of thought in the form of external behavior, consisting of three characteristics: fluency, flexibility, and originality (<xref ref-type="bibr" rid="B38">Guilford, 1950</xref>). Fluency refers to the ability to generate several ideas, flexibility refers to the variation in themes between several generated ideas, and originality refers to the novelty of the ideas generated in comparison to those of the group&#x2019;s. For the purpose of this work, we define the ability to generate ideas with greater fluency, flexibility and originality as creative thinking. Metrics of fluency, flexibility and originality are dependent on the choice of tasks made for each type of creativity. We also take divergent thinking into account as a component of creativity, and categorize activities that involve the creation of artifacts as activities that afford creativity.</p>
</sec>
<sec id="s2-2">
<title>Extrinsic Factors Influencing Creativity</title>
<p>Researchers have identified several factors that may serve as &#x201c;situational influences&#x201d; of creativity: freedom, autonomy, good role models and resources, encouragement for originality, little criticism, and &#x201c;norms in which innovation is prized and failure not fatal&#x201d; (<xref ref-type="bibr" rid="B10">Amabile and Gryskiewicz, 1989</xref>; <xref ref-type="bibr" rid="B94">Witt and Beorkem, 1989</xref>). In our work, we utilize the following factors to design effective creative interactions.</p>
<sec id="s2-2-1">
<title>Emulation</title>
<p>Emulation is described as &#x201c;[when] children achieve common goals to those modelled, but do so by using idiosyncratic means that were never observed&#x201d; (<xref ref-type="bibr" rid="B19">Bornstein and Bruner, 2014</xref>). Indeed, children are predisposed to social emulation (<xref ref-type="bibr" rid="B91">Yando et&#x20;al., 1978</xref>), and learn from other creators in their environments, such as teachers and classmates, through mechanisms of social emulation (<xref ref-type="bibr" rid="B95">Whiten et&#x20;al., 2009</xref>). Within classroom settings, researchers have suggested that the traditional educational model, which emphasizes rote problem solving, can be overcome by providing students with more diverse models of creativity to emulate (<xref ref-type="bibr" rid="B76">Root-Bernstein and Root-Bernstein, 2017</xref>). Social emulation may even be at the heart of innovation itself; one study showed that in a tower building task, children performed poorly at the task independently, but after observing one or two models building a tower, they were able to emulate the demonstrated elements and spontaneously recombine them, producing a novel tower of an optimal height (<xref ref-type="bibr" rid="B88">Subiaul and Stanton, 2020</xref>).</p>
</sec>
<sec id="s2-2-2">
<title>Social Interactions in the Classroom</title>
<p>The importance of the social environment to creativity is well researched (<xref ref-type="bibr" rid="B54">Kaufman and Sternberg, 2010</xref>). For children, the primary social environment is the classroom. Several factors that influence creativity, such as emulation, play, and collaboration, are heavily integrated into early education classroom curricula (<xref ref-type="bibr" rid="B42">Halverson and Sheridan, 2014</xref>; <xref ref-type="bibr" rid="B51">Kafai et&#x20;al., 1995</xref>). Question-asking during creative activities stimulates their creativity (<xref ref-type="bibr" rid="B93">Zheng et&#x20;al., 2013</xref>), and creative learning research outlines how game-based learning environments must facilitate reflective thinking (generating ideas and evaluating them) in order to foster creativity (<xref ref-type="bibr" rid="B44">Henriksen, 2006</xref>; <xref ref-type="bibr" rid="B20">Bowman, et&#x20;al., 2015</xref>).</p>
</sec>
<sec id="s2-2-3">
<title>Collaboration</title>
<p>Creativity has typically been understood as an individualistic pursuit. However, it is now widely accepted that creativity stems from the confluence of diverse perspectives and ideas, and that the nature of collaboration stimulates creative problem solving (<xref ref-type="bibr" rid="B51">Kafai et&#x20;al., 1995</xref>). For children in particular, several studies emphasize the importance of friendship and peership in fostering effective creative collaboration (<xref ref-type="bibr" rid="B63">MacDonald et&#x20;al., 2000</xref>; <xref ref-type="bibr" rid="B65">Miell and MacDonald, 2000</xref>; <xref ref-type="bibr" rid="B12">Bass et&#x20;al., 2008</xref>). The studies described in this work utilize a social robot as a peer in order to stimulate creative collaboration with children.</p>
</sec>
<sec id="s2-2-4">
<title>Play</title>
<p>Play-based learning tools and game-like activities have been repeatedly shown to promote creativity (<xref ref-type="bibr" rid="B44">Henriksen, 2006</xref>; <xref ref-type="bibr" rid="B32">Garaigordobil, 2006</xref>; <xref ref-type="bibr" rid="B13">Baggerly, 1999</xref>; <xref ref-type="bibr" rid="B25">Dansky, 1980</xref>; <xref ref-type="bibr" rid="B45">Howard-Jones et&#x20;al., 2002</xref>; <xref ref-type="bibr" rid="B64">Mellou, 1995</xref>; <xref ref-type="bibr" rid="B80">Russ, 2003</xref>; <xref ref-type="bibr" rid="B16">Berretta and Privette, 1990</xref>). They are effective for teaching concepts to children since their entertainment value ensures higher engagement levels. Furthermore, several behaviors that constitute creativity can be promoted <italic>via</italic> gameplay behaviors, such as developing multiple solutions to a problem, generating novel and appropriate solutions, metacognition, question-asking, and cross-contextual thinking (<xref ref-type="bibr" rid="B44">Henriksen, 2006</xref>). Games designed to specifically alter players&#x2019; behaviors, attitudes, or knowledge during and after play are known as <italic>transformational games</italic>, which can be used as tools to support meaningful learning. Digital games in particular provide players with the opportunity to find many creative solutions within a singular play space (<xref ref-type="bibr" rid="B20">Bowman et&#x20;al., 2015</xref>), especially in the case of well-known sandbox games such as Minecraft (<xref ref-type="bibr" rid="B28">Duncan, 2011</xref>). In our work, we utilize transformational digital games with game mechanics that allow for creative expression and creative problem-solving.</p>
</sec>
</sec>
<sec id="s2-3">
<title>Creativity Support Tools</title>
<p>Given the many extrinsic influencers of creativity, it is no surprise that HCI researchers have attempted to engineer creativity support tools (CSTs) &#x201c;that empower users to be not only more productive but also more innovative&#x201d; (<xref ref-type="bibr" rid="B83">Shneiderman et&#x20;al., 2006</xref>). Since the framework&#x2019;s proposal (<xref ref-type="bibr" rid="B82">Shneiderman, 2002</xref>), researchers have developed a wide range of CSTs. The vast majority of CSTs were built for digital devices, with the most common being a laptop or a personal computer (<xref ref-type="bibr" rid="B31">Frich et&#x20;al., 2019</xref>). Previous work has demonstrated how creativity is also facilitate through analog toolkits such as Scratch Coding Cards (<xref ref-type="bibr" rid="B81">Scratch Team, 2017</xref>) and robotic construction kits such as Lego Mindstorms, Popbots, and Cozmo (<xref ref-type="bibr" rid="B11">Anki, 1999</xref>; <xref ref-type="bibr" rid="B92">Williams et&#x20;al., 2019</xref>).</p>
</sec>
<sec id="s2-4">
<title>Social Robots as CSTs</title>
<p>Despite creativity&#x2019;s social nature, little work has been conducted on the benefit of utilizing social agents as CSTs. Previous work has demonstrated how verbal and non-verbal social robot behavior can serve to engage adults in a creative activity for longer and aid their own creative ideas (<xref ref-type="bibr" rid="B53">Kahn et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B8">Alves-Oliveira et&#x20;al., 2019</xref>), and children will emulate a social robot&#x2019;s expressed verbal and figural creativity, resulting in a higher level of creative expression (<xref ref-type="bibr" rid="B3">Ali et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B5">Ali et&#x20;al., 2020</xref>). <xref ref-type="bibr" rid="B7">Alves-Oliveira et&#x20;al. (2020)</xref> demonstrated how interacting with the robotic system YOLO when it displayed social and creative behaviors simulated children&#x2019;s creative abilities. Robots with light patterns have also benefited children&#x2019;s storytelling experiences (<xref ref-type="bibr" rid="B61">Ligthart et&#x20;al., 2020</xref>). Another study showed how people spent more time creating music with drums while collaborating with the Mortimer robot (<xref ref-type="bibr" rid="B62">Louis and Peter, 2015</xref>). <xref ref-type="bibr" rid="B75">Rond et&#x20;al. (2019)</xref> found that adult improve performers viewed a simple robot as a supportive teammate who positively inspired the scene&#x2019;s direction. A majority of previous work utilized social robots as peers or partners. However, all mentioned works are specific to one creative&#x20;task.</p>
<p>Social robotic agents are proven to be effective learning companions (<xref ref-type="bibr" rid="B15">Belpaeme et&#x20;al., 2018</xref>), and children form relationships with them through social interactions (<xref ref-type="bibr" rid="B89">Westlund et&#x20;al., 2018</xref>). There lies a unique opportunity in being able leverage these social and interactive agents as creativity fostering mechanisms for children. In this work, we demonstrate the efficacy of social robots as CSTs through three creative tasks that focus on three different kinds of creativity: verbal, figural and constructional. Further, we utilize game-based interactions since play is known to benefit creativity and it helps situate the robot as a collaborative playful peer. Like previous work, we situated the robot as a collaborative peer (<xref ref-type="bibr" rid="B75">Rond et&#x20;al., 2019</xref>). Similar to <xref ref-type="bibr" rid="B3">Ali et&#x20;al. (2019</xref>) and (<xref ref-type="bibr" rid="B4">Ali et&#x20;al., 2021</xref>), we utilize the robot&#x2019;s creativity demonstration as a creativity eliciting mechanism. Similar to <xref ref-type="bibr" rid="B8">Alves-Oliveira et&#x20;al. (2019)</xref> and <xref ref-type="bibr" rid="B53">Kahn et&#x20;al. (2016)</xref>, we made use of the robot&#x2019;s social verbal and non-verbal interactions during child-robot interaction. Through the three game interaction, and the robot assuming different social behaviors, we studied how creativity demonstration and creativity scaffolding through social interactions benefited children&#x2019;s creative expression. We suggest interaction patterns of social robots specific to a computational learning setting that aim to foster creativity (described as Creativity Scaffolding interactions) that are generalizable to other creative tasks for children. Through this work, we aim to contribute to the literature of using social interactive agents as creativity support tools, through both their social interactions scaffolding children&#x2019;s creativity, and their creativity demonstrations acting as a model for children to emulate.</p>
</sec>
</sec>
<sec id="s3">
<title>Robot Platforms</title>
<p>For the three creativity activities, we used Jibo, a socially embodied robot, as our robotic platform (<xref ref-type="bibr" rid="B48">Jibo, 2015</xref>). Jibo is an expressive tabletop social robot (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>) that can speak, respond to children&#x2019;s speech, track faces, gaze toward the person, attend to sound and movement in its environment, and physically express emotion through its display and three degree-of-freedom body. Jibo can communicate with an Android tablet that serves as a shared drawing surface or to display information for the child. Prior to each study, the experimenters discussed with children that Jibo uses WiFi to see, talk, draw, and interact with objects displayed on the tablet, and that it doesn&#x2019;t need physical hands to do so. Such discussion is important to building a believable experience for children that the robot knows what is displayed on the tablet and can draw on the tablet,&#x20;too.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Interaction Scene. <bold>(A)</bold> A child is playing the Droodle Creativity Game on an Android Tablet with social robot Jibo. <bold>(B)</bold> Example of a Droodle Image. 10 Droodles were used in the Droodle Creativity Game (five per player).</p>
</caption>
<graphic xlink:href="frobt-08-673730-g001.tif"/>
</fig>
<p>During the interaction, Jibo provides explanations and encouragement to the child, and expresses joy, curiosity, and pride. Between the high creative (C&#x2b;) and low creative (C&#x2212;) robot conditions, we carefully controlled the amount of verbal and non-verbal robot behaviors; however, the robot&#x2019;s speech differed based on the study condition. In the C&#x2b; condition, the robot exhibited greater creativity; in the C&#x2212; condition, it demonstrated substantially lower creativity.</p>
<p>We developed three game-based and interaction child-robot tasks which we introduce in the following sections.</p>
</sec>
<sec id="s4">
<title>Experiment 1: Droodle Creativity Game</title>
<p>Previous work in HRI demonstrated how children emulate robots&#x2019; learning behaviors such as curiosity and growth mindset (<xref ref-type="bibr" rid="B37">Gordon et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B68">Park et&#x20;al., 2017</xref>). Motivated from this literature, we explored whether this social emulation phenomenon extends to verbal creativity. Verbal creativity, defined as the ability to create verbal artifacts such as stories, prose and poetry has three indicators: fluency, or the ability to produce a large number of ideas; flexibility, or the aptitude for changing from one approach to another or from one line of thinking to another; and originality, or the capacity for bringing new ideas or solutions that are far from obvious, common, or established. Development of verbal creativity in children is pivotal to their learning, writing and thinking skills and helps them reflect their feelings, emotions, opinions, reactions, and notions to others (<xref ref-type="bibr" rid="B84">Shorofat, 2007</xref>; <xref ref-type="bibr" rid="B72">Rababah et&#x20;al., 2017</xref>). In this work we explore whether a social robot&#x2019;s creative verbal expression is emulated by children, for which we created the Droodle Creativity game (<xref ref-type="bibr" rid="B3">Ali et&#x20;al., 2019</xref>), inspired by the Droodle Creativity Task, a verbal creativity task that draws upon people&#x2019;s ability to creatively use language to describe an abstract image or figure known as a <italic>droodle</italic> (<xref ref-type="bibr" rid="B52">Kahn et&#x20;al., 2005</xref>). The Droodle Creativity Task has been previously validated as a means to measure people&#x2019;s verbal creativity, and is based on the cartoon book Droodles by Roger <xref ref-type="bibr" rid="B70">Price (1982)</xref>, thus making it appropriate for a children&#x2019;s game. The Droodle game encourages children to think creatively, express their thoughts and encourage&#x20;humor.</p>
<sec id="s4-1">
<title>Game Design</title>
<p>In the Droodle Creativity Game, two players take turns to generate Droodle titles (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>). The active player is presented with droodles on a tablet screen and they come up with droodle title(s) in 30&#xa0;s. Then the turn shifts to the other player until each player has played five turns each. The Droodle Task coding system, developed by <xref ref-type="bibr" rid="B52">Kahn et&#x20;al. (2005)</xref>, provides a metric for ranking the titles as &#x201c;non-droodle,&#x201d; &#x201c;low-,&#x201d; &#x201c;medium-,&#x201d; or &#x201c;high-droodle&#x201d; based on the participant&#x2019;s initial reaction, pattern matching to the image in question, and reasoning for providing such an answer. Droodles used in our study were taken from <italic>Droodles: The Classic Collection</italic> (<xref ref-type="bibr" rid="B71">Price and Lovka, 2000</xref>) which also includes a library of droodle titles.</p>
</sec>
<sec id="s4-2">
<title>Interaction Scenario</title>
<p>When the interaction starts, Jibo explains to the child how the Droodle task works and engages the child in a practice round. When the child generates a creative droodle title, the robot praises the child by using phrases such as, &#x201c;Great job,&#x201d; &#x201c;I would not have thought of that,&#x201d; or &#x201c;You are doing great.&#x201d; When the robot is &#x201c;thinking&#x201d; of a Droodle idea, it expresses curiosity through questioning sounds, swaying movements, and looking upwards.</p>
</sec>
<sec id="s4-3">
<title>Experiment Design</title>
<sec id="s4-3-1">
<title>Participants</title>
<p>We recruited 51 subjects in the 5&#x2013;10&#xa0;yr age range as a part of the Somerville after-school activities program at the public schools in Somerville, MA. All students had basic knowledge of robotics and artificial intelligence taught to them as a part of another module of the after-school program. Three students were excluded due to technological malfunctions or a rudimentary understanding of English.</p>
<p>All participants and their guardians signed an informed assent and consent form to participate in the study and permit us to collect demographic, assessment, audio and video data. The recruitment materials, study protocol, and data collection protocol were reviewed and approved by the Institute Research Board at Massachusetts Institute of Technology.</p>
</sec>
<sec id="s4-3-2">
<title>Pre-test</title>
<p>All students completed the Torrance Test of Creative Thinking (TTCT) assessment as a part of the pre-test activity (<xref ref-type="bibr" rid="B98">Torrance, 1968</xref>). The TTCT is a paper-based evaluation that consists of two sets of assessment activities: a verbal creativity test and a figural creativity test. The purpose of conducting the TTCT before the study was to drive a quasi-random assignment into groups such that their creativity scores are counterbalanced across the two conditions, described in the following section.</p>
</sec>
<sec id="s4-3-3">
<title>Study Conditions</title>
<p>Forty-eight participants were divided into two study condition groups, one that interacted with the high creative robot (C&#x2b;) and one that interacted with the low creative robot (C&#x2212;). The groups were divided such that the participants in the two groups were balanced in terms of their mean and standard deviations of TTCT scores (C&#x2b;: 42.16&#x20;&#xb1; 7.17; C&#x2212;: 40.66&#x20;&#xb1; 6.01), age (C&#x2b;: 7.78&#x20;&#xb1; 1.92; C&#x2212;: 8.38&#x20;&#xb1; 1.85), and gender (C&#x2b;: F &#x3d; 9, M &#x3d; 15; C&#x2212;: F &#x3d; 13, M &#x3d;&#x20;11).</p>
<p>The robot exhibits high or low creativity during gameplay depending on the study condition (<xref ref-type="table" rid="T1">Table&#x20;1</xref>). We use Boden&#x2019;s framework of creativity to design creative behaviors in gameplay (<xref ref-type="bibr" rid="B18">Boden, 2004</xref>), and Kahn et&#x20;al.&#x2019;s Droodle Task Coding system (<xref ref-type="bibr" rid="B52">Kahn et&#x20;al., 2005</xref>) to determine the creativity of Droodle titles.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>A gameplay comparison of the high creative and low creative study conditions.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">Fluency</th>
<th align="center">Novelty</th>
<th align="center">Value</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">High creative robot (C&#x2b;)</td>
<td align="left">Robot generated four to five ideas per Droodle</td>
<td align="left">Robot explored three or more different themes</td>
<td align="left">Robot picks Droodle titles that are tagged medium/high in creativity</td>
</tr>
<tr>
<td align="left">Low creative robot (C&#x2212;)</td>
<td align="left">Robot generated one to two ideas per Droodle</td>
<td align="left">Robot explored one to three different themes</td>
<td align="left">Robot picks Droodle titles that are tagged low/medium in creativity (e.g. the literal description of an image)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s4-3-4">
<title>Hypotheses</title>
<p>
<list list-type="simple">
<list-item>
<p>H1: Participants interacting with the high creative robot (C&#x2b;) generate a larger <italic>number</italic> of ideas than participants interacting with the low creative robot (C&#x2212;).</p>
</list-item>
<list-item>
<p>H2: Participants interacting with the high creative robot (C&#x2b;) explore more <italic>themes</italic> of ideas than participants interacting with the low creative robot (C&#x2212;).</p>
</list-item>
<list-item>
<p>H3: Participants interacting with the high creative robot (C&#x2b;) generate more <italic>creative</italic> ideas than participants interacting with the low creative condition (C&#x2212;).</p>
</list-item>
</list>
</p>
</sec>
<sec id="s4-3-5">
<title>Data Collection and Measures</title>
<p>Children&#x2019;s speech and video data was recorded. We used Google Cloud&#x2019;s Speech API (<xref ref-type="bibr" rid="B36">Google, 2020</xref>), as well as manual transcribing by three researchers blind to the study to transcribe children&#x2019;s phrases. We used the TTCT to assess children&#x2019;s verbal and figural creativity prior to all study interactions, and to divide them into balanced study groups.</p>
<p>We measured participants&#x2019; creativity in three parts:<list list-type="simple">
<list-item>
<p>&#x2022; <italic>Fluency.</italic> The number of ideas that the participants generated.</p>
</list-item>
<list-item>
<p>&#x2022; <italic>Novelty.</italic> The number of unique themes explored through the ideas. Each idea is associated with theme tags, which include all concepts and keywords included in the&#x20;idea.</p>
</list-item>
<list-item>
<p>&#x2022; <italic>Value.</italic> The droodle creativity scores of the ideas generated. Droodles are graded on a scale from 0 to 3, mapping to non-droodle, low-droodle, medium-droodle, and high-droodle respectively (<xref ref-type="bibr" rid="B52">Kahn et&#x20;al., 2005</xref>).</p>
</list-item>
</list>
</p>
<p>For instance, one participant came up with the following ideas for the droodle image in round 1 (<xref ref-type="fig" rid="F1">Figure&#x20;1</xref>): &#x201c;<italic>It&#x2019;s peppa pig</italic>&#x201d;; &#x201c;<italic>It&#x2019;s peppa pig&#x2019;s hands</italic>&#x201d;; and &#x201c;<italic>It&#x2019;s frog hands</italic>.&#x201d; This would be analyzed as: Number of ideas (fluency) &#x3d; 3; Unique themes (novelty) &#x3d; &#x201c;<italic>peppa pig</italic>,&#x201d; &#x201c;<italic>hands</italic>,&#x201d; &#x201c;<italic>frogs</italic>&#x201d;; Droodle scores (value): 2, 3,&#x20;2.</p>
</sec>
<sec id="s4-3-6">
<title>Results</title>
<p>We calculated numerical values for each of the three creativity measures, then further determined the mean and standard deviation of the <italic>Novelty</italic> and <italic>Value</italic> scores for every Droodle image for each participant. For instance, if a participant generated three ideas for Droodle &#x23;1, the <italic>Novelty</italic> and <italic>Value</italic> would be the mean score of the three individual <italic>Novelty</italic> and <italic>Value</italic> scores. We then conducted unpaired T-tests between the high creative and low creative study participants to determine any between group differences for each of the three metrics.<list list-type="simple">
<list-item>
<p>H1: Participants interacting with the high creative robot (C&#x2b;) generate a larger <italic>number</italic> of ideas than participants interacting with the low creative robot (C&#x2212;).</p>
</list-item>
</list>
</p>
<p>To test our first hypothesis, we analyzed the number of ideas generated by the participants in the two study conditions. We observed that participants who interacted with the robot expressing high levels of creativity (C&#x2b;) generated significantly more ideas (<italic>t</italic>(29) &#x3d; 1.699, <italic>p</italic>&#x20;&#x3c; 0.01&#x2a;&#x2a;) compared to the participants who interacted with the robot expressing low levels of creativity (C&#x2212;) (<xref ref-type="table" rid="T2">Table&#x20;2</xref>).<list list-type="simple">
<list-item>
<p>H2: Participants interacting with the high creative robot (C&#x2b;) explore more <italic>themes</italic> of ideas than participants interacting with the low creative robot (C&#x2212;).</p>
</list-item>
</list>
</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Droodle Creativity game <italic>t</italic>-test results per condition for each study hypothesis.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">SG</th>
<th align="center">Ideas generated (H1)</th>
<th align="center">Themes explored (H2)</th>
<th align="center">Creativity scores per Droodle (H3)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">
<bold>C&#x2b;</bold> (<italic>n</italic>&#x20;&#x3d; 24)</td>
<td align="center">3.325&#x20;&#xb1; 1.16</td>
<td align="center">4.983&#x20;&#xb1; 1.25</td>
<td align="center">1.73&#x20;&#xb1; 0.21</td>
</tr>
<tr>
<td align="left">
<bold>C</bold>&#x2212; (<italic>n</italic>&#x20;&#x3d; 24)</td>
<td align="center">2.417&#x20;&#xb1; 0.96</td>
<td align="center">3.842&#x20;&#xb1; 1.66</td>
<td align="center">1.532&#x20;&#xb1; 0.25</td>
</tr>
<tr>
<td align="left">
<italic>p</italic>
</td>
<td align="center">
<italic>t</italic>(29) &#x3d; 1.699, <italic>p &#x3d;</italic> 0.006</td>
<td align="center">
<italic>t</italic>(29) &#x3d; 1.699, <italic>p &#x3d;</italic> 0.010</td>
<td align="center">
<italic>t</italic>(29) &#x3d; 1.699, <italic>p &#x3d;</italic> &#x3c;0.015</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>Participants in the C&#x2b; condition generated more ideas, explored more themes, and overall received higher creativity scores than participants in the C&#x2212; condition.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>To understand the novelty of the themes that participants generated, we used the Rapid Automatic Keyword Extraction algorithm (Rake NLTK), a natural language processing library, to analyze the themes explored in each title (<xref ref-type="bibr" rid="B67">Mumford, 2001</xref>). We observed that participants in the C&#x2b; condition explored significantly more overall unique themes (<italic>t</italic>(29) &#x3d; 1.699, <italic>p</italic>&#x20;&#x3c; 0.01&#x2a;&#x2a;) as compared to the participants who interacted with the robot expressing low levels of creativity (<xref ref-type="table" rid="T2">Table&#x20;2</xref>).<list list-type="simple">
<list-item>
<p>H3: Participants interacting with the high creative robot (C&#x2b;) generate more <italic>creative</italic> ideas than participants interacting with the low creative condition (C&#x2212;).</p>
</list-item>
</list>
</p>
<p>Three coders blind to the study conditions were trained using the Droodle creativity coding scheme. They then coded all Droodle titles generated by the participants as &#x201c;non-,&#x201d; &#x201c;low-,&#x201d; &#x201c;medium-&#x201c; and &#x201c;high-droodle.&#x201d; To determine inter-rater reliability between researchers, Cohen&#x2019;s kappa (<xref ref-type="bibr" rid="B41">Hallgren, 2012</xref>) was calculated using 67% of the coded transcripts coded independently by a team member after an initial coding by other two coders. Cohen&#x2019;s kappa was 0.82, which is within the range for substantial agreement considered acceptable for inter-rater reliability.</p>
<p>An overall analysis of creativity scores for every idea revealed that participants in the creative condition scored significantly higher in creativity score per title than participants in the low creative condition (<italic>t</italic>(29) &#x3d; 1.699, <italic>p &#x3c;</italic> 0.01&#x2a;&#x2a;) (<xref ref-type="fig" rid="F2">Figure&#x20;2</xref>).</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Interface screenshots of the Magic Draw game explaining the child-robot gameplay. <bold>(A)</bold> The child draws a starting prompt (cat ears). <bold>(B)</bold> The child selects a target category (cat). <bold>(C)</bold> The robot tries to convert the starting prompt (circle) into the target category (cat). <bold>(D)</bold> Players switch turns and the robot gives the child a starting prompt. <bold>(E)</bold> The robot selects the category (bird). <bold>(F)</bold> The child converts the starting prompt to a bird. (order: left to right starting top-left).</p>
</caption>
<graphic xlink:href="frobt-08-673730-g002.tif"/>
</fig>
</sec>
</sec>
</sec>
<sec id="s5">
<title>Experiment 2: MagicDraw</title>
<p>Similar to verbal creativity, we aimed to explore whether children also emulate a robots&#x2019; expressed figural creativity. Generative models such as GANs make it possible for AI models to generate creative drawings (<xref ref-type="bibr" rid="B40">Ha and Eck, 2017</xref>; <xref ref-type="bibr" rid="B34">Ge et&#x20;al., 2020</xref>). Collaboration with both humans and digital interfaces has also been known to benefit figural creativity (<xref ref-type="bibr" rid="B55">Kim et&#x20;al., 2016</xref>). Collaborative digital CSTs have been constantly evolving to support the creativity needs of people, and have the ability to contribute to the drawing itself. In human-human creative collaborations, creators can socially interact with one another, provide feedback and comment on their drawings, an interaction style that is lost in digital CSTs. In this work, we explore whether collaborating with a robot that also interacts with the creators socially, in a figural co-creation activity benefits children&#x2019;s creativity. We explore whether children emulate the robot&#x2019;s expressed figural creativity through a co-doodling&#x20;task.</p>
<sec id="s5-1">
<title>Game Design</title>
<p>To investigate whether children model a social robot&#x2019;s figural creativity, we designed the MagicDraw game, which involves a collaborative drawing interaction on an Android tablet between the child and the robot (<xref ref-type="bibr" rid="B5">Ali et&#x20;al., 2020</xref>). The gameplay requires one player to start a drawing with a stroke, and the other player completing the drawing. After the drawing is complete, the players switch turns. When it is the robot&#x2019;s turn to complete the drawing, we utilize the Sketch-RNN model (<xref ref-type="bibr" rid="B40">Ha and Eck, 2017</xref>), which generates drawing strokes to convert a starting stroke into a meaningful illustration (<xref ref-type="fig" rid="F3">Figure&#x20;3</xref>).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>(top) <bold>(A)</bold> Child constructing models with Jibo. (bottom) <bold>(B)</bold> Model of interaction for the WeDo construction game where the robot provides creativity scaffolding.</p>
</caption>
<graphic xlink:href="frobt-08-673730-g003.tif"/>
</fig>
</sec>
<sec id="s5-2">
<title>Interaction Scenario</title>
<p>The collaborative figural activity utilized Jibo for similar reasons to the collaborative verbal activity, and its interactions were designed to evoke an autonomous &#x201c;artistic&#x201d; peer, collaboratively creating drawings with the child. Even though Jibo does not have appendages, it conveys interest and intent by looking at the tablet while it &#x201c;draws,&#x201d; and vocalizes relevant phrases, such as &#x201c;OK, a cat. I think I can make that drawing into a cat.&#x201d; &#x201c;Here I go!,&#x201d; or &#x201c;Watch me convert your doodle into a cat.&#x201d; The robot can also ask the child for feedback, e.g. &#x201c;What do you think about my drawing?,&#x201d; increasing the credulity of the interaction. We verified in the post-test that children perceived Jibo was drawing on the tablet with them. Similar to the Droodle Creativity Game, subjects and Jibo played the figural creativity game by taking turns on an Android tablet.</p>
</sec>
<sec id="s5-3">
<title>Experiment Design</title>
<sec id="s5-3-1">
<title>Participants</title>
<p>We recruited 78 children in the 5&#x2013;10&#xa0;yr age range as a part of the Somerville after-school activities program at the public schools in Somerville, MA. Eleven students in the figural creativity study were excluded due to incomplete data collections or network errors.</p>
</sec>
<sec id="s5-3-2">
<title>Pre-test</title>
<p>All students completed the TTCT assessment as a part of the&#x20;pretest activity. As with the prior study, the purpose of conducting the TTCT was to drive a quasi-random assignment into groups such that their creativity scores are counterbalanced across the two conditions, described in the following section.</p>
</sec>
<sec id="s5-3-3">
<title>Study Conditions</title>
<p>Participants were divided into two study condition groups: one that interacted with the high creative robot (C&#x2b;) and one that interacted with the low creative robot (C&#x2212;). The groups were divided such that the participants in the two groups were balanced in terms of their TTCT scores (C&#x2b;: 43.33&#x20;&#xb1; 6.30; C&#x2212;: 42.91&#x20;&#xb1; 5.16), age (C&#x2b;: 7.89&#x20;&#xb1; 1.91; C&#x2212;: 7.09&#x20;&#xb1; 1.96) and gender (C&#x2b;: F &#x3d; 14, M &#x3d; 23; C&#x2212;: F &#x3d; 20, M &#x3d;&#x20;21).</p>
<p>The robot in the C&#x2b; condition produced more creative drawings as defined by the metrics of the Test of Creative Thinking - Drawing production (TCT-DP) -- a figural creativity test (<xref ref-type="bibr" rid="B90">Urban, 2005</xref>). During the robot&#x2019;s turn, we adjusted the drawing model to reduce the randomness in drawing. We kept the speed of drawing to the default speed (60&#xa0;fps). The robot always drew true to the selected category. This led to higher quality drawings with a better model match to the category that the child selects. The length and number of interactions were controlled for across the two conditions. We validate this hypothesis of these drawings being rated as more creative in the following section.</p>
<p>In the low creative robot condition, the robot system was configured to produce less creative drawings as measured by the TCT-DP figural test parameters. We adjusted the generative model to increase the randomness of the drawing, thereby producing lower quality drawings with a lower model match to the category that the child selects. Further, we adjusted the frame rate of rendering to 30 frames per second to generate the drawings more slowly. We also made the model periodically select an incorrect category to make the drawing not match the selected&#x20;theme.</p>
</sec>
<sec id="s5-3-4">
<title>Hypotheses</title>
<p>
<list list-type="simple">
<list-item>
<p>H1: The drawing model produces more creative drawings in the C&#x2b; condition than in the C&#x2212; condition.</p>
</list-item>
<list-item>
<p>H2: Children who played the Magic Draw with the high creative Jibo (C&#x2b;) will exhibit higher levels of creativity in their own drawings than children that play with the low creative Jibo (C&#x2212;).</p>
</list-item>
</list>
</p>
</sec>
<sec id="s5-3-5">
<title>Data Collection and Measures</title>
<p>The MagicDraw application logged the drawings done by the child from all three rounds, the drawings done by the robot in all three rounds, and the time taken for each drawing onto a log file downloaded to the Android tablet. We also used an overhead GoPro camera to take a birds-eye video of the interaction, as well as for recording audio and participants&#x2019; post-test interviews.</p>
<p>To assess figural creativity from children&#x2019;s drawings in the MagicDraw interaction, we used the Test of Creative Thinking - Drawing Production (<xref ref-type="bibr" rid="B90">Urban, 2005</xref>). Three coders blind to the study&#x2019;s hypothesis and the participants&#x2019; study condition reviewed the drawings and rated them. These scores were then used for calculating the TCT-DP measures of the drawings. Some participants did not make any drawings, and some drawings were not saved due to network errors.</p>
</sec>
<sec id="s5-3-6">
<title>Results</title>
<p>We conducted unpaired t-tests comparing the creativity scores of drawings generated by participants in the control condition (C&#x2212;) and the experimental condition (C&#x2b;), as measured by the TCT-DP test.<list list-type="simple">
<list-item>
<p>H1: The robot&#x2019;s drawing model produces more creative drawings in the C&#x2b; condition than in the C&#x2212; condition.</p>
</list-item>
</list>
</p>
<p>To test this hypothesis, we compared the TCT-DP scores of the robot drawings generated by the creative model and by the low creative model. An unpaired <italic>t</italic>-test showed that the model type had a significant effect (<italic>p &#x3c; 0.01&#x2a;&#x2a;</italic>) on the generated drawing&#x2019;s corresponding creativity score (<xref ref-type="table" rid="T3">Table&#x20;3</xref>). This dataset was notably smaller than the children&#x2019;s drawing dataset since we did not collect all of the drawings generated by the model. This significant difference helped establish that the creative model was indeed generating drawings that were more creative than the low creative model. Hence, manipulating certain parameters of the model led to a change in the drawing&#x2019;s creativity.<list list-type="simple">
<list-item>
<p>H2: Children who played the Magic Draw with the high creative Jibo (C&#x2b;) will exhibit higher levels of creativity in their own drawings than children that play with the low creative Jibo (C&#x2212;).</p>
</list-item>
</list>
</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>MAGICDRAW figural creativity game one-way ANOVA results per condition for each study hypothesis.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Model Condition</th>
<th align="center">Robot Drawing TCT-DP scores (H1)</th>
<th align="center">Children&#x2019;s Drawing TCT-DP scores (H2)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">High creative model (C&#x2b;) (<italic>n</italic>&#x20;&#x3d; 37)</td>
<td align="center">28.91&#x20;&#xb1; 6.69</td>
<td align="center">42.27&#x20;&#xb1; 14.30</td>
</tr>
<tr>
<td align="left">Low creative model (C&#x2212;) (<italic>n</italic>&#x20;&#x3d; 41)</td>
<td align="center">20.33&#x20;&#xb1; 7.86</td>
<td align="center">32.88&#x20;&#xb1; 9.64</td>
</tr>
<tr>
<td align="left">Result (unpaired t-test)</td>
<td align="center">
<italic>t</italic>(26) &#x3d; 1.60, <italic>p</italic>&#x20;&#x3d; 0.0064</td>
<td align="center">
<italic>t</italic>(56) &#x3d; 1.67, <italic>p</italic>&#x20;&#x3d; 0.0023</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>One way ANOVA tests revealed that the study condition has a significant effect on participants&#x2019; figural creativity.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>To test this hypothesis, we compared the TCT-DP scores of all participants in all the conditions. An unpaired <italic>t</italic>-test test revealed that the study condition had a significant effect on children&#x2019;s figural creativity, and showed a significant difference between the High creative robot (C&#x2b;) and Low creative robot (C&#x2212;) (<italic>p</italic>&#x20;&#x3c; 0.01<italic>&#x2a;&#x2a;</italic>) (<xref ref-type="fig" rid="F4">Figure&#x20;4</xref>). We could hence validate our second hypothesis.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>
<bold>(A)</bold> Version 1 of the Jibo control interface for generating Jibo speech commands and emotional expressions. <bold>(B)</bold> A teacher using the remote control interface to control the robot.</p>
</caption>
<graphic xlink:href="frobt-08-673730-g004.tif"/>
</fig>
</sec>
</sec>
</sec>
<sec id="s6">
<title>Experiment 3: WeDo Construction Task</title>
<p>Physical construction, or the ability to make new artifacts by combining other artifacts, is a key indicator of children&#x2019;s creativity. Furthermore, unique ways of combining and using the creations also indicates divergent thinking. Physical construction kits facilitate playful learning, open-ended making and creativity, and often creates co-creation space with others (<xref ref-type="bibr" rid="B6">Alimisis, 2013</xref>). Robotic toolkits and environments have been successfully leveraged to afford construction by children (<xref ref-type="bibr" rid="B66">Mioduser and Levy, 2010</xref>). When children construct with others, their creativity is scaffolded by other children acting as models to emulate, providing ideas, brainstorming, challenging and asking questions. In this experiment, we explore whether this social support can be offered by a social robotic collaborator in a construction activity.</p>
<p>To afford constructional creative expression through making, we designed a third activity in which children and Jibo collaborate building models using the <xref ref-type="bibr" rid="B60">LEGO Education WeDo 2.0 Core Set (2020)</xref>. The set consists of LEGO bricks and electronics that can be programmed using a visual programming interface on a tablet application with the aim of introducing children to computational thinking and engineering principles in a fun and engaging&#x20;way.</p>
<p>The interaction involved children making construction projects using the WeDo 2.0 kit in the presence of a social robot, which assumed the role of a tutor and provided scaffolding to the child. In order to get acquainted with the programming interface, children were first guided by the robot to build a rover using LEGO blocks, and to program the rover such that it could detect obstacles and respond to their commands using the WeDo Android tablet application. Children could utilize WeDo 2.0 standard construction kit items, including a Bluetooth enabled controller, LEGO bricks, motors and supporting construction materials and motion sensors. This guided activity was conducted through a step-by-step verbal exchange between the child and the robot and lasted for 6&#xa0;min, with the robot taking the instructor role (<xref ref-type="fig" rid="F5">Figure&#x20;5</xref>). The activity introduced the child to sequential commands, condition statements, delays, and loops. Then, children were given 20&#xa0;min for free play, where they could explore different functions of the WeDo app, add new LEGO blocks, and make their models perform new actions. The idea generation process was guided by both the child and the robot. The role of the robot was to scaffold the child&#x2019;s creative learning through verbal and non-verbal behaviors. Throughout the interaction, children could ask the robot questions and receive dynamic troubleshooting guidance. The robot also engaged in active creativity scaffolding which involved asking the child reflective questions, challenging their ideas and assumptions, and suggesting alternate ideas for creations with the rover. The robot also provided feedback and positive affirmation after children generated new&#x20;ideas.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>
<bold>(A)</bold> The Jibo control interface. The questions, creative prompts, and positive reinforcement prompts only appeared for the instructors in C&#x002B; condition. <bold>(B)</bold> A teacher using the remote control interface to control the robot.</p>
</caption>
<graphic xlink:href="frobt-08-673730-g005.tif"/>
</fig>
<p>While the Droodle Creativity game and MagicDraw game utilized a fully autonomous Jibo interaction, in this activity, the robot was controlled by a human instructor using a dynamic and predictive Graphical User Interface (GUI) on the desktop to provide quality scaffolding at the right time and also to respond to the child appropriately. This GUI controller was iteratively co-designed in tandem with the instructors, with the goal of assisting them in providing creativity scaffolding to the children. This iterative process of designing the GUI is outlined in <xref ref-type="sec" rid="s3">Section 3.4.2</xref>. The desktop GUI application communicated with the robot using Robot Operating System (<xref ref-type="bibr" rid="B77">ROS, 2021</xref>). Children programmed the WeDo controllers using an Android application on a tablet screen. <xref ref-type="fig" rid="F5">Figure&#x20;5</xref> illustrates the system components and communications between&#x20;them.</p>
<sec id="s6-1">
<title>Interaction Scenario</title>
<sec id="s6-1-1">
<title>Introduction</title>
<p>Jibo guides the activity with the child, starting with a self-introduction and then engaging in a short ice-breaker activity. Jibo begins by looking at the child and saying, &#x201c;Hi. My name is Jibo. What is your name?.&#x201d; When the child responds with their name, Jibo replies with an affectionate expression while saying, &#x201c;It is so nice to meet you. My favorite activity is to do my favorite dance! What activities do you like?&#x201d;</p>
<p>Jibo explains the activity to the child: &#x201c;Today, we will be programming this rover robot to do cool things. [looks down at the tablet] Are you ready to begin?&#x201d; When the child says &#x201c;yes,&#x201d; Jibo responds with excitement, &#x201c;Let&#x2019;s go!&#x201d;</p>
</sec>
<sec id="s6-1-2">
<title>Child-robot Co-play</title>
<p>Jibo then begins a step-by-step guided activity to help the children learn how to program a rover with the LEGO WeDo kit. This activity ensures that children understand how to use the WeDo construction kit. After this guided activity, children are free to explore and build new models with the WeDo kit. Jibo provides creativity scaffolding to help children generate novel ideas by using verbal phrases like &#x201c;Can you think of another way to do this?&#x201d;</p>
</sec>
<sec id="s6-1-3">
<title>Robot Interactions</title>
<p>Jibo acts as an instructor by: <italic>1</italic>) assisting children in learning how to use the WeDo construction kit, and <italic>2</italic>) scaffolding children&#x2019;s creativity while they construct models. While the tone of interaction is collaborative -- for instance, Jibo says, &#x201c;Today, we will be building a rover together&#x201d; -- Jibo primarily takes on the role of a tutor that is helping children to create something. Jibo interacts with children through speech prompts and emotional expressions. Jibo&#x2019;s behaviors are remote controlled by a human instructor in a Wizard-of-Oz (WoZ) manner.</p>
<p>Actions for creativity scaffolding are inspired by how human instructors and peers scaffold children and enable them to be more creative by asking reflective questions, generating multiple diverse ideas, challenging assumptions, providing feedback, and appreciating the value of the child&#x2019;s ideas. Creativity and divergent thinking literature elaborates on how asking reflective questions, presenting challenges, and positive reinforcement fosters creativity in children and adults (<xref ref-type="bibr" rid="B51">Kafai et&#x20;al., 1995</xref>; <xref ref-type="bibr" rid="B42">Halverson and Sheridan, 2014</xref>). Collaboration with peers and tutors is also beneficial for creative thinking (<xref ref-type="bibr" rid="B74">Rojas-Drummond, et&#x20;al., 2008</xref>). In this activity, instructors use a remote control GUI that has preset suggestions for prompts. We gathered the prompts from collecting and categorizing interaction data from human instructors scaffolding children&#x2019;s creativity using an open-ended WoZ interface. The design of the interface is described in detail in the following section.</p>
</sec>
</sec>
<sec id="s6-2">
<title>WoZ Creativity Scaffolding Interface Design</title>
<p>The goal of designing a robot control interface was to provide instructors with a user-friendly tool to remotely control Jibo while enabling them to provide creativity scaffolding to children. First, three instructors were given a fully flexible desktop interface which contained a text box where they could freely create dialogues and buttons to choose from preset animations for Jibo, while overseeing the interaction using a birds-eye camera view (<xref ref-type="fig" rid="F6">Figure&#x20;6</xref>). All instructors were trained collectively to understand the task and the WeDo construction kits. The instructors were told that their task was to guide the children to build a simple rover, and then to assist children in thinking creatively about building other WeDo models. Further, all instructors were given a detailed protocol guide for the graphical interface to control Jibo. We evaluated the interface with three instructors and eight participants (6&#x2013;10&#xa0;yr&#x20;old).</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Participants in the C&#x002B; condition group generated significantly more Droodle titles, more unique titles and highly creative titles as compared to the C&#x2212; group.</p>
</caption>
<graphic xlink:href="frobt-08-673730-g006.tif"/>
</fig>
<p>An affinity diagramming method was used to categorize all of the prompts that were used by the instructors. And resulted in the following categories:<list list-type="simple">
<list-item>
<p>&#x2022; Instructions: Construction and programming instructions with the goal of teaching children how to use the WeDo construction kits and build their rover. Instructors tended to use the same language of instruction that was provided to them in the protocol.</p>
</list-item>
<list-item>
<p>&#x2022; Questions: Reflective questions that the instructors asked children. For example, &#x201c;Can you tell me why you did that (last action)?,&#x201d; &#x201c;Can you think of another way to do that (last action)?,&#x201d; or &#x201c;How will you do that?&#x201d;</p>
</list-item>
<list-item>
<p>&#x2022; Creativity prompts: All prompts that were not direct instructions to children but were focused towards helping them come up with creative ideas. These included new ideas and challenges. Prompts included &#x201c;Can you think of another way to use that block?&#x201d; or &#x201c;What else can you make with the same blocks?&#x201d;</p>
</list-item>
<list-item>
<p>&#x2022; Feedback: All responses to children&#x2019;s actions. These were mostly positive feedback, such as, &#x201c;Good job,&#x201d; but also involved encouragement prompts such as &#x201c;Let&#x2019;s try again.&#x201d;</p>
</list-item>
<list-item>
<p>&#x2022; Frequently asked questions (FAQ): There were times when children asked the robot questions to help them troubleshoot problems. Some patterns that arose were difficulty connecting the rover to Bluetooth, or not being able to find a part. The responses were first grouped by topics such as &#x201c;Bluetooth,&#x201d; or &#x201c;Missing parts&#x201d; and then all of the instructors&#x2019; responses to these questions were grouped under&#x20;FAQ.</p>
</list-item>
</list>
</p>
<p>We then provided teachers with a more structured GUI for interaction, where frequently used speech prompts were made into buttons in order to reduce time delays, and organized by their categories, as shown in <xref ref-type="fig" rid="F7">Figure&#x20;7</xref>. Instructors could also input custom speech if needed. We evaluated the interface using a think-aloud evaluation protocol (<xref ref-type="bibr" rid="B29">Ericsson and Simon, 1980</xref>), where the instructors spoke about what actions they want to perform, how they use the interface to perform it, and what the interface does not allow them to do. At the end of the interaction, the instructors were asked the following questions:<list list-type="simple">
<list-item>
<p>&#x2022; What worked in the interface to help you give instructions and scaffold for creativity?</p>
</list-item>
<list-item>
<p>&#x2022; What did not work in the interface?</p>
</list-item>
<list-item>
<p>&#x2022; Were there parts of the interface that you did not understand the functionality&#x20;of?</p>
</list-item>
<list-item>
<p>&#x2022; What will you change in the interface to better suit your needs?</p>
</list-item>
</list>
</p>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Participants who interacted with the high creative robot scored significantly higher on the TCT-DP test compared to the low creative robot condition (H2).</p>
</caption>
<graphic xlink:href="frobt-08-673730-g007.tif"/>
</fig>
<p>Based on their interactions with the interface and feedback post interaction, we iterated on the interface design. For instance, an instructor expressed that the interface was too cluttered, and short &#x201c;clues&#x201d; to the prompts would be preferable compared to the entire prompt for ease of use. Another instructor expressed how getting a sense of time elapsed on the screen can better prepare them in planning the activity. We stopped the iteration loop when the instructors reported that the interface presets were sufficient for their needs barring some outlier interactions. The final set of creativity scaffolding prompts used in the interface buttons are listed&#x20;below.</p>
<p>Reflective Questions:<list list-type="simple">
<list-item>
<p>&#x2022; Can you tell me why you did that?</p>
</list-item>
<list-item>
<p>&#x2022; What will you be doing next?</p>
</list-item>
<list-item>
<p>&#x2022; What are you trying to make?</p>
</list-item>
<list-item>
<p>&#x2022; How are you going to do that?</p>
</list-item>
<list-item>
<p>&#x2022; What are the materials you would be needing for that?</p>
</list-item>
<list-item>
<p>&#x2022; Do you have any questions about this?</p>
</list-item>
<list-item>
<p>&#x2022; Is that the best way to do that?</p>
</list-item>
</list>
</p>
<p>Creative Prompts (Ideas and Challenges):<list list-type="simple">
<list-item>
<p>&#x2022; What are some other things you can make the rover&#x20;do?</p>
</list-item>
<list-item>
<p>&#x2022; What else can you make the rover do when an object is near? Can you make it have a different output?</p>
</list-item>
<list-item>
<p>&#x2022; What are some other uses for the [motor/sensor]?</p>
</list-item>
<list-item>
<p>&#x2022; Let&#x2019;s think of some fun uses of the&#x20;rover.</p>
</list-item>
<list-item>
<p>&#x2022; There might be a better way to program&#x20;that.</p>
</list-item>
<list-item>
<p>&#x2022; I have an idea!</p>
</list-item>
<list-item>
<p>&#x2022; Let&#x2019;s try to make an obstacle for the rover&#x2019;s sensor to detect. You can use LEGO blocks to make an obstacle.</p>
</list-item>
<list-item>
<p>&#x2022; Let&#x2019;s try to make the rover move when you wave your hand in front of the sensor, and stop when you wave your hand again?</p>
</list-item>
</list>
</p>
<p>Positive Reinforcement:<list list-type="simple">
<list-item>
<p>&#x2022; That is such a great idea! Good&#x20;job.</p>
</list-item>
<list-item>
<p>&#x2022; You think of some really cool use of the&#x20;robot.</p>
</list-item>
<list-item>
<p>&#x2022; Well done. That was so creative.</p>
</list-item>
<list-item>
<p>&#x2022; Great job!</p>
</list-item>
<list-item>
<p>&#x2022; You are doing so&#x20;well.</p>
</list-item>
<list-item>
<p>&#x2022; I would not have thought of that. Good&#x20;going.</p>
</list-item>
</list>
</p>
<p>We conducted 20 playtests, logged instructor&#x2019;s interactions with the GUI, and coded them with: <italic>1</italic>) the previous GUI interaction, and 2) the child&#x2019;s actions that led to the interaction. We then calculated the probability of each GUI interaction following each child action, or preceding GUI interaction. For instance, the child connecting the sensor to the rover body had the highest probability to be followed by the prompt &#x201c;Instruction: try out the sensor by waving your hand&#x201d; (Prob. &#x3d; 0.58). We used these probabilities to predict what the instructor&#x2019;s next interaction with the GUI would be based on the child&#x2019;s actions and the instructor&#x2019;s previous GUI interaction. We developed a dynamic predictive suggestions feature where the interface would prompt the instructor with GUI elements to use when the child performed a certain action. Instructors could choose to use the predicted prompt or create a new&#x20;one.</p>
</sec>
<sec id="s6-3">
<title>Experiment Design</title>
<sec id="s6-3-1">
<title>Participants</title>
<p>A total of 43 participants in the 6&#x2013;10-yr-old age group were recruited for our third study (19 female, 24 male). All students completed the TTCT as a part of the pretest activity. The average age of the participants was 8.11 (S.D. &#x3d; 1.68). The subjects were recruited as part of the Somerville after-school activities program at the public schools in Somerville, MA. All participants and their guardians signed a consent form to participate and for audio and video data collection. Three adult instructors were also recruited for the study. All instructors were given preliminary training of WeDo construction kits, the programming interface, and a study protocol.</p>
</sec>
<sec id="s6-3-2">
<title>Pre-test</title>
<p>Participants were administered the first part of the verbal and figural module of the&#x20;TTCT.</p>
</sec>
<sec id="s6-3-3">
<title>Study Conditions</title>
<p>Participants were divided into two study-condition groups: one that interacted with the robot offering creativity scaffolding (C&#x2b; condition) and one that interacted with the robot not offering creativity scaffolding (C&#x2212; condition). The groups were divided such that the participants in the two groups were counterbalanced in terms of their mean and standard deviations of TTCT scores, age and gender (<xref ref-type="table" rid="T4">Table&#x20;4</xref>).</p>
<table-wrap id="T4" position="float">
<label>TABLE 4</label>
<caption>
<p>Study groups for WeDo Construction task.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Study Groups</th>
<th align="center">
<italic>n</italic>
</th>
<th align="center">TTCT scores</th>
<th align="center">Gender</th>
<th align="center">Age</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">High creative (C&#x2b;)</td>
<td align="center">23</td>
<td align="center">42.16&#x20;&#xb1; 7.17</td>
<td align="center">F &#x3d; 11&#x20;M &#x3d; 12</td>
<td align="center">8.3&#x20;&#xb1; 1.57</td>
</tr>
<tr>
<td align="left">Low creative (C&#x2212;)</td>
<td align="center">20</td>
<td align="center">40.66&#x20;&#xb1; 6.01</td>
<td align="center">F &#x3d; 8&#x20;M &#x3d; 12</td>
<td align="center">7.65&#x20;&#xb1; 1.85</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>43 participants were divided in balanced groups based on TTCT scores, gender and age.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>In both study conditions, the robot was controlled by a human instructor (blind to the study condition) using a WoZ desktop interface (<xref ref-type="fig" rid="F7">Figure&#x20;7</xref>). In both conditions, instructors were instructed to start with providing the same set of basic instructions to help the child build and program a rover model that incorporates a sensor and a motor, after which they are left to explore and make their own models. Instructors sent construction commands provided in the WoZ interface after the child completed the previous instruction, as was indicated by the live camera field. Instructors in the creativity scaffolding condition (C&#x2b;) were instructed to ask reflective questions, challenge the participants, and collaboratively ideate with them. In order to facilitate this scaffolding, they are equipped with the creativity scaffolding interface, which in addition to the construction instructions, also consisted of questions, creative prompts and positive reinforcement prompts (as outlined in <xref ref-type="sec" rid="s3">Section 3.4.2</xref>). In contrast, in the C&#x2212; condition, the robot prompted the child to explore and make new things in the beginning of the free exploration period, and the instructors were instructed to only participate to answer questions beyond that. In the C&#x2212; condition, the scaffolding interface also lacked the questions, creative prompts and positive reinforcement prompts. The three instructors were paired with an equal number of C&#x2b; and C&#x2212; condition participants to control for experimenter&#x20;bias.</p>
</sec>
<sec id="s6-3-4">
<title>Hypothesis for the Creativity Scaffolding Study</title>
<p>In order to understand the effect of creativity scaffolding on children&#x2019;s creativity, we hypothesize that participants who interacted with the robot offering creativity scaffolding exhibit higher levels of creativity in the WeDo construction task. We divide our hypothesis in these parts derived from the three ways of assessing creativity behaviors during the task:<list list-type="simple">
<list-item>
<p>H1: Participants who interact with the robot offering creativity scaffolding (C&#x2b;) generate a greater number of ideas and use cases for the rover than those who interact with the robot without creativity scaffolding (C&#x2212;).</p>
</list-item>
<list-item>
<p>H2: Participants who interact with the robot offering creativity scaffolding (C&#x2b;) use a higher number of new programming blocks (excluding the blocks used in the instructions) than those who interact with the robot without creativity scaffolding (C&#x2212;).</p>
</list-item>
<list-item>
<p>H3: Participants who interact with the robot offering creativity scaffolding (C&#x2b;) generate more uncommon ideas than those who interact with the robot without creativity scaffolding (C&#x2212;).</p>
</list-item>
</list>
</p>
</sec>
<sec id="s6-3-5">
<title>Post-test</title>
<p>We conducted an open-ended descriptive post-test interview with all participants in order to understand how they perceived the creation process.<list list-type="simple">
<list-item>
<p>Q1. Can you describe what you made today?</p>
</list-item>
<list-item>
<p>Q2. How do you think Jibo was helpful to&#x20;you?</p>
</list-item>
<list-item>
<p>Q3. How do you think Jibo can be of more help?</p>
</list-item>
<list-item>
<p>Q4. Do you think Jibo had any creative ideas?</p>
</list-item>
</list>
</p>
<p>In order to provide transparency about the robot&#x2019;s abilities, participants were briefed about the WoZ nature of the study and how the robot was being controlled by human instructors.</p>
</sec>
<sec id="s6-3-6">
<title>Data Collection and Measures</title>
<p>All interactions by the instructors on the desktop app were logged on to the computer along with time stamps. All tablet interactions on the WeDo application by the child were logged on to the Android tablets. We used a birds-eye view camera to record the video and audio of the interaction.</p>
<p>Two reviewers watched videos of the interaction and reported the creativity exhibited and the novelty of ideas. The reviewers were blind to the child&#x2019;s study condition as well as the hypotheses, but were familiar with the WeDo construction activity. We used the <italic>fluency</italic> of ideas, <italic>novelty</italic> of ideas, the Unusual Uses task (<xref ref-type="bibr" rid="B86">Silvia, 2011</xref>), and divergent thinking as bases for measuring creativity in this task. The following three behaviors were used as metrics of creativity:<list list-type="simple">
<list-item>
<p>1. <italic>Number of use cases for the rover.</italic> We counted the number of unique applications children came up with in the free exploration time as a measure of creativity. For instance, children utilized the toolkit robot&#x2019;s motion sensor and programmed an obstacle course, or used the waving of their hand to display their image. This measure is inspired by the <italic>fluency</italic> and originality of ideas measured (<xref ref-type="bibr" rid="B78">Runco and Acar, 2012</xref>), and was calculated by observing the video stream of the interaction.</p>
</list-item>
<list-item>
<p>2. <italic>Number of new programming blocks used.</italic> The instructions teach children how to use some blocks, such as the condition, motor, sensor, start and stop. Additionally, the WeDo programming interface has many different blocks that can be used in different ways, such as the image block, the sound block, other motor blocks, the text block, loops, etc. This measure is inspired by <italic>originality</italic> as a measure of creativity, and was calculated by analyzing the datalog of the tablet interactions.</p>
</list-item>
<list-item>
<p>3. <italic>Commonality.</italic> For each of the new use cases or application ideas of the rover, we determined how uncommon the idea was. We grouped and coded all ideas that were identical or similar, such as &#x201c;obstacle course&#x201d; and &#x201c;lego path.&#x201d; We then looked at the frequency of that idea in the data. For participants with multiple applications of the rover, we took an average of the two frequencies to report commonality. If an idea is uncommon, or deviates from the typical ideas of the group, they count as more creative (<xref ref-type="bibr" rid="B78">Runco and Acar, 2012</xref>). The frequencies of each application idea are inversely proportional to creativity. This measure is inspired by <italic>divergent thinking</italic> measures, which look at deviations from the group&#x2019;s trends.</p>
</list-item>
</list>
</p>
<p>For condition analysis, we calculated numerical values for each of the three metrics by coding the video recording of each interaction. We conducted the Shapiro-Wilk test to check for normal distribution of the data collected, and then conducted an unpaired <italic>t</italic>-test between the study conditions for each of these measures.</p>
</sec>
</sec>
<sec id="s6-4">
<title>Results</title>
<p>We tested for normality using the Kolmogorov-Smirnov test of normality on all three measures for both groups ({Number of ideas, number of new blocks, frequency of ideas}&#xd7;{C&#x2b;, C&#x2212;}). We found that none of the groups of data differed significantly from that which is normally distributed (<italic>p</italic>&#x20;&#x3d; 0.22, <italic>p</italic>&#x20;&#x3d; 0.57, <italic>p</italic>&#x20;&#x3d; 0.55, <italic>p</italic>&#x20;&#x3d; 0.36, <italic>p</italic>&#x20;&#x3d; 0.26, <italic>p</italic>&#x20;&#x3d; 0.053). Levene&#x2019;s test showed that the variances for the number of ideas were not equal, <italic>F</italic>(1,41) &#x3d; 7.96, <italic>p</italic>&#x20;&#x3d; 0.007, and the variances for number of new blocks, and frequency of ideas were equal, <italic>F</italic>(1,41) &#x3d; 0.312, <italic>p</italic>&#x20;&#x3d; 0.602 and F(1,41) &#x3d; 0.277, <italic>p</italic>&#x20;&#x3d; 0.579. For the number of ideas, we conducted the Welch&#x2019;s test assuming unequal variances, which revealed that participants expressed higher <italic>fluency</italic> by generating a significantly greater number of ideas for the rover (<italic>M</italic>&#x20;&#x3d; 1.42, <italic>SD</italic> &#x3d; 1.12, <italic>t</italic>(36) &#x3d; 1.688, <italic>p</italic>&#x20;&#x3d; 0.018). An unpaired parametric <italic>t</italic>-test revealed that participants in the C&#x2b; condition expressed significantly higher <italic>originality</italic> by using significantly more number of unique programming blocks (<italic>M</italic>&#x20;&#x3d; 5.40, <italic>SD</italic> &#x3d; 1.80, <italic>t</italic>(41) &#x3d; 1.682, <italic>p &#x3d; 0.013</italic>) in the C&#x2b; condition as compared to the C&#x2212; condition (<xref ref-type="table" rid="T5">Table&#x20;5</xref>; <xref ref-type="fig" rid="F8">Figure&#x20;8</xref>). While participants in the C&#x2b; condition demonstrated divergent thinking and found unusual uses of the same blocks by expressing less common ideas, or more novel ideas, than the C&#x2212; condition, this difference was not found to be statistically significant <italic>(M</italic> &#x3d; 1.02, <italic>SD</italic> &#x3d; 0.96, <italic>t</italic>(41) &#x3d; 1.68, <italic>p &#x3d; 0.076)</italic>. <italic>Creativity scaffolding</italic> offered by the robot influenced the number of ideas that children generated and the number of unique programming blocks used. Scaffolding offered by the robot led to more uncommon or atypical ideas by children, but the effect of scaffolding was not significant.</p>
<table-wrap id="T5" position="float">
<label>TABLE 5</label>
<caption>
<p>WeDo construction task results comparing the fluency and originality of idea, and divergent thinking expressed by participants in the three study groups.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">SG</th>
<th align="center">Number of ideas for the rover</th>
<th align="center">Number of new blocks</th>
<th align="center">Frequency of ideas</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">High creative robot (C&#x2b;) (n &#x003D; 23)</td>
<td align="center">1.74&#x20;&#xb1; 1.28</td>
<td align="center">5.96&#x20;&#xb1; 1.77</td>
<td align="center">0.82&#x20;&#xb1; 1.03</td>
</tr>
<tr>
<td align="left">Low creative robot (C&#x2212;) (n &#x003D; 20)</td>
<td align="center">1.05&#x20;&#xb1; 0.76</td>
<td align="center">4.75&#x20;&#xb1; 1.65</td>
<td align="center">1.21&#x20;&#xb1; 1.08</td>
</tr>
<tr>
<td align="left">
<italic>Result</italic>
</td>
<td align="center">
<italic>t</italic>(36) &#x3d; 1.688, <italic>p</italic>&#x20;&#x3d; 0.018</td>
<td align="center">
<italic>t</italic>(41) &#x3d; 1.682, <italic>p &#x3d; 0.013</italic>
</td>
<td align="center">
<italic>t</italic>(41) &#x3d; 1.68, <italic>p &#x3d; 0.076</italic>
</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>Participants in the High creative robot condition came up with a significantly higher number of ideas, and used a significantly higher number of programming blocks than the Low creative robot (C&#x2013;) condition.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption>
<p>Participants in the High creative robot condition (C&#x2b;) generated a significantly higher number of ideas than in the Low creative robot (C&#x2212;) condition (H1). Participants in the C&#x2b; condition used a significantly higher number of programming blocks than participants in the C&#x2212; condition (H2). There was no significant difference in the frequency of ideas generated in the two conditions (H3).</p>
</caption>
<graphic xlink:href="frobt-08-673730-g008.tif"/>
</fig>
<p>In addition to comparing participants&#x2019; creativity, we gained an insight into their perception of their creations and the robot&#x2019;s role as a collaborative peer through the post-test questionnaire.<list list-type="simple">
<list-item>
<p>Q1. Can you describe what you made today?</p>
</list-item>
</list>
</p>
<p>We asked participants to reflect on their creations, what they used and what they learned. One participant said, &#x201c;<italic>I made him drive, make music and show an image</italic>.&#x201d; Another participant said, &#x201c;<italic>I made a LEGO robot that when you put your hands to it it&#x2019;ll go back but without you touching it, and then I made a sensor and I made it make a noise</italic>.&#x201d; One participant said they made &#x201c;<italic>a spaghetti one-eyed snail cricket thing</italic>.&#x201d; These questions helped us unpack not only what their ideas were and which bricks they used, but also what their perceptions of their constructions were. Some participants also spoke about ideas they had but could not construct due to time constraints. One participant said, &#x201c;<italic>I wanted to make the rover move around and find all the walls, but there was no time</italic>.&#x201d; We also used participants&#x2019; narratives of what they made to match with the <italic>number of ideas</italic> metric that was reported by the blind reviewer.<list list-type="simple">
<list-item>
<p>Q2. Was Jibo helpful to you?&#x20;How?</p>
</list-item>
</list>
</p>
<p>Eighteen participants responded with &#x201c;yes, he was helpful.&#x201d; Nine participants provided no reasoning. Five participants said &#x201c;no&#x201d; (<italic>non-creativity scaffolding</italic> conditions). The most common reasoning response in both study conditions was that Jibo helped them construct the rover by providing instructions. Some participants in the creative condition pointed out how, &#x201c;<italic>Jibo had cool ideas</italic>&#x201d; and &#x201c;<italic>He helped me think of other uses for the sensors</italic>.&#x201d; Multiple participants pointed out how Jibo &#x201c;<italic>told me when I was doing well, or when he liked my ideas</italic>.&#x201d; Hence, children did notice the positive reinforcement provided by the scaffolding robot. One participant in the C&#x2212; condition said, &#x201c;<italic>He kind of was [helpful], but he&#x2019;s super rude. Because half the time I tried to say Jibo, can you help me? He will interrupt me with something else. I tried to say good morning but he didn&#x2019;t reply. it takes him a while to respond like he&#x2019;s not listening</italic>.&#x201d; This highlighted some technical difficulties such as speech delays in implementing this scaffolding model. We also learned that rapport-building utterances, such as greeting utterances in the beginning, can help the children establish common ground with the robot and also help them to get acquainted with speech delays.<list list-type="simple">
<list-item>
<p>Q3. How do you think Jibo can be of more help?</p>
</list-item>
</list>
</p>
<p>Participants had very valuable feedback about how to make the interaction better. The most common response from both robot conditions was that it would be nicer if the robot displays the blocks to be used on his screen, and that it is difficult to understand which block he is talking about using speech alone. Unlike a human instructor, Jibo cannot point, so visuals would be very helpful. One participant in the C&#x2212; condition said, &#x201c;<italic>He could have shown me other things that the rover can do</italic>.&#x201d; One participant in the C&#x2b; said, &#x201c;<italic>He could have told me what a microphone was</italic>.&#x201d; We observed that it is essential to unpack difficult terms that children might not have previously heard.<list list-type="simple">
<list-item>
<p>Q4. Do you think Jibo had any creative ideas?</p>
</list-item>
</list>
</p>
<p>79% of participants in the C&#x2b; condition, and 35% of participants in the C&#x2212; condition, responded with &#x201c;<italic>yes</italic>.&#x201d; Hence, participants successfully perceived the expressed creativity of the robot. Some participants went on to explain why they thought that Jibo was creative. One participant said, &#x201c;<italic>Yes, he told me to make the [rover] move and can put more than one thing on the screen.</italic>&#x201d; Another participant said, &#x201c;<italic>He had cool ideas like playing music. He played fun games with me and he had great ideas and he knows that he&#x2019;s smart</italic>.&#x201d; One participant also said, &#x201c;<italic>Jibo thought that I had cool ideas, and that made me happy</italic>&#x201d;, and another one said, &#x201c;<italic>Yes, he told me I can make what I want and told me my idea was great.</italic>&#x201d; Among participants that responded with &#x201c;<italic>No</italic>&#x201d; or &#x201c;<italic>Maybe</italic>&#x201d; there was typically no reasoning. One child in the C&#x2212; condition said, &#x201c;<italic>Jibo knew what to do but he was not really creative</italic>.&#x201d;</p>
</sec>
</sec>
<sec sec-type="discussion" id="s7">
<title>Discussion</title>
<p>In this work, we demonstrate how a social robotic peer&#x2019;s socio-behavioral patterns can influence creativity in children in the 5&#x2013;10&#xa0;yr old age group. Specifically, we highlight two robot interaction patterns: <italic>1</italic>) <italic>creativity demonstration</italic>, where the robot itself demonstrates artificial creativity, and <italic>2</italic>) <italic>creativity scaffolding</italic>, where the Jibo robot supports and encourages the child&#x2019;s creative thinking by asking reflective questions, providing challenges and positive reinforcements. We designed three game-based interactions that afforded different types of creativity. The robot&#x2019;s interaction patterns were inspired by children&#x2019;s creativity-eliciting social interactions with their peers and tutors. These interactions serve as playful ways of measuring creativity, as well as supporting children&#x2019;s creative expression. In order to assess the efficacy of these interaction patterns, we conducted an accompanying investigative study for each of our game-based interactions: the Droodle Creativity game that affords children&#x2019;s <italic>verbal</italic> creativity, the MagicDraw game that affords children&#x2019;s <italic>figural</italic> creativity, and the WeDo construction task that affords children&#x2019;s <italic>constructional</italic> creativity.</p>
<p>In the Droodle Creativity game, children emulated artificial verbal creativity exhibited by Jibo during gameplay. Participants who interacted with the high creative robot expressed more ideas, more diverse ideas, and highly creative ideas in the Droodle Creativity game, as compared to participants that interacted with the low creative robot. Similarly, in the Magic Draw Game, children emulated artificial figural creativity exhibited by Jibo in a co-drawing task, which led to their drawings being measured as more creative by the TCT-DP test for figural creativity. Participants also perceived the high creative robot as highly creative. Through these two studies, we verify our first hypothesis: that children adeptly socially emulate the creative behavior of peer-like robot playmates, and this in turn fosters children&#x2019;s own creative behavior. Importantly, this is a sufficiently robust enough finding that we could replicate it for two different kinds of creative expression: verbal and figural creativity.</p>
<p>In the second investigation, we demonstrated how a robot offering creativity scaffolding in the form of asking reflective questions, challenging the participants, and providing positive reinforcement had a positive effect on children&#x2019;s creativity. Participants engaged in an open-ended activity involving constructing and programming a rover using the WeDo construction kit. Creativity was measured by the ideas that children came up with for the rover, the number of different tools (programming bricks) they used, and how unique their ideas were. Children interacting with the robot that offered creativity scaffolding scored significantly higher on the number of different ideas and different programming bricks used. They also scored higher in the uniqueness of their ideas; however, that difference was not statistically significant. Hence, we could establish evidence that children can learn creativity from a social agent by emulating the agent&#x2019;s creative behaviors and by the agent scaffolding their creative learning, which informs the design of pedagogical embodied tools to foster creativity.</p>
<p>The WeDo construction task utilized a predictive scaffolding model. This paves the way toward the development of fully autonomous robot scaffolding systems for tailoring personalized learning to different students and contexts. Over time and over several playtests, the model is able to reinforce itself depending on whether the instructor accepts or rejects its suggestions, eventually leading to minimal error rates. Replicating a human instructors&#x2019; scaffolding into an artificial agent can be beneficial for personalized assistance when the teacher is not present or when there are many students per teacher. This scaffolding paradigm could be used in the context of other activities.</p>
<p>It is important to be wary of the shortcomings of such a suggestion based system for instructors. While these recommendations make it easy for instructors to provide help and scaffold children&#x2019;s creative learning, they also inhibit the instructor&#x2019;s original thought and manner of scaffolding, which holds high value. A more autonomous model would be built from data collected from multiple instructors with a diverse set of backgrounds and expertise, all of whom could instruct several students from a diverse set of backgrounds. Further, the model should be able to adapt based on an instructor&#x2019;s usage while allowing enough space for original thought. While the current interface does allow instructors to reject the model&#x2019;s recommendation and instead generate new Jibo utterances, it can still influence the instructors&#x2019; decision making process, and cause them to conform to commonly used instructions, which may be counterintuitive to promoting creativity. In our work we suggest two interaction patterns of social robots that effectively foster creativity in young children: creativity demonstration and creativity scaffolding using questions, questions and ideations. We position social robots as CSTs in collaborative activities with children that can leverage the benefits of having a co-located peer to create and socially interact with, and a digital CST that adapts to the person&#x2019;s creation style. We also add to the literature of HRI suggesting that children emulate a robot&#x2019;s learning behavior and extend it to verbal, figural and constructional creativity. Through our observations from playtests, iterative game design, study results and post-test questionnaires, we formulated evidence-based design guidelines as well as additional recommendations from researchers&#x2019; reflections for designing creativity supporting social agents that we have outlined in the next section. These recommendations could benefit pedagogical researchers, educators and HRI and HCI practitioners designing social agents for stimulating creativity, especially in children.</p>
<sec id="s7-1">
<title>Design Recommendations</title>
<sec id="s7-1-1">
<title>Evidence-based Design Guidelines</title>
<p>In this section, we suggest the following interaction design recommendations for social agents to support children&#x2019;s creativity based on our empirical findings:<list list-type="simple">
<list-item>
<p>1. The social agents should demonstrate the creativity behaviors that the designers aim to foster. We observed that children can learn verbal and figural creativity by emulating a social robot&#x2019;s creative behaviors across all three tasks. Hence, while designing social robots as pedagogical tools, we must ensure that they express the desired creative behavior that researchers aim to foster in children. The expression of creativity is context-dependent (such as generating creative drawings) and can be supported by social behaviors such as reflecting on the artifact generated, or making the creative process transparent through dialogue.</p>
</list-item>
<list-item>
<p>2. Make use of reflective questioning and challenges. Asking reflective questions about the children&#x2019;s actions aids their metacognition and creative thinking. Through the scaffolding study, we learned that instructors who were controlling the robot remotely chose to use many reflective questions as robot speech prompts to provide creativity scaffolding for children. Providing children with optimal levels of difficulty encouraged them to solve problems creatively. In the WeDo construction activity, the scaffolding robot provided challenges to the child, such as, &#x201c;Can you think of other uses of the same sensor?&#x201d; or &#x201c;Do you think that&#x2019;s the best way to do it?&#x201d; These questions were followed by students exploring creative uses of the objects beyond the first use that they imagined which encouraged flexibility. For instance, one child utilized the motion sensor&#x2019;s ability to detect motion and turn to create an obstacle path for her rover. We observed that children who interacted with the creativity scaffolding robot, which asked reflective questions, exhibited higher levels of creativity in the&#x20;task.</p>
</list-item>
<list-item>
<p>3. The agent should generate unique and frequent ideas during the interaction. In addition to asking reflective questions and posing challenges, the robot could also demonstrate new idea generation. During the WeDo task, when the robot suggested, &#x201c;You can use the picture icon to display images when the robot senses an object,&#x201d; the child subsequently used the feature to display the preset images. The child then uploaded their own image and made the rover move towards them. When the rover detected the child as the obstacle, it displayed the child&#x2019;s photograph. Children not only incorporated the robot&#x2019;s ideas, but also built upon them. In the Droodle Creativity game, we observed that the robot&#x2019;s idea generation behaviors were emulated by the child, both in terms of the fluency and originality of ideas generated.</p>
</list-item>
<list-item>
<p>4. Provide positive reinforcement to children when they create. Children in all three tasks commented how the robot said &#x201c;Good job!&#x201d; or other similar positive comments after they completed the task. Positive reinforcement after creative behaviors has a strong influence on children. Children often form relationships with social robots, which lead to increased learning gains (<xref ref-type="bibr" rid="B89">Westlund et&#x20;al., 2018</xref>) and getting positive validation upon exhibition of creativity encourages them to be more creative.</p>
</list-item>
</list>
</p>
</sec>
<sec id="s7-1-2">
<title>Additional Recommendations From Researcher&#x2019;s Reflections</title>
<p>We incorporated several design principles from background research in CSTs and iteratively designing our child-robot interactions. While we found these design decisions to be beneficial for children&#x2019;s creativity and had a positive combined effect, we did not analyze the effectiveness of each of these recommendations, and future work is required to disambiguate individual effectiveness. We present these as additional design recommendations for designing creativity scaffolding interventions for children:<list list-type="simple">
<list-item>
<p>1. Co-design interactions with instructors. Co-designing scaffolding robot interactions with instructors helped us personalize interactions for the students, and incorporate instructors&#x2019; teaching experience into the robot&#x2019;s behaviors. Instructors were particularly helpful in designing the interaction GUI; while the pre-set GUI speech prompts were grounded in historic scaffolding commands used by other instructors, we found that teachers often needed to personalize interactions during unique occurrences. Having the option of typing new commands in the GUI text-box afforded instructors that flexibility. This hybrid interface equipped teachers with historically useful commands, reducing their cognitive load during the task, and gave them the ability to create their&#x20;own.</p>
</list-item>
<list-item>
<p>2. Scaffolding must be grounded in tasks and materials. In the creativity scaffolding task, we started with providing teachers with generic scaffolding prompts such as &#x201c;What else can you make?&#x201d; or &#x201c;What is another way to do that?&#x201d; However, teachers provided us with feedback that the scaffolding prompts needed to be specific to the task (construction) and materials (blocks). For instance, they used the prompt, &#x201c;How else can you use that sensor to make the rover move?&#x201d; This grounding in the collaborative task portrayed the robot as a context-aware scaffolding agent. Hence, while designing scaffolding interactions such as challenges or reflective questions, we found it beneficial to ground the interactions in the task&#x2019;s context instead of generic interactions. However, this reduces the scalability of these interactions across&#x20;tasks.</p>
</list-item>
<list-item>
<p>3. Agents must scaffold, but not impose. Scaffolding through social interactions can be powerful but has the potential to inhibit creativity. Interactions such as idea generation in collaborative tasks must be designed such that the agent does not impose their ideas on the child, nor intrude upon the children&#x2019;s creative space. For instance, in the WeDo scaffolding tasks, we observed that teachers who controlled the robot suggested ideas related to the child&#x2019;s working idea, and while the child worked on an idea, they did not interfere. This delicate scaffolding can be a challenge to execute in fully autonomous interactions. Providing scaffolding only when the child asks, or when the child is stuck, could be a beneficial approach. Further, care should be taken to not interrupt children&#x2019;s creative process; in the MagicDraw interaction, where players had a fixed time to draw for each turn, one participant reported displeasure for the robot interrupting their drawing.</p>
</list-item>
<list-item>
<p>4. Design game-based interactions with peer-like social agents. Designing game-based child-robot interactions enabled us to position the robot as a collaborative playful peer. This made the interaction fun for children as reported in the post-test, and children were engaged throughout the games. We designed game tasks with no fail state in order to provide an outlet for unconstrained creative thinking and encourage divergent thinking. Since assessment is shown to hinder creativity, we refrained from providing any assessment during the interaction. Game-like interactions made the tasks engaging for young children and allowed for a safe space for failure.</p>
</list-item>
<list-item>
<p>5. Center task around creation of artifacts. In order to maximize space for creative thinking, we designed the tasks around the creation of artifacts rather than the completion of a specific deliverable. In accordance with literature showing evaluation&#x2019;s negative effect on creativity, these artifacts were designed to have no set of &#x201c;correct&#x201d; answers, supporting creative exploration without an end goal. To ground robotic scaffolding in the context of the task, we provided a limited set of materials that can be used creatively to produce an unlimited number of artifacts. For instance, in the WeDo construction task, one student wanted to create two rovers but was limited to one controller. They wired the sensor of the second rover from the first rover&#x2019;s controller and called it a &#x201c;parasite&#x201d;&#x20;rover.</p>
</list-item>
<list-item>
<p>6. Leverage collaboration as an agent behavior and game mechanic. Since collaboration has a positive influence on creativity, we must ensure that the child-agent interactions are collaborative in nature and the robot acts as a collaborative peer instead of a competitive one, which hinders creativity in children. The collaborative nature of the interaction was made explicit in robot speech, such as, &#x201c;Today we will program a robot together.&#x201d; Within our tasks, we framed the social robot agent as a peer helping the child do their best creative work, and the majority of children perceived Jibo as a collaborator rather than a competitor. Collaboration is among the most prominent social factors that positively influence creativity. Careful consideration must be given to interactions with the agent in particular, in order to ensure that children see it as a partner rather than as a competitor, which can hinder their creativity. Introduction of the robot and the task can be leveraged to position the robot as a collaborative&#x20;peer.</p>
</list-item>
</list>
</p>
</sec>
</sec>
</sec>
<sec sec-type="conclusion" id="s8">
<title>Conclusion</title>
<p>In this work, we posit social robots as CSTs for children in collaborative tasks. We studied the effects of an autonomous social robot&#x2019;s verbal and nonverbal interactions on children&#x2019;s creativity as measured by three collaborative game-based child-robot interactions. We observed that both creativity demonstration and creativity scaffolding offered by the social robot had a positive effect on children&#x2019;s creativity in verbal, figural and constructional creativity tasks. This work contributes to the design of game-based child-robot interactions that afford creativity, provides evidence for the efficacy of these interactions and provides guidelines for designing social embodied agents to foster creativity in young children. These findings are valuable to game designers creating game-based interactions to foster children&#x2019;s creativity, as well as HRI and HCI practitioners leveraging social agents as&#x20;CSTs.</p>
<p>Since robots are already being used in classroom settings as learning peers and personalized tutors, it is imperative to think about how their behaviors can influence children&#x2019;s learning behaviors, such as creative thinking. While social robots are not the only way to provide creativity support through behavioral modeling, they certainly are a compelling way given their social nature. Effort must go into designing the agents&#x2019; behavior such that they exhibit creativity and scaffold the child&#x2019;s creativity as a peer or a tutor. Embodied AI agents have the potential to use generative modeling techniques to express different forms of creativity through generating media such as drawing, poetry, art styles, patterns, physical body movements, etc. They are also socially emotive and can express the social interactions that accompany creativity such as reflection, inquisitiveness and positive affect. This work opens up opportunities to explore how these different forms of artificial creativity can be embedded into tools that children use and interact with, and help them be more creative.</p>
<p>Recent works have demonstrated how robots can help creativity, as a co-present partner and through social interactions. In this work, we suggest two interaction patterns of social robots that we observed to effectively foster creativity in young children: creativity demonstration and creativity scaffolding using questions, questions and ideations. We add to the literature of HRI suggesting that children emulate robots&#x2019; learning behaviors, and that this phenomenon extends to creativity. We also contribute to the field of Creativity Support Tools by positioning social peer-like robots as a creativity support peer in collaborative activities. This contribution is not only valuable for HRI practitioners, but also other interactive AI agents, such as conversational agents. Creativity supporting social robots combine the benefits of having a co-located peer to collaboratively create with and socially interact with, and a digital CST that adapts to the user&#x2019;s creation style. Leveraging generative AI models now allow for expressing creativity in several modalities, which robots can successively leverage. Further, we elaborate the design of a scaffolding mechanism by learning from human scaffolders through one construction activity. This approach can be generalized to other activities.</p>
<p>While introducing an extrinsic factor in the form of a social robot, we must ensure that it does not come across as an evaluator; classroom research has demonstrated how extrinsic factors such as evaluation, competition and unrealistic expectations can potentially inhibit creativity, instead of fostering it (<xref ref-type="bibr" rid="B97">Torrance, 1967</xref>). In the scaffolding GUI design, we provide instructors with a predictive interface that helps them scaffold the child for creative learning; however, this suggestion model also limits creativity and personalization of teaching style from the instructors. To tackle this issue, we must also aim to build personalized scaffolding models that take input from every teacher and personalize over time in both the content and style of learning.</p>
<p>In our work, we chose a wide age range (5&#x2013;10&#xa0;yr) and we did not analyze differences across age ranges. This is a limitation of the current work, and future analysis needs to be run with narrower age ranges to determine the efficacy of the intervention on different age groups. Another limitation of this work is that these robot interactions lead to an increase in creativity within the narrow constructs of these tasks, and may not scale to every creative task, or to students&#x2019; life outside of these tasks. There are also countless ways of expressing creativity such as poetry, storytelling, painting, music, etc., that are not explored in these tasks. This work also defines a limited scope of creativity in terms of fluency, novelty and value of ideation. Creativity encompasses a much wider array of behaviors (such as divergent thinking) that can be explored using other interactions. Furthermore, while all these interactions currently focus on one-on-one child-robot interaction, we must strive towards designing interactions that involve multiple children because collaboration with peers forms a major part of creative learning.</p>
<p>Finally, while this work evaluates the role of the robot&#x2019;s creativity fostering behaviors, it does not evaluate the benefits of embodiment over other non-embodied agents such as computers or voice agents. Previous research has found that adults did not show significant gains in creativity merely in the presence of a social robot (<xref ref-type="bibr" rid="B8">Alves-Oliveira et&#x20;al., 2019</xref>). In future work, we aim to study the combined effect of embodiment and creativity scaffolding behaviors by running a 2&#x20;&#xd7; 2 study ({embodied, non-embodied}&#xd7;{scaffolding, non-scaffolding}) (<xref ref-type="bibr" rid="B27">Devasia et&#x20;al., 2020</xref>). In order to evaluate whether robots are really that social, future work is required to assess the creativity effects of human peers vs robots.</p>
<p>While this work makes use of Jibo as the social agent, these interactions are learning tools that can foster creativity in classrooms and homes independent of Jibo. These games also serve as game-based creativity assessment measures.</p>
<p>We designed a creativity scaffolding paradigm for the WeDo construction task. This model currently supports a semi-autonomous scaffolding system, where a human controls the robot using a remote control desktop program. In the current version of the robot control interface, which lets instructors control the robot remotely, we can incorporate ASR to use the instructors&#x2019; speech to control the robot&#x2019;s speech. Moreover, collecting more data about how instructors use the program can help us build a fully autonomous model of scaffolding. While this approach can be used to design interactions for an autonomous or semi-autonomous system, the timing of the interactions and during-study improvisation are reliant on children&#x2019;s actions in the task and interactions with the robot. Current status of natural language understanding and computer vision limit a complex understanding on the scene, and hence a similar fidelity of robotic interactions are challenging to currently implement in a fully autonomous system. However, as we demonstrated, a semi autonomous system (where the system suggests interactions and the human decides the timing of the prompts) is feasible.</p>
<p>Another limitation of this work is that all activities are self-contained and involve single interactions. In future work, it would be valuable to evaluate creativity transfer from one activity to another, and even in the absence of the robot in the long-term. Design recommendations from this work can be incorporated in several creativity support tools such as computer games, voice agents, tablet apps, embodied tools, space design, etc. Finally, advances in generative modeling techniques enable us to create child-robot interactions supporting multiple modalities of autonomous creative expression.</p>
</sec>
</body>
<back>
<sec id="s9">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s10">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Massachusetts Institute of Technology Institute Review Board (IRB). Written informed consent to participate in this study was provided by the participants&#x2019; legal guardian/next of kin. Written informed consent was obtained from the individual(s), and minor(s)&#x2019; legal guardian/next of kin, for the publication of any potentially identifiable images or data included in this article.</p>
</sec>
<sec id="s11">
<title>Author Contributions</title>
<p>SA designed the child-robot interactions, conducted the user study, evaluated the data and wrote about the findings. ND assisted in conducting the study and writing about the findings. HP and CB were advisors for interaction and study design, and evaluation of the data collected.</p>
</sec>
<sec id="s12">
<title>Funding</title>
<p>This work is funded by the MIT Media Lab Consortia&#x20;fund.</p>
</sec>
<sec sec-type="COI-statement" id="s13">
<title>Conflict of Interest</title>
<p>The reviewer (KF) declared a past co-authorship with one of the authors (CB) to the handling Editor.</p>
</sec>
<sec id="s14" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ack>
<p>We would like to thank the students and teachers of Somerville Public Schools for their participation in this study. We would also like to thank Ellie Hoban, Randi Williams, Tyler Moroso and Marwa AlAlawi for helping us conduct studies and collect&#x20;data.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Adamson</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Ghose</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Yasuda</surname>
<given-names>S. C.</given-names>
</name>
<name>
<surname>Shepard</surname>
<given-names>L. J.&#x20;S.</given-names>
</name>
<name>
<surname>Lewkowicz</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Duan</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). &#x201c;<article-title>Why We Should Build Robots that Both Teach and Learn</article-title>,&#x201d; in <conf-name>Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (HRI &#x2019;21)</conf-name>, <conf-loc>Boulder, CO</conf-loc>, <conf-date>March 8&#x2013;11, 2021</conf-date>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://scazlab.yale.edu/sites/default/files/files/hrifp1028-adamsonA.pdf">https://scazlab.yale.edu/sites/default/files/files/hrifp1028-adamsonA.pdf</ext-link>
</comment>. <pub-id pub-id-type="doi">10.1145/3434073.3444647</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ali</surname>
<given-names>S. A.</given-names>
</name>
</person-group> (<year>2019</year>). <source>Designing Child Robot Interaction for Facilitating Creative Learning</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Massachusetts Institute of Technology</publisher-name>.</citation>
</ref>
<ref id="B3">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ali</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Moroso</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Can Children Learn Creativity from a Social Robot?</article-title>,&#x201d; in <conf-name>Proceedings of the 2019 on Creativity and Cognition</conf-name>, (<conf-loc>San Diego, CA</conf-loc>: <publisher-name>IEEE</publisher-name>), <fpage>359</fpage>&#x2013;<lpage>368</lpage>. </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ali</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>A Social Robot&#x2019;s Influence on Children&#x2019;s Figural Creativity during Gameplay</article-title>. <source>Int. J.&#x20;Child-Computer Interaction</source> <volume>28</volume> (<issue>100234</issue>), <fpage>100234</fpage>. <pub-id pub-id-type="doi">10.1016/j.ijcci.2020.100234</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ali</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Can Children Emulate a Robotic Non-player Character&#x2019;s Figural Creativity?</article-title>&#x201d; in <conf-name>Proceedings of the Annual Symposium on Computer-Human Interaction in Play</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>499</fpage>&#x2013;<lpage>509</lpage>. <pub-id pub-id-type="doi">10.1145/3410404.3414251</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Alimisis</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Educational Robotics: Open Questions and New Challenges</article-title>. <source>Themes Sci. Tech. Edu.</source> <volume>6</volume> (<issue>1</issue>), <fpage>63</fpage>&#x2013;<lpage>71</lpage>. </citation>
</ref>
<ref id="B7">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Alves-Oliveira</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Arriaga</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Cronin</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Paiva</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Creativity Encounters Between Children and Robots</article-title>,&#x201d; in <conf-name>Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (HRI &#x2019;20)</conf-name>, <conf-loc>Cambridge, UK</conf-loc>, <conf-date>March 23&#x2013;26, 2020</conf-date>. (<publisher-name>IEEE</publisher-name>), <fpage>379</fpage>&#x2013;<lpage>388</lpage>. <pub-id pub-id-type="doi">10.1145/3319502.3374817</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Alves-Oliveira</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Tulli</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Wilken</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Merhej</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Gandum</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Sparking Creativity with Robots: A Design Perspective</article-title>. <comment>OSF [Preprint]. Available at: <ext-link ext-link-type="uri" xlink:href="https://osf.io/preprints/za5h8/">https://osf.io/preprints/za5h8/</ext-link> (Accessed October 20, 2019)</comment>. </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Amabile</surname>
<given-names>T. M.</given-names>
</name>
<name>
<surname>Gryskiewicz</surname>
<given-names>N. D.</given-names>
</name>
</person-group> (<year>1989</year>). <article-title>The Creative Environment Scales: Work Environment Inventory</article-title>. <source>Creativity Res. J.</source> <volume>2</volume> (<issue>4</issue>), <fpage>231</fpage>&#x2013;<lpage>253</lpage>. <pub-id pub-id-type="doi">10.1080/10400418909534321</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="web">
<collab>Anki</collab> (<year>1999</year>). <article-title>Cozmo</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.anki.com/en-us/cozmo">https://www.anki.com/en-us/cozmo</ext-link> (Accessed February 21, 2021)</comment>. </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baas</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>De Dreu</surname>
<given-names>C. K. W.</given-names>
</name>
<name>
<surname>Nijstad</surname>
<given-names>B. A.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>A Meta-Analysis of 25&#x20;Years of Mood-Creativity Research: Hedonic Tone, Activation, or Regulatory Focus?</article-title> <source>Psychol. Bull.</source> <volume>134</volume> (<issue>6</issue>), <fpage>779</fpage>&#x2013;<lpage>806</lpage>. <pub-id pub-id-type="doi">10.1037/a0012815</pub-id> </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baggerly</surname>
<given-names>J.&#x20;N.</given-names>
</name>
</person-group> (<year>1999</year>). <article-title>Adjustment of Kindergarten Children through Play Sessions Facilitated by Fifth Grade Students Trained in Child-Centered Play Therapy Procedures and Skills</article-title>. <comment>Dissertation</comment> (<publisher-loc>Denton, TX</publisher-loc>). </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Ramachandran</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Scassellati</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Tanaka</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Social Robots for Education: A Review</article-title>. <source>Sci. Robot.</source> <volume>3</volume> (<issue>21</issue>), <fpage>eaat5954</fpage>. <pub-id pub-id-type="doi">10.1126/scirobotics.aat5954</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Berretta</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Privette</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>1990</year>). <article-title>Influence of Play on Creative Thinking</article-title>. <source>Percept Mot. Skills</source> <volume>71</volume> (<issue>2</issue>), <fpage>659</fpage>&#x2013;<lpage>666</lpage>. <pub-id pub-id-type="doi">10.2466/pms.1990.71.2.659</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Boden</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2004</year>). <source>The Creative Mind: Myths and Mechanisms</source>. <publisher-loc>London and New York</publisher-loc>: <publisher-name>Routledge</publisher-name>.</citation>
</ref>
<ref id="B19">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bornstein</surname>
<given-names>M. H.</given-names>
</name>
<name>
<surname>Bruner</surname>
<given-names>J.&#x20;S.</given-names>
</name>
</person-group> (<year>2014</year>). <source>Interaction in Human Development</source>. <publisher-loc>London and New York</publisher-loc>: <publisher-name>Psychology Press</publisher-name>.</citation>
</ref>
<ref id="B20">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bowman</surname>
<given-names>N. D.</given-names>
</name>
<name>
<surname>Kowert</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ferguson</surname>
<given-names>C. J.</given-names>
</name>
</person-group> (<year>2015</year>). &#x201c;<article-title>The Impact of Video Game Play on Human (And Orc) Creativity</article-title>,&#x201d; in <source>Video Games and Creativity</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Green</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Kaufman</surname>
<given-names>J.&#x20;C.</given-names>
</name>
</person-group> (<publisher-name>Academic Press</publisher-name>), <fpage>41</fpage>&#x2013;<lpage>56</lpage>. <pub-id pub-id-type="doi">10.1016/b978-0-12-801462-2.00002-3</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Carterette</surname>
<given-names>E. C.</given-names>
</name>
<name>
<surname>Friedman</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Miller</surname>
<given-names>J.&#x20;L.</given-names>
</name>
<name>
<surname>Eimas</surname>
<given-names>P. D.</given-names>
</name>
</person-group> (<year>1994</year>). <source>Handbook of Perception and Cognition</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Academic Press</publisher-name>.</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Teaching and Learning with Children: Impact of Reciprocal Peer Learning with a Social Robot on Children&#x27;s Learning and Emotive Engagement</article-title>. <source>Comput. Edu.</source> <volume>150</volume>, <fpage>103836</fpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2020.103836</pub-id> </citation>
</ref>
<ref id="B96">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Claxton</surname>
<given-names>A. F.</given-names>
</name>
<name>
<surname>Pannells</surname>
<given-names>T. C.</given-names>
</name>
<name>
<surname>Rhoads</surname>
<given-names>P. A.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Developmental trends in the creativity of school-age children</article-title>. <source>Creativity Res. J.</source> <volume>17</volume> (<issue>4</issue>), <fpage>327</fpage>&#x2013;<lpage>335</lpage>. </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dansky</surname>
<given-names>J.&#x20;L.</given-names>
</name>
</person-group> (<year>1980</year>). <article-title>Make-Believe: A Mediator of the Relationship between Play and Associative Fluency</article-title>. <source>Child. Dev.</source> <volume>51</volume>, <fpage>576</fpage>&#x2013;<lpage>579</lpage>. <pub-id pub-id-type="doi">10.2307/1129296</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Devasia</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Ali</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Escape! Bot: Child-Robot Interaction to Promote Creative Expression During Gameplay</article-title>,&#x201d; in <conf-name>Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY &#x2019;20)</conf-name>, <fpage>219</fpage>&#x2013;<lpage>223</lpage>. <pub-id pub-id-type="doi">10.1145/3383668.3419895</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Duncan</surname>
<given-names>S. C.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Minecraft, beyond construction and survival. Well Played: a journal on video games, value and meaning. 1:1</article-title>. <publisher-loc>Pittsburgh, PA</publisher-loc>. </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ericsson</surname>
<given-names>K. A.</given-names>
</name>
<name>
<surname>Simon</surname>
<given-names>H. A.</given-names>
</name>
</person-group> (<year>1980</year>). <article-title>Verbal Reports as Data</article-title>. <source>Psychol. Rev.</source> <volume>87</volume> (<issue>3</issue>), <fpage>215</fpage>&#x2013;<lpage>251</lpage>. <pub-id pub-id-type="doi">10.1037/0033-295x.87.3.215</pub-id> </citation>
</ref>
<ref id="B31">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Frich</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>MacDonald Vermeulen</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Remy</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Biskjaer</surname>
<given-names>M. M.</given-names>
</name>
<name>
<surname>Dalsgaard</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Mapping the Landscape of Creativity Support Tools in HCI</article-title>,&#x201d; in <conf-name>Proceedings of CHI Conference on Human Factors in Computing Systems (CHI &#x2019;19)</conf-name>, <conf-loc>Glasgow, UK</conf-loc>, <conf-date>May 4&#x2013;9, 2019</conf-date>. (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1145/3290605.3300619</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Garaigordobil</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Intervention in Creativity with Children Aged 10 and 11&#x20;years: Impact of a Play Program on Verbal and Graphic-Figural Creativity</article-title>. <source>Creativity Res. J.</source> <volume>18</volume> (<issue>3</issue>), <fpage>329</fpage>&#x2013;<lpage>345</lpage>. <pub-id pub-id-type="doi">10.1207/s15326934crj1803_8</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Gardner</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Art</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>1982</year>). <source>Brain: A Cognitive Approach to Creativity</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Basic Books</publisher-name>.</citation>
</ref>
<ref id="B34">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Ge</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Goswami</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Zitnick</surname>
<given-names>C. L.</given-names>
</name>
<name>
<surname>Parikh</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Creative Sketch Generation</article-title>. <publisher-loc>Vienna, Austria</publisher-loc>. </citation>
</ref>
<ref id="B36">
<citation citation-type="web">
<collab>Google</collab> (<year>2020</year>). <article-title>Google</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://cloud.google.com/speech-to-text/">https://cloud.google.com/speech-to-text/</ext-link>
</comment>. </citation>
</ref>
<ref id="B37">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Gordon</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Engel</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2015</year>). &#x201c;<article-title>Can Children Catch Curiosity from a Social Robot?</article-title>&#x201d; in <conf-name>HRI&#x2019;15: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction</conf-name> (<publisher-name>Portland, OR: IEEE</publisher-name>), <fpage>91</fpage>&#x2013;<lpage>98</lpage>. </citation>
</ref>
<ref id="B38">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Guilford</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>1950</year>). <source>Creativity</source>. <publisher-name>American Psychology</publisher-name>. <volume>5</volume> (<issue>9</issue>), <fpage>444</fpage>&#x2013;<lpage>454</lpage>. <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://doi.org/10.1037/h0063487">https://doi.org/10.1037/h0063487</ext-link> </citation>
</ref>
<ref id="B39">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Guilford</surname>
<given-names>J.&#x20;P.</given-names>
</name>
</person-group> (<year>1957</year>). <article-title>Creative Abilities in the Arts</article-title>. <source>Psychol. Rev.</source> <volume>64</volume> (<issue>2</issue>), <fpage>110</fpage>&#x2013;<lpage>118</lpage>. <pub-id pub-id-type="doi">10.1037/h0048280</pub-id> </citation>
</ref>
<ref id="B40">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Ha</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Eck</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>A Neural Representation of Sketch Drawings</article-title>. <comment>arXiv [Preprint]. Available at: <ext-link ext-link-type="uri" xlink:href="http://arxiv.org/abs/1704.03477">http://arxiv.org/abs/1704.03477</ext-link>
</comment>. </citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hallgren</surname>
<given-names>K. A.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Computing Inter-rater Reliability for Observational Data: An Overview and Tutorial</article-title>. <source>Tqmp</source> <volume>8</volume> (<issue>1</issue>), <fpage>23</fpage>&#x2013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.20982/tqmp.08.1.p023</pub-id> </citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Halverson</surname>
<given-names>E. R.</given-names>
</name>
<name>
<surname>Sheridan</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>The Maker Movement in Education</article-title>. <source>Harv. Educ. Rev.</source> <volume>84</volume> (<issue>4</issue>), <fpage>495</fpage>&#x2013;<lpage>504</lpage>. <pub-id pub-id-type="doi">10.17763/haer.84.4.34j1g68140382063</pub-id> </citation>
</ref>
<ref id="B43">
<citation citation-type="web">
<person-group person-group-type="author">
<name>
<surname>Harel</surname>
<given-names>I. E.</given-names>
</name>
<name>
<surname>Papert</surname>
<given-names>S. E.</given-names>
</name>
</person-group> (<year>1991</year>). <article-title>Constructionism</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://psycnet.apa.org/fulltext/1991-99006-000.pdf">https://psycnet.apa.org/fulltext/1991-99006-000.pdf</ext-link>
</comment>. </citation>
</ref>
<ref id="B44">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Henriksen</surname>
<given-names>T. D.</given-names>
</name>
</person-group> (<year>2006</year>). &#x201c;<article-title>Games and Creativity Learning</article-title>,&#x201d; in <source>Role, Play, Art: Collected Experiences of Role-Playing</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Fritzon</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Wrigstad</surname>
<given-names>T.</given-names>
</name>
</person-group> (<publisher-loc>Stockholm, Sweden</publisher-loc>: <publisher-name>F&#xf6;reningen Knutpunkt</publisher-name>), <fpage>3</fpage>&#x2013;<lpage>15</lpage>. </citation>
</ref>
<ref id="B45">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Howard-Jones</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Taylor</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Sutton</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>The Effect of Play on the Creativity of Young Children during Subsequent Activity</article-title>. <source>Early Child. Dev. Care</source> <volume>172</volume> (<issue>4</issue>), <fpage>323</fpage>&#x2013;<lpage>328</lpage>. <pub-id pub-id-type="doi">10.1080/03004430212722</pub-id> </citation>
</ref>
<ref id="B48">
<citation citation-type="book">
<collab>Jibo</collab> (<year>2015</year>). <source>jibo.com</source>.</citation>
</ref>
<ref id="B51">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kafai</surname>
<given-names>Y. B.</given-names>
</name>
</person-group> (<year>1995</year>). <source>Minds in Play: Computer Game Design as a Context for Children&#x2019;s Learning</source>. <publisher-name>Hillsdale, NJUnited States: L. Erlbaum Associates Inc.</publisher-name>.</citation>
</ref>
<ref id="B52">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kahn</surname>
<given-names>P. H.</given-names>
<suffix>Jr</suffix>
</name>
<name>
<surname>Friedman</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Severson</surname>
<given-names>R. L.</given-names>
</name>
<name>
<surname>Feldman</surname>
<given-names>E. N.</given-names>
</name>
</person-group> (<year>2005</year>). <source>Creativity Tasks and Coding System-Uused in the Plasma Display Window Study</source>. <publisher-loc>Seattle, WA</publisher-loc>: <publisher-name>University of Washington</publisher-name>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.researchgate.net/profile/Rachel_Severson/publication/33513295_Creativity_Tasks_and_Coding_System_--_Used_in_the_Plasma_Display_Window_Study/links/560d746608ae96742010cd80.pdf">https://www.researchgate.net/profile/Rachel_Severson/publication/33513295_Creativity_Tasks_and_Coding_System_--_Used_in_the_Plasma_Display_Window_Study/links/560d746608ae96742010cd80.pdf</ext-link>
</comment>.</citation>
</ref>
<ref id="B53">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kahn</surname>
<given-names>P. H.</given-names>
</name>
<name>
<surname>Kanda</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Ishiguro</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Gill</surname>
<given-names>B. T.</given-names>
</name>
<name>
<surname>Shen</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Ruckert</surname>
<given-names>J.&#x20;H.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). &#x201c;<article-title>Human Creativity Can Be Facilitated through Interacting with a Social Robot</article-title>,&#x201d; in <conf-name>2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)</conf-name>, <conf-loc>Christchurch, New&#x20;Zealand</conf-loc>, <conf-date>March 7&#x2013;10, 2016</conf-date>. (<publisher-name>IEEE</publisher-name>), <fpage>173</fpage>&#x2013;<lpage>180</lpage>. <pub-id pub-id-type="doi">10.1109/HRI.2016.7451749</pub-id> </citation>
</ref>
<ref id="B54">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kaufman</surname>
<given-names>J.&#x20;C.</given-names>
</name>
<name>
<surname>Sternberg</surname>
<given-names>R. J.</given-names>
</name>
</person-group> (<year>2010</year>). <source>The Cambridge Handbook of Creativity</source>. <publisher-loc>Cambridge, UK</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation>
</ref>
<ref id="B55">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kim</surname>
<given-names>H. J.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>J.&#x20;H.</given-names>
</name>
<name>
<surname>Yoo</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Fostering Creativity in Tablet-Based Interactive Classrooms</article-title>. <source>J.&#x20;Educ. Tech. Soc.</source> <volume>19</volume> (<issue>3</issue>), <fpage>207</fpage>&#x2013;<lpage>220</lpage>. </citation>
</ref>
<ref id="B60">
<citation citation-type="web">
<collab>LEGO Education WeDo 2.0 Core Set</collab> (<year>2020</year>). <article-title>LEGO</article-title>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://education.lego.com/en-us/products/lego-education-wedo-2-0-core-set/45300#wedo-20">https://education.lego.com/en-us/products/lego-education-wedo-2-0-core-set/45300&#x23;wedo-20</ext-link>
</comment>. (Accessed February 21, 2021). </citation>
</ref>
<ref id="B61">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ligthart</surname>
<given-names>M. E. U.</given-names>
</name>
<name>
<surname>Neerincx</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Koen</surname>
<given-names>V.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Design Patterns for an Interactive Storytelling Robot to Support Children&#x2019;s Engagement and Agency</article-title>,&#x201d; in <conf-name>Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United&#x20;Kingdom) (HRI &#x2019;20)</conf-name> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>), <fpage>409</fpage>&#x2013;<lpage>418</lpage>. <pub-id pub-id-type="doi">10.1145/3319502.3374826</pub-id> </citation>
</ref>
<ref id="B62">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Louis</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Peter</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2015</year>). &#x201c;<article-title>Face the Music and Glance: How Nonverbal Behaviour Aids Human Robot Relationships Basedin Music</article-title>,&#x201d; in <conf-name>Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (Portland, Oregon, USA) (HRI &#x2019;15)</conf-name> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>), <fpage>237</fpage>&#x2013;<lpage>244</lpage>. </citation>
</ref>
<ref id="B63">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>MacDonald</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Miell</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Morgan</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>Social Processes and Creative Collaboration in Children</article-title>. <source>Eur. J.&#x20;Psychol. Educ.</source> <volume>15</volume> (<issue>4</issue>), <fpage>405</fpage>&#x2013;<lpage>415</lpage>. <pub-id pub-id-type="doi">10.1007/bf03172984</pub-id> </citation>
</ref>
<ref id="B64">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mellou</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>1995</year>). <article-title>Review of the Relationship between Dramatic Play and Creativity in Young Children</article-title>. <source>Early Child. Dev. Care</source> <volume>112</volume> (<issue>1</issue>), <fpage>85</fpage>&#x2013;<lpage>107</lpage>. <pub-id pub-id-type="doi">10.1080/0300443951120108</pub-id> </citation>
</ref>
<ref id="B65">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Miell</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>MacDonald</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>Children&#x27;s Creative Collaborations: The Importance of Friendship when Working Together on a Musical Composition</article-title>. <source>Soc. Dev.</source> <volume>9</volume> (<issue>3</issue>), <fpage>348</fpage>&#x2013;<lpage>369</lpage>. <pub-id pub-id-type="doi">10.1111/1467-9507.00130</pub-id> </citation>
</ref>
<ref id="B66">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mioduser</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Levy</surname>
<given-names>S. T.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Making Sense by Building Sense: Kindergarten Children&#x27;s Construction and Understanding of Adaptive Robot Behaviors</article-title>. <source>Int. J.&#x20;Comput. Math. Learn.</source> <volume>15</volume> (<issue>2</issue>), <fpage>99</fpage>&#x2013;<lpage>127</lpage>. <pub-id pub-id-type="doi">10.1007/s10758-010-9163-9</pub-id> </citation>
</ref>
<ref id="B67">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mumford</surname>
<given-names>M. D.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Something Old, Something New: Revisiting Guilford&#x27;s Conception of Creative Problem Solving</article-title>. <source>Creativity Res. J.</source> <volume>13</volume> (<issue>3-4</issue>), <fpage>267</fpage>&#x2013;<lpage>276</lpage>. <pub-id pub-id-type="doi">10.4324/9781410608604-4</pub-id> </citation>
</ref>
<ref id="B68">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Rosenberg-Kima</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Rosenberg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gordon</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Growing Growth Mindset with a Social Robot Peer</article-title>,&#x201d; in <conf-name>Proceedings of the ACM SIGCHI</conf-name> (<publisher-loc>Vienna, Austria</publisher-loc>: <publisher-name>ACM Conference on Human-Robot Interaction</publisher-name>), <fpage>137</fpage>&#x2013;<lpage>145</lpage>. <pub-id pub-id-type="doi">10.1145/2909824.3020213</pub-id> </citation>
</ref>
<ref id="B69">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Plucker</surname>
<given-names>J.&#x20;A.</given-names>
</name>
<name>
<surname>Beghetto</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Dow</surname>
<given-names>G. T.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Why Isn&#x27;t Creativity More Important to Educational Psychologists? Potentials, Pitfalls, and Future Directions in Creativity Research</article-title>. <source>Educ. Psychol.</source> <volume>39</volume> (<issue>2</issue>), <fpage>83</fpage>&#x2013;<lpage>96</lpage>. <pub-id pub-id-type="doi">10.1207/s15326985ep3902_1</pub-id> </citation>
</ref>
<ref id="B70">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Price</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>1982</year>). <source>Droodles</source>. <publisher-loc>Los Angeles, CA</publisher-loc>: <publisher-name>Pricd</publisher-name>.</citation>
</ref>
<ref id="B71">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Price</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Lovka</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2000</year>). <source>Droodles: The Classic Collection</source>. <publisher-loc>Los Angeles, CA</publisher-loc>: <publisher-name>Tallfellow Press</publisher-name>.</citation>
</ref>
<ref id="B72">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rababah</surname>
<given-names>L. M.</given-names>
</name>
<name>
<surname>Alshehab</surname>
<given-names>M. H.</given-names>
</name>
<name>
<surname>Melhem</surname>
<given-names>N. Z. B.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Exploring the Factors that Hinder Jordanian Students in Developing Creativity in EFL Writing</article-title>,&#x201d; in <conf-name>International Conference on Studies in Arts, Humanities and Social Sciences (SAHSS-2017)</conf-name>, <conf-loc>Bali, Indonesia</conf-loc>, <conf-date>January 31&#x2013;February 1, 2017</conf-date>. (<publisher-name>IEEE</publisher-name>), <fpage>7</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.17758/eirai.f0117427</pub-id> </citation>
</ref>
<ref id="B74">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rojas-Drummond</surname>
<given-names>S. M.</given-names>
</name>
<name>
<surname>Albarr&#xe1;n</surname>
<given-names>C. D.</given-names>
</name>
<name>
<surname>Littleton</surname>
<given-names>K. S.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Collaboration, Creativity and the Co-construction of Oral and Written Texts</article-title>. <source>Thinking skills and creativity</source> <volume>3</volume> (<issue>3</issue>), <fpage>177</fpage>&#x2013;<lpage>191</lpage>. <pub-id pub-id-type="doi">10.1016/j.tsc.2008.09.008</pub-id> </citation>
</ref>
<ref id="B75">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rond</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Sanchez</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Berger</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Knight</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Improve with Robots: Creativity, Inspiration, Co-performance</article-title>,&#x201d; in <conf-name>2019 28th IEEE InternationalConference on Robot and Human Interactive Communication (RO-MAN)</conf-name> (<publisher-name>New Delhi, India: IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>8</lpage>. </citation>
</ref>
<ref id="B76">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Root-Bernstein</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Root-Bernstein</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>People, Passions, Problems: The Role of Creative Exemplars in Teaching for Creativity</article-title>,&#x201d; in <source>Creative Contradictions in Education: Cross Disciplinary Paradoxes and Perspectives</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Beghetto</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Sriraman</surname>
<given-names>B.</given-names>
</name>
</person-group> (<publisher-name>Springer International Publishing</publisher-name>), <fpage>143</fpage>&#x2013;<lpage>164</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-21924-0_9</pub-id> </citation>
</ref>
<ref id="B77">
<citation citation-type="book">
<collab>ROS</collab> (<year>2021</year>). <source>Robot Operating System</source>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="http://ros.org">ros.org</ext-link>
</comment>. (Accessed February 21, 2021).</citation>
</ref>
<ref id="B78">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Runco</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Acar</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Divergent Thinking as an Indicator of Creative Potential</article-title>. <source>Creativity Res. J.</source> <volume>24</volume> (<issue>1</issue>), <fpage>66</fpage>&#x2013;<lpage>75</lpage>. <pub-id pub-id-type="doi">10.1080/10400419.2012.652929</pub-id> </citation>
</ref>
<ref id="B80">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Russ</surname>
<given-names>S. W.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>Play and Creativity: Developmental Issues</article-title>. <source>Scand. J.&#x20;Educ. Res.</source> <volume>47</volume> (<issue>3</issue>), <fpage>291</fpage>&#x2013;<lpage>303</lpage>. <pub-id pub-id-type="doi">10.1080/00313830308594</pub-id> </citation>
</ref>
<ref id="B81">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Scratch Team</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <source>Scratch Coding Cards: Creative Coding Activities for Kids</source>. <publisher-loc>San Francisco, CA</publisher-loc>: <publisher-name>No Starch Press</publisher-name>.</citation>
</ref>
<ref id="B82">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shneiderman</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>Creativity Support Tools</article-title>. <source>Commun. ACM</source> <volume>45</volume> (<issue>10</issue>), <fpage>116</fpage>&#x2013;<lpage>120</lpage>. <pub-id pub-id-type="doi">10.1145/570907.570945</pub-id> </citation>
</ref>
<ref id="B83">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shneiderman</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Fischer</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Czerwinski</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Resnick</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Myers</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Candy</surname>
<given-names>L.</given-names>
</name>
<etal/>
</person-group> (<year>2006</year>). <article-title>Creativity Support Tools: Report from a U.S. National Science Foundation Sponsored Workshop</article-title>. <source>Int. J.&#x20;Human-Computer Interaction</source> <volume>20</volume> (<issue>2</issue>), <fpage>61</fpage>&#x2013;<lpage>77</lpage>. <pub-id pub-id-type="doi">10.1207/s15327590ijhc2002_1</pub-id> </citation>
</ref>
<ref id="B84">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Shorofat</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2007</year>). <source>The Effect of Using the Brainstorming Strategy on Developing Ninth Grade Students&#x2019; Creative Writings Skills in Arabic Language</source>. <publisher-loc>Amman, Jordan</publisher-loc>: <publisher-name>The University of Jordan</publisher-name>.</citation>
</ref>
<ref id="B86">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Silvia</surname>
<given-names>P. J.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Subjective Scoring of Divergent Thinking: Examining the Reliability of Unusual Uses, Instances, and Consequences Tasks</article-title>. <source>Thinking Skills and Creativity</source> <volume>6</volume> (<issue>Issue 1</issue>), <fpage>24</fpage>&#x2013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.1016/j.tsc.2010.06.001</pub-id> </citation>
</ref>
<ref id="B87">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smith</surname>
<given-names>G. J.&#x20;W.</given-names>
</name>
<name>
<surname>Carlsson</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>1983</year>). <article-title>Creativity in Early and Middle School&#x20;Years</article-title>. <source>Int. J.&#x20;Behav. Dev.</source> <volume>6</volume> (<issue>2</issue>), <fpage>167</fpage>&#x2013;<lpage>195</lpage>. <pub-id pub-id-type="doi">10.1177/016502548300600204</pub-id> </citation>
</ref>
<ref id="B88">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Subiaul</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Stanton</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Intuitive Invention by Summative Imitation in Children and Adults</article-title>. <source>Cognition</source> <volume>202</volume>, <fpage>104320</fpage>. <pub-id pub-id-type="doi">10.1016/j.cognition.2020.104320</pub-id> </citation>
</ref>
<ref id="B99">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Torrance</surname>
<given-names>E. P.</given-names>
</name>
</person-group> (<year>1966</year>). <source>Torrance tests of creative thinking&#x2014;norms technical manual research edition&#x2014;verbal tests, forms A and B&#x2014;figural tests, forms A and B</source>. <publisher-loc>Princeton</publisher-loc>: <publisher-name>Personnel Pres. Inc.</publisher-name>
</citation>
</ref>
<ref id="B97">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Torrance</surname>
<given-names>E. P.</given-names>
</name>
</person-group> (<year>1967</year>). <source>Understanding the fourth grade slump in creative thinking. Final report</source>. <publisher-name>ERIC</publisher-name>.</citation>
</ref>
<ref id="B98">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Torrance</surname>
<given-names>E. P.</given-names>
</name>
</person-group> (<year>1968</year>). <article-title>A longitudinal examination of the fourth grade slump in creativity</article-title>. <source>Gifted Child Quart.</source> <volume>12</volume> (<issue>4</issue>), <fpage>195</fpage>&#x2013;<lpage>199</lpage>. </citation>
</ref>
<ref id="B90">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Urban</surname>
<given-names>K. K.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Assessing Creativity: The Test for Creative Thinking-Drawing Production (TCT-DP)</article-title>. <source>Int. Educ. J.</source> <volume>6</volume> (<issue>2</issue>), <fpage>272</fpage>&#x2013;<lpage>280</lpage>. </citation>
</ref>
<ref id="B89">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Westlund</surname>
<given-names>J.&#x20;M. K.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Williams</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>Measuring Young Children&#x27;s Long-Term Relationships with Social Robots</article-title>,&#x201d; in <conf-name>IDC &#x2019;18: Proceedings of the 17th ACM Conference on Interaction Design and Children</conf-name> (<publisher-loc>Trondheim, Norway</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>207</fpage>&#x2013;<lpage>218</lpage>. <pub-id pub-id-type="doi">10.1145/3202185.3202732</pub-id> </citation>
</ref>
<ref id="B95">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Whiten</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>McGuigan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Marshall-Pescini</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Hopper</surname>
<given-names>L. M.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Emulation, imitation, over-imitation and the scope of culture for child and chimpanzee</article-title>. <source>Philos. Trans. Roy. Soc. B: Biol. Sci.</source> <volume>364</volume> (<issue>1528</issue>), <fpage>2417</fpage>&#x2013;<lpage>2428</lpage>. </citation>
</ref>
<ref id="B92">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Williams</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Oh</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Popbots: Designing an artificial intelligence curriculum for early childhood education</article-title>,&#x201d; in <conf-name>Proceedings of the AAAI Conference on Artificial Intelligence</conf-name>, <fpage>9729</fpage>&#x2013;<lpage>9736</lpage>. </citation>
</ref>
<ref id="B94">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Witt</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Beorkrem</surname>
<given-names>M. N.</given-names>
</name>
</person-group> (<year>1989</year>). <article-title>Climate for creative productivity as a predictor of research usefulness and organizational effectiveness in an R&#x0026;D organization</article-title>. <source>Creativity Res. J.</source> <volume>2</volume> (<issue>1-2</issue>), <fpage>30</fpage>&#x2013;<lpage>40</lpage>. </citation>
</ref>
<ref id="B91">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Yando</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Seitz</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Zigler</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>1978</year>). <source>Imitation: A developmental perspective</source>. <publisher-name>Lawrence Erlbaum</publisher-name>.</citation>
</ref>
<ref id="B93">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Zheng</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Yin</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Correlation analysis of scaffolding creative problem solving through question prompts with process and outcomes of project-based service learning</article-title>,&#x201d; in <conf-name>Proc. ASEE Annu. Conf. Expo.</conf-name> <fpage>1</fpage>&#x2013;<lpage>19</lpage>. </citation>
</ref>
</ref-list>
</back>
</article>