<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Robot. AI</journal-id>
<journal-title>Frontiers in Robotics and AI</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Robot. AI</abbrev-journal-title>
<issn pub-type="epub">2296-9144</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">1240408</article-id>
<article-id pub-id-type="doi">10.3389/frobt.2024.1240408</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Robotics and AI</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Embodied, visible, and courteous: exploring robotic social touch with virtual idols</article-title>
<alt-title alt-title-type="left-running-head">Onishi et al.</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/frobt.2024.1240408">10.3389/frobt.2024.1240408</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Onishi</surname>
<given-names>Yuya</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/671611/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ogawa</surname>
<given-names>Kosuke</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Tanaka</surname>
<given-names>Kazuaki</given-names>
</name>
<xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/2156040/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Nakanishi</surname>
<given-names>Hideyuki</given-names>
</name>
<xref ref-type="aff" rid="aff4">
<sup>4</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/196820/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>Interaction Science Laboratories, Advanced Telecommunication Research Institute International</institution>, <addr-line>Sorakugun</addr-line>, <country>Japan</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>Department of Mechanical Engineering, Osaka University</institution>, <addr-line>Suita</addr-line>, <country>Japan</country>
</aff>
<aff id="aff3">
<sup>3</sup>
<institution>Faculty of Information and Human Sciences, Kyoto Institute of Technology</institution>, <addr-line>Kyoto</addr-line>, <country>Japan</country>
</aff>
<aff id="aff4">
<sup>4</sup>
<institution>Faculty of Informatics, Kindai University</institution>, <addr-line>Higashi-osaka</addr-line>, <country>Japan</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/903916/overview">Raffaele Rodogno</ext-link>, Universit&#xe9; de Lausanne, Switzerland</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/438618/overview">Hirotaka Osawa</ext-link>, University of Tsukuba, Japan</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/258892/overview">Johanna Seibt</ext-link>, Aarhus University, Denmark</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Yuya Onishi, <email>y-onishi@atr.jp</email>; Hideyuki Nakanishi, <email>nakanishi@info.kindai.ac.jp</email>
</corresp>
</author-notes>
<pub-date pub-type="epub">
<day>25</day>
<month>03</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>11</volume>
<elocation-id>1240408</elocation-id>
<history>
<date date-type="received">
<day>15</day>
<month>06</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>15</day>
<month>02</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2024 Onishi, Ogawa, Tanaka and Nakanishi.</copyright-statement>
<copyright-year>2024</copyright-year>
<copyright-holder>Onishi, Ogawa, Tanaka and Nakanishi</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>In recent years, virtual idols have garnered considerable attention because they can perform activities similar to real idols. However, as they are fictitious idols with nonphysical presence, they cannot perform physical interactions such as handshake. Combining a robotic hand with a display showing virtual idols is the one of the methods to solve this problem. Nonetheless a physical handshake is possible, the form of handshake that can effectively induce the desirable behavior is unclear. In this study, we adopted a robotic hand as an interface and aimed to imitate the behavior of real idols. To test the effects of this behavior, we conducted step-wise experiments. The series of experiments revealed that the handshake by the robotic hand increased the feeling of intimacy toward the virtual idol, and it became more enjoyable to respond to a request from the virtual idol. In addition, viewing the virtual idols during the handshake increased the feeling of intimacy with the virtual idol. Moreover, the method of the hand-shake peculiar to idols, which tried to keep holding the user&#x2019;s hand after the conversation, increased the feeling of intimacy to the virtual idol.</p>
</abstract>
<kwd-group>
<kwd>handshake</kwd>
<kwd>social touch</kwd>
<kwd>haptic devices</kwd>
<kwd>virtual interaction</kwd>
<kwd>human-likeness</kwd>
<kwd>virtual idol</kwd>
</kwd-group>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Human-Robot Interaction</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1 Introduction</title>
<p>Virtual idols are nonphysical fictitious idols whose appearances are generated by computer graphics. Virtual idols can be classified into two primary types. First, the agent type in which creators write algorithms to control the movements and voices of the virtual idols, which are thereafter performed autonomously (<xref ref-type="bibr" rid="B21">Lam, 2016</xref>; <xref ref-type="bibr" rid="B48">Yin, 2018</xref>). Second, the avatar-type in which human actors perform their movements and voices (<xref ref-type="bibr" rid="B6">Choudhry et al., 2022</xref>). In recent years, avatar-type virtual idols have attracted increasing attention. The movement of the avatar is generated based on the actor&#x2019;s facial and body movements. This type of virtual idols utilizes performances from live video streams or recorded videos. A past study reported that avatars and real individuals are streaming similar contents (<xref ref-type="bibr" rid="B22">Lu et al., 2021</xref>). In addition, the activities of the avatar-type virtual idols include interaction with the fans, similar to Japanese idols who perform activities such as singing, dancing, and live performances displaying their charm. For instance, in certain events, idols engage with their fans in a simple conversation (<xref ref-type="bibr" rid="B10">Galbraith, 2012</xref>; <xref ref-type="bibr" rid="B46">Yakura, 2021</xref>), which raise the feeling of intimacy between the fans and their idols.</p>
<p>The distinction between virtual idols and Japanese idols is the possession of a physical body. Japanese idols can conduct face-to-face communication with fans, e.g., handshake and gestures. However, virtual idols cannot easily perform these physical interactions, which limit their modes of communication. Although certain face-to-face events have been organized by virtual idols, they primarily adopted nonphysical interactions, i.e., conversations and capturing pictures. Therefore, embodying virtual idol&#x2019;s body can enhance the interaction methods involving social touch between the idols and fans using hands. The purpose of this study is to raise the feeling of intimacy toward the virtual idol by replicating the social touch between Japanese idols and fans utilizing a robotic hand.</p>
<p>Past study reported that touch by a robotic hand influences the perception of agents regarding their cognized co-presence, and it did not influence the likability (<xref ref-type="bibr" rid="B15">Hoppe et al., 2020</xref>). This study applied a short tap on the participant&#x2019;s shoulder as the social interaction. However, the studied scenarios did not involve the virtual idols shake hands with fans. Other study reported that an advanced controller enabled a user wearing a head-mounted display to engage in a physical handshake with a virtual agent (<xref ref-type="bibr" rid="B44">Wang et al., 2011</xref>). Despite this controller demonstrated physical behavior similar to a human handshake, the aspect of intimacy toward the virtual agent remained unexplored. In other handshake-related studies developed a robotic hand and attached it to a video-conference device. This system can embody a part of a remote person&#x2019;s body and enhance the social telepresence (feeling as if users are meeting each other in the same room) by performing a handshake with a remotely connected individual (<xref ref-type="bibr" rid="B27">Nakanishi et al., 2014</xref>). Furthermore, another study reported that positional consistency between the video and the robotic hand in mobile video calls enhances social bonding and intimacy with the remote partner (<xref ref-type="bibr" rid="B39">Tanaka et al., 2021</xref>). Although this system was developed for remote communication, it can be applied to the embodiment of virtual idols, which is the purpose of the current study. Therefore, there is a possibility that a handshake with the virtual idol can raise the intimacy felt by a user. This study improves the robotic hand for a virtual idol and explored the feeling of intimacy towards to a virtual idol by imitating the handshake behavior of Japanese idols in a virtual idol.</p>
<p>Our paper is structured as follows. After introducing related work in <xref ref-type="sec" rid="s2">Section 2</xref>, we describe the experiments in <xref ref-type="sec" rid="s3">Section 3</xref>. Since the experiment consists of three parts, the overall goal is shown in <xref ref-type="sec" rid="s3-1">Section 3.1</xref>. <xref ref-type="sec" rid="s4">Section 4</xref> describes the deployment, and <xref ref-type="sec" rid="s5">Section 5</xref> discusses about the results obtained from <xref ref-type="sec" rid="s3">Section 3</xref> and the feedback obtained from <xref ref-type="sec" rid="s4">Section 4</xref>. And we conclude by describing our main findings in <xref ref-type="sec" rid="s6">Section 6</xref>.</p>
</sec>
<sec id="s2">
<title>2 Related works</title>
<sec id="s2-1">
<title>2.1 Social touch interface in human-human communication</title>
<p>Social touch has been extensively studied in terms of human-robot interaction, virtual environments, and remote communications. In a remote communication scenario, previous study added a haptic stimulus functionality to the existing media. For instance, a user&#x2019;s mobile device vibrates when a remote partner squeezes his/her device (<xref ref-type="bibr" rid="B5">Chang et al., 2002</xref>). Another study adds stimuli, which can exert a poking force on cheek through a pneumatically inflated silicone balloon (<xref ref-type="bibr" rid="B29">Park et al., 2013</xref>). Moreover, mediate kissing device reproduced the pressure and movement of the partner&#x2019;s lips using servomotors (Samani et al., 2013). This device creates a more intimate interaction than ordinary video calls. To reproduce hugs, clothing-type devices have been proposed, which simulate a conversation while viewing a mirror that displays the hugging users (<xref ref-type="bibr" rid="B43">Vetere et al., 2005</xref>; <xref ref-type="bibr" rid="B25">Morikawa et al., 2006</xref>; <xref ref-type="bibr" rid="B40">Teh et al., 2008</xref>; <xref ref-type="bibr" rid="B49">Zhang et al., 2015</xref>). Furthermore, a hug can be reproduced via a voice call while hugging a bolster with a built-in mobile phone (<xref ref-type="bibr" rid="B36">Sumioka et al., 2013</xref>). To reproduce a handshake a band-type device tightens the user&#x2019;s hand and presents a body temperature (<xref ref-type="bibr" rid="B47">Yarosh et al., 2017</xref>). This device tightens each other&#x2019;s hands if the users place their hands on the corresponding place. Another approach has been proposed to reproduce a handshake by attaching a human-like robotic hand with a video-conferencing terminal. These devices enhanced social telepresence (<xref ref-type="bibr" rid="B27">Nakanishi et al., 2014</xref>) and social bonding (<xref ref-type="bibr" rid="B39">Tanaka et al., 2021</xref>). In general, all these devices have been explored for human&#x2013;human communication but not for agent/avatar&#x2013;human communication.</p>
</sec>
<sec id="s2-2">
<title>2.2 Social touch with agents or avatars</title>
<p>Past studies have explored the action and effects of touch with agents or avatars. These studies can be categorized into touch in virtual environments and touch in real environments. In the case of touch in virtual environments, users exist as avatars in the virtual space and touch another avatar. Previous studies focused on the influences of the perceived impression by touch with visual (<xref ref-type="bibr" rid="B3">Biocca et al., 2001</xref>; <xref ref-type="bibr" rid="B37">Swidrak et al., 2019</xref>; <xref ref-type="bibr" rid="B26">Nagamachi et al., 2020</xref>; <xref ref-type="bibr" rid="B38">Sykownik et al., 2020</xref>; <xref ref-type="bibr" rid="B7">Fusaro et al., 2021</xref>; <xref ref-type="bibr" rid="B35">Sugimori et al., 2021</xref>) and audio stimuli (<xref ref-type="bibr" rid="B2">Biocca et al., 2002</xref>). For instance, a novel avatar-tracking controller enabled rapid, accurate tracking with flexible motion in response to contact (<xref ref-type="bibr" rid="B35">Sugimori et al., 2021</xref>). However, this study only investigated the visual and audio effects without any touch. Thus, various devices have been proposed to achieve physical touch. For instance, simple haptic gloves or arm straps have been widely used to study the touch interaction effects in virtual environments (<xref ref-type="bibr" rid="B12">Haans et al., 2009</xref>; <xref ref-type="bibr" rid="B17">Huisman et al., 2013</xref>; <xref ref-type="bibr" rid="B16">Huisman, 2017</xref>; <xref ref-type="bibr" rid="B4">Boucaud et al., 2019</xref>). Other studies employed physical robots to reproduce more realistic tactile stimuli for users in virtual environments (<xref ref-type="bibr" rid="B19">Kotranza et al., 2009</xref>; <xref ref-type="bibr" rid="B44">Wang et al., 2011</xref>). However, such physical touch aims to immerse users in virtual environments and prerequisites wearing a dedicated device.</p>
<p>In the case of touch in real enviroments, humanoid robots are used as agents and avatars. Previous studies reported the effectiveness of social touch with robots (<xref ref-type="bibr" rid="B18">Knapp et al., 2010</xref>; <xref ref-type="bibr" rid="B1">Bevan et al., 2015</xref>; <xref ref-type="bibr" rid="B42">van Erp et al., 2015</xref>; <xref ref-type="bibr" rid="B32">Shiomi et al., 2016</xref>; <xref ref-type="bibr" rid="B31">Shiomi et al., 2019</xref>; <xref ref-type="bibr" rid="B11">Geva et al., 2020</xref>; <xref ref-type="bibr" rid="B33">Shiomi et al., 2020</xref>). The robot&#x2019;s touch encourages motivation (<xref ref-type="bibr" rid="B34">Shiomi et al., 2020</xref>), persuasion (<xref ref-type="bibr" rid="B32">Shiomi et al., 2016</xref>), self-disclosures (<xref ref-type="bibr" rid="B1">Bevan et al., 2015</xref>), and increases pain or stress-buffering effects (<xref ref-type="bibr" rid="B31">Shiomi et al., 2019</xref>; <xref ref-type="bibr" rid="B11">Geva et al., 2020</xref>). The touch interaction with robots yields positive impressions (<xref ref-type="bibr" rid="B45">Willemse et al., 2019</xref>) and conveys various emotions by altering the touch characteristics (<xref ref-type="bibr" rid="B41">Teyssier et al., 2020</xref>; <xref ref-type="bibr" rid="B14">Higashino et al., 2021</xref>; <xref ref-type="bibr" rid="B50">Zheng et al., 2020</xref>; <xref ref-type="bibr" rid="B33">Shiomi et al., 2020</xref>, Began et al., 2015). For instance, in a study exploring a robot&#x2019;s touch on the rear side of a human hand, the length and type of touch influenced the perception of the intensity and ingenuity of the emotions expressed by the robot (<xref ref-type="bibr" rid="B50">Zheng et al., 2020</xref>). More importantly, a handshake with a robot used for avatar can be effective in negotiation contexts (Began et al., 2015). However, agents and avatars in these studies were not investigated for special roles (i.e., like idols). In this study we explored the effectiveness of social touch with avatars embodying a special role as the idol.</p>
</sec>
<sec id="s2-3">
<title>2.3 Touch interactions with idols</title>
<p>Past study has explored touch interactions with idols, epitomized by handshake events initiated by Japanese groups (<xref ref-type="bibr" rid="B8">Galbraith, 2017</xref>). Fans must purchase CDs that come with tickets to participate in these handshake events. And they spend a short time engaging in handshakes or high-five and conversations with specific members (Patrick and Jason, 2012; <xref ref-type="bibr" rid="B24">Maneechaeye, 2021</xref>). In addition, photo-session events where fans can take an instant photo with idols are also common (<xref ref-type="bibr" rid="B23">Lukacs, 2015</xref>). On the other hand, since virtual idols are unable to engage in physical interactions, face-to-face events have primarily utilized non-physical forms of interaction, such as conversations and photo-sessions. Another study examined the effects of combining a photo of a Japanese idol with a handshake device (<xref ref-type="bibr" rid="B20">Kumagai and Nonomura, 2023</xref>). It demonstrated that viewing a photo of the idol&#x2019;s face placed above the handshake device while grasping it increased her perceived attractiveness. However, this study lacked interactive elements such as conversation. This study attempted to replicate the face-to-face interactions of Japanese idols, such as conversations and handshakes, in virtual idols by utilizing a robotic hand.</p>
</sec>
</sec>
<sec id="s3">
<title>3 Experiments</title>
<sec id="s3-1">
<title>3.1 Goal</title>
<p>This study aimed to raise the feeling of intimacy toward the virtual idol by replicating the social touch between Japanese idols and fans utilizing a robotic hand. To this end, we separately conducted three investigations step-by-step. First, we tested the effectiveness of a robotic handshake by comparing the proposed method that reproduces the handshake of a Japanese idol with a conventional method of face-to-face interaction with the virtual idol. Second, we considered a situation where the user continues to hold hands with the virtual idol throughout the conversation. This situation provides fans with an experience like a date. Therefore, we simulated a date continuously holding hands with a virtual idol. In our propose method, the user will see the virtual idol&#x2019;s appearance including the handshake device, when the user and the virtual idol face each other while holding hands. However, a partition between the display portrayed the upper body of the virtual idol and the robotic hand, which bears a visual contradiction between the virtual space and physical space. Accordingly, we tested whether the users accept this visual contradiction. Third, we reproduced the handshake with a real idol. The handshake between a real idol and fans vary from that between general users. Real idols strive to courteously shake hands with their fans because they cherish the interaction their fans. Thus, we tested this courteous behavior in the handshake with the virtual idol.</p>
<p>We conducted these three investigations in laboratory experiments. The virtual idols featured in these experiments were created by a free license software. Therefore, participants met with the virtual idol for the first time. On the other hand, typical virtual idols continuously communicate with their fans, who may feel a sense of intimacy towards them. We deployed these experiments into a handshake event, and gathered feedback by observing fan behaviors.</p>
</sec>
<sec id="s3-2">
<title>3.2 Hypothesis</title>
<p>Japanese idol handshake events permit fans to spend a brief period with a particular member, engaging in handshakes and conversations with the idol (<xref ref-type="bibr" rid="B24">Maneechaeye, 2021</xref>). On the other hand, in the face-to-face event with virtual idols, the typical touch-based interaction is high-five. Fans can touch the virtual idol by touching the display. Our proposed method can reproduce the handshake of the Japanese idols. We tested the effectiveness of a robotic handshake by comparing the proposed method with a conventional method of face-to-face interaction with the virtual idol. Therefore, we formulated the following hypothesis.</p>
<p>
<statement content-type="hypothesis" id="uHypothesis_1">
<label>Hypothesis 1-a</label>
<p>Handshaking with an embodied hand of a virtual idol improves the feeling of intimacy towards the virtual idol than video-based interaction.</p>
<p>Not limited to virtual idols, real Japanese idols ask fans to purchase CDs, participate in events, and engage in other activities (<xref ref-type="bibr" rid="B9">Galbraith, 2012</xref>; <xref ref-type="bibr" rid="B24">Maneechaeye, 2021</xref>). A past study investigated the relationship between such requests and social touch (<xref ref-type="bibr" rid="B14">Higashino et al., 2021</xref>), reporting that social touch improved the time of task while performing them. If an idol requests fans, it may be placed during the social touch as well as after the social touch. In this experiment, we adopted requests from the virtual idol after doing a social touch. The user&#x2019;s actions were performed after the request from the virtual idol. Therefore, we assessed the enjoyability of a task as a factor of motivation and formulated the following hypothesis.</p>
</statement>
</p>
<p>
<statement content-type="hypothesis" id="uHypothesis_2">
<label>Hypothesis 1-b</label>
<p>Handshaking with an embodied hand of a virtual idol provides a sense of joy to the task after it than video-based interaction.</p>
<p>Conversing while holding hands with an idol provides fans with an experience like a date. Therefore, we simulated a date situation continuously holding hands with a virtual idol. If the user and the virtual idol face each other while holding hands, the user will see the virtual idol&#x2019;s appearance including the handshake device. However, a partition between the display portrayed the upper body of the virtual idol and the robotic hand, which bears a visual contradiction between the virtual space and physical space. A previous study investigating video-conferencing and embodiment of the remote partner&#x2019;s body clarified that this partition caused a negative impression on the user (<xref ref-type="bibr" rid="B28">Onishi et al., 2016</xref>). Thus, we considered that the boundary between the image of the virtual idol and robotic hand should be concealed. A previous study indicated that viewing a photo of a Japanese idol&#x2019;s face placed above a handshake device, while simultaneously grasping the device, increased her perceived attractiveness (<xref ref-type="bibr" rid="B20">Kumagai and Nonomura, 2023</xref>). The handshake in this study employed a grip handle, concealed by fabric to render it invisible to the user, thus enabling users to engage in the handshake while imaging that they were directly holding her hand. Other studies reported that the utilization of solely audio and tactile channels can augment communication, even on devices without video channels. ComTouch augmented remote communication by converting hand pressure into vibrational intensity between users in real-time (<xref ref-type="bibr" rid="B5">Chang et al., 2002</xref>). POKE improved the communication using calling devices that reproduced the voice and touch channels for couples in long-distance relationships (<xref ref-type="bibr" rid="B30">Samani et al., 2012</xref>). According to these studies, there have a possibility that users can imagine virtual idols through voice and touch channels. Accordingly, we formulated the following hypothesis.</p>
</statement>
</p>
<p>
<statement content-type="hypothesis" id="Hypothesis_2">
<label>Hypothesis 2</label>
<p>Stimulating the imagination of the virtual idol&#x2019;s appearance by holding hands without directly viewing them improve feelings of intimacy towards the virtual idol more than holding hands with viewing their image directly.</p>
<p>Handshakes between Japanese idols and fans differ from those among general users. A handshake between general users is unaffected, regardless of which user first releases the hand. However, at handshake events of Japanese idols, the idols do not release the hand first, because fans may feel rude if the idols first release their hand. Thus, idols should communicate courteously with their fans. Instead, event staff will announce the end of a handshake. Therefore, we focused on the variation in a user&#x2019;s impression depending on the timing of releasing the robot hand at the end of handshake with the virtual idol. Accordingly, we formulated the following hypothesis.</p>
</statement>
</p>
<p>
<statement content-type="hypothesis" id="Hypothesis_3">
<label>Hypothesis 3</label>
<p>The courteous handshake from the virtual idol provides a sense of intimacy to the users.</p>
</statement>
</p>
</sec>
<sec id="s3-3">
<title>3.3 Setups</title>
<sec id="s3-3-1">
<title>3.3.1 Virtual idols</title>
<p>We used a free license software to generate the image of virtual idols. The gender of the virtual idol was opposite to that of participants. The movement of the virtual idols was synchronized with the movement of the experimenter&#x2019;s mouth and upper body, as captured through motion tracking. The voice of the virtual idols was synthesized voices, and the conversation script was prepared during the experiment. Therefore, the experimenter who was the performer of the virtual idol, lip-synced according to the conversation.</p>
</sec>
<sec id="s3-3-2">
<title>3.3.2 Robotic handshake with virtual idols</title>
<p>Based on a previous study (<xref ref-type="bibr" rid="B27">Nakanishi et al., 2014</xref>), this study employed a robotic hand that has three features. First, this robotic hand reproduces substantial grip force. Specifically, wires are attached to the inside and outside of each finger. The servomotor pulls the inside wire to bend the finger and pulls the outside wire to stretch the finger. Second, the robotic hand reproduces the body temperature as a human hand. To warm the entire hand, heating cords have been placed near the fingers and palm. Third, to represent the softness of a human hand, the fingers and palm of the robot hand were coated in urethane gel, which imparts the required softness. In addition, the size of the robotic hand was evaluated based on the average size of adult hands. This robotic hand can be operated by an experimenter.</p>
</sec>
<sec id="s3-3-3">
<title>3.3.3 Environments</title>
<p>The structural setup of the experimental room is presented in <xref ref-type="fig" rid="F1">Figure 1</xref>. As depicted in <xref ref-type="fig" rid="F1">Figure 1A</xref>, the robotic hand was attached to the virtual idol device under the display, acting as the virtual idol&#x2019;s right arm. In Experiment 1-a and Experiment 1-b, we compare the results obtained with/without the robotic hand. As portrayed in <xref ref-type="fig" rid="F1">Figures 1B</xref> if the participants and the virtual idol did not shake hands, we removed the robotic hand.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Structure of the experiment room (length unit: centimeters). <bold>(A)</bold> With handshake; <bold>(B)</bold> Without handshake.</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g001.tif"/>
</fig>
<p>We used a 50&#x2033;wide-screen display to project a nearly life-size picture of the virtual idol&#x2019;s upper body, which followed the movement of the experimenter&#x2019;s body. In particular, the participants stood on a platform base with adjustable height that ensured correspondence between the participant&#x2019;s and virtual idol&#x2019;s eye level. Additionally, the speaker installed behind the display transmitted the voice of the virtual idol. Moreover, the experimenter can view and listen to the participants via the camera and microphone. In Experiment 1-b, we placed a desk adjacent to the virtual idol device. In Experiment 2, we projected an image on the wall that was opposite to the virtual idol device.</p>
</sec>
</sec>
<sec id="s3-4">
<title>3.4 Conditions</title>
<p>We conducted two experiments to test if the virtual idol should embody social touch. In Experiment 1-a corresponding to hypothesis 1-a, we measured the intimacy toward the virtual idol, and in Experiment 1-b corresponding to hypothesis 1-b, we assessed the joy felt in responding to a request from the virtual idol. In Experiment 1-a, we compared under the following three conditions.<list list-type="simple">
<list-item>
<p>&#x2022; Nontouch condition: Participants engaged in a conversation without any social touch.</p>
</list-item>
<list-item>
<p>&#x2022; Disembodied touch condition: Participants can high-five the display at the beginning and end of the conversation. The virtual idol was not embodied and the participants can touch only the display.</p>
</list-item>
<list-item>
<p>&#x2022; Embodied touch condition: Participants shake hands with the robot hand at the beginning and end of the conversation. The virtual idol was embodied by the robotic hand and the participants can touch the virtual idol&#x2019;s hand.</p>
</list-item>
</list>
</p>
<p>In Experiment 1-b, to evaluate the effectiveness of the embodied touch condition, we disregarded the Disembodied touch condition and compared the following two conditions.<list list-type="simple">
<list-item>
<p>&#x2022; Nontouch condition: Participants engaged in a conversation without any social touch.</p>
</list-item>
<list-item>
<p>&#x2022; Embodied touch condition: Participants shake hands with the robotic hand at the beginning and end of the conversation.</p>
</list-item>
</list>
</p>
<p>We conducted Experiment 2 to the effect of visibility with social touch corresponding to hypothesis 2. We compared under the following two conditions.<list list-type="simple">
<list-item>
<p>&#x2022; Visible condition: Participants engaged in handshake and conversation with the virtual idol. Participants can view the boundary between the image of the virtual idol and robotic hand.</p>
</list-item>
<list-item>
<p>&#x2022; Imaginable condition: Participants engaged in handshake and conversation with the virtual idol. Participants viewing the same direction as virtual idols but cannot observe the boundary between the image of the virtual idol and robotic hand.</p>
</list-item>
</list>
</p>
<p>We conducted Experiment 3 to the effect of courteousness with social touch corresponding to hypothesis 3. We compared under the following two conditions.<list list-type="simple">
<list-item>
<p>&#x2022; Business-like condition: Participants and virtual idol release hands simultaneously.</p>
</list-item>
<list-item>
<p>&#x2022; Courteous condition: The virtual idol continues to hold the participant&#x2019;s hand even if the participant attempts to release their hand.</p>
</list-item>
</list>
</p>
</sec>
<sec id="s3-5">
<title>3.5 Procedure</title>
<p>In all experiments, we set a task for participants to engage in conversations with the virtual idols regarding certain locations. The virtual idol talked about various places in each condition (e.g., aquarium, zoo and museum). To conduct a disciplined experiment, the length of all conversations, number of questions, and number of responses remained constant. In particular, we reduced the number of responses during the conversation, because simple conversations with the virtual idol can produce a ceiling effect.</p>
<p>Participants shake hands with the virtual idol at the beginning and end of the conversation, or during the conversation. These differences depend on the procedure of the experiment. The participants were not accustomed to the action of handshake with virtual idols, and thus, they practiced the required prior to the experiment. After the task, the participants answered a questionnaire and an interview.</p>
<sec id="s3-5-1">
<title>3.5.1 Effects of embodied social touch (Experiment 1)</title>
<p>In Experiment 1-a, high fives and handshakes were performed at the beginning and end of the conversation. In Experiment 1-b, the virtual idol needs to make requests to participants. Therefore, we added a simple drag-and-drop task, which has earlier been used to assess the degree of effort toward a form of reward in social psychology (<xref ref-type="bibr" rid="B15">Hoppe et al., 2020</xref>). In this task, a red circle and a black square were projected on the display. The participants dragged the circle and dropped it into the square. After dropping the circle into the square, the circle disappears and a new circle appears at random positions on the <italic>x</italic>-axis. Participants repeatedly performed this operation for 3 min. First, we set a practice phase for 15 s to ensure the understanding of the task among the participants. Thereafter, the participants pressed the start button and performed the task for 3 min. After completing the task, the participants conversed with the virtual idol. Under certain conditions, the participants and virtual idol shook hands at the beginning and end of the conversation. After the conversation, the participants performed the same task for 3 min.</p>
</sec>
<sec id="s3-5-2">
<title>3.5.2 Effect of visibility with social touch (Experiment 2)</title>
<p>In this experiment, the participants may encounter difficulty in grasping hands if they release the robot hand and attempt to grasp it again, at the imaginable condition. Therefore, we adopted the method of holding hands during the conversation instead of a handshake in this experiment. In addition, to simulate the sensation of holding hands and conversing with a virtual idol, a projector cast an image of a road scene onto the wall opposite the display.</p>
</sec>
<sec id="s3-5-3">
<title>3.5.3 Effect of courteousness with social touch (Experiment 3)</title>
<p>In this experiment, participants were holding hands throughout the conversation with the virtual idols during the experiment. The flow of the experiment is presented in <xref ref-type="table" rid="T1">Table 1</xref>. At the end of the conversation, the virtual idol stated, &#x201c;Now, we are ending the conversation,&#x201d; and participants released the virtual idol&#x2019;s hand. After this announcement, the virtual idol became silent. In a business-like condition, the participant and the virtual idol released hands simultaneously. In a courteous condition, the robotic hand continued to hold the participant&#x2019;s hand even if the participant attempted to release the virtual idol&#x2019;s hand. Consequently, in certain cases, the participants forcibly released the virtual idol&#x2019;s hand. The mean of the time from the announcement of the end of the conversation to the release of the robotic hand by the participant was 2.4 s (<italic>S.D.</italic> &#x3d; 0.2 s) in the business-like condition and 5.4 s (<italic>S.D.</italic> &#x3d; 1.2 s) in the courteous condition. We conducted a <italic>t</italic>-test for these times and significant variations were observed between the conditions (<italic>t</italic>(20) &#x3d; 2.086, <italic>p</italic> &#x3c; .05). Therefore, the duration for which the participants held the robotic hand varied.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Variations between time to release participants hand.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="center">Business-like condition</th>
<th colspan="2" align="center">Courteous condition</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">Images when participant releases the virtual idol&#x2019;s hand</td>
<td align="center">Status of a handshake (Participant/Virtual idol)</td>
<td align="center">Images when participant releases the virtual idol&#x2019;s hand</td>
<td align="center">Status of a handshake (Participant/Virtual idol)</td>
</tr>
<tr>
<td rowspan="4" align="center">
<inline-graphic xlink:href="FROBT_frobt-2024-1240408_wc_tfx1.tif"/>
</td>
<td align="center">Close/CloseOpen/OpenOpen/Open-/Open</td>
<td rowspan="4" align="center">
<inline-graphic xlink:href="FROBT_frobt-2024-1240408_wc_tfx2.tif"/>
</td>
<td align="center">Close/CloseOpen/CloseOpen/Close-/Close</td>
</tr>
<tr>
<td/>
<td/>
</tr>
<tr>
<td/>
<td/>
</tr>
<tr>
<td/>
<td/>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec id="s3-6">
<title>3.6 Questionnaire</title>
<p>After completing each task, the participants answered a questionnaire and an interview. In the Experiment 1-a, 2, 3, we asked &#x201c;I felt intimacy toward the partner.&#x201d; And in the Experiment 1-b, we asked &#x201c;I felt that the drag-and-drop task was enjoyable&#x201d;. The statements were rated on a Likert scale with lowest &#x3d; strongly disagree and highest &#x3d; strongly agree. In addition, the participants described the reasons for the responses in the free description.</p>
</sec>
<sec id="s3-7">
<title>3.7 Participants</title>
<p>Participants were undergraduate students whose ages ranged from eighteen to 24 years. Eighteen males participated in the Experiment 1-a. Recently, several situations have been reported in which female virtual idols and male fans communicate with each other. Thus, we conducted the experiment with female virtual idols and male participants, following the within-subject design. Twenty-eight individuals, consisting of fourteen females and fourteen males, participated in the Experiment 1-b, following the between-subject design. Twelve individuals, consisting of six females and six males, participated in the Experiment 2, following the within-subject design. Twenty-two individuals, consisting of eleven females and eleven males, participated in the Experiment 3. This experiment was between-subjects and had two conditions, so eleven individuals participated in each condition. In total, seventy individuals participated in our experiments.</p>
<p>This experiment was based on an experiment plan that was approved by Osaka University&#x2019;s Research Ethics Committee (Number: 28-5-0). Participants were given a consent form before the experiment began. We conducted the experiment only if they agreed.</p>
</sec>
<sec id="s3-8">
<title>3.8 Results</title>
<p>The results of Experiment 1-a are shown in <xref ref-type="fig" rid="F2">Figure 2</xref>, wherein each box represents the mean value of the responses to each statement and each bar represents the standard error of the mean value. The results indicate a comparison of the three conditions through one-way factorial ANOVA followed by Bonferroni&#x2019;s test. We determined a significant variation in the feeling of intimacy (<italic>F</italic> (2,17) &#x3d; 9.081, <italic>p</italic> &#x3c; .01, <italic>partial &#x3b7;</italic>
<sup>
<italic>2</italic>
</sup> &#x3d; 0.348). Multiple comparisons revealed that this feeling was significantly stronger in the embodied touch condition compared to the no-touch condition (<italic>p</italic> &#x3c; .01). Therefore, this result supports Hypothesis 1.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Results of the Experiment 1-a questionnaire &#x201c;I felt intimacy toward the partner.&#x201d;</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g002.tif"/>
</fig>
<p>The results of Experiment 1-b are shown in <xref ref-type="fig" rid="F3">Figure 3</xref>, wherein each box represents the mean value of the responses to each statement, and each bar represents the standard error of the mean value. In particular, we set two factors: one was contact factor and second was gender factor. The results were obtained with two-way factorial ANOVA followed by Bonferroni&#x2019;s test, which noted a significant variation in the contact factor (<italic>F</italic>(1,24) &#x3d; 4.260, <italic>p</italic> &#x3c; .05, <italic>partial &#x3b7;</italic>
<sup>
<italic>2</italic>
</sup> &#x3d; 0.264). Furthermore, multiple comparisons implied the higher score of the embodied touch condition than the no-touch condition (<italic>p</italic> &#x3c; .01). Overall, no significant variations were observed between the gender factors and interaction effects, thereby validating Hypothesis 1-b.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Results of the Experiment 1-b questionnaire &#x201c;I felt that the drag-and-drop task was enjoyable.&#x201d;</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g003.tif"/>
</fig>
<p>The results of Experiment 2 are shown in <xref ref-type="fig" rid="F4">Figure 4</xref>, wherein each box represents the mean value of the responses to each statement and each bar represents the standard error of the mean value. The two factors were set, namely, visibility and gender. The results were calculated using two-way factorial ANOVA followed by Bonferroni&#x2019;s test, which indicated significant variations in the visibility factor (<italic>F</italic> (1,10) &#x3d; 6.914, <italic>p</italic> &#x3c; .05, <italic>partial &#x3b7;</italic>
<sup>
<italic>2</italic>
</sup> &#x3d; 0.168). Thus, no significant variations were observed with factors of gender and interaction effects, which did not support Hypothesis 2.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Results of the Experiment 2 questionnaire &#x201c;I felt intimacy toward the partner.&#x201d;</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g004.tif"/>
</fig>
<p>The results of Experiment 3 are shown in <xref ref-type="fig" rid="F5">Figure 5</xref>, wherein each box represents the mean value of the responses to each statement and each bar represents the standard error of the mean value. We set two factors, namely, duration before releasing the participant&#x2019;s hand and the gender factor. The results were calculated using two-way factorial ANOVA followed by Bonferroni&#x2019;s test, which exhibited significant variations in the courteousness factor (<italic>F</italic> (1,18) &#x3d; 5.0241, <italic>p</italic> &#x3c; .05, <italic>partial &#x3b7;</italic>
<sup>
<italic>2</italic>
</sup> &#x3d; 0.218). However, no significant variations were observed in the gender factor and interaction effects. Therefore, the results support Hypothesis 3.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Results of the Experiment 3 questionnaire &#x201c;I felt intimacy toward the partner.&#x201d;</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g005.tif"/>
</fig>
</sec>
</sec>
<sec id="s4">
<title>4 Deployment</title>
<p>Based on the experimental results, we organized a handshake event with &#x201c;Hibiki Ao,&#x201d; currently active as a virtual idol streamer, and their fans. Unlike the laboratory experiment, the participants in this event were real fans, and consequently, their intimacy toward the virtual idol would be noteworthy. We gathered feedback by observing fan behaviors.</p>
<sec id="s4-1">
<title>4.1 Procedure</title>
<p>The participants held hands with the virtual idol during conversation for approximately 5 min. The event was segmented into two distinct halves. The first half included a handshake date while viewing the projector video on the screen, and the second half included a free talk with a handshake. Specifically, the handshake method varied between the first and second halves (<xref ref-type="fig" rid="F6">Figure 6</xref>). In the first half, the virtual idol and participants were facing the same direction (similar to the imaginable condition in Experiment 2; <xref ref-type="fig" rid="F6">Figure 6A</xref>), whereas in the second half, they were facing each other (similar to visible condition in Experiment 2; <xref ref-type="fig" rid="F6">Figure 6B</xref>).</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Images of participants holding hands with virtual idols <bold>(A)</bold> First half of event <bold>(B)</bold> Second half of event.</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g006.tif"/>
</fig>
<p>The flow of the event is stated as follows. First, we explained the flow of the event and informed the fans that we were recording throughout this event. After the explanation, we guided the participants toward the venue. Subsequently, we noted the participant&#x2019;s name according to their preferred addressal by the virtual idols. Initially, the virtual idol and participants held hands looking at the same direction. After the guide exited the venue, the projector video and background music started, indicating the initiation of the handshake date. During the handshake date, the virtual idol and participants engaged in a conversation based on the video content. The duration of the video was approximately 2 min 30 s. After the video, the participants turned around to the virtual idol and held hands, but on this instance, they faced each other. Thereafter, a free talk started. After 2 min 30 s, a guide entered the venue and announced the end of the event. As the participants dispersed from the venue, we conducted an interview with informed consent to use the recorded video. The preliminary explanations and an interview were conducted outside the venue.</p>
<p>We analyzed the interview responses and the transcript of the interactions between the participant and virtual idol. At the interview, we asked participants to rank the pleasant instances of the event. Accordingly, we prepared four ranking items: &#x201c;a conversation experience,&#x201d; &#x201c;a dating experience,&#x201d; &#x201c;a handshake experience,&#x201d; and &#x201c;others.&#x201d; For the transcript, we transcribed the characteristics of the scene occurring at the event. The analysis with the transcript is a method of ethnomethodology that can qualitatively analyze the human communication. By noting the utterances and physical behaviors in chronological order, the analysis proceeded based on the order and timing.</p>
<p>Overall, 21 male fans of the virtual idol attended the organized event, among which certain individuals participated on multiple instances, and the experience was conducted 27 times in total.</p>
</sec>
<sec id="s4-2">
<title>4.2 Results</title>
<p>Based on the interview, the participants ranked their pleasant experience at the event. The answers from the rankings were only one time and we asked after the first time of experience. The results are presented in <xref ref-type="table" rid="T2">Tables 2</xref> and <xref ref-type="table" rid="T3">3</xref>. The distribution of the ranked experiences of the fans is presented in <xref ref-type="table" rid="T2">Table 2</xref>, wherein numerous fans placed the conversation experience at the first rank. In particular, no one ranked the handshake experience as third, and no one answered the item &#x201c;others.&#x201d; To analyze this ranking, we confirmed the number of participants answering the patterns of the ranking (<xref ref-type="table" rid="T3">Table 3</xref>). As such, three patterns could be observed from the responses of the participants.</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Ranking of event experience.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center"/>
<th align="center">First</th>
<th align="center">Second</th>
<th align="center">Third</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">Conversation experience</td>
<td align="center">13</td>
<td align="center">2</td>
<td align="center">6</td>
</tr>
<tr>
<td align="center">Handshake experience</td>
<td align="center">8</td>
<td align="center">13</td>
<td align="center">0</td>
</tr>
<tr>
<td align="center">Dating experience</td>
<td align="center">0</td>
<td align="center">6</td>
<td align="center">15</td>
</tr>
</tbody>
</table>
</table-wrap>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>Number of participants answering the patterns of each ranking.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Patterns of the ranking</th>
<th align="center">Number of responses</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">First: Conversation experienceSecond: Handshake experienceThird: Dating experience</td>
<td align="center">13</td>
</tr>
<tr>
<td align="left">First: Handshake experienceSecond: Dating experienceThird: Conversation experience</td>
<td align="center">6</td>
</tr>
<tr>
<td align="left">First: Handshake experienceSecond: Conversation experienceThird: Dating experience</td>
<td align="center">2</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s4-3">
<title>4.3 Transcript</title>
<p>To analyze the recorded video, we used a transcript of the conversation and transcribed the interactions between a participant and virtual idol to correspond the word order and meanings between the original language and English. The end-segment of a conversation between the virtual idol and a participant is depicted in <xref ref-type="fig" rid="F7">Figure 7</xref>, wherein the red text denotes the important conversations. Based on the transcript, the virtual idol suggested ending the conversation (line 1), and in response, the participant accepted the suggestion (line 5). Generally, individuals release their hand at this instant. However, the participant and virtual idol retained their grasp and continued conversing for &#x223c;2 s (from lines 7&#x2013;10, red highlighted portion of transcript). Thereafter, the guide forcibly announced the end of event (line 11). Participants attempted to extend the event to the greatest possible extent (line 17). In this event, the virtual idol was conscious and did not release the participant&#x2019;s hand until guided. Thus, the virtual idol courteously treated the fans, and the participant accepted the end of the event in conversation, but he did not accept it in his action. Possibly, this occurred because the virtual idol behaved courteously with the participant.</p>
<table-wrap id="udT1" position="float">
<table>
<thead valign="top">
<tr>
<th align="left">01</th>
<th align="left">V</th>
<th align="left">See you later</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">02</td>
<td align="left">P</td>
<td align="left">Yes. thank you</td>
</tr>
<tr>
<td align="left">03</td>
<td align="left">V</td>
<td align="left">Yeah. I&#x2019;m planning a live streaming on the 14th [so come to see me</td>
</tr>
<tr>
<td align="left"/>
<td align="left">P</td>
<td align="left">[Yeah, I&#x2019;ll go</td>
</tr>
<tr>
<td align="left">04</td>
<td align="left">V</td>
<td align="left">Yeah, I&#x2019;ll be waiting</td>
</tr>
<tr>
<td align="left">05</td>
<td align="left">P</td>
<td align="left">See you on the live streaming</td>
</tr>
<tr>
<td align="left">06</td>
<td align="left">V</td>
<td align="left">See you later</td>
</tr>
<tr>
<td align="left">
<bold>07</bold>
</td>
<td align="left">
<bold>P</bold>
</td>
<td align="left">
<bold>See you</bold>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">
<bold>V</bold>
</td>
<td align="left">
<bold>((Open the robotic hand and close it immediately.))</bold>
</td>
</tr>
<tr>
<td align="left"/>
<td align="left">
<bold>P</bold>
</td>
<td align="left">
<bold>((Grip with right hand, and wave with left hand.)) (0.3)</bold>
</td>
</tr>
<tr>
<td align="left">
<bold>08</bold>
</td>
<td align="left">
<bold>P</bold>
</td>
<td align="left">
<bold>Uh-huh. (0.3)</bold>
</td>
</tr>
<tr>
<td align="left">
<bold>09</bold>
</td>
<td align="left">
<bold>V</bold>
</td>
<td align="left">
<bold>See you</bold>
</td>
</tr>
<tr>
<td align="left">
<bold>10</bold>
</td>
<td align="left">
<bold>P</bold>
</td>
<td align="left">
<bold>See you. (1.5)</bold>
</td>
</tr>
<tr>
<td align="left">11</td>
<td align="left">G</td>
<td align="left">[Thank you very much</td>
</tr>
<tr>
<td align="left"/>
<td align="left">V</td>
<td align="left">[Ehehe</td>
</tr>
<tr>
<td align="left">12</td>
<td align="left">P</td>
<td align="left">((While holding the robot hand with both hands)) Ohh:</td>
</tr>
<tr>
<td align="left">13</td>
<td align="left">G</td>
<td align="left">Sorry. It&#x2019;s time</td>
</tr>
<tr>
<td align="left">14</td>
<td align="left">V</td>
<td align="left">I do not want to leave your hands</td>
</tr>
<tr>
<td align="left">15</td>
<td align="left">G</td>
<td align="left">Wa, wait V</td>
</tr>
<tr>
<td align="left">16</td>
<td align="left">V</td>
<td align="left">Okay. I see:</td>
</tr>
<tr>
<td align="left">17</td>
<td align="left">P</td>
<td align="left">Just a little more</td>
</tr>
<tr>
<td align="left">18</td>
<td align="left">G</td>
<td align="left">V, it&#x2019;s time</td>
</tr>
<tr>
<td align="left"/>
<td align="left">V</td>
<td align="left">((Open the robotic hand))</td>
</tr>
<tr>
<td align="left"/>
<td align="left">P</td>
<td align="left">((Release the robotic hand))</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Transcript of virtual idol behaving courteously with the participant. V refers to the virtual idol, P denotes the participant, and G indicates the guide. The numbers in parentheses (<italic>e.g</italic> (0.0)) indicate the time of pause. Square bracket [indicates no &#x201c;gap&#x201d; between the two lines. (( )) describes the actions of the individuals.</p>
</caption>
<graphic xlink:href="frobt-11-1240408-g007.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s5">
<title>5 Discussion</title>
<p>According to Experiment 1, we tested the effectiveness of a robotic handshake by comparing the proposed method that reproduces the handshake of a Japanese idol with a conventional method of face-to-face interaction with the virtual idol. According to the free description in Experiment 1-a, there were comments such as feeling the tactile sensation of the hand during the handshake and perceiving the virtual idol as human-like. We consider that perceiving the virtual idol as human-like raised the sense of intimacy towards the virtual idol. According to the interviews, the participants realized that they were not touching the virtual idol&#x2019;s hand, because the high-five was touched by the flat display. In addition, as participants touched the robotic hand in the embodied condition, the feeling of touching the virtual idol&#x2019;s hand was strengthened. Thus, embodying a part of the virtual idol enhanced the sense of intimacy. As observed from the results of Experiment 1-b, the participants perceived the drag-and-drop task as an enjoyable experience under the embodied touch condition. Therefore, we can consider that the handshake enhanced the social presence of the virtual idol and its reality. These reasons enhanced the feeling of joy. Certain participants remarked that they were surprised by the temperature and softness of the robotic hand (one male and two females in embodied touch condition). The size of the robotic hand remained the same throughout the experiment. Presumably, the impression of the robot hand varied because the male&#x2019;s hands are larger than female&#x2019;s hands, implying that the females were more responsive to the robotic hand&#x2019;s movements than the males. This reason possibly explains the higher score of the females under the embodied touch condition, although no significant variations were observed in the gender factor. In addition, fans participating in the event exhibited similar reactions as participants in the experiment. The fans commented that handshake with the virtual idol provided them happiness, surprise, and their heart were beating. Therefore, the fans exhibited a positive impression of shaking hands with the virtual idol. Based on the results stated in <xref ref-type="table" rid="T2">Table 2</xref>, several fans ranked the conversation experience as the best. In contrast, eight fans ranked the handshake experience as the best, and none ranked it at third. However, six fans ranked the conversation experience as third. Note that the fans participated in this event to engage in a conversation with the virtual idol rather than shaking hands with it. Regardless, all the fans were satisfied after shaking hands with the virtual idol. Thus, the handshake experience was more effective than the fan&#x2019;s expectation.</p>
<p>Based on the results of Experiment 2, the participants experienced more intimacy toward the virtual idol in the visible condition than the imaginable condition. We expected that the boundary between the image of the virtual idol and the robotic hand eluded the sense of reality. Although the participants could experience the presence of the virtual idol in the imaginable condition, the results were contrary to our expectations. Thus, participants who engaged in handshakes were more effective than those in the visible boundary conditions. This result was confirmed from the interview of the event. In the items ranked in <xref ref-type="table" rid="T3">Table 3</xref>, 15 fans ranked the conversation experience (viewing the virtual idol) higher than the date experience (cannot view the virtual idol) and six fans ranked opposite. Certain participants preferred the imaginable situation. The impression with visible/imaginable conditions varied with the relationship between the user and virtual idol. As the fans participated in the event with prior knowledge of the virtual idol, they could imagine the appearance of the virtual idol without viewing it while holding hands.</p>
<p>The results of Experiment 3 revealed that the courteous behavior increased the sense of intimacy toward the virtual idol. In this experiment, the duration between the end of the conversation and the release of the robotic hand by the participant varied. We considered that the feeling of intimacy increased but not with the touching duration, and the virtual idol maintained the handshake, which can be verified from the transcript. At the event, the virtual idol was preconfigured to behave courteously. As observed from the transcript in <xref ref-type="fig" rid="F7">Figure 7</xref>, the fan did not release their hand even after the conversation had ended. More importantly, the virtual idol did not release the fan&#x2019;s hand, which was in line with the fan&#x2019;s intention. Consequently, the fan felt a warm-hearted response that increased the sense of intimacy. We considered that this courteous behavior modified their action. Regardless of the users being fans of the virtual idol, its courteous behavior increased the sense of intimacy toward it.</p>
</sec>
<sec sec-type="conclusion" id="s6">
<title>6 Conclusion</title>
<p>This study focused on handshake with virtual idols and clarified the effective form of shake hands with them. We observed that the handshake by the robotic hand increased the feeling of intimacy toward the virtual idol, which became enjoyable to respond to a request from the virtual idol. In our interface, a certain contradiction was observed between the display and robotic hand, <italic>i.e.</italic>, a virtual idol is presented as an image and its robotic hand acts as a physical embodiment. Based on the experimental results, we observed that even if this contradiction was visible, the appearance of the virtual idols during the handshake increased the feeling of intimacy to the virtual idol. Furthermore, the typical handshake method for idols, wherein the user&#x2019;s hand was grasped after the conversation, increased the feeling of intimacy toward the virtual idol. This courteous touch behavior was effective regardless of the user feeling a favorable impression of the virtual idol.</p>
<p>Virtual idols are nonphysical fictitious idols. The proposed method involved physically shaking hands with them. To combine a handshake gesture with virtual idols, the simulation of the courteous behavior is essential, as observed with real idols. Therefore, the effect of embodying the hand of a virtual idol is necessary, including the effect of their visual contradictions. This study revealed that agents with special roles, like idols, can enhance a sense of familiarity towards them by imitating the behaviors of real idols. As virtual agents with various roles are expected to emerge in the future, we anticipate that the findings of this study regarding social touch that imitates human interactions will be applicable.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s7">
<title>Data availability statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s8">
<title>Ethics statement</title>
<p>The studies involving humans were approved by Osaka University&#x2019;s Research Ethics Committee (Number: 28-5-0). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.</p>
</sec>
<sec id="s9">
<title>Author contributions</title>
<p>YO: conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, software, visualization, writing&#x2013;original draft, and writing&#x2013;review and editing. KO: formal analysis, investigation, visualization, and writing&#x2013;original draft. KT: conceptualization, formal analysis, funding acquisition, investigation, methodology, software, resources, writing&#x2013;original draft, and writing&#x2013;review and editing. HN: conceptualization, formal analysis, funding acquisition, project administration, resources, supervision, writing&#x2013;original draft, and writing&#x2013;review and editing. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="s10">
<title>Funding</title>
<p>The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by JSPS KAKENHI Grant Numbers JP19H00605, 19K12081, JP20H01585, JP20K02982, JP20K20709, JP22K18548, JP22K12126, JP23K13305, and JST CREST Grant Number JPMJCR18A1.</p>
</sec>
<ack>
<p>We thank helo Inc. for hosting the event. And we also thank Okada Hiroshi, Gin Ichiguchi, Yusuke Fujii and Reo Mayuzumi for helping us conduct experiments and the event.</p>
</ack>
<sec sec-type="COI-statement" id="s11">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s12">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Bevan</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Fraser</surname>
<given-names>D. S.</given-names>
</name>
</person-group> (<conf-date>March 2015</conf-date>). <article-title>Shaking hands and cooperation in tele-present human-robot negotiation</article-title>. <conf-name>Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction</conf-name>, <conf-loc>New York, NY, USA</conf-loc>, <fpage>247</fpage>&#x2013;<lpage>254</lpage>. <year>2015</year>, <pub-id pub-id-type="doi">10.1145/2696454.2696490</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Biocca</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Inoue</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Lee</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Polinsky</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Tang</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>Visual cues and virtual touch: role of visual stimuli and intersensory integration in cross-modal haptic illusions and the sense of presence</article-title>. <source>Proc. presence</source> <volume>2002</volume>, <fpage>376</fpage>&#x2013;<lpage>394</lpage>.</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Biocca</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Choi</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Visual touch in virtual environments: an exploratory study of presence, multimodal interfaces, and cross-modal sensory illusions</article-title>. <source>Presence Teleoperators Virtual Environ.</source> <volume>10</volume> (<issue>3</issue>), <fpage>247</fpage>&#x2013;<lpage>265</lpage>. <pub-id pub-id-type="doi">10.1162/105474601300343595</pub-id>
</citation>
</ref>
<ref id="B4">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Boucaud</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Tafiani</surname>
<given-names>Q.</given-names>
</name>
<name>
<surname>Pelachaud</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Thouvenin</surname>
<given-names>I.</given-names>
</name>
</person-group> (<conf-date>June 2019</conf-date>). <article-title>Social touch in human-agent interactions in an immersive virtual environment</article-title>. <conf-name>Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications</conf-name>, <conf-loc>New York, NY, USA</conf-loc>, <year>2019</year>, <fpage>129</fpage>&#x2013;<lpage>136</lpage>. <pub-id pub-id-type="doi">10.5220/0007397001290136</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Chang</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Modhrain</surname>
<given-names>S. O.</given-names>
</name>
<name>
<surname>Jacob</surname>
<given-names>R. J. K.</given-names>
</name>
<name>
<surname>Gunther</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Ishii</surname>
<given-names>H.</given-names>
</name>
</person-group> (<conf-date>July 2002</conf-date>). <article-title>ComTouch: a vibrotactile communication device</article-title>. <conf-name>Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and technique</conf-name>, <fpage>312</fpage>&#x2013;<lpage>320</lpage>. <conf-loc>New York, NY, USA</conf-loc>, <year>2002</year>, <pub-id pub-id-type="doi">10.1145/778712.778755</pub-id>
</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Choudhry</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Han</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Xu</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Huang</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>&#x201c;I felt a little crazy following a &#x2018;doll&#x2019;&#x201d; investigating real influence of virtual influencers on their followers</article-title>. <source>Proc. ACM Human-Computer Interact.</source> <volume>6</volume> (<issue>43</issue>), <fpage>1</fpage>&#x2013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1145/3492862</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fusaro</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Lisi</surname>
<given-names>M. P.</given-names>
</name>
<name>
<surname>Tieri</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Aglioti</surname>
<given-names>S. M.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Heterosexual, gay, and lesbian people&#x2019;s reactivity to virtual caresses on their embodied avatars&#x2019; taboo zones</article-title>. <source>Sci. Rep.</source> <volume>11</volume>, <fpage>2221</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-021-81168-w</pub-id>
</citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Galbraith</surname>
<given-names>P. W.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>AKB business: idols and affective economics in contemporary Japan</article-title>,&#x201d; in <source>Introducing Japanese Popular Culture</source>, <volume>12</volume>, <fpage>158</fpage>&#x2013;<lpage>167</lpage>.</citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Galbraith</surname>
<given-names>P. W.</given-names>
</name>
<name>
<surname>Karlin</surname>
<given-names>J. G.</given-names>
</name>
</person-group> (<year>2012a</year>). <article-title>Introduction: the mirror of idols and celebrity</article-title>. <source>Idols Celebrity Jpn. Media Cult.</source>, <volume>52</volume>, <fpage>1</fpage>&#x2013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1057/9781137283788_1</pub-id>
</citation>
</ref>
<ref id="B10">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Galbraith</surname>
<given-names>P. W.</given-names>
</name>
<name>
<surname>Karlin</surname>
<given-names>J. G.</given-names>
</name>
</person-group> (<year>2012b</year>). <source>Introduction: the mirror of idols and celebrity</source>. <publisher-name>Palgrave Macmillan</publisher-name>. <publisher-loc>London, UK</publisher-loc>.</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Geva</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Uzefovsky</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Levy-Tzedek</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Touching the social robot PARO reduces pain perception and salivary oxytocin levels</article-title>. <source>Sci. Rep.</source> <volume>10</volume> (<issue>1</issue>), <fpage>9814</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-020-66982-y</pub-id>
</citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Haans</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Ijsselsteijn</surname>
<given-names>W. A.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>The virtual midas touch: helping behavior after a mediated social touch</article-title>. <source>IEEE Trans. Haptics</source> <volume>2</volume> (<issue>3</issue>), <fpage>136</fpage>&#x2013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1109/TOH.2009.20</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Higashino</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Kimoto</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Iio</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Shimohara</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Tactile stimulus is essential to increase motivation for touch interaction in virtual environment</article-title>. <source>Adv. Robot.</source> <volume>35</volume> (<issue>17</issue>), <fpage>1043</fpage>&#x2013;<lpage>1053</lpage>. <pub-id pub-id-type="doi">10.1080/01691864.2021.1967780</pub-id>
</citation>
</ref>
<ref id="B15">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Hoppe</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Neumann</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Streuber</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Schmidt</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Machulla</surname>
<given-names>T. K.</given-names>
</name>
</person-group> (<conf-date>June 2020</conf-date>). <article-title>A human touch: social touch increases the perceived human-likeness of agents in virtual reality</article-title>. <conf-name>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems</conf-name>, <conf-loc>Honolulu, HI, USA</conf-loc>, <year>2020</year>, <fpage>1</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1145/3313831.3376719</pub-id>
</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Social touch technology: a survey of haptic technology for social touch</article-title>. <source>IEEE Trans. Haptics</source> <volume>10</volume> (<issue>3</issue>), <fpage>391</fpage>&#x2013;<lpage>408</lpage>. <pub-id pub-id-type="doi">10.1109/TOH.2017.2650221</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huisman</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Bruijnes</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kolkmeier</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Jung</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Frederiks</surname>
<given-names>A. D.</given-names>
</name>
<name>
<surname>Rybarczyk</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Touching virtual agents: embodiment and mind</article-title>. <source>IFIP Adv. Inf. Commun. Technol.</source> <volume>425</volume>, <fpage>114</fpage>&#x2013;<lpage>138</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-642-55143-7_5</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Knapp</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Hall</surname>
<given-names>J. A.</given-names>
</name>
</person-group> (<year>2010</year>). <source>Nonverbal communication in human interaction</source>. <publisher-name>Cengage Learning</publisher-name>, <publisher-loc>Coimbatore, India</publisher-loc>.</citation>
</ref>
<ref id="B19">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Kotranza</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Lok</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Pugh</surname>
<given-names>C. M.</given-names>
</name>
<name>
<surname>Lind</surname>
<given-names>D. S.</given-names>
</name>
</person-group> (<conf-date>June 2009</conf-date>). <article-title>Virtual humans that touch back: enhancing nonverbal communication with virtual humans through bidirectional touch</article-title>. <conf-name>Proceedings of the IEEE Virtual Real. Conf.</conf-name>, <year>2009</year>, <conf-loc>Atlanta, GA, USA</conf-loc>, <fpage>175</fpage>&#x2013;<lpage>178</lpage>. <pub-id pub-id-type="doi">10.1109/VR.2009.4811019</pub-id>
</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kumagai</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Nonomura</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2023</year>). <article-title>Enhancement of handshake attraction through tactile, visual, and auditory multimodal stimulation</article-title>. <source>Technologies</source> <volume>11</volume> (<issue>4</issue>), <fpage>86</fpage>. <pub-id pub-id-type="doi">10.3390/technologies11040086</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lam</surname>
<given-names>K. Y.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>The hatsune miku phenomenon: more than a virtual J-pop diva</article-title>. <source>J. Popular Cult.</source> <volume>49</volume> (<issue>5</issue>), <fpage>1107</fpage>&#x2013;<lpage>1124</lpage>. <pub-id pub-id-type="doi">10.1111/jpcu.12455</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Lu</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Shen</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Shen</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Wigdor</surname>
<given-names>D.</given-names>
</name>
</person-group> (<conf-date>March 2021</conf-date>). <article-title>More kawaii than a real-person live streamer: understanding how the otaku community engages with and perceives virtual YouTubers</article-title>. <conf-name>Proceedings of the 2021 CHI Conf. Hum. Factors Comput. Syst.</conf-name>, <conf-loc>Yokohama, Japan</conf-loc>, <year>2021</year>, <fpage>1</fpage>&#x2013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1145/3411764.3445660</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lukacs</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>The labor of cute: net idols, cute culture, and the digital economy in contemporary Japan</article-title>. <source>Positions Asia Crit.</source> <volume>23</volume> (<issue>3</issue>), <fpage>487</fpage>&#x2013;<lpage>513</lpage>. <pub-id pub-id-type="doi">10.1215/10679847-3125863</pub-id>
</citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Maneechaeye</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>The commodification of idol culture with a loot-boxes-style marketing strategy practice in Thai idol culture and aspects of consumer psychology toward uncertainties</article-title>. <source>Humanit. Arts Soc. Sci. Stud.</source> <volume>21</volume> (<issue>2</issue>), <fpage>179</fpage>&#x2013;<lpage>198</lpage>. <pub-id pub-id-type="doi">10.14456/hasss.2021.18</pub-id>
</citation>
</ref>
<ref id="B25">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Morikawa</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Hashimoto</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Munakata</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Okunaka</surname>
<given-names>J.</given-names>
</name>
</person-group> (<conf-date>November 2006</conf-date>). <article-title>Embrace system for remote counseling</article-title>. <conf-name>Proceedings of the 8th Int. Conf. Multimodal interfaces</conf-name>, <conf-loc>Alberta, Canada</conf-loc>, <fpage>318</fpage>&#x2013;<lpage>325</lpage>. <pub-id pub-id-type="doi">10.1145/1180995.1181055</pub-id>
</citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nagamachi</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Kato</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Sugimoto</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Inami</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kitazaki</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Pseudo physical contact and communication in VRChat: a study with survey method in Japanese users</article-title>. <source>ICAT-EGVE</source> <volume>2020</volume>. <pub-id pub-id-type="doi">10.2312/egve.2020127</pub-id>
</citation>
</ref>
<ref id="B27">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Nakanishi</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Tanaka</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Wada</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<conf-date>June 2014</conf-date>). <article-title>Remote handshaking: touch enhances video-mediated social telepresence</article-title>. <conf-name>Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</conf-name>, <conf-loc>Toronto, Canada</conf-loc>, <fpage>2143</fpage>&#x2013;<lpage>2152</lpage>. <pub-id pub-id-type="doi">10.1145/2556288.2557169</pub-id>
</citation>
</ref>
<ref id="B28">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Onishi</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Tanaka</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Nakanishi</surname>
<given-names>H.</given-names>
</name>
</person-group> (<conf-date>August 2016</conf-date>). <article-title>Embodiment of video-mediated communication enhances social telepresence</article-title>. <conf-name>Proceedings of the Fourth International Conference on Human Agent Interaction</conf-name>, <conf-loc>Singapore</conf-loc>, <fpage>171</fpage>&#x2013;<lpage>178</lpage>. <pub-id pub-id-type="doi">10.1145/2974804.2974826</pub-id>
</citation>
</ref>
<ref id="B29">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Park</surname>
<given-names>Y. W.</given-names>
</name>
<name>
<surname>Baek</surname>
<given-names>K. M.</given-names>
</name>
<name>
<surname>Nam</surname>
<given-names>T. J.</given-names>
</name>
</person-group> (<conf-date>May 2013</conf-date>). <article-title>The roles of touch during phone conversations: long-distance couples&#x2019; use of POKE in their homes</article-title>. <conf-name>Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</conf-name>, <conf-loc>San Francisco, CA, USA</conf-loc>, <fpage>1679</fpage>&#x2013;<lpage>1688</lpage>. <pub-id pub-id-type="doi">10.1145/2470654.2466222</pub-id>
</citation>
</ref>
<ref id="B30">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Samani</surname>
<given-names>H. A.</given-names>
</name>
<name>
<surname>Parsani</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Rodriguez</surname>
<given-names>L. T.</given-names>
</name>
<name>
<surname>Saadatian</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Dissanayake</surname>
<given-names>K. H.</given-names>
</name>
<name>
<surname>Cheok</surname>
<given-names>A. D.</given-names>
</name>
</person-group> (<conf-date>March 2012</conf-date>). <article-title>Kissenger: design of a kiss transmission device</article-title>. <conf-name>Proceedings of the Designing Interactive Systems Conference</conf-name>, <conf-loc>Pittsburgh, PA, USA</conf-loc>, <fpage>48</fpage>&#x2013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1145/2317956.2317965</pub-id>
</citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hagita</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Audio-visual stimuli change not only robot&#x2019;s hug impressions but also its stress-buffering effects</article-title>. <source>Int. J. Soc. Robotics</source> <volume>13</volume>, <fpage>469</fpage>&#x2013;<lpage>476</lpage>. <pub-id pub-id-type="doi">10.1007/s12369-019-00530-1</pub-id>
</citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Nakagawa</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Shinozawa</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Matsumura</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ishiguro</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Hagita</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Does A robot&#x2019;s touch encourage human effort?</article-title> <source>Int. J. Soc. Robotics</source> <volume>9</volume>, <fpage>5</fpage>&#x2013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1007/s12369-016-0339-x</pub-id>
</citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Nakata</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Kanbara</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hagita</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2020a</year>). <article-title>Robot reciprocation of hugs increases both interacting times and self-disclosures</article-title>. <source>Int. J. Soc. Robotics</source> <volume>13</volume>, <fpage>353</fpage>&#x2013;<lpage>361</lpage>. <pub-id pub-id-type="doi">10.1007/s12369-020-00644-x</pub-id>
</citation>
</ref>
<ref id="B34">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Sumioka</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Ishiguro</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2020b</year>). <article-title>Survey of social touch interaction between humans and robots</article-title>. <source>J. Robotics Mechatronics</source> <volume>32</volume> (<issue>1</issue>), <fpage>128</fpage>&#x2013;<lpage>135</lpage>. <pub-id pub-id-type="doi">10.20965/jrm.2020.p0128</pub-id>
</citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sugimori</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Mitake</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Sato</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Oguri</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Hasegawa</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Avatar tracking control with generations of physically natural responses on contact to reduce performers&#x2019; loads</article-title>. <source>Proc. 27th ACM Symposium Virtual Real. Softw. Technol.</source> <volume>1</volume>, <fpage>1</fpage>&#x2013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1145/3489849.3489859</pub-id>
</citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sumioka</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Nakae</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Kanai</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ishiguro</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Huggable communication medium decreases cortisol levels</article-title>. <source>Sci. Rep.</source> <volume>3</volume> (<issue>1</issue>), <fpage>3034</fpage>. <pub-id pub-id-type="doi">10.1038/srep03034</pub-id>
</citation>
</ref>
<ref id="B37">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Swidrak</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Pochwatko</surname>
<given-names>G.</given-names>
</name>
</person-group> (<conf-date>July 2019</conf-date>). <article-title>Being touched by a virtual human.: relationships between heart rate, gender, social status, and compliance</article-title>. <conf-name>Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents</conf-name>, <conf-loc>Paris, France</conf-loc>, <fpage>49</fpage>&#x2013;<lpage>55</lpage>. <pub-id pub-id-type="doi">10.1145/3308532.3329467</pub-id>
</citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sykownik</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Masuch</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>The experience of social touch in multi-user virtual reality</article-title>. <source>Proc. 26th ACM Symposium Virtual Real. Softw. Technol.</source> <volume>30</volume>, <fpage>1</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1145/3385956.3418944</pub-id>
</citation>
</ref>
<ref id="B39">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Tanaka</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Mayazumi</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Takahashi</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Takaki</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Oka</surname>
<given-names>N.</given-names>
</name>
</person-group> (<conf-date>June 2021</conf-date>). <article-title>Robot mediated handholding combined with a mobile video call makes the users feel nearer and closer</article-title>. <conf-name>Proceedings of the 9th International Conference on Human-Agent Interaction</conf-name>, <conf-loc>New York, NY, USA</conf-loc>, <fpage>3</fpage>&#x2013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1145/3472307.3484168</pub-id>
</citation>
</ref>
<ref id="B40">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Teh</surname>
<given-names>J. K. S.</given-names>
</name>
<name>
<surname>Cheok</surname>
<given-names>A. D.</given-names>
</name>
<name>
<surname>Peiris</surname>
<given-names>R. L.</given-names>
</name>
<name>
<surname>Choi</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Thuong</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Lai</surname>
<given-names>S.</given-names>
</name>
</person-group> (<conf-date>December 2008</conf-date>). <article-title>Huggy pajama: a mobile parent and child hugging communication system</article-title>. <conf-name>Proceedings of the 7th international conference on Interaction design and children</conf-name>, <conf-loc>Chicago, IL, USA</conf-loc>, <fpage>250</fpage>&#x2013;<lpage>257</lpage>. <pub-id pub-id-type="doi">10.1145/1463689.1463763</pub-id>
</citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Teyssier</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bailly</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Pelachaud</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Lecolinet</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Conveying emotions through device-initiated touch</article-title>. <source>IEEE Trans. Affect. Comput.</source> <volume>13</volume> (<issue>3</issue>), <fpage>1477</fpage>&#x2013;<lpage>1488</lpage>. <pub-id pub-id-type="doi">10.1109/TAFFC.2020.3008693</pub-id>
</citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>van Erp</surname>
<given-names>J. B. F.</given-names>
</name>
<name>
<surname>Toet</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Social touch in Human&#xe2;&#x20ac; computer interaction</article-title>. <source>Front. Digital Humanit.</source> <volume>2</volume> (<issue>2</issue>). <pub-id pub-id-type="doi">10.3389/fdigh.2015.00002</pub-id>
</citation>
</ref>
<ref id="B43">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Vetere</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Gibbs</surname>
<given-names>M. R.</given-names>
</name>
<name>
<surname>Kjeldskov</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Howard</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Mueller</surname>
<given-names>F. F.</given-names>
</name>
<name>
<surname>Pedell</surname>
<given-names>S.</given-names>
</name>
<etal/>
</person-group> (<conf-date>May 2005</conf-date>). <article-title>Mediating intimacy: designing technologies to support strong-tie relationships</article-title>. <conf-name>Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</conf-name>, <conf-loc>Toronto, Canada</conf-loc>, <fpage>471</fpage>&#x2013;<lpage>480</lpage>. <pub-id pub-id-type="doi">10.1145/1054972.1055038</pub-id>
</citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Giannopoulos</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Slater</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Peer</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Handshake: realistic human-robot interaction in haptic enhanced virtual reality</article-title>. <source>Presence</source> <volume>20</volume> (<issue>4</issue>), <fpage>371</fpage>&#x2013;<lpage>392</lpage>. <pub-id pub-id-type="doi">10.1162/PRES_a_00061</pub-id>
</citation>
</ref>
<ref id="B45">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Willemse</surname>
<given-names>C. J. A. M.</given-names>
</name>
<name>
<surname>van Erp</surname>
<given-names>J. B. F.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Social touch in human&#x2013;robot interaction: robot-initiated touches can induce positive responses without extensive prior bonding</article-title>. <source>Int. J. Soc. Robotics</source> <volume>11</volume> (<issue>2</issue>), <fpage>285</fpage>&#x2013;<lpage>304</lpage>. <pub-id pub-id-type="doi">10.1007/s12369-018-0500-9</pub-id>
</citation>
</ref>
<ref id="B46">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Yakura</surname>
<given-names>H.</given-names>
</name>
</person-group> (<conf-date>August 2021</conf-date>). <article-title>No More Handshaking: how have COVID-19 pushed the expansion of computer-mediated communication in Japanese idol culture?</article-title> <conf-name>Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems</conf-name>, <conf-loc>Yokohama Japan</conf-loc>, <fpage>1</fpage>&#x2013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.1145/3411764.3445252</pub-id>
</citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yarosh</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Mejia</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Unver</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Yao</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Campbell</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>SqueezeBands: mediated social touch using shape memory alloy actuation</article-title>. <source>Proc. ACM Human-Computer Interact.</source> <volume>1</volume> (<issue>116</issue>), <fpage>1</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1145/3134751</pub-id>
</citation>
</ref>
<ref id="B48">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yin</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Vocaloid in China: cosmopolitan music, cultural expression, and multilayer identity</article-title>. <source>Glob. Media China</source> <volume>3</volume> (<issue>1</issue>), <fpage>51</fpage>&#x2013;<lpage>66</lpage>. <pub-id pub-id-type="doi">10.1177/2059436418778600</pub-id>
</citation>
</ref>
<ref id="B49">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Saboune</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Saddik</surname>
<given-names>A. E.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Development of a haptic video chat system</article-title>. <source>Multimedia Tools Appl.</source> <volume>74</volume>, <fpage>5489</fpage>&#x2013;<lpage>5512</lpage>. <pub-id pub-id-type="doi">10.1007/s11042-014-1865-x</pub-id>
</citation>
</ref>
<ref id="B50">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zheng</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Minato</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Ishiguro</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>What kinds of robot&#x27;s touch will match expressed emotions?</article-title> <source>IEEE Robotics Automation Lett.</source> <volume>5</volume> (<issue>1</issue>), <fpage>127</fpage>&#x2013;<lpage>134</lpage>. <pub-id pub-id-type="doi">10.1109/LRA.2019.2947010</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>