<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Virtual Real.</journal-id>
<journal-title>Frontiers in Virtual Reality</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Virtual Real.</abbrev-journal-title>
<issn pub-type="epub">2673-4192</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">837616</article-id>
<article-id pub-id-type="doi">10.3389/frvir.2022.837616</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Virtual Reality</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Opportunities and Challenges of Virtual Reality in Healthcare &#x2013; A Domain Experts Inquiry</article-title>
<alt-title alt-title-type="left-running-head">Halbig&#x2009; et&#x20;al.</alt-title>
<alt-title alt-title-type="right-running-head">Acceptance of VR in Healthcare</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Halbig&#x2009;</surname>
<given-names>Andreas</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1133006/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Babu&#x2009;</surname>
<given-names>Sooraj K.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1602664/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Gatter&#x2009;</surname>
<given-names>Shirin</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1581800/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Latoschik&#x2009;</surname>
<given-names>Marc Erich</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/137631/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Brukamp</surname>
<given-names>Kirsten</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>von Mammen&#x2009;</surname>
<given-names>Sebastian</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/171131/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>Human-Computer Interaction</institution>, <institution>Julius-Maximilians University</institution>, <addr-line>W&#xfc;rzburg</addr-line>, <country>Germany</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>Research Group Health&#x2013;Technology&#x2013;Ethics</institution>, <institution>Protestant University of Applied Sciences</institution>, <addr-line>Ludwigsburg</addr-line>, <country>Germany</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1050690/overview">Salam Daher</ext-link>, New Jersey Institute of Technology, United&#x20;States</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1319719/overview">Margarita Vinnikov</ext-link>, New Jersey Institute of Technology, United&#x20;States</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1634638/overview">Jordi Torner</ext-link>, Universitat Politecnica de Catalunya, Spain</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Andreas Halbig&#x2009;, <email>andreas.halbig@uni-wuerzburg.de</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Virtual Reality in Medicine, a section of the journal Frontiers in Virtual Reality</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>23</day>
<month>03</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>3</volume>
<elocation-id>837616</elocation-id>
<history>
<date date-type="received">
<day>16</day>
<month>12</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>03</day>
<month>02</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Halbig&#x2009;, Babu&#x2009;, Gatter&#x2009;, Latoschik&#x2009;, Brukamp and von Mammen&#x2009;.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Halbig&#x2009;, Babu&#x2009;, Gatter&#x2009;, Latoschik&#x2009;, Brukamp and von Mammen&#x2009;</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>In recent years, the applications and accessibility of Virtual Reality (VR) for the healthcare sector have continued to grow. However, so far, most VR applications are only relevant in research settings. Information about what healthcare professionals would need to independently integrate VR applications into their daily working routines is missing. The actual needs and concerns of the people who work in the healthcare sector are often disregarded in the development of VR applications, even though they are the ones who are supposed to use them in practice. By means of this study, we systematically involve health professionals in the development process of VR applications. In particular, we conducted an online survey with 102 healthcare professionals based on a video prototype which demonstrates a software platform that allows them to create and utilise VR experiences on their own. For this study, we adapted and extended the Technology Acceptance Model (TAM). The survey focused on the perceived usefulness and the ease of use of such a platform, as well as the attitude and ethical concerns the users might have. The results show a generally positive attitude toward such a software platform. The users can imagine various use cases in different health domains. However, the perceived usefulness is tied to the actual ease of use of the platform and sufficient support for learning and working with the platform. In the discussion, we explain how these results can be generalized to facilitate the integration of VR in healthcare practice.</p>
</abstract>
<kwd-group>
<kwd>virtual reality</kwd>
<kwd>healthcare</kwd>
<kwd>therapy</kwd>
<kwd>rehabilitation</kwd>
<kwd>ethics</kwd>
<kwd>technology acceptance</kwd>
<kwd>authoring platform</kwd>
<kwd>healthcare professionals</kwd>
</kwd-group>
<contract-sponsor id="cn001">Bundesministerium f&#xfc;r Bildung und Forschung<named-content content-type="fundref-id">10.13039/501100002347</named-content>
</contract-sponsor>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>There is a wide range of potential applications of VR systems in the healthcare sector. Therapeutic support applications target, for instance, exposure therapy for patients with a fear of heights (<xref ref-type="bibr" rid="B31">Gonzalez et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B49">Kaur et&#x20;al., 2019</xref>), spiders (<xref ref-type="bibr" rid="B86">Shiban et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B68">Mertens et&#x20;al., 2019</xref>), or public speaking (<xref ref-type="bibr" rid="B40">Herumurti et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B30">Gl&#xe9;marec et&#x20;al., 2021</xref>). Others use the effects of embodiment to deal with body perception disorders that often come with obesity or anorexia (<xref ref-type="bibr" rid="B23">D&#xf6;llinger et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B104">Wolf et&#x20;al., 2021</xref>). Physiological health can be supported by exercise-based training applications in which VR promises increased motivational and training effects. The same arguments apply to virtual physiotherapy measures, e.g. to recover from surgery or to counteract gait impairments (<xref ref-type="bibr" rid="B37">Hamzeheinejad et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B53">Kern et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B29">Gianola et&#x20;al., 2020</xref>). Patients who suffer from the consequences of a stroke can regain motor skills by practicing with virtual replacements of their limbs (<xref ref-type="bibr" rid="B100">Wang W. et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B69">Moldoveanu et&#x20;al., 2019</xref>) and even addiction scenarios can be simulated in virtual worlds which can serve as a basis for treatment (<xref ref-type="bibr" rid="B93">Thompson-Lake et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B101">Wang Y.-g. et&#x20;al., 2019</xref>).</p>
<p>The fact that the possibilities are so versatile also means that it is relatively difficult for healthcare professionals to get a hold of applications that are suitable for their clientele. While there have been various efforts to making the creation of VR applications easier and more accessible (<xref ref-type="bibr" rid="B57">Latoschik and Tramberend, 2011</xref>; <xref ref-type="bibr" rid="B25">Fischbach et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B73">Neelakantam and Pant, 2017</xref>; <xref ref-type="bibr" rid="B5">Andone and Frydenberg, 2019</xref>; <xref ref-type="bibr" rid="B84">Santos and Cardoso, 2019</xref>; <xref ref-type="bibr" rid="B109">Zhang and Oney, 2020</xref>), they have not focused on the healthcare domain with its specific requirements. Moreover, these works had programmers and designers of virtual words in mind as the targeted users, whereas healthcare professionals likely lack both these backgrounds. In this study, we assume that there was a platform, similar to the concept presented by <xref ref-type="bibr" rid="B97">von Mammen et&#x20;al. (2019)</xref>, that specifically allowed health professionals to compose VR experiences that are meant to help them in their daily work. Based on this assumption, we embark on the quest to find out whether such a software platform had the potential to be established in healthcare practice and what the conditions for its acceptance would be. In this work we will refer to this as our &#x201c;envisioned software platform&#x201d;. We see potential users of this platform mainly from four specific healthcare domains. In the 1) therapy domain the envisioned software platform can be used to create VR applications for the treatment of anxiety, obsessive-compulsive, and body-awareness disorders. For example, this work by <xref ref-type="bibr" rid="B23">D&#xf6;llinger et&#x20;al. (2019)</xref> investigates the usage of VR for modulated body image perception for behavior therapy that addresses obesity challenges. In the 2) rehabilitation domain the envisioned software platform can be used to create, for example, VR applications that assist in regaining physical and motor abilities after an accident, surgery, or a stroke. So, this area mainly concerns physiotherapists. <xref ref-type="bibr" rid="B53">Kern et&#x20;al. (2019)</xref>; <xref ref-type="bibr" rid="B37">Hamzeheinejad et&#x20;al. (2019)</xref> have examined the impact of VR in gait rehabilitation, and <xref ref-type="bibr" rid="B58">Laver et&#x20;al. (2017)</xref>; <xref ref-type="bibr" rid="B108">Zhang (2020)</xref> used VR for stroke rehabilitation and helped patients to recover from the impacts after spinal cord injuries. In the domain of 3) training, the envisioned software platform can be used to create controlled and save virtual training environments for the healthcare domain, e.g. for schooling first-aid, nursing, or surgical procedures. An example here comes from <xref ref-type="bibr" rid="B66">Mathur (2015)</xref> who worked on a low-cost VR system for medical training and found it to be more effective than a normal setup. In the 4) prevention domain the envisioned software platform can be used to create simulations that showcase the dangers of drug abuse or help with relaxation to prevent stress-related diseases. For example, the work by <xref ref-type="bibr" rid="B75">Nemire et&#x20;al. (1999)</xref> looked into the possibilities of using a Hi-Fi VR system to prevent teens from smoking. So when we talk about the &#x201c;potential users&#x201d; of the envisioned software platform or &#x201c;healthcare professionals&#x201d; we usually refer to people who are employed in these four domains. There are other relevant areas, but they are not in focus for now; as they affect fewer patients or for other reasons. This includes, for example, the use of VR for training cognitive skills in dementia or for distraction in palliative patients. In the first area, however, good technologically supported applications already exist (<xref ref-type="bibr" rid="B7">Arlati et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B107">Zaj&#x105;c-Lamparska et&#x20;al., 2019</xref>). The second application area is smaller, and the provision of beautiful environments tends to be sufficient (<xref ref-type="bibr" rid="B76">Niki et&#x20;al., 2019</xref>), which is probably also an important prerequisite for the other application&#x20;areas.</p>
<p>Surveying the literature, we found no information about the view of healthcare professionals on VR. In particular, we could not find any studies that shed light on the prioritization of aspects for adaptation of VR from the view of healthcare professionals. Yet, their assessment is an invaluable source of information that has not yet been sufficiently embraced. This lack of information motivates this study. We aim at understanding whether and under which conditions healthcare specialists without technical background would embrace VR as a medium to enhance the effectiveness of their work. We are specifically interested in their prerequisites to autonomously create and utilize VR applications. We also want to determine their acceptance of an according software platform that would empower them to do so. We want to capture their opinions and concerns, as well as their suggestions toward design specifics and ideas about requirements of the platform.</p>
<p>As a result, we conducted an online inquiry based on a video that depicts our envisioned software platform. Our questions target the categories 1) perceived usefulness, 2) perceived ease of use, 3) general attitude, and 4) ethical concerns toward the envisioned software platform. Together, they address two aspects which are considered central in the context of technology development: The users and their needs in the sense of user-centered design (e.g., <xref ref-type="bibr" rid="B48">Karat and Karat, 2003</xref>) and a basis for ELSI-conform development, i.e.,&#x20;to reflect the ethical, legal, and social implications on individuals as well as on society and to engineer according measures (e.g., <xref ref-type="bibr" rid="B32">Greenbaum, 2015</xref>).</p>
<p>The gained knowledge can be used to spur the integration of VR into healthcare work routines and pave the way for VR out of the laboratory and into common practice. The captured requirements can immediately and effectively inform the development of a great number of health-related VR experiences, and be considered in according, generic authoring platforms for VR experiences. In addition, it can provide a basis for future research, especially considering concerns of the potential&#x20;users.</p>
<p>The rest of this article is structured as follows: In the related work section, we report on VR authoring tools and technology-related acceptance and ethics studies. Then, in the methods section, we explain how the video prototype was created and how we structured and executed the online survey. In the fourth section, we list the results and in section five we discuss these results in terms of what they mean for the envisioned software platform and VR healthcare applications in general. Eventually, we will wrap the article up in the conclusion.</p>
</sec>
<sec id="s2">
<title>2 Related Work</title>
<p>This chapter presents preceding works that form the basis for our study. With regard to the technological background, this includes an introduction to previously developed systems similar to the envisioned software platform and a summary of their relevant components. To bolster the methodological and conceptual basis for the inquiry, preceding studies on the user acceptance of novel technologies by specific professional groups are presented. Moreover, we describe the Technology Acceptance Model and shed light on preceding research on the ethical aspects of using&#x20;VR.</p>
<sec id="s2-1">
<title>2.1 Evolution of Authoring Tools</title>
<p>Different from previous attempts, the market success of VR head-mounted displays and 3D controllers that started in the early 2000s has not been stopped short, yet. With pricing and capabilities making VR technology more accessible than ever and sales numbers growing rapidly (<xref ref-type="bibr" rid="B6">Angelov et&#x20;al., 2020</xref>), the need for authoring platforms of VR experiences has grown as well (<xref ref-type="bibr" rid="B8">Ashtari et&#x20;al., 2020</xref>).</p>
<p>The developments towards authoring tools started in the early nineties with technical libraries and toolkits. Scene graph libraries such as OpenGL Performer (<xref ref-type="bibr" rid="B81">Rohlf and Helman, 1994</xref>), Open Inventor (<xref ref-type="bibr" rid="B90">Strauss and Carey, 1992</xref>), and OpenSceneGraph (<xref ref-type="bibr" rid="B99">Wang and Qian, 2010</xref>) were created to realize visual simulations, virtual reality environments and other real-time 3D graphics applications. But oftentimes, most of these libraries focused on performance over ease of programmability. Also, developers often found it difficult to use these general-purpose libraries for specific problems (<xref ref-type="bibr" rid="B12">Bethel et&#x20;al., 1999</xref>). Either these libraries were extended (<xref ref-type="bibr" rid="B41">Hesina et&#x20;al., 1999</xref>), or additional packages and frameworks were developed upon these toolkits that could be used to bridge this gap (<xref ref-type="bibr" rid="B52">Kelso et&#x20;al., 2002</xref>; <xref ref-type="bibr" rid="B77">Pavlik and Vance, 2012</xref>).</p>
<p>Further, many platforms supported networking and enabled the development of multi-user virtual environments (<xref ref-type="bibr" rid="B15">Carlsson and Hagsand, 1993</xref>; <xref ref-type="bibr" rid="B33">Greenhalgh and Benford, 1995</xref>; <xref ref-type="bibr" rid="B2">Allard et&#x20;al., 2002</xref>). <xref ref-type="bibr" rid="B57">Latoschik and Tramberend (2011)</xref> created the open-source research platform Simulator X that is targeted at developing real-time interactive systems. <xref ref-type="bibr" rid="B25">Fischbach et&#x20;al. (2017)</xref>, for example, demonstrated how this platform can be used to increase the software quality of real-time interactive systems. Efforts like this made multiple developers and applications work in a common environment and communicate with each other without exposing the complex internal architectures. Frameworks like Avocado/Avango (<xref ref-type="bibr" rid="B94">Tramberend, 1999</xref>; <xref ref-type="bibr" rid="B55">Kuck et&#x20;al., 2008</xref>), MR Toolkit (<xref ref-type="bibr" rid="B85">Shaw et&#x20;al., 1993</xref>), or VR Juggler (<xref ref-type="bibr" rid="B13">Bierbaum et&#x20;al., 2001</xref>) provided high-level APIs to mask the system level architecture from the author. Also, the generality of the data-flow architecture used in these platforms enabled an easy exchange of data across modules, and their users were empowered to create a wide variety of virtual environments (<xref ref-type="bibr" rid="B24">Figueroa et&#x20;al., 2002</xref>; <xref ref-type="bibr" rid="B1">Allard et&#x20;al., 2004</xref>, <xref ref-type="bibr" rid="B3">2010</xref>, <xref ref-type="bibr" rid="B4">2005</xref>).</p>
<p>These libraries and frameworks focused on software architectures and were thus to be used by programmers. A user without profound knowledge in software development would find it overwhelming to understand their respective workflows. The early developments, starting from the libraries and toolkits, slowly evolved into high fidelity authoring platforms over time. With the current advancements in technology and with the wide acceptance of VR, researchers and developers are innovating more sophisticated and effective solutions that can be used to produce more immersive and realistic content. A-frame<xref ref-type="fn" rid="FN1">
<sup>1</sup>
</xref> is a relatively new open-source framework from Mozilla to generate WebVR content (<xref ref-type="bibr" rid="B73">Neelakantam and Pant, 2017</xref>). Creating a VR experience is cost-effective in A-frame, but the initial learning curve can be an insurmountable obstacle to novice users (<xref ref-type="bibr" rid="B84">Santos and Cardoso, 2019</xref>). Many commercial and research solutions are addressing the design challenges faced by educators. CoSpaces<xref ref-type="fn" rid="FN2">
<sup>2</sup>
</xref>, InstaVR<xref ref-type="fn" rid="FN3">
<sup>3</sup>
</xref>, or WondaVR<xref ref-type="fn" rid="FN4">
<sup>4</sup>
</xref> are examples for commercial platforms primarily targeting the education sector. Among these, we found CoSpaces to be an easy-to-use, beginner-friendly tool, that allows the users to create simple VR environments using a drag and drop facility and allows to make the models interactive by employing a Scratch-like visual programming environment (<xref ref-type="bibr" rid="B5">Andone and Frydenberg, 2019</xref>). FlowMatic (<xref ref-type="bibr" rid="B109">Zhang and Oney, 2020</xref>) is a VR experience editor that uses a different approach to the design process by introducing a concept called immersive authoring. Most of the authoring platforms use 2D software to design the VR experience which takes off the freedom of using spatial information into consideration. FlowMatic makes use of VR, to create VR experiences taking advantage of the 3D spatial interaction. However, FlowMatic focuses only on making the newly created VR environment interactive using a visual programming tool. The above mentioned tools provide ways to facilitate the creation of VR experiences. However, there are some features that they are missing. Especially in terms of healthcare applications there could be the need for additional features such as, control over set stimuli and thus the experience, the ability to monitor the state of the end-user, or an easy creation process for virtual environments. These are also ideas that are part of our vision for a software authoring platform.</p>
<sec id="s2-1-1">
<title>2.1.1 Content Creation</title>
<p>Many tools address the 3D asset creation process aimed specifically at novice users. For instance, 360proto (<xref ref-type="bibr" rid="B71">Nebeling and Madier, 2019</xref>) and Lift-off (<xref ref-type="bibr" rid="B44">Jackson and Keefe, 2016</xref>) are tools that allows users to create minimal AR/VR prototypes and 3D models just by drawing the intended diagram or a skeleton of the envisioned 3D asset on paper and directly importing it into the virtual environment, allowing further modification possibilities. On the commercial side, Google Tiltbrush<xref ref-type="fn" rid="FN5">
<sup>5</sup>
</xref> and Blocks<xref ref-type="fn" rid="FN6">
<sup>6,</sup>
</xref>
<xref ref-type="fn" rid="FN7">
<sup>7</sup>
</xref>, a VR drawing tool and virtual modeling tool respectively, are popular among artists and VR enthusiasts. Though it was released for hobbyists, they are now being used in both healthcare and education fields as well (<xref ref-type="bibr" rid="B106">Ying-Chun and Chwen-Liang, 2018</xref>; <xref ref-type="bibr" rid="B88">So and Lu, 2019</xref>). Developments from the field of 3D asset creation can be used to enable people with no programming skills to create or adapt their own virtual environments.</p>
</sec>
<sec id="s2-1-2">
<title>2.1.2 User Measurements and User Assistance</title>
<p>Making use of physiological measurements in immersive technology alone is a vast area of study. Especially for therapy and training applications there are many possibilities. For a detailed elaboration of these possibilities refer to the literature review of <xref ref-type="bibr" rid="B35">Halbig and Latoschik (2021)</xref>. To our knowledge, user assistance is addressed in the surveyed authoring platforms and related tools only employing conventional methods, such as tooltips, web-based tutorials, community forums, etc. An intelligent system, that provides contextual assistance would make the user experience easy, and flatten the learning&#x20;curve.</p>
<p>The major challenge we observed from the literature is that most of the high-fidelity authoring tools, for example, Unity3D, Unreal Engine, or even A-frame are targeted at experienced developers and designers. The other tools such as CoSpaces, which is relatively easy to use, restrict the users from making the most out of VR technology due to its limited designing capacities and experience control features. This obstructs most of the consumers from creating their content for specific purposes and relies on very limited choices of VR experiences developed by others (<xref ref-type="bibr" rid="B18">Conway et&#x20;al., 2000</xref>; <xref ref-type="bibr" rid="B72">Nebeling and Speicher, 2018</xref>; <xref ref-type="bibr" rid="B8">Ashtari et&#x20;al., 2020</xref>). From a healthcare perspective, the authoring tools should additionally provide facilities to help the user fulfil a task completely, such as the provisions for monitoring an event or controlling the user&#x2019;s experience in real-time. Most of the existing tools we came across are lacking those components. We have therefore come to the conclusion that the development of a specific software platform is necessary: A software platform that aims at facilitating the process that healthcare professionals can create and operate VR applications on their&#x20;own.</p>
</sec>
</sec>
<sec id="s2-2">
<title>2.2 User Acceptance Studies</title>
<p>Understanding a user and their perception of technology plays an important role in the user-centered software development process. A user acceptance study is a critical milestone to find out if users are convinced by the implementations, to see if their expectations are met, and to make it clear to developers and designers if the system is usable for the end user. It is generally carried out before the final release of the software system (<xref ref-type="bibr" rid="B61">Leung and Wong, 1997</xref>). This seems to be an ideal procedure in a user-centered approach where the design process happens <italic>for</italic> the user. However, there is a shift towards participatory design approaches where users are a <italic>part</italic> of the design and development process from the very beginning till the release of the platform (<xref ref-type="bibr" rid="B83">Sanders, 2002</xref>).</p>
<p>There is a vast literature that addresses technology acceptance studies. In the area of VR and healthcare, information from various acceptance studies are available. However, these studies tend to focus on specific applications that have already been completed (<xref ref-type="bibr" rid="B87">Snoswell and Snoswell, 2019</xref>; <xref ref-type="bibr" rid="B20">da Costa and de Carvalho, 2004</xref>; <xref ref-type="bibr" rid="B28">Garcia-Palacios et&#x20;al., 2007</xref>) or VR-acceptance overall (<xref ref-type="bibr" rid="B91">Syed-Abdul et&#x20;al., 2019</xref>). Some studies also set in at an earlier stage and used participatory approaches. In a study by <xref ref-type="bibr" rid="B47">Karaosmanoglu et&#x20;al. (2021)</xref> healthcare professionals provided feedback via interviews before the development of a VR exergame to enhance physical activities by people suffering from dementia. In a study by <xref ref-type="bibr" rid="B42">Hilton et&#x20;al. (2011)</xref> professionals&#x2019; feedback was gathered via questionnaires and focus groups to inform the development of a system for stroke rehabilitation. Such studies are very valuable because they ensure that applications meet the needs of users. Besides, they can serve as a guideline for future research in the fields of interest and are a stepping stone for any researchers who further want to explore a similar area with a similar user base. However, their conclusions are to some point limited to specific applications and user groups. Besides, while health professionals are consulted for the development of these applications, the ultimate focus is on their use by patients. To our knowledge, acceptance studies that focus on the needs of professionals in the healthcare domain and their use of VR applications have not been published so&#x20;far.</p>
<p>One of the most used theoretical frameworks to assess an individual&#x2019;s acceptance of any technical applications or devices is the Technology Acceptance Model (TAM), widely categorized under the umbrella of Information Systems (<xref ref-type="bibr" rid="B21">Davis, 1989</xref>; <xref ref-type="bibr" rid="B60">Lee et&#x20;al., 2003</xref>). It assesses how different features of a system affect the perception and attitude of a user toward using the actual system (<xref ref-type="bibr" rid="B10">Balog and Pribeanu, 2009</xref>). The original TAM proposed two major variables to understand user acceptance, namely, Perceived Usefulness and Perceived ease of Use. Perceived Usefulness is defined as to what level a person thinks using a system would improve his or her work performance. Perceived ease of Use, is defined as the degree to which a user thinks using a system is effortless (<xref ref-type="bibr" rid="B21">Davis, 1989</xref>). Over time, the TAM has gone through major revisions (<xref ref-type="bibr" rid="B60">Lee et&#x20;al., 2003</xref>). Even the original authors had extended it to TAM2, adding more constructs to evaluate user acceptance (<xref ref-type="bibr" rid="B96">Venkatesh and Davis, 2000</xref>). Researchers have also combined other frameworks and added their questions and constructs considering the existing TAM as a base, to understand the users&#x2019; view better (<xref ref-type="bibr" rid="B59">Lee et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B26">Fussell and Truong, 2021</xref>).</p>
</sec>
<sec id="s2-3">
<title>2.3 Ethical Implications</title>
<p>Ethical aspects play an important role for the acceptance of software. Numerous articles have already investigated ethical aspects for VR use in general (e.g., <xref ref-type="bibr" rid="B56">Kuntze et&#x20;al., 2002</xref>), in health-impaired individuals in general (e.g., <xref ref-type="bibr" rid="B50">Kellmeyer et&#x20;al., 2019</xref>), or in specific health domains (e.g., <xref ref-type="bibr" rid="B62">Lewis and Griffin, 1997</xref>). The focus of the majority of papers has been on ethical aspects of virtual reality in psychology/psychotherapy (e.g., <xref ref-type="bibr" rid="B105">Yellowlees et&#x20;al., 2012</xref>; <xref ref-type="bibr" rid="B51">Kellmeyer, 2018</xref>; <xref ref-type="bibr" rid="B65">Marloth et&#x20;al., 2020</xref>) and in rehabilitation (<xref ref-type="bibr" rid="B62">Lewis and Griffin, 1997</xref>; <xref ref-type="bibr" rid="B51">Kellmeyer, 2018</xref>). The identified aspects of ethical relevance are manifold. In addition to aspects that concern the specifics of VR, differential ethical challenges arise depending on the health care setting (e.g., <xref ref-type="bibr" rid="B62">Lewis and Griffin, 1997</xref>) and patient groups (e.g., <xref ref-type="bibr" rid="B50">Kellmeyer et&#x20;al., 2019</xref>). These papers are mainly theoretical. In contrast, empirical research on health professionals&#x2019; ethical evaluation of VR is scarce. A general assessment is desirable regarding ethically relevant principles, such as respect for autonomy or justice (e.g., <xref ref-type="bibr" rid="B11">Beauchamp and Childress, 2019</xref>), and how they are positively or negatively affected by VR from the perspectives of employees in health care areas. Positive and negative expectations need to be investigated for a wide range of health care areas, such as psychotherapy and palliative care. This will help to identify critical areas of VR usage, to get an impression of the awareness for ethical issues in the professional group and to assess the acceptance of the platform based on ethical criteria. This is particularly important since VR usage in healthcare is on the&#x20;rise.</p>
<p>In the introduction, we described the target of understanding the prerequisites for healthcare professionals to autonomously operate and create VR applications. Literature on this question is missing to date. While there are regular acceptance studies for various soft- and hardware products, until now they have never focused on healthcare professionals&#x2019; views on VR. Therefore, we address an important gap. In order to proceed as systematically as possible, our study is based on two pillars: the Technology Acceptance Model (TAM) and the envisioned software platform. Thus, we have concrete categories available as well as novel ideas to be presented to potential users. In this way, people from the healthcare sector are encouraged to share their opinions and suggestions regarding our proposals.</p>
</sec>
</sec>
<sec id="s3">
<title>3 Methods</title>
<sec id="s3-1">
<title>3.1 Mockup Trailer</title>
<p>First, we had to solve the problem of measuring the acceptance toward a software platform that does not exist yet. Moreover, we had to assume that for some of the potential respondents, the topic of VR is little or not known at all. Therefore, the subject of our evaluation was a mockup trailer, which is supposed to bring our ideas closer to the potential users from the healthcare sector. It should give them an idea of what using and creating VR applications might look like in their everyday work. The use of a trailer and surveying at an early stage also have the advantage that the results are less dependent on details. Instead, at a more general level, the survey asks what the professional group&#x2019;s needs are when using VR and how they would envision using it professionally.</p>
<p>First, the trailer shows examples of VR applications in the healthcare sector, i.e.,&#x20;a virtual knee rehabilitation exercise and an example for exposure therapy targeting pyrophobic patients. Moreover, the trailer depicts potential features of the envisioned software platform. The first one would be a supervisor monitor that allows the supervisor of a healthcare application to keep track of the current state of the patient and adapt the virtual environment accordingly. Next, the trailer shows how users of the software platform can create their own VR applications by choosing from standard templates of virtual environments. Those templates are then adapted by creating virtual objects and by altering the sequence of events and interactions. Prototypical user interfaces and example interactions are shown for these operations. Another idea that is depicted in the trailer is the possibility to scan people via the smartphone and thus create custom avatars of a patient as described in <xref ref-type="bibr" rid="B103">Wenninger et&#x20;al. (2020)</xref>. So with the fire-exposure therapy and the knee rehabilitation exercise we chose two fundamentally different areas of application, which can nevertheless be presented in a relatively short duration and in an easily understandable way. However, both concepts are transferable to other areas and are thus intended to stimulate further ideas. By showing possible features like creating an avatar, we wanted to show viewers possibilities of VR that they might not have thought of on their own. Combined with expertise in their respective fields, we hope that participants will be stimulated to think about how such opportunities might be applied in their field. Hence, the mockup trailer introduces different facets of VR healthcare applications and gives the viewer a quick and concise impression of&#x20;it.</p>
<p>Such a mockup trailer has previously been used to give study participants an impression of a new technology (e.g., <xref ref-type="bibr" rid="B39">Haugstvedt and Krogstie, 2012</xref>). The biggest advantage of this method is that it provides a good overview that conveniently can be distributed to a large group of people, accordingly supporting gathering larger samples than individual presentations could. <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> shows the screenshots of above mentioned features from the mockup trailer. The trailer is available in an English and a German version. The English version of this trailer can be viewed at <ext-link ext-link-type="uri" xlink:href="https://www.youtube.com/watch?v=HWXp6ke93_w">https://www.youtube.com/watch?v&#x3d;HWXp6ke93_w</ext-link>.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>The screenshots from the mockup video used for the study that shows different features of the envisioned software platform. <bold>(A,B)</bold> Demonstration of virtual leg coordination therapy. <bold>(C,D)</bold> Demonstrations of Supervision monitor and how it is used to control a fire exposure therapy session. <bold>(E)</bold> Demonstrations of Behaviour editor used to configure assets. <bold>(F)</bold> VR environment editor. <bold>(G)</bold> Avatar scanning process using a mobile phone. <bold>(H)</bold> Representation of the assistance system.</p>
</caption>
<graphic xlink:href="frvir-03-837616-g001.tif"/>
</fig>
</sec>
<sec id="s3-2">
<title>3.2 Survey</title>
<p>For the actual study, we adopted the TAM that we already introduced in the related work section (<xref ref-type="bibr" rid="B21">Davis, 1989</xref>; <xref ref-type="bibr" rid="B60">Lee et&#x20;al., 2003</xref>). From this model, we adapted categories and corresponding questions as the basis for our study. These three categories are the perceived usefulness of the platform, the perceived ease of use, and the user&#x2019;s attitude toward the platform. We adopted Likert-type questions from the TAM model that capture these categories. Furthermore, we added additional open-ended questions to the categories in order to gather valuable feedback on the prerequisites for the acceptance or rejection of the software platform and VR in general. Moreover, we wanted to get specific feedback on the idea of a supervisor monitor, which allows to surveil and control a VR session. In an additional question, we wanted to find out what kind of support potential users are hoping for when creating their own VR application. Then, questions were asked about ethical aspects of VR use. One question was on overall positive expectations regarding the effect of VR on people and society. Ultimately, expectations and concerns regarding the use of VR in different health areas were inquired.</p>
<p>That means in summary, six questions were asked about the perceived usefulness, four questions were asked about the perceived ease of use, four questions were asked about the attitude toward using the envisioned software platform, two questions were asked about a supervisor monitor, one question was asked about assistance, and three questions were asked on ethical topics. The final survey also included a demographics section. An overview of the categories and the asked questions can be found in <xref ref-type="table" rid="T1">Table&#x20;1</xref>.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Questions that were asked in the online survey and their corresponding categories and&#x20;types.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Category</th>
<th align="center">Type</th>
<th align="center">Question</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Perceived Usefulness</td>
<td align="left">Likert (7 points)</td>
<td align="left">The software platform could improve the effectiveness of my work</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">The software platform could improve the effectiveness of my work</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">The software platform could increase my productivity at work</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">The software platform could prove useful for my work</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Open-ended</td>
<td align="left">How could you use the software platform for your work?</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">What features do you think the software platform</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">should have to be useful for your work?</td>
</tr>
<tr>
<td align="left">Perceived ease of Use</td>
<td align="left">Likert (7 points)</td>
<td align="left">Learning to use the software platform would be easy for me</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Overall, I would find the software platform easy to use</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Open-ended</td>
<td align="left">What does the software platform need to take into account so</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">that you can easily learn to use it?</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">What aspects of the software platform might be more likely to</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">prevent you from learning how to use it?</td>
</tr>
<tr>
<td align="left">Attitude Toward Using</td>
<td align="left">Likert (7 points)</td>
<td align="left">Using the software platform for treatment and training is a good idea</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">I am positive about the software platform</td>
</tr>
<tr>
<td align="left"/>
<td align="left">Open-ended</td>
<td align="left">In your opinion, what are the reasons for using the software platform?</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">In your opinion, what are the reasons for not using the software platform?</td>
</tr>
<tr>
<td align="left">Supervisor Monitor</td>
<td align="left">Open-ended</td>
<td align="left">What components do you think a supervisor monitor would</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">need to have to be useful for your work?</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Are there specific tools you use to assess the condition of your clients in practice?</td>
</tr>
<tr>
<td align="left">Assistance</td>
<td align="left">Open-ended</td>
<td align="left">What kind of support are you hoping for when you create</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">your own VR application?</td>
</tr>
<tr>
<td align="left">Ethical principles</td>
<td align="left">Likert (7 points)</td>
<td align="left">The following statements relate to the possible effects of virtual reality in healthcare</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Please indicate to what extent you agree that virtual reality promotes the</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">following aspects in users (patients)</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Respect for Autonomy; Support; Quality of Life; Participation; Safety/Security</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Transparency; Privacy; Justice; Positive self-conception</td>
</tr>
<tr>
<td align="left">Expectations regarding areas of healthcare</td>
<td align="left">Rating scale (7 points)</td>
<td align="left">Virtual reality can be used in various areas of healthcare</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Please indicate how high your expectations are that virtual reality will have a</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">positive impact on users (patients)</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Surgery; Pediatrics; Psychiatry/Psychotherapy; Neurology; Palliative care; Rehabilitation</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Prevention; Physical therapy; Education/Academic studies/Training/Continuing education</td>
</tr>
<tr>
<td align="left">Ethical concerns regarding areas of healthcare</td>
<td align="left">Rating scale (7 points)</td>
<td align="left">Please indicate how you rate virtual reality in terms of moral concerns for</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">the following uses in healthcare</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Surgery; Pediatrics; Psychiatry/Psychotherapy; Neurology; Palliative care; Rehabilitation</td>
</tr>
<tr>
<td align="left"/>
<td align="left"/>
<td align="left">Prevention; Physical therapy; Education/Academic studies/Training/Continuing education</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s3-3">
<title>3.3 Execution</title>
<p>The survey was conducted using LimeSurvey. It is an online tool that allows users to create their own surveys from a wide variety of question types and edit them at will. Before the actual survey started, participants confirmed their voluntary participation and the use of their anonymized data for research purposes. With the help of LimeSurvey, we were also able to integrate the trailer directly into the survey. That means participants first watched the trailer and then answered the questions right after. The tool was hosted on a university server to protect the corresponding data. Closed-ended questions were answered on a 7-point Likert scale. Survey participants could skip questions or stop answering at any time if they wanted. Before the actual survey started, we asked the participants for permission to store their data anonymously. The language of the survey was German. The link to the survey was distributed to potential users <italic>via</italic> email, either directly or via mail distribution lists. Each invitation email was also accompanied by a request to forward the survey to colleagues. The link was also shared in Facebook groups to which only persons of the respective professional groups had access. In addition, a professional association&#x2019;s website invited participation in the survey. In this way, we ensured that we surveyed a broad user group. At the same time, we were able to comply with pandemic containment regulations, which is of course a priority when working together with people from the healthcare sector.</p>
</sec>
<sec id="s3-4">
<title>3.4 Data Analysis</title>
<p>The analysis of the quantitative data was done using SPSS. For the qualitative analysis, we transferred all the answers to MAXQDA<xref ref-type="fn" rid="FN8">
<sup>8</sup>
</xref>, which is a software that helps with transcribing, ordering, and analyzing qualitative data. In this software, an entry for each subject was created which included all their respective statements. Subsequently, we developed a code system according to a methodology following <xref ref-type="bibr" rid="B67">Mayring (2015)</xref>. In an iterative process, we analyzed the statements and grouped them by content. This created categories, which we also grouped again until a hierarchical system of categories and statements emerged. The coding was checked a second time after some weeks to uncover inconclusive categorizations. With this procedure, qualitative data could be converted into quantitative data. The frequency with which certain topics were mentioned can serve as one indicator of their importance.</p>
</sec>
</sec>
<sec id="s4">
<title>4 Results</title>
<p>In this paragraph, we will first explain the demographic characteristics of the study participants, especially in terms of their professional roles in healthcare and their prior experience with VR. We then report the results on the three categories of the TAM; perceived usefulness, perceived ease of use, and attitude toward the envisioned software platform. Here we first explain the answers to each of the closed-ended questions and then the answers to the open-ended questions. We then explain the results for the questions on the supervisor monitor and the required assistance. We conclude with the results of the ethics-related questions. For the quantitative questions, means and the <italic>t-</italic> and <italic>p</italic>-values for one-sample t-tests are reported that indicate whether the means deviate significantly from the mean of the scale. Thus, we appraise whether the evaluations are above or below the average. For the answers to the open questions, we indicate in parentheses how often the respective statement was made and what proportion of all answers to the respective question that&#x20;makes.</p>
<sec id="s4-1">
<title>4.1 Demographics</title>
<p>A total of 102 participants took part in the survey. In order to ensure the voluntary nature of the survey, it was possible not to answer each question. This resulted in different numbers of cases for the various questions. The average age of the participants was 42.4&#xa0;years and varied between 24 and 73. Of the participants, 58 were female, 42 were male, and 2 did not provide this information. Just under half of the participants in the overall sample were working in psychotherapy, 24 were working in physical therapy, and 11 were working in training and teaching. The rest of the participants were distributed among research, development, consulting, prevention, and other discrete medical fields. Another important piece of information to us was the extent to which participants were using technology to support their daily activities. Forty participants had prior experience with VR. Of these forty participants, 16 had experience with VR applications that were related to medical applications such as physical therapy, exposure therapy, various simulators, or anatomy studies. The rest of the participants that had prior VR experience had seen demos during exhibitions, worked on research projects, or just experienced common entertainment applications. Merely eight of the participants use VR frequently and only three of them for their work. In addition, 58 participants regularly use computers to support their work. Due to the voluntary nature of the study and also because the ethical aspects were addressed at the end of the survey, up to 54 valid answers were provided for the ethical questions.</p>
</sec>
<sec id="s4-2">
<title>4.2 Perceived Usefulness</title>
<p>The envisioned software platform is intended to serve as a tool that people can use to create VR environments without major hurdles. From the demographic data we collected, we found that only three of the participants use VR for their work. For most of the other participants, VR is new territory. Especially here it is important to see if the potential users even consider the concept of the envisioned software platform as useful for their own work. For this exact purpose, the TAM offers questions about the perceived usefulness of a product. Thus, participants were asked whether the envisioned software platform could improve their work effectiveness, enhance their work performance, increase their work productivity, and whether it could prove useful for their&#x20;work.</p>
<p>An exact overview of the distribution of responses in this category can be found in <xref ref-type="table" rid="T2">Table&#x20;2</xref>. On a Likert scale of 1&#x2212;7, the mean score in this category for 64 participants was 4.4, indicating that they regard the envisioned software platform as a potentially useful tool for their work (<italic>t</italic> (63) &#x3d; 2.00, <italic>p</italic>&#x20;&#x3d; 0.050).</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Summary of the results regarding the perceived usefulness of the envisioned software platform.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">The software platform could improve the effectiveness of my work</td>
<td align="center">4.63</td>
<td align="center">1.77</td>
<td align="center">63</td>
</tr>
<tr>
<td align="left">The software platform could improve the effectiveness of my work</td>
<td align="center">4.11</td>
<td align="center">1.73</td>
<td align="center">63</td>
</tr>
<tr>
<td align="left">The software platform could increase my productivity at work</td>
<td align="center">3.95</td>
<td align="center">1.66</td>
<td align="center">63</td>
</tr>
<tr>
<td align="left">The software platform could prove useful for my work</td>
<td align="center">4.83</td>
<td align="center">1.80</td>
<td align="center">64</td>
</tr>
<tr>
<td align="left">Overall perceived usefulness</td>
<td align="center">4.40</td>
<td align="center">1.61</td>
<td align="center">64</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="s4-2-1">
<title>4.2.1 Use Cases of VR in Healthcare</title>
<p>Since there is a wide range of potential use cases of VR in healthcare, we first wanted to know from the participants what specific use cases they foresee in the context of their areas of&#x20;work.</p>
<p>Exposure therapies for anxiety and trauma were mentioned most frequently (<italic>n</italic>&#x20;&#x3d; 39 (43.3%)). Scenarios that are not easily representable in real life were emphasized, e.g., heights, crowds, job interviews, or animals.</p>
<p>Another mentioned therapy area was the treatment of eating and body image disorders (<italic>n</italic>&#x20;&#x3d; 4 (3.6%)). For example, virtual therapy applications could reinforce an examination of one&#x2019;s own body image by having a subject embody avatars with different characteristics. In addition, coping with potentially stressful situations could be simulated and practiced, such as grocery shopping or observing one&#x2019;s own body in the mirror.</p>
<p>Survey participants also saw the potential to use VR to foster teaching scenarios (<italic>n</italic>&#x20;&#x3d; 9 (10%)). For example, the teaching of cardiac catheter interventions or the training of future physiotherapists and physicians was mentioned. Simulation of the anatomy via 3D models was mentioned to be helpful here. The training for the acquisition of various competencies was also mentioned quite often (<italic>n</italic>&#x20;&#x3d; 14 (15.6%)). Here, VR was suggested to be used to simulate critical interpersonal situations. There is potential here in the training of all personnel who have contact with customers or patients. In VR, these critical situations could be represented with the help of virtual agents. This simulation of social situations also has the potential to enable a change of perspective. Roleplays were mentioned that could, for example, be used in couple therapy to increase understanding of others. If people had the opportunity to take both positions in a conflict, this could also help to reduce discrimination.</p>
<p>Participants also emphasized the potential of VR for physiotherapy and rehabilitation (<italic>n</italic>&#x20;&#x3d; 8 (8.9%)). Physiotherapists also hope that VR could provide relief in everyday work. Patients could perform exercises from home or independently in the virtual world, thus avoiding 1-to-1 supervision. This idea could potentially counteract staff shortages.</p>
</sec>
<sec id="s4-2-2">
<title>4.2.2 Desired Functions</title>
<p>In the second open question in the category of perceived usefulness, we asked the participants to name features and functions that a VR authoring platform must bring along in order to have a benefit for their personal&#x20;work.</p>
<p>Many of the potential users asked for individual customization in the creation and use of virtual applications (<italic>n</italic>&#x20;&#x3d; 18 (21.7%)). Participants described a desire to be able to customize the intensity of virtual stimuli, for example, by selecting specific fear stimuli in an exposure, changing the degree of realism of the graphics, or by adjusting the necessary repetitions in a physical rehabilitation exercise (<italic>n</italic>&#x20;&#x3d; 5 (6.0%)). Other specific requests included the ability to simulate different times of day, the ability for users to observe themselves in the virtual world (mirror), the ability to interrupt stimuli (by switching to a relaxation room), or an automatic collection and analysis of data. All these examples reflect the desire for customizability. A feature that was also requested more often was the embedding of avatars (<italic>n</italic>&#x20;&#x3d; 6 (7.2%)). End users should see their own virtual representations or the representations of other users in shared VR experiences. This would be an important factor in simulating and practicing various social situations, e.g., a dispute between two&#x20;sides.</p>
<p>Participants emphasized that they would like to be provided with certain standard scenarios and templates in which one only has to add minor components or change a few settings (<italic>n</italic>&#x20;&#x3d; 19 (22.9%)). Such standard scenarios could exist for common types of disorders, for example, the most common anxiety scenarios. Examples that were mentioned are train rides, narrow spaces, elevator rides and crowded or wide places. In addition to the standard scenarios already mentioned, some users here suggested a modular system, i.e.,&#x20;a kind of building block system that allows individual adaptation of the applications to the clients.</p>
<p>Some of the participants also demanded assurance of a certain basic quality and support when it comes to medical applications (<italic>n</italic>&#x20;&#x3d; 7 (8.4%)). The envisioned software platform should be aligned with medical guidelines and even offer warnings or corrections in case someone wants to create an incorrect or potentially dangerous application. In addition, the logging of progress over several sessions was mentioned. In general, certain technical requirements were named, which should be fulfilled (<italic>n</italic>&#x20;&#x3d; 13 (15.5%)). This includes a low error susceptibility, stable performance, the possibility to do remote sessions, and compliance with data protection guidelines.</p>
</sec>
</sec>
<sec id="s4-3">
<title>4.3 Perceived Ease of Use</title>
<p>Next, we wanted to find out if potential users can imagine that the envisioned software platform could be useable for them. Therefore, we asked two questions from the TAM that focus on the perceived ease of use of a product. Here we asked how easy the potential users thought it was to use the envisioned software platform and how easy they imagined the learning process of the platform.</p>
<p>An overview of the responses to this category can be found in <xref ref-type="table" rid="T3">Table&#x20;3</xref>. On a Likert scale of 1-7, the mean of responses for all questions about the perceived ease of use was 5.30 (<italic>t</italic> (68) &#x3d; 9.86, <italic>p</italic>&#x20;&#x3c; 0.001). When asked if potential users would find it easy to learn how to use the envisioned software platform, 54 of 69 people responded with a 5 (somewhat agree) or higher. This indicates that users tend to be confident that they can master the use of a software platform that allows them to create their own healthcare applications.</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>Summary of the results regarding the perceived ease of use of the envisioned software platform.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Learning to use the software platform would be easy for me</td>
<td align="center">5.33</td>
<td align="center">1.11</td>
<td align="center">69</td>
</tr>
<tr>
<td align="left">Overall, I would find the software platform easy to use</td>
<td align="center">5.28</td>
<td align="center">1.15</td>
<td align="center">68</td>
</tr>
<tr>
<td align="left">Overall perceived ease of use</td>
<td align="center">5.30</td>
<td align="center">1.10</td>
<td align="center">69</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="s4-3-1">
<title>4.3.1 Support for Learning</title>
<p>With the first open question in the ease of use category, we wanted to find out what features the envisioned software platform must have to easily learn its&#x20;usage.</p>
<p>As before, one of the most central points that very often resonates here is that the learning process should not be too laborious (<italic>n</italic>&#x20;&#x3d; 26 (13.3%)). Many participants demanded a certain simplicity from the platform (<italic>n</italic>&#x20;&#x3d; 30 (15.3%)). For example, there should be only a few setting variations or not too many preliminary settings should be necessary (<italic>n</italic>&#x20;&#x3d; 10 (5.1%)), there should not be too much necessary equipment and in general, the learning process should be simple and short. This simplicity was also demanded on a technical level (<italic>n</italic>&#x20;&#x3d; 15 (7,7%)). Here the point was mentioned that the platform should work on laptops with common operating systems to avoid the extra purchase of hardware. One suggestion for making it easier to incorporate VR in working routines was to provide templates, or demo versions (<italic>n</italic>&#x20;&#x3d; 19 (9.7%). Many of the potential users would like to have ready-made scenarios where they only have to modify a few points. Such scenarios could be available for typical use cases and could also serve as a basis for the learning process. This idea was also mentioned in the desired functions in paragraph&#x20;4.2.2.</p>
<p>Another point that was raised repeatedly is intuitive usage (<italic>n</italic>&#x20;&#x3d; 20 (10.2%)). The potential users do not want an intensive learning process, but an interaction that builds on their existing knowledge. A further specific aspect that was mentioned here is the language (<italic>n</italic>&#x20;&#x3d; 16 (8.2%)). Many of the potential users explicitly pointed out that the user interface of the software platform should work with their native language. At the same time, the use of technical terms should be avoided.</p>
<p>Furthermore, ideas were put forward as to how learning to use VR could look in concrete terms. Some of the participants demand supporting materials (<italic>n</italic>&#x20;&#x3d; 19 (9.7%)) like tutorial videos, a manual with extensive descriptions, or demo examples. Others wish for support through experts (<italic>n</italic>&#x20;&#x3d; 17 (8.7%)), e.g. support via email and phone or through online/offline training. Seven people suggested that there could be support among the different users of the envisioned software platform, for example over community chats or forums.</p>
</sec>
<sec id="s4-3-2">
<title>4.3.2 Obstacles to Learning</title>
<p>Complementary to the previous question, we next wanted to know which aspects might rather prevent potential users from learning how to integrate VR in their working routines. However, the results here were very similar to those of the last question. A majority of the potential users emphasized that too much effort in learning and using the platform is a criterion for exclusion. The main warnings here were that it could be too time-consuming and too complicated to&#x20;use.</p>
<p>In addition, some of the potential users expressed that not meeting prerequisites could be an obstacle in learning to create and operate their own VR applications. On the one hand, these prerequisites may be on the side of the users. They fear that they do not have the necessary technical knowledge and equipment to guarantee effective use of VR (<italic>n</italic>&#x20;&#x3d; 11). On the other hand, these preconditions can also be on the software side. Frequent error messages, long loading times, hanging graphics, or poor usability (<italic>n</italic>&#x20;&#x3d; 15) would be reasons not to learn how to use the envisioned software platform.</p>
</sec>
</sec>
<sec id="s4-4">
<title>4.4 Attitude Toward Using</title>
<p>Next we wanted to know whether the respondents would actually use the platform to support their work - in essence, we wanted to find out about the attitudes toward using the platform. To understand this, two questions were asked. With one, we wanted to know if the participants thought that introducing the envisioned software platform into their daily work routine was a good idea, and with the other, if they were positive about using the software platform. These questions were also adopted from the&#x20;TAM.</p>
<p>On a Likert scale of 1-7, the mean of all 65 responses was 5.66 (<italic>t</italic> (64) &#x3d; 11.45, <italic>p</italic>&#x20;&#x3c; 0.001)&#x2013;indicating that participants agreed that the envisioned software platform can actually help them in their job. The results are depicted in <xref ref-type="table" rid="T4">Table&#x20;4</xref>.</p>
<table-wrap id="T4" position="float">
<label>TABLE 4</label>
<caption>
<p>Summary of the results regarding the attitude toward using the envisioned software platform.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Using the software platform for treatment and training is a good idea</td>
<td align="center">5.69</td>
<td align="center">1.20</td>
<td align="center">65</td>
</tr>
<tr>
<td align="left">I am positive about the software platform</td>
<td align="center">5.63</td>
<td align="center">1.27</td>
<td align="center">65</td>
</tr>
<tr>
<td align="left">Overall attitude toward using</td>
<td align="center">5.66</td>
<td align="center">1.17</td>
<td align="center">65</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="s4-4-1">
<title>4.4.1 Reasons for the Use</title>
<p>In order to better understand how basic attitudes toward the envisioned software platform arose, we asked the participants what reasons they see for using the platform.</p>
<p>Many of the participants expect an advantage for their clients from the use of the platform. It was frequently stated that the virtual applications could increase the clients&#x2019; motivation (<italic>n</italic>&#x20;&#x3d; 24 (22.0%)). Especially the variety and novelty of the virtual therapy and exercise systems could contribute to this motivation boost. At the same time, potential users also believe that the use of virtual applications can increase the fun factor for clients. In particular, gamification of content can help to increase the fun and at the same time create new incentives.</p>
<p>Many of the participants also simply hope for practical benefits in implementing their treatments. Here, the creation of conditions was frequently mentioned that would be impossible or very difficult to realize in the real world (<italic>n</italic>&#x20;&#x3d; 6 (5.5%)), e.g., the realization of a (virtual) flight in the treatment of aviophobia. In addition, many of the potential users hope that it will be easier to create new treatment options that are adapted to the clients and thus simplify current processes (<italic>n</italic>&#x20;&#x3d; 8 (7.3%)). This is also hoped to increase the effectiveness (<italic>n</italic>&#x20;&#x3d; 5 (4.6%)) and flexibility (<italic>n</italic>&#x20;&#x3d; 10 (9.2%)) of treatments. Another opportunity to increase one&#x2019;s own treatment options with the help of the envisioned software platform is seen by many of the participants in the fact that the virtual applications could function regardless of location (<italic>n</italic>&#x20;&#x3d; 22 (20.2%)). Here, the idea that clients could run the applications themselves in their own homes was frequently described. In this way, the workload for therapists and trainers could be reduced and inflexible or limited clients could be more easily involved. Especially in times of a global pandemic, this is an interesting aspect for some of the respondents.</p>
</sec>
<sec id="s4-4-2">
<title>4.4.2 Reasons against the Use</title>
<p>Of course, it is also important for us to understand why some participants would rather refrain from using VR. Therefore, we asked the potential users what reasons they have against using the envisioned software platform.</p>
<p>For some participants, the use of virtual applications means too much mechanization of their work (<italic>n</italic>&#x20;&#x3d; 13 (10.1%)). The importance of direct interaction and the associated relationship with clients was often emphasized. Psychotherapists in particular stated that direct interaction and direct face-to-face conversations are of great importance for their work. Therefore, they view the virtual component rather critically. Another disadvantage that many psychotherapists mentioned is the danger of a blurring between reality and VR or an escape from reality (<italic>n</italic>&#x20;&#x3d; 6 (4.7%)). Clients would flee into a virtual world and thus have even more problems dealing with reality. In the treatment of depression, for example, it is more important for clients to go outside and establish activities there. Escaping into a virtual world could be more of a hindrance to&#x20;this.</p>
<p>Another aspect that was also frequently mentioned here is the fear of too much extra effort that would come with using VR. The participants fear that the possibilities would be too diverse and thus the learning process and the creation of new applications would be too time-consuming (<italic>n</italic>&#x20;&#x3d; 41 (31.8%)). This fear was also expressed with regard to the technical equipment. Procuring and setting up the hardware could be too costly, which would make the envisioned software platform unattractive for certain users (<italic>n</italic>&#x20;&#x3d; 9 (7.0%)). Also, financial concerns were expressed with regard to hardware procurement (<italic>n</italic>&#x20;&#x3d; 12 (9.3%)).</p>
<p>Some participants expressed that they simply do not work with the right target audience that would be eligible to use a virtual application (<italic>n</italic>&#x20;&#x3d; 8 (6.2%)). The use of VR technology for severely affected patients or patients in intensive care units is not conceivable for the respective participants. Potential users who work with elderly people, for example, also fear a lack of acceptance of VR among their clients (<italic>n</italic>&#x20;&#x3d; 4 (3.1%)).</p>
<p>Some participants expressed the fear that virtual therapies might be too ineffective, e.g., because clients get used to them too quickly (<italic>n</italic>&#x20;&#x3d; 8 (6.2%)). Furthermore, some even fear negative consequences for the clients when using virtual applications (<italic>n</italic>&#x20;&#x3d; 8 (6.2%)). This could lead to an aversion to VR if the technology is used improperly by laypersons. Hazards from cybersickness, dizziness, improper use, or falls were mentioned. In general, there were still some concerns about an unsuitable design of the software platform (<italic>n</italic>&#x20;&#x3d; 13 (10.1%)). These included that the platform could be too inflexible, that it could communicate in an incomprehensible language, or that too many pre-settings were necessary.</p>
<p>The results in concerning the three surveyed categories of the TAM can be found in <xref ref-type="fig" rid="F2">Figure&#x20;2</xref> and <xref ref-type="table" rid="T5">Table&#x20;5</xref>. Overall, the TAM shows a mean score of 5.19 on a scale of 7 which is significantly above the mean (<italic>t</italic> (66) &#x3d; 7.14, <italic>p</italic>&#x20;&#x3c; 0.001).</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Summary of the results regarding the three surveyed categories of the Technology Acceptance Model (TAM).</p>
</caption>
<graphic xlink:href="frvir-03-837616-g002.tif"/>
</fig>
<table-wrap id="T5" position="float">
<label>TABLE 5</label>
<caption>
<p>Summary of the results regarding the TAM and its surveyed dimensions.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Perceived Usefulness</td>
<td align="center">4.40</td>
<td align="center">1.61</td>
<td align="center">64</td>
</tr>
<tr>
<td align="left">Perceived ease of use</td>
<td align="center">5.30</td>
<td align="center">1.10</td>
<td align="center">69</td>
</tr>
<tr>
<td align="left">Attitude towards using</td>
<td align="center">5.66</td>
<td align="center">1.17</td>
<td align="center">65</td>
</tr>
<tr>
<td align="left">Overall TAM mean</td>
<td align="center">5.13</td>
<td align="center">1.29</td>
<td align="center">69</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec id="s4-5">
<title>4.5 Supervisor Monitor</title>
<p>The planned implementation of a supervisor monitor was also part of our acceptance study. For this purpose, the participants once again saw a short clip of the trailer showing a prototype of the monitor.</p>
<sec id="s4-5-1">
<title>4.5.1 Components of the Supervisor Monitor</title>
<p>Subsequently, we wanted to find out which components this monitor must have from the perspective of potential&#x20;users.</p>
<p>Many of the participants&#x2019; suggestions related to the recording and display of the client&#x2019;s condition. For example, the desire to display the client&#x2019;s view through the head-mounted display in the monitor was expressed in some cases (<italic>n</italic>&#x20;&#x3d; 11 (15.7%)). In addition, physiological parameters were mentioned as important information (<italic>n</italic>&#x20;&#x3d; 16 (22.9%)). First and foremost, the display of the heart rate was mentioned, but also the display of the skin conductivity, the movement parameters, and the pupil reactions were desired. The recording of the users does not always have to refer to the current situation. Participants also asked for a display of progress over several applications (<italic>n</italic>&#x20;&#x3d; 3 (4.3%)). For example, for a movement exercise in the physiological domain, the monitor could display the intensity and number of repetitions of past sessions. For anxiety therapy, the intensity of the anxiety stimulus achieved could be documented.</p>
<p>In addition to the display of the patient&#x2019;s condition, many of the potential users would also like to be able to intervene in the current application via the supervisor monitor (<italic>n</italic>&#x20;&#x3d; 13 (18.6%)). This includes, above all, the adjustment of the set stimulus in order to control the intensity of the current application or the activation of assistance. Often, even the possibility to completely switch off the current situation was desired, i.e.,&#x20;to get clients out of the situation immediately if necessary. Some suggested, for example, switching to a relaxation environment.</p>
<p>Other ideas for the supervisor monitor included displaying a map of the virtual environment and the possibility of operating the monitor via a tablet or smartphone. In general, a clear layout with simple operations was desired (<italic>n</italic>&#x20;&#x3d; 10 (14.3%)).</p>
</sec>
<sec id="s4-5-2">
<title>4.5.2 Capturing the User State</title>
<p>To be able to monitor a VR application really effectively, a supervisor needs information about the state of the client immersed in the virtual environment. Therefore, we wanted to know from the participants what tools they usually use to capture the state of their clients. This provides us with a basis for discussing which of these tools could also find their way into VR healthcare applications.</p>
<p>Methods in written form were mentioned most frequently. Primarily questionnaires (<italic>n</italic>&#x20;&#x3d; 20 (19.0%)) and the writing of protocols (<italic>n</italic>&#x20;&#x3d; 15 (14.3%)) were named. In addition, standardized rating scales were mentioned (<italic>n</italic>&#x20;&#x3d; 8 (7.6&#x26;)). Here, also specific examples were mentioned sporadically, like the Borg scale <xref ref-type="bibr" rid="B14">Borg (1998)</xref> for recording subjective exhaustion or the SUD score <xref ref-type="bibr" rid="B38">Hartanto et&#x20;al. (2012)</xref> for recording subjective anxiety. Probably the simplest form of assessing the user&#x2019;s condition is observation. Many of the potential users report that direct observation of body language, behavior, facial expressions and gestures is an important indicator of the state of the current treatment (<italic>n</italic>&#x20;&#x3d; 22 (21%)). Especially on the side of the psychotherapists, the conversation or interviews are often used to find out about the course and the effect of the treatment (<italic>n</italic>&#x20;&#x3d; 8 (7.6%)).</p>
<p>Physiological parameters were also mentioned as a method for recording the user&#x2019;s condition (<italic>n</italic>&#x20;&#x3d; 19 (18.1%)). Among the mentions were heart rate, motion data, skin conductance, eye tracking, or blood pressure.</p>
</sec>
</sec>
<sec id="s4-6">
<title>4.6 Assistance System</title>
<p>If people from the healthcare sector should really be able to integrate VR into their everyday work, then they need to be supported as well as possible. To better understand how assistance should look like we asked potential users what kind of support they would want when creating a virtual environment.</p>
<p>Users want continuous information about the next steps to take (<italic>n</italic>&#x20;&#x3d; 8 (36,4%)). There should therefore be as linear a process as possible when creating VR applications, with the next step always being clearly indicated. This support was requested across the whole process, e.g., support in designing the virtual environment, or help in finding suitable applications and templates.</p>
<p>Again, some of the participants took the opportunity to express that they would like templates provided to them (<italic>n</italic>&#x20;&#x3d; 7 (31.9%)). Frequently used standard applications should be identified and made available as a basis for further adjustments. Other features that were requested are the explanation of the different functions, the highlighting of often-used applications, or the linking to further&#x20;help.</p>
<p>While few actionable responses were provided here, the answers to previous questions also offer many insights into what type of support is necessary when people want to create their own VR applications. More on this is outlined in the discussion.</p>
</sec>
<sec id="s4-7">
<title>4.7 Ethics</title>
<p>The questions on ethical issues covered two topics: an evaluation of how several ethical principles are affected as well as an assessment of benefits and concerns expected for different health areas. Due to the novelty of the research, a principle-based approach provides an excellent starting point for an ethical assessment. This approach relates to a range of ethical principles that were previously defined as being important with regard to innovative health technologies (<xref ref-type="bibr" rid="B98">Walker and Morrissey, 2014</xref>). Principles considered relevant were quality of life as the key outcome of all health care activities (<xref ref-type="bibr" rid="B70">Musschenga, 1997</xref>), respect for autonomy and justice drawn from the four principles of biomedical ethics (<xref ref-type="bibr" rid="B11">Beauchamp and Childress, 2019</xref>), safety/security, privacy, participation, and a positive self-conception delineated in a model for the ethical evaluation of age-appropriate assistive systems, ambient-assisted living (AAL), and other health-related technologies (<xref ref-type="bibr" rid="B64">Manzeschke et&#x20;al., 2015</xref>; <xref ref-type="bibr" rid="B74">Nelles et&#x20;al., 2016</xref>), as well as transparency (e.g., <xref ref-type="bibr" rid="B95">Turilli and Floridi, 2009</xref>). The term support substituted the principle of beneficence (<xref ref-type="bibr" rid="B11">Beauchamp and Childress, 2019</xref>) because it was considered more concrete and tangible. Due to the wide range of areas in which VR is used, it was considered important to compare benefits and concerns for VR use in different health care areas. Examining professionals&#x2019; views of benefits and concerns reveals areas where VR use requires particular caution, for example for vulnerable persons with psychiatric symptoms like psychosis (<xref ref-type="bibr" rid="B79">Rizzo et&#x20;al., 2003</xref>) or adolescents and children (<xref ref-type="bibr" rid="B46">Kaimara et&#x20;al., 2021</xref>). For all questions, 7-point scales were utilized. The endpoints for the question on the agreement to how VR would support the selected ethical principles were 1-<italic>totally disagree</italic>, 7-<italic>totally agree</italic>. For the questions on expectations, the endpoints were 1-<italic>very low expectations/morally very low concerns</italic>; 7-<italic>very high expectations/morally very high concerns</italic>. <italic>T</italic>- and <italic>p</italic>-values are reported to indicate whether the single means deviate significantly from the mean of the scale to appraise whether the evaluation is above or below the average.</p>
<sec id="s4-7-1">
<title>4.7.1 Effects on Different Ethical Principles</title>
<p>Participants agreed most that VR would provide support for its users (<italic>M</italic>&#x20;&#x3d; 5.44, <italic>t</italic> (51) &#x3d; 11.09, <italic>p</italic>&#x20;&#x3c; 0.001), which indicates that they overall expect benefits for their patients. Safety/Security was the second highest rated dimension (<italic>M</italic>&#x20;&#x3d; 4.94, <italic>t</italic> (50) &#x3d; 5.22, <italic>p</italic>&#x20;&#x3c; 0.001), which shows that health professionals were hardly worried that VR would do any harm. The evaluations of respect for autonomy, quality of life and positive effects on the self-conception were also quite positive (all <italic>p</italic>&#x20;&#x3c; 0.002). Privacy and participation reached values tightly and not significantly above the mean of the scale (both <italic>p</italic>&#x20;&#x3e; 0.102). The evaluations for transparency (<italic>M</italic>&#x20;&#x3d; 3.94) and justice (<italic>M</italic>&#x20;&#x3d; 3.88) were slightly, but not significantly beyond the scale&#x2019;s mean (both <italic>p</italic>&#x20;&#x3e; 0.564), however indicating that there might be some concerns regarding the effect on these dimensions. All means are shown in <xref ref-type="fig" rid="F3">Figure&#x20;3</xref> and in <xref ref-type="table" rid="T6">Table&#x20;6</xref>.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Summary of the arithmetic means for the question how ethical principles are positively affected by VR in healthcare.</p>
</caption>
<graphic xlink:href="frvir-03-837616-g003.tif"/>
</fig>
<table-wrap id="T6" position="float">
<label>TABLE 6</label>
<caption>
<p>Results for the questions on how the selected ethical principles are positively affected by VR.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Respect for Autonomy</td>
<td align="center">4.83</td>
<td align="center">1.08</td>
<td align="center">52</td>
</tr>
<tr>
<td align="left">Support</td>
<td align="center">5.44</td>
<td align="center">0.94</td>
<td align="center">52</td>
</tr>
<tr>
<td align="left">Quality of Life</td>
<td align="center">4.79</td>
<td align="center">1.32</td>
<td align="center">52</td>
</tr>
<tr>
<td align="left">Participation</td>
<td align="center">4.13</td>
<td align="center">1.53</td>
<td align="center">52</td>
</tr>
<tr>
<td align="left">Safety</td>
<td align="center">4.94</td>
<td align="center">1.29</td>
<td align="center">51</td>
</tr>
<tr>
<td align="left">Transparency</td>
<td align="center">3.94</td>
<td align="center">1.20</td>
<td align="center">49</td>
</tr>
<tr>
<td align="left">Privacy</td>
<td align="center">4.32</td>
<td align="center">1.36</td>
<td align="center">50</td>
</tr>
<tr>
<td align="left">Justice</td>
<td align="center">3.88</td>
<td align="center">1.44</td>
<td align="center">52</td>
</tr>
<tr>
<td align="left">Positive self-conception</td>
<td align="center">4.71</td>
<td align="center">1.43</td>
<td align="center">52</td>
</tr>
<tr>
<td align="left">Overall</td>
<td align="center">4.56</td>
<td align="center">0.75</td>
<td align="center">52</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s4-7-2">
<title>4.7.2 Benefits and Concerns for the Use in Different Health Care Areas</title>
<p>Expectations were for all health areas significantly above the mean of the scale (<italic>p</italic>&#x20;&#x3c; 0.001) except for palliative care. Expectations were the highest for rehabilitation (<italic>M</italic>&#x20;&#x3d; 5.96), education/academic studies/training/continuing education (<italic>M</italic>&#x20;&#x3d; 5.77) and physical therapy (<italic>M</italic>&#x20;&#x3d; 5.56). For these areas, concerns were also the lowest, resulting in an also highest positive balance between expectations and concerns. Expectations for all other areas except palliative care ranged between 4.83 and 5.13 and were accordingly quite positive. Expectations were considerably low for the area of palliative care (<italic>M</italic>&#x20;&#x3d; 3.31), where they were significantly below the mean (<italic>t</italic> (47) &#x3d; &#x2212;3.00, <italic>p</italic>&#x20;&#x3d; 0.004), and here, concerns were also highest, resulting in a negative balance (<italic>M</italic>&#x20;&#x3d; &#x2212;1.09). Concerns were second highest for psychiatry/psychotherapy, but did not differ significantly from the mean (<italic>M</italic>&#x20;&#x3d; 3.76, <italic>t</italic> (48) &#x3d; &#x2212;0.96, <italic>p</italic>&#x20;&#x3d; 0.342). Here the positive balance between expectations and concerns was the second lowest (<italic>1.38</italic>). Concerns were third highest, but significantly below the mean, for pediatrics (<italic>M</italic>&#x20;&#x3d; 3.46, <italic>t</italic> (47) &#x3d; &#x2212;2.10, <italic>p</italic>&#x20;&#x3d; 0.041). For all other areas, concerns were also significantly below the mean of the scale (all <italic>p</italic>&#x20;&#x3c; 0.005) indicating low concerns. The means are depicted in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref> and in <xref ref-type="table" rid="T7">Table&#x20;7</xref>.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Summary of the arithmetic means regarding the questions on positive expectations and ethical concerns. Education/Academic studies includes training/continuing education.</p>
</caption>
<graphic xlink:href="frvir-03-837616-g004.tif"/>
</fig>
<table-wrap id="T7" position="float">
<label>TABLE 7</label>
<caption>
<p>Distribution of results in terms of ethical expectations and concerns with regard to various healthcare domains and VR.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th colspan="3" align="center">Expectations</th>
<th colspan="3" align="center">Concerns</th>
<th align="center">Difference</th>
</tr>
<tr>
<th align="left"/>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
<th align="center">
<italic>M</italic>
</th>
<th align="center">
<italic>SE</italic>
</th>
<th align="center">
<italic>N</italic>
</th>
<th align="center">&#x394;</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Surgery</td>
<td align="center">4.83</td>
<td align="center">1.29</td>
<td align="center">46</td>
<td align="center">2.87</td>
<td align="center">1.56</td>
<td align="center">46</td>
<td align="center">1.96</td>
</tr>
<tr>
<td align="left">Pediatrics</td>
<td align="center">5.02</td>
<td align="center">1.59</td>
<td align="center">52</td>
<td align="center">3.46</td>
<td align="center">1.79</td>
<td align="center">48</td>
<td align="center">1.56</td>
</tr>
<tr>
<td align="left">Psychiatry/Psychotherapy</td>
<td align="center">5.13</td>
<td align="center">1.63</td>
<td align="center">52</td>
<td align="center">3.76</td>
<td align="center">1.79</td>
<td align="center">49</td>
<td align="center">1.38</td>
</tr>
<tr>
<td align="left">Neurology</td>
<td align="center">4.86</td>
<td align="center">1.47</td>
<td align="center">49</td>
<td align="center">3.26</td>
<td align="center">1.67</td>
<td align="center">47</td>
<td align="center">1.60</td>
</tr>
<tr>
<td align="left">Palliative Care</td>
<td align="center">3.31</td>
<td align="center">1.59</td>
<td align="center">48</td>
<td align="center">4.40</td>
<td align="center">1.88</td>
<td align="center">45</td>
<td align="center">-1.09</td>
</tr>
<tr>
<td align="left">Rehabilitation</td>
<td align="center">5.96</td>
<td align="center">0.97</td>
<td align="center">52</td>
<td align="center">2.50</td>
<td align="center">1.25</td>
<td align="center">48</td>
<td align="center">3.46</td>
</tr>
<tr>
<td align="left">Prevention</td>
<td align="center">5.06</td>
<td align="center">1.38</td>
<td align="center">52</td>
<td align="center">2.67</td>
<td align="center">1.29</td>
<td align="center">48</td>
<td align="center">2.39</td>
</tr>
<tr>
<td align="left">Physical therapy</td>
<td align="center">5.56</td>
<td align="center">1.02</td>
<td align="center">52</td>
<td align="center">2.53</td>
<td align="center">1.29</td>
<td align="center">49</td>
<td align="center">3.03</td>
</tr>
<tr>
<td align="left">Education/Academic studies/</td>
<td align="center">5.77</td>
<td align="center">1.28</td>
<td align="center">53</td>
<td align="center">2.08</td>
<td align="center">1.32</td>
<td align="center">49</td>
<td align="center">3.69</td>
</tr>
<tr>
<td align="left">Training/Continuing education</td>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left">&#xa0;Overall</td>
<td align="center">5.04</td>
<td align="center">0.90</td>
<td align="center">54</td>
<td align="center">3.17</td>
<td align="center">1.22</td>
<td align="center">50</td>
<td align="center">1.87</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
</sec>
<sec id="s5">
<title>5 Discussion</title>
<p>Overall, the three categories surveyed by the TAM showed a mean of 5.19. Since the TAM measures how likely a system is to actually be used, we can conclude, that our envisioned software platform and its features actually have the potential to be established in healthcare practice. That means a software platform that allows people to create and customize their own VR content could promote the actual use of VR in this domain. Many of the responses we received also gave us an idea of what such a platform should look like. But not only that, many of the answers can be generalized to show what should overall be considered in VR applications that are intended to be suitable for healthcare practice. We will discuss both facets in this section.</p>
<sec id="s5-1">
<title>5.1 Insights About This Study</title>
<p>When we asked the participants about the potential use of VR in their field, the answers were fairly broad (see <xref ref-type="sec" rid="s4-2-1">Section 4.2.1</xref>). This is very important for the basic motivation behind the envisioned software platform. If experts from different fields can imagine a concrete use of VR for their work, then this speaks for the potential of a broad-based software platform that can support many of them. It should also be considered that many of the study participants had no previous contact with VR. The fact that we received a total of 88 mentions about possible use cases for VR shows that the mockup trailer was successful in getting our ideas across.</p>
<p>In terms of the perceived ease of use, the figures also show that potential users tend to feel able to operate the envisioned software platform. This also shows a positive basic attitude of the participants toward the platform. However, questions and statements relating to the user-friendliness and operation of the system should always be treated with caution in this case. After all, the basis of this evaluation was a video. The actual usability of a user interface can only be determined on the basis of actual prototypes and in controlled test environments. Only then can we really make statements about what intuitive use of the platform could look&#x20;like.</p>
</sec>
<sec id="s5-2">
<title>5.2 Customization and Simplicity</title>
<p>It is particularly interesting that there is a certain trade-off in desired functions. The people demand a certain amount of customization, as the multitude of different clients put different requirements to the VR applications. At the same time, they want the envisioned software platform to be very simple and straightforward without too much effort. In general, healthcare applications in VR have to manage this balancing act. Therefore, when implementing the envisioned software platform, we should ensure that standard applications and templates are available to users. We should thus prevent users from being forced to build their own applications from scratch and thus being overwhelmed with a multitude of options. At the same time, these standard applications must be modifiable in the right places so that they cover as many use cases as possible. So when implementing VR healthcare applications, one should always have an overview of what the most commonly used default scenarios and settings are. These must then be adaptable in the simplest possible&#x20;way.</p>
<p>For exposure therapy, this could mean that common fear stimuli are available (animals, height, confinement, presentation in front of an audience), but that their peculiarities can be adapted. For example, with a virtual audience for virtual speech training, one should be able to modify the number of virtual agents, their degree of realism, and their behavior. At the same time, there could also be standard environments in which such an exposition can take place, e.g., in a large hall (for more stress) or on a beach (for more relaxation).</p>
<p>For physical rehabilitation, this could mean that one can choose between standard muscle groups that should be trained, e.g., the arm/shoulder area or the leg/knee area. Standard exercises could comprise the continuous lifting, holding up, or rotation of those extremities, while the number of repetitions or the time of the exercise could be adjustable and visible for the immersed person. Adaptability can also come into its own when it comes to embodiment. As mentioned before, it is possible to create custom avatars of people quite comfortably with just a smartphone <xref ref-type="bibr" rid="B103">Wenninger et&#x20;al. (2020)</xref>. However, one could also provide standard avatars for those who find it too time-consuming to carry out a scan process. This could also be useful in some applications, as already the sense of embodiment toward a regular hand can be sufficient to alter emotional responses to virtual stimuli (<xref ref-type="bibr" rid="B27">Gall et&#x20;al., 2021</xref>). It would also be conceivable here to exploit the <italic>Proteus</italic> Effect, for example by providing athletic avatars when physical exercise is required.</p>
</sec>
<sec id="s5-3">
<title>5.3 Learn to Create and Operate VR Applications</title>
<p>The most important thing when it comes to the learning process of autonomously creating and operating VR applications is simplicity. For the envisioned software platform this means that we should refrain from overwhelming users with too many options. A large proportion of the participants in this survey had little to no prior experience with VR. This also explains the wish for close support. The potential users, therefore, attach less importance to having a large number of functions and options available. Rather, they want a relatively straightforward and simple path to their own virtual application. Again, this is generally true for healthcare applications in VR. One should not try to cover every extraordinary use case, but rather make standard use cases available quickly and easily. If it takes too long to learn how to use the VR application and to prepare it, it makes it more or less useless for practical use in the healthcare sector. Their already stressful working day does not allow for too much additional effort. This does not only apply to the software itself, but also to the equipment or hardware. Again, the fact that many of the participants had less prior technical experience comes into play here. On the one hand, this means that the requirements for operating VR applications should not be too high. On the other hand, one should make suitable hardware recommendations or minimum requirements for the applications. In this way, one can save potential users from having to search for their own hardware solutions. This can apply to both computers and head-mounted displays.</p>
<p>The desire for appropriate language is also relevant in this context. The focus should be on the use of the native language. Technical terms could additionally be provided with their own explanations via mouseover effect or in separate documentation. To be absolutely sure, one should test a VR application beforehand with potential users in the healthcare sector to find out whether the descriptions are comprehensible and appropriate. If one wants to ensure an intuitive and smooth user interaction, this step is inevitable anyway.</p>
<p>As far as the method of learning is concerned, there should definitely be documentation on the envisioned software platform. However, to further ease the burden on potential users, the suggestion of interactive tutorials is quite interesting. If the envisioned software platform provides the standard applications already mentioned, then these could also be used relatively easily as the basis for a tutorial. For each demo application provided, there could be a tutorial that shows where one has to change which parameters and what you achieve with them. This idea is also transferable to all VR applications that are to be used autonomously by people from the healthcare sector.</p>
</sec>
<sec id="s5-4">
<title>5.4 Support for the Supervisor</title>
<p>If healthcare professionals are to be truly capable of creating and operating VR applications on their own, they need support in different dimensions. Based on the answers to the survey, there are a few points that can be addressed. Based on our ideas for a software platform, an assistance system seems to be a really interesting solution. This system could offer personalized assistance, based on the experience of the user, the environment that needs to be created, or the type of treatment that is aimed for. The exchange of ideas with other users and communication with experts can also be supported by the assistance system. Ideas and approaches of other users on a certain topic could be shared and then, if relevant, suggested by the assistance system. The templates created by other users can also be shared if they have been published for reuse. The templates could be categorized via a tagging system and thus be found and tested more quickly by others. These tags could refer to diseases, forms of treatment, or medical specialties. This would also greatly facilitate an active search for relevant templates by potential users and optimize possible recommendations by the system. Thus, we could also fulfill the collaborative character that some of the participants have been asking&#x20;for.</p>
<p>The desire of the potential users that some of the applications should also function without direct supervision, i.e. be carried out by the clients themselves, is quite interesting. In some areas, this could be an interesting approach to further relieve staff in the healthcare sector. People who want to make their VR applications more attractive might keep this option in mind. Suggestions in this direction came mainly from participants in the field of physiotherapy. This is probably less relevant for the treatment of mental disorders, as more intensive care is sometimes necessary here. For our envisioned software platform this means that it should allow users to decide which form of application they want to create. Either a form of application that is controlled by a supervisor or the form in which the clients themselves are responsible for the progress of the application. Automated logs could then still inform caregivers and clients of the achieved progress. In physiotherapy, this could result in some kind of scoreboard. Repetitions of lifting exercises or endurance exercises, e.g., of a treadmill or ergometer training, could serve as evidence of continuous training. Thus, the supervisor would have a convenient overview and clients could draw additional motivation from the introduction of gamification elements.</p>
<p>To make a VR application as attractive as possible for usage in healthcare, it should support the minimization of potential negative consequences and thus also take weight off the shoulders of a supervisor. This includes the definition of an exact play area to prevent falls. To prevent the symptoms of cybersickness, applications should give warnings when the frame rate is too low or the latency is too high. The dynamic restriction of the field of view (<xref ref-type="bibr" rid="B34">Groth et&#x20;al., 2021</xref>; <xref ref-type="bibr" rid="B92">Teixeira and Palmisano, 2021</xref>) or the adaption of navigation velocity and acceleration (<xref ref-type="bibr" rid="B78">Plouzeau et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B17">Chardonnet et&#x20;al., 2021</xref>) are possible automatic methods that can reduce the hazards of cybersickness. In this way, the supervisor could be further relieved.</p>
<p>The specification or recommendation of certain hardware can also help to ensure minimum quality. Another starting point is the collection of physiological data. It can help to detect cybersickness and general discomfort (<xref ref-type="bibr" rid="B16">Cebeci et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B43">Islam et&#x20;al., 2021</xref>). Here, too, the automatic recording, analysis, and visualization of the user&#x2019;s condition can help to relieve the supervisor. More on this when we talk about the supervisor monitor in the next subsection.</p>
</sec>
<sec id="s5-5">
<title>5.5 Supervisor Monitor</title>
<p>The idea of implementing a supervisor monitor also seems to be a suitable measure to give people from the healthcare sector the necessary support and security to integrate VR into their work. Frequently requested was information about the current view of the VR users and information about their physiological state. Wearable sensors are particularly interesting here, as they have a very short setup time. Parameters like heart rate and skin conductivity can be conveniently captured with wristbands such as the Empatica E4<xref ref-type="fn" rid="FN9">
<sup>9</sup>
</xref>, that has been used before in VR studies (<xref ref-type="bibr" rid="B82">&#x160;alkevicius et&#x20;al., 2019</xref>). Gaze and pupil behavior information could also be captured relatively conveniently using head-mounted displays. Eye trackers from tobii<xref ref-type="fn" rid="FN10">
<sup>10</sup>
</xref> or Pupil Labs<xref ref-type="fn" rid="FN11">
<sup>11</sup>
</xref> are commonly used to augment VR headsets. Different characteristics of experience can thus be classified automatically, e.g. stress (<xref ref-type="bibr" rid="B36">Ham et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B80">Robitaille and McGuffin, 2019</xref>), anxiety (<xref ref-type="bibr" rid="B82">&#x160;alkevicius et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B9">B&#x103;lan et&#x20;al., 2020</xref>), or cognitive workload (<xref ref-type="bibr" rid="B19">Currie et&#x20;al., 2019</xref>). Corresponding classification results can then either be used to directly control the virtual environment, can be visualized for the supervisor, or be used to determine the progress over multiple sessions. The various options that exist here are discussed in <xref ref-type="bibr" rid="B35">Halbig and Latoschik (2021)</xref>. In any case, the capture, analysis, and visualization of physiological data can help to give the supervisor more confidence in dealing with VR. In practice, of course, one has to weigh how much and to what extent this information is displayed at once. Dangers and unusual physiological signals must be presented in such a way that they can be perceived immediately, e.g. via acoustic signals and a salient layout. So, if possible, not all details should be shown to the supervisor, such as raw physiological or movement data. Rather, the supervisor should be shown the interpretation of the data (e.g., high or low stress) by default. Raw data could be displayed on request. The data and its interpretation could also be part of automated logs of the specific sessions.</p>
<p>Another interesting approach is the ability to intervene in what is happening in the virtual world via the supervisor monitor. Especially the attenuation or amplification of stimuli plays an important role in applications that are supposed to trigger fear or stress. Feedback from potential users also speaks in favor of a kind of emergency off switch on the display that allows the situation to be completely resolved. Here, more control and security can be brought to the supervisor.</p>
<p>The possibility to take notes and save them for the respective client and session could provide basic support for interviews and observations. Such a digital notepad could then also be helpful when documenting progress across multiple sessions. In addition, one has all the information about the stimuli that were set in the virtual environment. Automated logs can then be used to store information about the stimuli and the client&#x2019;s behavior. In this way, it should be possible for therapists and trainers to analyze the progress of the treatments.</p>
</sec>
<sec id="s5-6">
<title>5.6 Ethics</title>
<p>Overall, the results demonstrate that professionals expect positive outcomes for their patients with regard to ethical principles and for most health areas. Nevertheless, negative outcomes are mostly perceived for transparency and justice. Doubts with regard to transparency refer to the possibility that users might unconsciously be manipulated by VR (<xref ref-type="bibr" rid="B54">Kool, 2016</xref>; <xref ref-type="bibr" rid="B89">Spiegel, 2018</xref>) or that wrong information about VR effectiveness is given (<xref ref-type="bibr" rid="B63">Madary and Metzinger, 2016</xref>). With regard to justice, only privileged groups could benefit from VR (<xref ref-type="bibr" rid="B63">Madary and Metzinger, 2016</xref>). These issues were previously mentioned in the literature. Future research needs to address the reasons for these concerns and derive conclusions to avoid these negative effects. Besides, psychiatry/psychotherapy and palliative care are the areas with the highest ethical concerns. These disciplines have previously been identified as ethically critical (e.g., <xref ref-type="bibr" rid="B79">Rizzo et&#x20;al., 2003</xref>; <xref ref-type="bibr" rid="B102">Weijers and DiSilvestro, 2017</xref>), and the concerns should be addressed adequately. VR has already been proven beneficial in these areas, at least in certain contexts (e.g., <xref ref-type="bibr" rid="B22">Dellazizzo et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B45">Johnson et&#x20;al., 2020</xref>). Accordingly, it is important to reflect on these concerns and to carefully consider potential applications, but also to resolve concerns by informing about proven positive effects and positive perceptions by&#x20;users.</p>
</sec>
<sec id="s5-7">
<title>5.7 Limitations</title>
<p>Although this study provides many useful information, it also has limitations. Probably the most severe is that the findings of this study are based on a video and not on actual interaction with a prototype. It is therefore very difficult to make statements about what a functioning interaction with our envisioned software platform would look like. Nevertheless, it is important to collect the opinion of potential users at the very beginning. In addition, the video was also a suitable means to convey ideas of VR and its connection with healthcare to a wide range of people.</p>
<p>Another point to mention here is the fact that this is an online study. Interviews would have made it possible to get more in-depth information. In addition, ambiguities could have been explained. However, the decision to conduct the study online also had its advantages. First, it allowed us to reach more different people as we were able to send invitations around easily. These could then spread further and reach many experts to whom we would not have had access at all. Second, this also enabled us to comply with the pandemic restrictions and get in contact with healthcare personnel at the same&#x20;time.</p>
</sec>
<sec id="s5-8">
<title>5.8 Prospects</title>
<p>In the course of the discussion, we elucidated how the knowledge gained in the present study can be used to develop VR applications that respect more of the requirements of healthcare practice. However, there is still a lot of unfinished work here, especially considering the concrete implementation of the discussed ideas. While it became clear that some kind of supervisor monitor should be helpful to spur the integration of VR into healthcare practice, it remains unclear how exactly this should look. It needs to be clarified how this monitor represents the current state of the immersed person, may it be the location in 3D space or the physiological status. This is accompanied by the question of how a supervisor would alter the sequence of events and how possible dangers are communicated perceptibly and understandably via the monitor.</p>
<p>Further research potential lies in the question of how exactly the support looks like that is received by a person that creates a VR environment. An AI could be designed that understandably supports laymen to create their own virtual applications. The exact solution of the trade-off between adaptability of such applications and low effort in their creation process is another unknown. While we have already shown possible approaches, the details of which features should be customizable and which not remain unclear. Just as with all the other open points, progress will only be made here with concrete user studies. Only a series of iterative tests with concrete interfaces and actual users can provide accurate information on what the implementation of the discussed features would look like. User studies with healthcare professionals and clients using demonstrator applications are planned as a next&#x20;step.</p>
</sec>
</sec>
<sec id="s6">
<title>6 Conclusion</title>
<p>The results of the three surveyed areas of the TAM show that the trailer left a positive impression on potential users. Overall, the TAM shows a mean score of 5.19 on a scale of 7, indicating that the majority of participants agreed with the concept that was depicted by the mockup trailer and that the envisioned software platform has the potential to be accepted by the target users. Of course there were also potential users that pointed out critical aspects about the integration of VR into their working routines.</p>
<p>Looking at the statements of the potential users, there is one point that could prevent almost all users from using our envisioned software platform. This is the potentially too high effort that could be associated with learning and using the platform. Since this is an online survey, we have not used direct quotes of respondents so far. At this point, however, there is a comment that illustrates the main threat for VR in healthcare vividly. The respondent with ID 102 describes it as follows: &#x201c;We already maintain and document so much that I&#x2019;m frankly just not into that platform. In the video, I dropped out after the third &#x2018;Design &#x2026; , Do&#x2026;, Add &#x2026; &#x201d;. This was one of the most negative comments we received and should not be seen as representative of all the respondents. Nevertheless, it sums up well what the biggest threat to the success of integrating VR applications into healthcare routines is. If users are confronted with too much complexity and too many options, it will discourage them from using it. The day-to-day work of most people in the healthcare sector simply does not allow for too much extra efforts. So when working on VR healthcare applications, one should not fall into aimless actionism and try to enable the users with a myriad of options and settings that allow them to cover every conceivable use case. Rather, applications themselves should take care of a lot of things and provide help wherever possible. This can be done, for example, by automatically analyzing the user&#x2019;s state, by providing a supervisor monitor, or by providing customizable templates. The focus should rather be on standard use cases that are fast and feasible. This ensures that most people from the healthcare sector will even consider using a product for their&#x20;work.</p>
<p>Of course, there is still a lot of work to be done to integrate VR into healthcare routines. For the future work we are planning to actually implement the envisioned software platform, taking into account the findings from this work. Studies based on actual prototypes will be necessary to see how well the actual integration into working routines works. Especially ideas like the supervisor monitor will require a close cooperation with the potential users in form of usability tests. Only if there is an understanding of potential users and how they work, the ambitious goal of promoting an autonomous use of VR in healthcare practice can be achieved. We have laid the foundation with this&#x20;study.</p>
</sec>
</body>
<back>
<sec id="s7">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s8">
<title>Ethics Statement</title>
<p>Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec id="s9">
<title>Author Contributions</title>
<p>SG and KB were responsible for the ethics part of the survey and the interpretation of the data. SG was responsible for the statistical analysis of the ethics part. AH and SB were responsible for the remainder of the survey and the corresponding evaluation and interpretation of the data. SvM, KB, and ML were supervising this project and helped with the structuring of the survey and with writing the article.</p>
</sec>
<sec id="s10">
<title>Funding</title>
<p>This publication was supported by the Open-Access Publication Fund of the University of W&#xfc;rzburg. The research has been funded by the German Federal Ministry of Education and Research in the project VIA-VR (project numbers 16SV8444 and 16SV8445).</p>
</sec>
<sec sec-type="COI-statement" id="s11">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s12">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<fn-group>
<fn id="FN1">
<label>1</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://aframe.io/">https://aframe.io/</ext-link>
</p>
</fn>
<fn id="FN2">
<label>2</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://cospaces.io/edu/">https://cospaces.io/edu/</ext-link>
</p>
</fn>
<fn id="FN3">
<label>3</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.instavr.co/">https://www.instavr.co/</ext-link>
</p>
</fn>
<fn id="FN4">
<label>4</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.wondavr.com/">https://www.wondavr.com/</ext-link>
</p>
</fn>
<fn id="FN5">
<label>5</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.tiltbrush.com/">https://www.tiltbrush.com/</ext-link>
</p>
</fn>
<fn id="FN6">
<label>6</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://arvr.google.com/blocks/">https://arvr.google.com/blocks/</ext-link>
</p>
</fn>
<fn id="FN7">
<label>7</label>
<p>All websites were accessed and checked on 16 November&#x20;2021</p>
</fn>
<fn id="FN8">
<label>8</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.maxqda.de">https://www.maxqda.de</ext-link>
</p>
</fn>
<fn id="FN9">
<label>9</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.empatica.com/research/e4/">https://www.empatica.com/research/e4/</ext-link>
</p>
</fn>
<fn id="FN10">
<label>10</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://www.tobiipro.com/de/anwendungsfelder/virtual-reality/">https://www.tobiipro.com/de/anwendungsfelder/virtual-reality/</ext-link>
</p>
</fn>
<fn id="FN11">
<label>11</label>
<p>
<ext-link ext-link-type="uri" xlink:href="https://pupil-labs.com/products/vr-ar/">https://pupil-labs.com/products/vr-ar/</ext-link>
</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Allard</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Gouranton</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Lecointre</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Limet</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Melin</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Raffin</surname>
<given-names>B.</given-names>
</name>
<etal/>
</person-group> (<year>2004</year>). &#x201c;<article-title>Flowvr: a Middleware for Large Scale Virtual Reality Applications</article-title>,&#x201d; in <conf-name>European Conference on Parallel Processing</conf-name> (<publisher-name>Springer</publisher-name>), <fpage>497</fpage>&#x2013;<lpage>505</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-540-27866-5_65</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Allard</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Gouranton</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Lecointre</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Melin</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Raffin</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2002</year>). &#x201c;<article-title>Net Juggler: Running Vr Juggler with Multiple Displays on a Commodity Component Cluster</article-title>,&#x201d; in <conf-name>Proceedings IEEE Virtual Reality 2002</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>273</fpage>&#x2013;<lpage>274</lpage>. </citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Allard</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Lesage</surname>
<given-names>J.-D.</given-names>
</name>
<name>
<surname>Raffin</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Modularity for Large Virtual Reality Applications</article-title>. <source>Presence: Teleoperators and Virtual Environments</source> <volume>19</volume>, <fpage>142</fpage>&#x2013;<lpage>161</lpage>. <pub-id pub-id-type="doi">10.1162/pres.19.2.142</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Allard</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>M&#xe9;nier</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Boyer</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Raffin</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2005</year>). &#x201c;<article-title>Running Large Vr Applications on a Pc Cluster: the Flowvr Experience</article-title>,&#x201d; in <conf-name>9th International Workshop on Immersive Projection Technology</conf-name> (<publisher-loc>Aalborg, Denmark</publisher-loc>: <publisher-name>Eurographics Association</publisher-name>), <fpage>59</fpage>&#x2013;<lpage>68</lpage>. </citation>
</ref>
<ref id="B5">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Andone</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Frydenberg</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Creating Virtual Reality in a Business and Technology Educational Context</article-title>,&#x201d; in <source>Augmented Reality and Virtual Reality</source> (<publisher-name>Springer</publisher-name>), <fpage>147</fpage>&#x2013;<lpage>159</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-06246-0_11</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Angelov</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Petkov</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Shipkovenski</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Kalushkov</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Modern Virtual Reality Headsets</article-title>,&#x201d; in <source>2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications</source> (<publisher-loc>New York</publisher-loc>: <publisher-name>HORA</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1109/HORA49412.2020.9152604</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Arlati</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Greci</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Mondellini</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Zangiacomi</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Santo</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Franchini</surname>
<given-names>F.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). &#x201c;<article-title>A Virtual Reality-Based Physical and Cognitive Training System Aimed at Preventing Symptoms of Dementia</article-title>,&#x201d; in <conf-name>International Conference on Wireless Mobile Communication and Healthcare</conf-name> (<publisher-name>Springer</publisher-name>), <fpage>117</fpage>&#x2013;<lpage>125</lpage>. </citation>
</ref>
<ref id="B8">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ashtari</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Bunt</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>McGrenere</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Nebeling</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Chilana</surname>
<given-names>P. K.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities</article-title>,&#x201d; in <conf-name>Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>13</lpage>. <pub-id pub-id-type="doi">10.1145/3313831.3376722</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>B&#x103;lan</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Moise</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Moldoveanu</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Leordeanu</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Moldoveanu</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>An Investigation of Various Machine and Deep Learning Techniques Applied in Automatic Fear Level Detection and Acrophobia Virtual Therapy</article-title>. <source>Sensors (Basel)</source> <volume>20</volume>, <fpage>496</fpage>. <pub-id pub-id-type="doi">10.3390/s20020496</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Balog</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Pribeanu</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Developing a Measurement Scale for the Evaluation of Ar-Based Educational Systems</article-title>. <source>Stud. Inform. Control.</source> <volume>18</volume>, <fpage>137</fpage>&#x2013;<lpage>148</lpage>. </citation>
</ref>
<ref id="B11">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Beauchamp</surname>
<given-names>T. L.</given-names>
</name>
<name>
<surname>Childress</surname>
<given-names>J.&#x20;F.</given-names>
</name>
</person-group> (<year>2019</year>). <source>Principles of Biomedical Ethics</source>. <edition>8 edn</edition>. <publisher-loc>New York</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.: </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bethel</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Bass</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Clay</surname>
<given-names>S. R.</given-names>
</name>
<name>
<surname>Hook</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Jones</surname>
<given-names>M. T.</given-names>
</name>
<name>
<surname>Sowizral</surname>
<given-names>H.</given-names>
</name>
<etal/>
</person-group> (<year>1999</year>). <article-title>Scene Graph apis: Wired or Tired?</article-title> <source>ACM SIGGRAPH 99 Conf. Abstr. Appl.</source> <volume>8</volume>, <fpage>136</fpage>&#x2013;<lpage>138</lpage>. </citation>
</ref>
<ref id="B13">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bierbaum</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Just</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Hartling</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Meinert</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Baker</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Cruz-Neira</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2001</year>). &#x201c;<article-title>Vr Juggler: A Virtual Platform for Virtual Reality Application Development</article-title>,&#x201d; in <conf-name>Proceedings IEEE Virtual Reality 2001</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>89</fpage>&#x2013;<lpage>96</lpage>. </citation>
</ref>
<ref id="B14">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Borg</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>1998</year>). <source>Borg&#x2019;s Perceived Exertion and Pain Scales</source>. <publisher-loc>Champaign, Illinois</publisher-loc>: <publisher-name>Human Kinetics</publisher-name>. </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Carlsson</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Hagsand</surname>
<given-names>O.</given-names>
</name>
</person-group> (<year>1993</year>). <article-title>DIVE-A Platform for Multi-User Virtual Environments</article-title>. <source>Comput. Graphics</source> <volume>17</volume>, <fpage>663</fpage>&#x2013;<lpage>669</lpage>. <pub-id pub-id-type="doi">10.1016/0097-8493(93)90115-p</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cebeci</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Celikcan</surname>
<given-names>U.</given-names>
</name>
<name>
<surname>Capin</surname>
<given-names>T. K.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>A Comprehensive Study of the Affective and Physiological Responses Induced by Dynamic Virtual Reality Environments</article-title>. <source>Computer Animation Virtual Worlds</source> <volume>30</volume>, <fpage>e1893</fpage>. <pub-id pub-id-type="doi">10.1002/cav.1893</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chardonnet</surname>
<given-names>J.-R.</given-names>
</name>
<name>
<surname>Mirzaei</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Merienne</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Influence of Navigation Parameters on Cybersickness in Virtual Reality</article-title>. <source>Virtual Reality</source> <volume>25</volume>, <fpage>565</fpage>&#x2013;<lpage>574</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-020-00474-2</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Conway</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Audia</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Burnette</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Cosgrove</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Christiansen</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2000</year>). &#x201c;<article-title>Alice: Lessons Learned from Building a 3d System for Novices</article-title>,&#x201d; in <conf-name>Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>486</fpage>&#x2013;<lpage>493</lpage>. </citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Currie</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Bond</surname>
<given-names>R. R.</given-names>
</name>
<name>
<surname>McCullagh</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Black</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Finlay</surname>
<given-names>D. D.</given-names>
</name>
<name>
<surname>Gallagher</surname>
<given-names>S.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>Wearable Technology-Based Metrics for Predicting Operator Performance during Cardiac Catheterisation</article-title>. <source>Int. J.&#x20;CARS</source> <volume>14</volume>, <fpage>645</fpage>&#x2013;<lpage>657</lpage>. <pub-id pub-id-type="doi">10.1007/s11548-019-01918-0</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>da Costa</surname>
<given-names>R. M. E. M.</given-names>
</name>
<name>
<surname>de Carvalho</surname>
<given-names>L. A. V.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>The Acceptance of Virtual Reality Devices for Cognitive Rehabilitation: a Report of Positive Results with Schizophrenia</article-title>. <source>Comp. Methods Programs Biomed.</source> <volume>73</volume>, <fpage>173</fpage>&#x2013;<lpage>182</lpage>. <pub-id pub-id-type="doi">10.1016/s0169-2607(03)00066-x</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Davis</surname>
<given-names>F. D.</given-names>
</name>
</person-group> (<year>1989</year>). <article-title>Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology</article-title>. <source>MIS Q.</source> <volume>13</volume>, <fpage>319</fpage>&#x2013;<lpage>340</lpage>. <pub-id pub-id-type="doi">10.2307/249008</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dellazizzo</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Potvin</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Luigi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Dumais</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Evidence on Virtual Reality-Based Therapies for Psychiatric Disorders: Meta-Review of Meta-Analyses</article-title>. <source>J.&#x20;Med. Internet Res.</source> <volume>22</volume>, <fpage>e20889</fpage>. <pub-id pub-id-type="doi">10.2196/20889</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>D&#xf6;llinger</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Wienrich</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Wolf</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Botsch</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Vitras - Virtual Reality Therapy by Stimulation of Modulated Body Image - Project Outline</article-title>,&#x201d; in <conf-name>Mensch und Computer 2019-Workshop band</conf-name> (<publisher-loc>Bonn, Germany</publisher-loc>: <publisher-name>Gesellschaft f&#xfc;r Informatik e.V.</publisher-name>), <fpage>606</fpage>&#x2013;<lpage>611</lpage>. </citation>
</ref>
<ref id="B24">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Figueroa</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Green</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hoover</surname>
<given-names>H. J.</given-names>
</name>
</person-group> (<year>2002</year>). &#x201c;<article-title>Intml: a Description Language for Vr Applications</article-title>,&#x201d; in <conf-name>Proceedings of the Seventh International Conference on 3D Web Technology</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>53</fpage>&#x2013;<lpage>58</lpage>. </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fischbach</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Wiebusch</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal Vr-Systems</article-title>. <source>IEEE Trans. Vis. Comput. Graphics</source> <volume>23</volume>, <fpage>1342</fpage>&#x2013;<lpage>1351</lpage>. <pub-id pub-id-type="doi">10.1109/tvcg.2017.2657098</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fussell</surname>
<given-names>S. G.</given-names>
</name>
<name>
<surname>Truong</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Accepting Virtual Reality for Dynamic Learning: an Extension of the Technology Acceptance Model</article-title>. <source>Interactive Learn. Environments</source> <volume>3</volume>, <fpage>1</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1080/10494820.2021.2009880</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gall</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Roth</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Stauffert</surname>
<given-names>J.-P.</given-names>
</name>
<name>
<surname>Zarges</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Embodiment in Virtual Reality Intensifies Emotional Responses to Virtual Stimuli</article-title>. <source>Front. Psychol.</source> <volume>12</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2021.674179</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Garcia-Palacios</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Botella</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Hoffman</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Fabregat</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Comparing Acceptance and Refusal Rates of Virtual Reality Exposure vs. <italic>In Vivo</italic> Exposure by Patients with Specific Phobias</article-title>. <source>CyberPsychology Behav.</source> <volume>10</volume>, <fpage>722</fpage>&#x2013;<lpage>724</lpage>. <pub-id pub-id-type="doi">10.1089/cpb.2007.9962</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gianola</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Stucovitz</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Castellini</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Mascali</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Vanni</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Tramacere</surname>
<given-names>I.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Effects of Early Virtual Reality-Based Rehabilitation in Patients with Total Knee Arthroplasty</article-title>. <source>Medicine</source> <volume>99</volume>, <fpage>e19136</fpage>. <pub-id pub-id-type="doi">10.1097/md.0000000000019136</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gl&#xe9;marec</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Lugrin</surname>
<given-names>J.-L.</given-names>
</name>
<name>
<surname>Bosser</surname>
<given-names>A.-G.</given-names>
</name>
<name>
<surname>Collins Jackson</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Buche</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Indifferent or Enthusiastic? Virtual Audiences Animation and Perception in Virtual Reality</article-title>. <source>Front. Virtual Reality</source> <volume>2</volume>, <fpage>72</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2021.666232</pub-id> </citation>
</ref>
<ref id="B31">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Gonzalez</surname>
<given-names>D. S.</given-names>
</name>
<name>
<surname>Moro</surname>
<given-names>A. D.</given-names>
</name>
<name>
<surname>Quintero</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Sarmiento</surname>
<given-names>W. J.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>Fear Levels in Virtual Environments, an Approach to Detection and Experimental User Stimuli Sensation</article-title>,&#x201d; in <conf-name>2016 XXI Symposium on Signal Processing, Images and Artificial Vision (STSIVA)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1109/stsiva.2016.7743323</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Greenbaum</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Expanding Elsi to All Areas of Innovative Science and Technology</article-title>. <source>Nat. Biotechnol.</source> <volume>33</volume>, <fpage>425</fpage>&#x2013;<lpage>426</lpage>. <pub-id pub-id-type="doi">10.1038/nbt.3193</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Greenhalgh</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Benford</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>1995</year>). &#x201c;<article-title>Massive: a Distributed Virtual Reality System Incorporating Spatial Trading</article-title>,&#x201d; in <conf-name>Proceedings of 15th International Conference on Distributed Computing Systems</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>27</fpage>&#x2013;<lpage>34</lpage>. </citation>
</ref>
<ref id="B34">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Groth</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Tauscher</surname>
<given-names>J.-P.</given-names>
</name>
<name>
<surname>Heesen</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Castillo</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Magnor</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>). &#x201c;<article-title>Visual Techniques to Reduce Cybersickness in Virtual Reality</article-title>,&#x201d; in <conf-name>2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>486</fpage>&#x2013;<lpage>487</lpage>. <pub-id pub-id-type="doi">10.1109/vrw52623.2021.00125</pub-id> </citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Halbig</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>A Systematic Review of Physiological Measurements, Factors, Methods, and Applications in Virtual Reality</article-title>. <source>Front. Virtual Reality</source> <volume>2</volume>, <fpage>89</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2021.694567</pub-id> </citation>
</ref>
<ref id="B36">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ham</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Cho</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Oh</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Lee</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Discrimination of Multiple Stress Levels in Virtual Reality Environments Using Heart Rate Variability</article-title>,&#x201d; in <conf-name>2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>3989</fpage>&#x2013;<lpage>3992</lpage>. <pub-id pub-id-type="doi">10.1109/embc.2017.8037730</pub-id> </citation>
</ref>
<ref id="B37">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Hamzeheinejad</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Roth</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>G&#xf6;tz</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Weilbach</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Physiological Effectivity and User Experience of Immersive Gait Rehabilitation</article-title>,&#x201d; in <conf-name>2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1421</fpage>&#x2013;<lpage>1429</lpage>. <pub-id pub-id-type="doi">10.1109/vr.2019.8797763</pub-id> </citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hartanto</surname>
<given-names>D. W.</given-names>
</name>
<name>
<surname>Kang</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Brinkman</surname>
<given-names>W. P.</given-names>
</name>
<name>
<surname>Kampmann</surname>
<given-names>I. L.</given-names>
</name>
<name>
<surname>Morina</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Emmelkamp</surname>
<given-names>P. G.</given-names>
</name>
<etal/>
</person-group> (<year>2012</year>). <article-title>Automatic Mechanisms for Measuring Subjective Unit of Discomfort</article-title>. <source>Stud. Health Technol. Inform.</source> <volume>181</volume>, <fpage>192</fpage>&#x2013;<lpage>196</lpage>. </citation>
</ref>
<ref id="B39">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Haugstvedt</surname>
<given-names>A.-C.</given-names>
</name>
<name>
<surname>Krogstie</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2012</year>). &#x201c;<article-title>Mobile Augmented Reality for Cultural Heritage: A Technology Acceptance Study</article-title>,&#x201d; in <source>2015 IEEE Mixed and Augmented Reality</source> (<publisher-name>IEEE</publisher-name>), <fpage>247</fpage>&#x2013;<lpage>255</lpage>. <pub-id pub-id-type="doi">10.1109/ismar.2012.6402563</pub-id> </citation>
</ref>
<ref id="B40">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Herumurti</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Yuniarti</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Rimawan</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Yunanto</surname>
<given-names>A. A.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Overcoming Glossophobia Based on Virtual Reality and Heart Rate Sensors</article-title>,&#x201d; in <conf-name>2019 IEEE International Conference on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>139</fpage>&#x2013;<lpage>144</lpage>. <pub-id pub-id-type="doi">10.1109/iciaict.2019.8784846</pub-id> </citation>
</ref>
<ref id="B41">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Hesina</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Schmalstieg</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Furhmann</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Purgathofer</surname>
<given-names>W.</given-names>
</name>
</person-group> (<year>1999</year>). &#x201c;<article-title>Distributed Open Inventor: A Practical Approach to Distributed 3d Graphics</article-title>,&#x201d; in <conf-name>Proceedings of the ACM Symposium on Virtual Reality Software and Technology</conf-name> (<publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>74</fpage>&#x2013;<lpage>81</lpage>. </citation>
</ref>
<ref id="B42">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Hilton</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Cobb</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Pridmore</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Gladman</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Edmans</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2011</year>). &#x201c;<article-title>Development and Evaluation of a Mixed Reality System for Stroke Rehabilitation</article-title>,&#x201d; in <source>Advanced Computational Intelligence Paradigms in Healthcare 6. Virtual Reality in Psychotherapy, Rehabilitation, and Assessment</source> (<publisher-name>Springer</publisher-name>), <fpage>193</fpage>&#x2013;<lpage>228</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-642-17824-5_10</pub-id> </citation>
</ref>
<ref id="B43">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Islam</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Quarles</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). &#x201c;<article-title>Cybersense: A Closed-Loop Framework to Detect Cybersickness Severity and Adaptively Apply Reduction Techniques</article-title>,&#x201d; in <conf-name>2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>148</fpage>&#x2013;<lpage>155</lpage>. <pub-id pub-id-type="doi">10.1109/vrw52623.2021.00035</pub-id> </citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jackson</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Keefe</surname>
<given-names>D. F.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Lift-off: Using Reference Imagery and Freehand Sketching to Create 3d Models in Vr</article-title>. <source>IEEE Trans. Vis. Comput. Graphics</source> <volume>22</volume>, <fpage>1442</fpage>&#x2013;<lpage>1451</lpage>. <pub-id pub-id-type="doi">10.1109/tvcg.2016.2518099</pub-id> </citation>
</ref>
<ref id="B45">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Johnson</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Bauler</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Vos</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Hifko</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Garg</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Ahmed</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>Virtual Reality Use for Symptom Management in Palliative Care: A Pilot Study to Assess User Perceptions</article-title>. <source>J.&#x20;Palliat. Med.</source> <volume>23</volume>, <fpage>1233</fpage>&#x2013;<lpage>1238</lpage>. <pub-id pub-id-type="doi">10.1089/jpm.2019.0411</pub-id> </citation>
</ref>
<ref id="B46">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kaimara</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Oikonomou</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Deliyannis</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Could Virtual Reality Applications Pose Real Risks to Children and Adolescents? a Systematic Review of Ethical Issues and Concerns</article-title>. <source>Virtual Reality</source> <volume>11</volume>, <fpage>1</fpage>&#x2013;<lpage>39</lpage>. </citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Karaosmanoglu</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Rings</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Kruse</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Stein</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Steinicke</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Lessons Learned from a Human-Centered Design of an Immersive Exergame for People with Dementia</article-title>. <source>Proc. ACM Hum.-Comput. Interact.</source> <volume>5</volume>, <fpage>1</fpage>&#x2013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1145/3474679</pub-id> </citation>
</ref>
<ref id="B48">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Karat</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Karat</surname>
<given-names>C. M.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>The Evolution of User-Centered Focus in the Human-Computer Interaction Field</article-title>. <source>IBM Syst. J.</source> <volume>42</volume>, <fpage>532</fpage>&#x2013;<lpage>541</lpage>. <pub-id pub-id-type="doi">10.1147/sj.424.0532</pub-id> </citation>
</ref>
<ref id="B49">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kaur</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Ziegelman</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Sowers</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Hernandez</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Using Virtual Reality to Examine the Neural and Physiological Responses to Height and Perturbations in Quiet Standing</article-title>,&#x201d; in <conf-name>2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>5233</fpage>&#x2013;<lpage>5236</lpage>. <pub-id pub-id-type="doi">10.1109/embc.2019.8857647</pub-id> </citation>
</ref>
<ref id="B50">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kellmeyer</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Biller-Andorno</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Meynen</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Ethical Tensions of Virtual Reality Treatment in Vulnerable Patients</article-title>. <source>Nat. Med.</source> <volume>25</volume>, <fpage>1185</fpage>&#x2013;<lpage>1188</lpage>. <pub-id pub-id-type="doi">10.1038/s41591-019-0543-y</pub-id> </citation>
</ref>
<ref id="B51">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kellmeyer</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Neurophilosophical and Ethical Aspects of Virtual Reality Therapy in Neurology and Psychiatry</article-title>. <source>Camb Q. Healthc. Ethics</source> <volume>27</volume>, <fpage>610</fpage>&#x2013;<lpage>627</lpage>. <pub-id pub-id-type="doi">10.1017/s0963180118000129</pub-id> </citation>
</ref>
<ref id="B52">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kelso</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Arsenault</surname>
<given-names>L. E.</given-names>
</name>
<name>
<surname>Satterfield</surname>
<given-names>S. G.</given-names>
</name>
<name>
<surname>Kriz</surname>
<given-names>R. D.</given-names>
</name>
</person-group> (<year>2002</year>). &#x201c;<article-title>Diverse: A Framework for Building Extensible and Reconfigurable Device Independent Virtual Environments</article-title>,&#x201d; in <conf-name>Proceedings IEEE Virtual Reality 2002</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>183</fpage>&#x2013;<lpage>190</lpage>. </citation>
</ref>
<ref id="B53">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kern</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Winter</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Gall</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>K&#xe4;thner</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Pauli</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Immersive Virtual Reality and Gamification within Procedurally Generated Environments to Increase Motivation during Gait Rehabilitation</article-title>,&#x201d; in <conf-name>2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>500</fpage>&#x2013;<lpage>509</lpage>. <pub-id pub-id-type="doi">10.1109/vr.2019.8797828</pub-id> </citation>
</ref>
<ref id="B54">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kool</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>The Ethics of Immersive Journalism: A Rhetorical Analysis of News Storytelling with Virtual Reality Technology</article-title>. <source>Intersect: Stanford J.&#x20;Sci. Technol. Soc.</source> <volume>9</volume>, <fpage>1</fpage>&#x2013;<lpage>11</lpage>. </citation>
</ref>
<ref id="B55">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kuck</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Wind</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Riege</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Bogen</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Birlinghoven</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2008</year>). &#x201c;<article-title>Improving the Avango Vr/ar Framework: Lessons Learned</article-title>,&#x201d; in <conf-name>Workshop Virtuelle und Erweiterte Realit&#xe4;t</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>209</fpage>&#x2013;<lpage>220</lpage>. </citation>
</ref>
<ref id="B56">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuntze</surname>
<given-names>M. F.</given-names>
</name>
<name>
<surname>Stoermer</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Mueller-Spahn</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Bullinger</surname>
<given-names>A. H.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>Ethical Codes and Values in a Virtual World</article-title>. <source>CyberPsychology Behav.</source> <volume>5</volume>, <fpage>203</fpage>&#x2013;<lpage>206</lpage>. <pub-id pub-id-type="doi">10.1089/109493102760147187</pub-id> </citation>
</ref>
<ref id="B57">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
<name>
<surname>Tramberend</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2011</year>). &#x201c;<article-title>Simulator X: A Scalable and Concurrent Architecture for Intelligent Realtime Interactive Systems</article-title>,&#x201d; in <conf-name>2011 IEEE Virtual Reality Conference</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>171</fpage>&#x2013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.1109/vr.2011.5759457</pub-id> </citation>
</ref>
<ref id="B58">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Laver</surname>
<given-names>K. E.</given-names>
</name>
<name>
<surname>Lange</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>George</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Deutsch</surname>
<given-names>J.&#x20;E.</given-names>
</name>
<name>
<surname>Saposnik</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Crotty</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Virtual Reality for Stroke Rehabilitation</article-title>. <source>Cochrane database Syst. Rev.</source> <volume>11</volume> (<issue>11</issue>), <fpage>CD008349</fpage>. <pub-id pub-id-type="doi">10.1002/14651858.cd008349.pub4</pub-id> </citation>
</ref>
<ref id="B59">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lee</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Choi</surname>
<given-names>J.&#x20;Y.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>The Adoption of Virtual Reality Devices: The Technology Acceptance Model Integrating Enjoyment, Social Interaction, and Strength of the Social Ties</article-title>. <source>Telematics Inform.</source> <volume>39</volume>, <fpage>37</fpage>&#x2013;<lpage>48</lpage>. <pub-id pub-id-type="doi">10.1016/j.tele.2018.12.006</pub-id> </citation>
</ref>
<ref id="B60">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lee</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Kozar</surname>
<given-names>K. A.</given-names>
</name>
<name>
<surname>Larsen</surname>
<given-names>K. R.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>The Technology Acceptance Model: Past, Present, and Future</article-title>. <source>Commun. Assoc. Inf. Syst.</source> <volume>12</volume>, <fpage>50</fpage>. <pub-id pub-id-type="doi">10.17705/1cais.01250</pub-id> </citation>
</ref>
<ref id="B61">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Leung</surname>
<given-names>H. K. N.</given-names>
</name>
<name>
<surname>Wong</surname>
<given-names>P. W. L.</given-names>
</name>
</person-group> (<year>1997</year>). <article-title>A Study of User Acceptance Tests</article-title>. <source>Softw. Qual. J.</source> <volume>6</volume>, <fpage>137</fpage>&#x2013;<lpage>149</lpage>. <pub-id pub-id-type="doi">10.1023/a:1018503800709</pub-id> </citation>
</ref>
<ref id="B62">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Lewis</surname>
<given-names>C. H.</given-names>
</name>
<name>
<surname>Griffin</surname>
<given-names>M. J.</given-names>
</name>
</person-group> (<year>1997</year>). &#x201c;<article-title>Human Factors Consideration in Clinical Applications of Virtual Reality</article-title>,&#x201d; in <source>Virtual Reality in Neuro-Psycho-Physiology: Cognitive, Clinical and Methodological Issues in Assessment and Treatment</source>. Editor <person-group person-group-type="editor">
<name>
<surname>Riva</surname>
<given-names>G.</given-names>
</name>
</person-group> (<publisher-loc>Amsterdam, Netherlands</publisher-loc>: <publisher-name>IOS Press</publisher-name>), <fpage>35</fpage>&#x2013;<lpage>56</lpage>. </citation>
</ref>
<ref id="B63">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Madary</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Metzinger</surname>
<given-names>T. K.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Real Virtuality: a Code of Ethical Conduct. Recommendations for Good Scientific Practice and the Consumers of Vr-Technology</article-title>. <source>Front. Robotics AI</source> <volume>2016</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.3389/frobt.2016.00003</pub-id> </citation>
</ref>
<ref id="B64">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Manzeschke</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Weber</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Rother</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Fangerau</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2015</year>). <source>Results of the Study &#x201d;Ethical Questions in the Area of Age Appropriate Assisting Systems&#x201d;</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>VDI</publisher-name>. </citation>
</ref>
<ref id="B65">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Marloth</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Chandler</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Vogeley</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Psychiatric Interventions in Virtual Reality: Why We Need an Ethical Framework</article-title>. <source>Camb Q. Healthc. Ethics</source> <volume>29</volume>, <fpage>574</fpage>&#x2013;<lpage>584</lpage>. <pub-id pub-id-type="doi">10.1017/s0963180120000328</pub-id> </citation>
</ref>
<ref id="B66">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Mathur</surname>
<given-names>A. S.</given-names>
</name>
</person-group> (<year>2015</year>). &#x201c;<article-title>Low Cost Virtual Reality for Medical Training</article-title>,&#x201d; in <conf-name>2015 IEEE Virtual Reality (VR)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>345</fpage>&#x2013;<lpage>346</lpage>. <pub-id pub-id-type="doi">10.1109/vr.2015.7223437</pub-id> </citation>
</ref>
<ref id="B67">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Mayring</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2015</year>). <source>Qualitative Inhaltsanalyse. Grundlagen und Techniken</source>. <edition>12 edn</edition>. <publisher-loc>Weinheim</publisher-loc>: <publisher-name>Beltz</publisher-name>. </citation>
</ref>
<ref id="B68">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mertens</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Wagensveld</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Engelhard</surname>
<given-names>I. M.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Cue Conditioning Using a Virtual Spider Discriminates between High and Low Spider Fearful Individuals</article-title>. <source>Comput. Hum. Behav.</source> <volume>91</volume>, <fpage>192</fpage>&#x2013;<lpage>200</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2018.10.006</pub-id> </citation>
</ref>
<ref id="B69">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Moldoveanu</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Ferche</surname>
<given-names>O.-M.</given-names>
</name>
<name>
<surname>Moldoveanu</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Lupu</surname>
<given-names>R. G.</given-names>
</name>
<name>
<surname>Cinteza</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Constantin Irimia</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>The Travee System for a Multimodal Neuromotor Rehabilitation</article-title>. <source>IEEE Access</source> <volume>7</volume>, <fpage>8151</fpage>&#x2013;<lpage>8171</lpage>. <pub-id pub-id-type="doi">10.1109/access.2018.2886271</pub-id> </citation>
</ref>
<ref id="B70">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Musschenga</surname>
<given-names>A. W.</given-names>
</name>
</person-group> (<year>1997</year>). <article-title>The Relation between Concepts of Quality-Of-Life, Health and Happiness</article-title>. <source>J.&#x20;Med. Philos.</source> <volume>22</volume>, <fpage>11</fpage>&#x2013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1093/jmp/22.1.11</pub-id> </citation>
</ref>
<ref id="B71">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Nebeling</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Madier</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>360proto: Making Interactive Virtual Reality &#x26; Augmented Reality Prototypes from Paper</article-title>,&#x201d; in <conf-name>Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>13</lpage>. </citation>
</ref>
<ref id="B72">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Nebeling</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Speicher</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>The Trouble with Augmented Reality/virtual Reality Authoring Tools</article-title>,&#x201d; in <conf-name>2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>333</fpage>&#x2013;<lpage>337</lpage>. <pub-id pub-id-type="doi">10.1109/ismar-adjunct.2018.00098</pub-id> </citation>
</ref>
<ref id="B73">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Neelakantam</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Pant</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Introduction to A-Frame</article-title>,&#x201d; in <source>Learning Web-Based Virtual Reality</source> (<publisher-name>Springer</publisher-name>), <fpage>17</fpage>&#x2013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1007/978-1-4842-2710-7_4</pub-id> </citation>
</ref>
<ref id="B74">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Nelles</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kohns</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Spies</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Br&#xf6;hl</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Brandl</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Mertens</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2016</year>). &#x201c;<article-title>Best-practice Approach for a Solution-Oriented Technology Assessment: Ethical, Legal, and Social Issues in the Context of Human-Robot Collaboration</article-title>,&#x201d; in <conf-name>Advances in Ergonomic Design of Systems, Products and Processes: Proceedings of the Annual Meeting of GfA 2016</conf-name> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-662-53305-5_1</pub-id>: </citation>
</ref>
<ref id="B75">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nemire</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Beil</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Swan</surname>
<given-names>R. W.</given-names>
</name>
</person-group> (<year>1999</year>). <article-title>Preventing Teen Smoking with Virtual Reality</article-title>. <source>CyberPsychology Behav.</source> <volume>2</volume>, <fpage>35</fpage>&#x2013;<lpage>47</lpage>. <pub-id pub-id-type="doi">10.1089/cpb.1999.2.35</pub-id> </citation>
</ref>
<ref id="B76">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Niki</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Okamoto</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Maeda</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Mori</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Ishii</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Matsuda</surname>
<given-names>Y.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>A Novel Palliative Care Approach Using Virtual Reality for Improving Various Symptoms of Terminal Cancer Patients: a Preliminary Prospective, Multicenter Study</article-title>. <source>J.&#x20;Palliat. Med.</source> <volume>22</volume>, <fpage>702</fpage>&#x2013;<lpage>707</lpage>. <pub-id pub-id-type="doi">10.1089/jpm.2018.0527</pub-id> </citation>
</ref>
<ref id="B77">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Pavlik</surname>
<given-names>R. A.</given-names>
</name>
<name>
<surname>Vance</surname>
<given-names>J.&#x20;M.</given-names>
</name>
</person-group> (<year>2012</year>). &#x201c;<article-title>Vr Jugglua: A Framework for Vr Applications Combining Lua, Openscenegraph, and Vr Juggler</article-title>,&#x201d; in <conf-name>2012 5th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>29</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1109/searis.2012.6231166</pub-id> </citation>
</ref>
<ref id="B78">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Plouzeau</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Chardonnet</surname>
<given-names>J.-R.</given-names>
</name>
<name>
<surname>Merienne</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>Using Cybersickness Indicators to Adapt Navigation in Virtual Reality: a Pre-study</article-title>,&#x201d; in <conf-name>2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>661</fpage>&#x2013;<lpage>662</lpage>. <pub-id pub-id-type="doi">10.1109/vr.2018.8446192</pub-id> </citation>
</ref>
<ref id="B79">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rizzo</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Schulteis</surname>
<given-names>M. T.</given-names>
</name>
<name>
<surname>Rothbaum</surname>
<given-names>B. O.</given-names>
</name>
</person-group> (<year>2003</year>). &#x201c;<article-title>Ethical Issues for the Use of Virtual Reality in the Psychological Sciences</article-title>,&#x201d; in <source>Ethical Issues in Clinical Neuropsychology</source> (<publisher-loc>Lisse, NL</publisher-loc>: <publisher-name>Swets &#x26; Zeitlinger Publishers</publisher-name>), <fpage>243</fpage>&#x2013;<lpage>280</lpage>. </citation>
</ref>
<ref id="B80">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Robitaille</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>McGuffin</surname>
<given-names>M. J.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Increased Affect-Arousal in Vr Can Be Detected from Faster Body Motion with Increased Heart Rate</article-title>,&#x201d; in <conf-name>Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1145/3306131.3317022</pub-id> </citation>
</ref>
<ref id="B81">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rohlf</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Helman</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>1994</year>). &#x201c;<article-title>Iris Performer: A High Performance Multiprocessing Toolkit for Real-Time 3d Graphics</article-title>,&#x201d; in <conf-name>Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>381</fpage>&#x2013;<lpage>394</lpage>. </citation>
</ref>
<ref id="B82">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>&#x160;alkevicius</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Dama&#x161;evi&#x10d;ius</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Maskeliunas</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Laukien&#x117;</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Anxiety Level Recognition for Virtual Reality Therapy System Using Physiological Signals</article-title>. <source>Electronics</source> <volume>8</volume>, <fpage>1039</fpage>. </citation>
</ref>
<ref id="B83">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Sanders</surname>
<given-names>E. B.-N.</given-names>
</name>
</person-group> (<year>2002</year>). &#x201c;<article-title>From User-Centered to Participatory Design Approaches</article-title>,&#x201d; in <source>Design and the Social Sciences</source> (<publisher-loc>Boca Raton, Florida</publisher-loc>: <publisher-name>CRC Press</publisher-name>), <fpage>18</fpage>&#x2013;<lpage>25</lpage>. <pub-id pub-id-type="doi">10.1201/9780203301302.ch1</pub-id> </citation>
</ref>
<ref id="B84">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Santos</surname>
<given-names>S. G.</given-names>
</name>
<name>
<surname>Cardoso</surname>
<given-names>J</given-names>
</name>
</person-group>. (<year>2019</year>). <source>A-frame Experimentation and Evaluation for the Development of Interactive Vr: A Virtual Tour of the Conimbriga Museum</source>. <publisher-loc>Coimbra, Portugal</publisher-loc>: <publisher-name>Technical Report</publisher-name>. </citation>
</ref>
<ref id="B85">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shaw</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Green</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Liang</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>1993</year>). <article-title>Decoupled Simulation in Virtual Reality with the Mr Toolkit</article-title>. <source>ACM Trans. Inf. Syst.</source> <volume>11</volume>, <fpage>287</fpage>&#x2013;<lpage>317</lpage>. <pub-id pub-id-type="doi">10.1145/159161.173948</pub-id> </citation>
</ref>
<ref id="B86">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shiban</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Fruth</surname>
<given-names>M. B.</given-names>
</name>
<name>
<surname>Pauli</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Kinateder</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Reichenberger</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>M&#xfc;hlberger</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Treatment Effect on Biases in Size Estimation in Spider Phobia</article-title>. <source>Biol. Psychol.</source> <volume>121</volume>, <fpage>146</fpage>&#x2013;<lpage>152</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopsycho.2016.03.005</pub-id> </citation>
</ref>
<ref id="B87">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Snoswell</surname>
<given-names>A. J.</given-names>
</name>
<name>
<surname>Snoswell</surname>
<given-names>C. L.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Immersive Virtual Reality in Health Care: Systematic Review of Technology and Disease States</article-title>. <source>JMIR Biomed. Eng.</source> <volume>4</volume>, <fpage>e15025</fpage>. <pub-id pub-id-type="doi">10.2196/15025</pub-id> </citation>
</ref>
<ref id="B88">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>So</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Lu</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Virtual Reality in Visual Arts Education: A Study on Using Google Tilt brush</article-title>,&#x201d; in <source>EdMedia&#x2b; Innovate Learning (Association for the Advancement of Computing in Education)</source> (<publisher-loc>Waynesville</publisher-loc>: <publisher-name>AACE</publisher-name>), <fpage>1485</fpage>&#x2013;<lpage>1490</lpage>. </citation>
</ref>
<ref id="B89">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Spiegel</surname>
<given-names>J.&#x20;S.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>The Ethics of Virtual Reality Technology: Social Hazards and Public Policy Recommendations</article-title>. <source>Sci. Eng. Ethics</source> <volume>24</volume>, <fpage>1537</fpage>&#x2013;<lpage>1550</lpage>. <pub-id pub-id-type="doi">10.1007/s11948-017-9979-y</pub-id> </citation>
</ref>
<ref id="B90">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Strauss</surname>
<given-names>P. S.</given-names>
</name>
<name>
<surname>Carey</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>1992</year>). <article-title>An Object-Oriented 3d Graphics Toolkit</article-title>. <source>SIGGRAPH Comput. Graph.</source> <volume>26</volume>, <fpage>341</fpage>&#x2013;<lpage>349</lpage>. <pub-id pub-id-type="doi">10.1145/142920.134089</pub-id> </citation>
</ref>
<ref id="B91">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Syed-Abdul</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Malwade</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Nursetyo</surname>
<given-names>A. A.</given-names>
</name>
<name>
<surname>Sood</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bhatia</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Barsasella</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>Virtual Reality Among the Elderly: a Usefulness and Acceptance Study from Taiwan</article-title>. <source>BMC Geriatr.</source> <volume>19</volume>, <fpage>223</fpage>&#x2013;<lpage>310</lpage>. <pub-id pub-id-type="doi">10.1186/s12877-019-1218-8</pub-id> </citation>
</ref>
<ref id="B92">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Teixeira</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Palmisano</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Effects of Dynamic Field-Of-View Restriction on Cybersickness and Presence in Hmd-Based Virtual Reality</article-title>. <source>Virtual Reality</source> <volume>25</volume>, <fpage>433</fpage>&#x2013;<lpage>445</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-020-00466-2</pub-id> </citation>
</ref>
<ref id="B93">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Thompson-Lake</surname>
<given-names>D. G. Y.</given-names>
</name>
<name>
<surname>Cooper</surname>
<given-names>K. N.</given-names>
</name>
<name>
<surname>Mahoney</surname>
<given-names>J.&#x20;J.</given-names>
<suffix>III</suffix>
</name>
<name>
<surname>Bordnick</surname>
<given-names>P. S.</given-names>
</name>
<name>
<surname>Salas</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Kosten</surname>
<given-names>T. R.</given-names>
</name>
<etal/>
</person-group> (<year>2015</year>). <article-title>Withdrawal Symptoms and Nicotine Dependence Severity Predict Virtual Reality Craving in Cigarette-Deprived Smokers</article-title>. <source>Nicotine Tob. Res.</source> <volume>17</volume>, <fpage>796</fpage>&#x2013;<lpage>802</lpage>. <pub-id pub-id-type="doi">10.1093/ntr/ntu245</pub-id> </citation>
</ref>
<ref id="B94">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Tramberend</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>1999</year>). &#x201c;<article-title>Avocado: A Distributed Virtual Reality Framework</article-title>,&#x201d; in <conf-name>Proceedings IEEE Virtual Reality (Cat. No. 99CB36316)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>14</fpage>&#x2013;<lpage>21</lpage>. </citation>
</ref>
<ref id="B95">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Turilli</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Floridi</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>The Ethics of Information Transparency</article-title>. <source>Ethics Inf. Technol.</source> <volume>11</volume>, <fpage>105</fpage>&#x2013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.1007/s10676-009-9187-9</pub-id> </citation>
</ref>
<ref id="B96">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Venkatesh</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Davis</surname>
<given-names>F. D.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies</article-title>. <source>Manag. Sci.</source> <volume>46</volume>, <fpage>186</fpage>&#x2013;<lpage>204</lpage>. <pub-id pub-id-type="doi">10.1287/mnsc.46.2.186.11926</pub-id> </citation>
</ref>
<ref id="B97">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>von Mammen</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>M&#xfc;ller</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
<name>
<surname>Botsch</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Brukamp</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Schr&#xf6;der</surname>
<given-names>C.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). &#x201c;<article-title>Via Vr: A Technology Platform for Virtual Adventures for Healthcare and Well-Being</article-title>,&#x201d; in <conf-name>2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>2</lpage>. <pub-id pub-id-type="doi">10.1109/VS-Games.2019.8864580</pub-id> </citation>
</ref>
<ref id="B98">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Walker</surname>
<given-names>R. L.</given-names>
</name>
<name>
<surname>Morrissey</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Bioethics Methods in the Ethical, Legal, and Social Implications of the Human Genome Project Literature</article-title>. <source>Bioethics</source> <volume>28</volume>, <fpage>481</fpage>&#x2013;<lpage>490</lpage>. <pub-id pub-id-type="doi">10.1111/bioe.12023</pub-id> </citation>
</ref>
<ref id="B99">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Qian</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2010</year>). <source>OpenSceneGraph 3.0: Beginner&#x2019;s Guide</source>. <publisher-loc>Birmingham</publisher-loc>: <publisher-name>Packt Publishing Ltd</publisher-name>. </citation>
</ref>
<ref id="B100">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Guan</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2019a</year>). &#x201c;<article-title>A Vr Combined with Mi-Bci Application for Upper Limb Rehabilitation of Stroke</article-title>,&#x201d; in <conf-name>2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>4</lpage>. <pub-id pub-id-type="doi">10.1109/imbioc.2019.8777805</pub-id> </citation>
</ref>
<ref id="B101">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Y.-g.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>M.-h.</given-names>
</name>
<name>
<surname>Shen</surname>
<given-names>Z.-h.</given-names>
</name>
</person-group> (<year>2019b</year>). <article-title>A Virtual Reality Counterconditioning Procedure to Reduce Methamphetamine Cue-Induced Craving</article-title>. <source>J.&#x20;Psychiatr. Res.</source> <volume>116</volume>, <fpage>88</fpage>&#x2013;<lpage>94</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychires.2019.06.007</pub-id> </citation>
</ref>
<ref id="B102">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Weijers</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>DiSilvestro</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>The Morality of Experience Machines for Palliative and End-Of-Life Care</article-title>,&#x201d; in <source>Experience Machines: The Philosophy of Virtual Worlds</source>. Editor <person-group person-group-type="editor">
<name>
<surname>Silcox</surname>
<given-names>M.</given-names>
</name>
</person-group> (<publisher-loc>London</publisher-loc>: <publisher-name>Rowman &#x26; Littlefield</publisher-name>), <fpage>183</fpage>&#x2013;<lpage>201</lpage>. </citation>
</ref>
<ref id="B103">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Wenninger</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Achenbach</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Bartl</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Latoschik</surname>
<given-names>M. E.</given-names>
</name>
<name>
<surname>Botsch</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Realistic Virtual Humans from Smartphone Videos</article-title>,&#x201d; in <source>VRST</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Teather</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Joslin</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Stuerzlinger</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Figueroa</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Hu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Batmaz</surname>
<given-names>A. U.</given-names>
</name>
<etal/>
</person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>29</lpage>. <pub-id pub-id-type="doi">10.1145/3385956.3418940</pub-id> </citation>
</ref>
<ref id="B104">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Wolf</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Merdan</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>D&#xf6;linger</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Mal</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Wienrich</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Botsch</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). &#x201c;<article-title>The Embodiment of Photorealistic Avatars Influences Female Body Weight Perception in Virtual Reality</article-title>,&#x201d; in <source>2021 IEEE Virtual Reality and 3D User Interfaces (VR)</source> (<publisher-name>IEEE</publisher-name>), <fpage>65</fpage>&#x2013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1109/vr50410.2021.00027</pub-id> </citation>
</ref>
<ref id="B105">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yellowlees</surname>
<given-names>P. M.</given-names>
</name>
<name>
<surname>Holloway</surname>
<given-names>K. M.</given-names>
</name>
<name>
<surname>Parish</surname>
<given-names>M. B.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Therapy in Virtual Environments-Clinical and Ethical Issues</article-title>. <source>Telemed. e-Health</source> <volume>18</volume>, <fpage>558</fpage>&#x2013;<lpage>564</lpage>. <pub-id pub-id-type="doi">10.1089/tmj.2011.0195</pub-id> </citation>
</ref>
<ref id="B106">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ying-Chun</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Chwen-Liang</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>The Application of Virtual Reality Technology in Art Therapy: A Case of Tilt brush</article-title>,&#x201d; in <conf-name>2018 1st IEEE International Conference on Knowledge Innovation and Invention (ICKII)</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>47</fpage>&#x2013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1109/ickii.2018.8569081</pub-id> </citation>
</ref>
<ref id="B107">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zaj&#x105;c-Lamparska</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Wi&#x142;ko&#x15b;&#x107;-D&#x119;bczy&#x144;ska</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Wojciechowski</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Podhorecka</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Polak-Szabela</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Warcho&#x142;</surname>
<given-names>&#x141;.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>Effects of Virtual Reality-Based Cognitive Training in Older Adults Living without and with Mild Dementia: a Pretest-Posttest Design Pilot Study</article-title>. <source>BMC Res. Notes</source> <volume>12</volume>, <fpage>776</fpage>&#x2013;<lpage>778</lpage>. <pub-id pub-id-type="doi">10.1186/s13104-019-4810-2</pub-id> </citation>
</ref>
<ref id="B108">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Zhang</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2020</year>). <source>Immersive Virtual Reality Training Improved Upper Extremity Function in Patients with Spinal Cord Injuries</source>. <publisher-loc>Omaha, Nebraska</publisher-loc>: <publisher-name>A case series</publisher-name>. </citation>
</ref>
<ref id="B109">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Oney</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Flowmatic: An Immersive Authoring Tool for Creating Interactive Scenes in Virtual Reality</article-title>,&#x201d; in <conf-name>Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology</conf-name> (<publisher-name>IEEE</publisher-name>), <fpage>342</fpage>&#x2013;<lpage>353</lpage>. <pub-id pub-id-type="doi">10.1145/3379337.3415824</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>