<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2021.671871</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Virtual Reality Exposure Therapy for Fear of Heights: Clinicians&#x2019; Attitudes Become More Positive After Trying VRET</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Rimer</surname> <given-names>Elise</given-names></name>
</contrib>
<contrib contrib-type="author">
<name><surname>Husby</surname> <given-names>Lars V&#x00E5;gsholm</given-names></name>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Solem</surname> <given-names>Stian</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/399159/overview"/>
</contrib>
</contrib-group>
<aff><institution>Department of Psychology, Norwegian University of Science and Technology</institution>, <addr-line>Trondheim</addr-line>, <country>Norway</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Youssef Shiban, Private University of Applied Sciences, Germany</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Jorge Osma, University of Zaragoza, Spain; Ant&#x00F3;nio Fernando Coelho, University of Porto, Portugal</p></fn>
<corresp id="c001">&#x002A;Correspondence: Stian Solem, <email>stian.solem@ntnu.no</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Psychology for Clinical Settings, a section of the journal Frontiers in Psychology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>15</day>
<month>07</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>12</volume>
<elocation-id>671871</elocation-id>
<history>
<date date-type="received">
<day>24</day>
<month>02</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>06</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2021 Rimer, Husby and Solem.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Rimer, Husby and Solem</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<sec><title>Background</title><p>Virtual reality exposure therapy (VRET) has the potential to solve logistic challenges when treating specific phobias. However, VRET has yet to see a large-scale implementation in clinical settings despite positive findings in treatment trials. This may partly be due to attitudes and lack of experience among clinicians, but also because of expensive and stationary VR solutions.</p></sec>
<sec><title>Objective</title><p>This study tested whether modern, wireless, commercially available VR equipment with controller-free hand tracking could induce and reduce discomfort using scenarios designed for fear of heights. Also, the study tested if clinicians&#x2019; attitudes toward using VR in therapy changed after trying it themselves.</p></sec>
<sec><title>Method</title><p>Attitudes to using VR in therapy and discomfort ratings were assessed for 74 clinicians before and after completing two VR scenarios. In addition, 54 non-clinicians completed the same scenarios. Participants were not diagnosed with acrophobia.</p></sec>
<sec><title>Results</title><p>The VR scenarios induced discomfort comparable to participants&#x2019; reported fear of heights in real life. Repeated training reduced discomfort. Positive attitudes toward use of VR in therapy was predicted by previous experience with VR, as well as positive attitudes toward novel technology and exposure therapy. Clinicians&#x2019; attitudes became more favorable after trying VRET themselves. Clinicians reported a range of possible advantages and disadvantages of using VR in therapy.</p></sec>
<sec><title>Conclusion</title><p>VRET for fear of heights was able to induce and reduce discomfort in clinicians and non-clinicians, and clinicians&#x2019; attitudes toward using VRET become more positive after trying VRET for themselves. The latest generation of VR solutions has potential to improve clinical availability and treatment options. Future research should explore how VRET can be implemented in clinical settings.</p></sec>
</abstract>
<kwd-group>
<kwd>virtual reality</kwd>
<kwd>VR</kwd>
<kwd>exposure therapy</kwd>
<kwd>attitudes</kwd>
<kwd>fear of heights</kwd>
<kwd>acrophobia</kwd>
</kwd-group>
<counts>
<fig-count count="5"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="45"/>
<page-count count="11"/>
<word-count count="0"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1">
<title>Introduction</title>
<p>About one third of the population suffers from susceptibility to acrophobia (fear of heights) and visual height intolerance (<xref ref-type="bibr" rid="B24">Huppert et al., 2020</xref>). For the purposes of this study, fear of heights is regarded as an inter- and intra-individual continuum of varying degrees of discomfort that may be elicited by visual heights. Research suggests that exposure therapy is the most robust treatment available for specific phobias (<xref ref-type="bibr" rid="B9">Deacon and Abramowitz, 2004</xref>). On the other hand, exposure therapy is not without its limitations. Issues with confidentiality can arise when treatment takes place outside the therapy room, and it can be difficult to access the feared stimuli (<xref ref-type="bibr" rid="B1">Anderson et al., 2004</xref>).</p>
<p>Although the treatment efficacy of exposure therapy is well established, many cases remain untreated or even undiagnosed (<xref ref-type="bibr" rid="B32">Neudeck and Einsle, 2012</xref>). In a study by <xref ref-type="bibr" rid="B22">Hipol and Deacon (2013)</xref>, they discovered that only 19&#x2013;33% of patients treated for anxiety disorders received <italic>in vivo</italic> exposure. They pointed to different reasons for this: (1) Structural challenges like time, space, and logistics, (2) clinicians&#x2019; attitudes toward exposure techniques, (3) reservations among clinicians, and (4) lack of knowledge and skills concerning how to apply exposure appropriately. This calls for more practical means of delivering exposure-based treatments, efforts to challenge attitudes and reservations among clinicians, and opportunities for clinicians to gain experience.</p>
<p>The growing body of research on virtual reality exposure therapy (VRET) shows promising results, particularly for specific phobias (<xref ref-type="bibr" rid="B36">Parsons and Rizzo, 2008</xref>; <xref ref-type="bibr" rid="B37">Powers and Emmelkamp, 2008</xref>; <xref ref-type="bibr" rid="B33">Opri&#x015F; et al., 2012</xref>; <xref ref-type="bibr" rid="B31">Morina et al., 2015</xref>; <xref ref-type="bibr" rid="B4">Botella et al., 2017</xref>; <xref ref-type="bibr" rid="B27">Lindner et al., 2017</xref>; <xref ref-type="bibr" rid="B7">Carl et al., 2019</xref>). VRET may offer some advantages as opposed to <italic>in vivo</italic> exposure therapy, such as being more appealing to some patients, more cost-effective, afford possibilities for more gradual exposure (<xref ref-type="bibr" rid="B12">Emmelkamp, 2005</xref>), as well as mitigating structural barriers like time and logistics (<xref ref-type="bibr" rid="B32">Neudeck and Einsle, 2012</xref>; <xref ref-type="bibr" rid="B5">Bouchard et al., 2017</xref>). In addition, there are indications that drop-out rates are lower with VR treatments and that patients could have a preference for VR exposure over <italic>in vivo</italic> treatment (<xref ref-type="bibr" rid="B16">Garcia-Palacios et al., 2001</xref>, <xref ref-type="bibr" rid="B15">2007</xref>). Furthermore, a meta-analysis proposed that the deterioration rate in VRET is low (4%), and comparable with face-to-face therapy (<xref ref-type="bibr" rid="B13">Fern&#x00E1;ndez-&#x00C1;lvarez et al., 2019</xref>).</p>
<p>Another potential advantage of VR is that patients know that the virtual environment is not real, but their minds and bodies respond as if it is; which could explain why VRET may offer improvements that are generalizable to the real world (<xref ref-type="bibr" rid="B14">Freeman et al., 2017</xref>). VR also affords the possibility of various scenarios and stimuli tailored to individual needs, reduced inconsistency of treatment delivery, as well as eliminating the need for real-world stimuli that might be difficult to procure and/or manipulate in a therapeutic context (<xref ref-type="bibr" rid="B5">Bouchard et al., 2017</xref>; <xref ref-type="bibr" rid="B14">Freeman et al., 2017</xref>; <xref ref-type="bibr" rid="B3">Boeldt et al., 2019</xref>). In theory, any real situation can be simulated in VR, and the virtual environment can be extended by elements that would not be feasible in the real world.</p>
<p>However, potential limitations of VRET need to be considered. Considering the constant upgrades of technology, there is a scarcity of studies utilizing newer hardware. Earlier generations of VR products are usually wired, which can hinder mobility, and consequently immersion by restricting free movement in the VR simulation. Immersion is important to consider as it might be a prerequisite for fear responses (<xref ref-type="bibr" rid="B38">Price and Anderson, 2007</xref>; <xref ref-type="bibr" rid="B20">Gromer et al., 2018</xref>), but anxiety could also increase the feeling of presence (<xref ref-type="bibr" rid="B6">Bouchard et al., 2008</xref>). Additionally, products that utilize handheld controllers might be unintuitive for some individuals. Although some research has been done with newer hardware, there is no evidence to suggest that recently developed VR products &#x2013; with better resolution, mobility, and controller-free hand tracking &#x2013; are more clinically successful than older systems (<xref ref-type="bibr" rid="B25">Jerdan et al., 2018</xref>). However, immersive capabilities are likely to be better with newer VR systems. Studies also indicate that the potential of cybersickness (i.e., nausea, headaches, and/or dizziness as a side effect of VR use) can be a considerable barrier for some patients (<xref ref-type="bibr" rid="B44">Weech et al., 2019</xref>), and this has been a challenge with older generations of VR headsets (<xref ref-type="bibr" rid="B40">Rebenitsch and Owen, 2016</xref>).</p>
<p>Despite a growing number of novel technological inventions, we have yet to see widespread implementation of the technology into clinical settings (<xref ref-type="bibr" rid="B18">Gega, 2017</xref>; <xref ref-type="bibr" rid="B30">Mishkind et al., 2017</xref>). This may partly be due to lack of acceptance and technological literacy among clinicians (<xref ref-type="bibr" rid="B2">Anton and Jones, 2017</xref>). However, a study where eight clinicians were interviewed after trying VR seemed to indicate willingness and potential for implementation (<xref ref-type="bibr" rid="B34">Ose et al., 2019</xref>). Furthermore, many clinicians perceive exposure therapy to be unethical, harmful, and intolerable (<xref ref-type="bibr" rid="B21">Gunter and Whittal, 2010</xref>; <xref ref-type="bibr" rid="B10">Deacon and Farrell, 2013</xref>). However, studies also indicate that negative attitudes toward exposure therapy can be changed through training and experience (<xref ref-type="bibr" rid="B11">Deacon et al., 2013</xref>). Thus, it seems plausible that negative attitudes toward VRET might change through training and experience as well.</p>
<p>A recent cross-sectional survey of cognitive-behavioral therapists found significantly higher average positive scores than average negative scores regarding their views on VRET, but negative attitude was a larger predictor of future use (<xref ref-type="bibr" rid="B28">Lindner et al., 2019</xref>). They concluded that therapists&#x2019; attitudes did not seem to constitute a major barrier to implementation of VR in clinical practice, and that CBT clinicians overall had positive attitudes toward VRET. Commonly held negative concerns were: low realism; that therapy will not translate into real-world improvements; and the possibility of technical difficulties. Technological and organizational factors, such as major expenses, technological complexity and low graphical fidelity, have also been mentioned as barriers to implementation of VR as a therapeutic tool in psychiatric treatment (<xref ref-type="bibr" rid="B39">Ramsey et al., 2016</xref>; <xref ref-type="bibr" rid="B42">Slater and Sanchez-Vives, 2016</xref>; <xref ref-type="bibr" rid="B19">Glegg and Levac, 2018</xref>).</p>
<p>As technological barriers dissipate, it is of fundamental interest to investigate predictors of clinicians&#x2019; general attitude toward the use of VR in therapy, and document changes in attitudes after trying a VRET program. In addition, the therapeutic value of the specific VR software and hardware needs to be established by empirically testing its ability to induce discomfort at different levels of intensity. Finally, clinicians&#x2019; views of the pros and cons of VR need to be further examined. These are the aims of this study.</p>
<p>This study utilizes VR hardware with certain features that, to our knowledge, have not been used in previous studies on VRET. The VRET product in this study is wireless and utilizes controller-free hand tracking, which allows the user to move more freely &#x2013; thereby also sustaining immersion &#x2013; and affords multisensory integration, which could be clinically beneficial (<xref ref-type="bibr" rid="B45">Wiederhold and Riva, 2019</xref>). Fully tracked hands and articulated fingers can potentially enhance engagement and deliver a more natural interaction with the environment (<xref ref-type="bibr" rid="B35">Park et al., 2019</xref>).</p>
<p>This study tested the following hypotheses:</p>
<list list-type="simple">
<list-item>
<label>1.</label>
<p>The VR intervention will induce Subjective Units of Discomfort (SUD) ratings comparable to the participants&#x2019; experience of heights in real life. Furthermore, repeated exposure to the height scenarios will reduce SUD ratings in this undiagnosed sample of clinicians and non-clinicians.</p>
</list-item>
<list-item>
<label>2.</label>
<p>Young age, male sex, few years of experience as a clinician, previous experience with VR and VRET, favorable attitudes toward novel technology and exposure therapy, and high technological literacy will predict a more favorable general attitude toward the use of VR in therapy among clinicians.</p>
</list-item>
<list-item>
<label>3.</label>
<p>Clinicians&#x2019; general attitude toward use of VR in therapy, how supplemental VR seems in therapy, and an assessment of the feasibility and usefulness of VR in therapy will be rated higher after trying VRET.</p>
</list-item>
<list-item>
<label>4.</label>
<p>Clinicians can see pros and cons of using VR in therapy.</p>
</list-item>
</list>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="S2.SS1">
<title>Participants and Procedure</title>
<p>The sample was partly obtained by email invitations to employees at a University psychology department, and private and 10 public health clinics across Norway. In total, clinicians from nine different clinics were recruited. In addition, fifth and sixth year psychology students (with clinical experience) and psychologists were recruited using Facebook invitations. We also recruited 54 non-clinicians using convenience sampling (participants were asked to share information about the project to friends, family, and colleagues).</p>
<p>All willing adult respondents were permitted to participate with no exclusion based on their degree of fear of heights. The sample was divided between clinicians (<italic>n</italic> = 74) and non-clinicians (<italic>n</italic> = 54). The final sample consisted of 128 consenting adults (83 women and 45 men), with age ranging from 18 to 70 years (<italic>M</italic> = 34.64, SD = 12.33).</p>
<p>The clinician sample consisted of 28 clinical psychology graduate students with clinical experience, 24 therapists from a local psychiatric clinic, 6 from the university, 6 from a child and adolescent outpatient clinic, 4 from primary health care services, 4 from a substance abuse clinic, 1 from a habilitation clinic, and 1 from an inpatient clinic. The clinicians had 7.16 (9.93) years of experience (range 0&#x2013;38). Twenty-five percent of the clinicians used exposure therapy in their work, and those who did had 6.81 (5.95) years of experience with doing so (range 0&#x2013;20). The clinicians also reported a markedly favorable attitude toward exposure therapy with a mean score of 4.68 (0.55) on a 1&#x2013;5 scale. Forty-five percent of the clinicians had tried VR before, while 3.9% had tried VRET.</p>
</sec>
<sec id="S2.SS2">
<title>Measurements</title>
<p>The self-report questionnaires were composed of the following sections: demographics, therapeutic background, subjective discomfort during the interventions, immersion, altitude perception, and technological literacy. Moreover, certain attitudes (i.e., general attitude toward VR in therapy, exposure therapy, and novel technology) were measured, as well as the perceptions of benefits and cost of VR in anxiety/phobia treatment, the degree of which VR can be a supplemental tool in anxiety/phobia treatment, and the feasibility of anxiety/phobia treatment with VR therapy. A six-point Likert scale was chosen to compel respondents to take a position, by giving them no option to take a neutral stance. Attitudes were scored on six-point Likert scales ranging from (0) <italic>extremely negative</italic>, (1) <italic>very negative</italic>, (2) <italic>quite negative</italic>, (3) <italic>quite positive</italic>, (4), <italic>very positive</italic>, (5) <italic>extremely positive</italic>. Clinicians&#x2019; pre-intervention assessment of the utility of VR in therapy, their own technological literacy, and post-intervention ratings were scored on a six-point Likert scale ranging from (0) <italic>not at all</italic>, (1) <italic>to a small extent</italic>, (2) <italic>to some extent</italic>, (3) <italic>to a moderate extent</italic>, (4) <italic>to a great extent</italic>, (5) <italic>to a very great extent</italic>. Clinicians were also asked to fill out empty text boxes with suggested advantages and disadvantages of using VR in therapy. Non-clinicians were given a simplified questionnaire excluding variables concerning therapy and technological literacy. The questionnaires are included in the <xref ref-type="supplementary-material" rid="DS1">Supplementary Appendix</xref>.</p>
<p>Levels of discomfort were measured using a SUD Scale. The participants were asked to rate their level of situational discomfort from 0 (i.e., <italic>no discomfort</italic>) to 100 (i.e., <italic>extreme discomfort</italic>) at five different time points: (1) Before the VR intervention, a suggested maximum level of discomfort when hypothetically faced with extreme heights in real life was measured, (2) Additionally, all participants reported an <italic>in vivo</italic> reference to their fear of heights while standing on a footstool (50 cm in height with a surface area of 39 cm &#x00D7; 25 cm). In total, three SUDs ratings were reported during the VR interventions and written down by the test administrators. The first and second of these were measured at peak discomfort in both VR scenarios (see below for details). The third was measured at the end of the second scenario, approximately 2 min after peak discomfort.</p>
</sec>
<sec id="S2.SS3">
<title>Interventions</title>
<p>The VRET software was developed by Fornix in Trondheim. The program utilized the VR hardware Oculus Quest, which is a wireless head-mounted display (HMD) with internal processing power, and consequently does not require a separate computer to be functional. It included a controller-free hand tracking feature, which enabled the use of hands as an input method to control the program. The HMD also delivered simulated surround sound, which was audible to both the participant and test administrator. This feature is clinically relevant considering the potential for increased discomfort when visual stimuli is combined with auditory stimuli (<xref ref-type="bibr" rid="B43">Taffou et al., 2013</xref>). Furthermore, the HMD had a low input lag, which can potentially mitigate loss of immersion and cybersickness (<xref ref-type="bibr" rid="B26">Kim et al., 2020</xref>). The software consisted of two different scenarios, which will be referred to as the &#x201C;Lift&#x201D; and the &#x201C;Plank.&#x201D; The scenarios required an unobstructed movement area of 2 &#x00D7; 3 m. Videos demonstrating the scenarios can be found at fornixvr.com/our-solutions and youtube.com/watch?v=p04vMpX4_MI&#x0026;t=39s.</p>
<p>All participants were initially asked to climb a footstool and rate their subsequent discomfort from 0 to 100. After this, they were instructed to wear the HMD to experience the VR scenarios. Brief verbal instructions were given to inform participants how to navigate the environment (e.g., moving around and pressing buttons). The Lift simulated a 3D environment where the participants entered a lift that could be elevated to six different levels of altitude (see <xref ref-type="fig" rid="F1">Figure 1</xref>). It had a low railing and was located on a street surrounded by houses and trees. In addition, the audio consisted of the sound of the wind, the rustling of branches, bird calls, the interactive console buttons, and the lift mechanics moving up and down. The participants were always in control and could choose how high they wanted the lift to go by pushing the arrow-button upwards or downwards. The lift elevated in non-linear increments (i.e., 1.5, 2, 3, 4, 5, and 6 m above ground). The top level was at an elevation of 21.5 m. To advance to the next intervention, the participants formed a special hand-gesture (see top-left illustration in <xref ref-type="fig" rid="F2">Figure 2</xref>) which transported them almost instantaneously to the Plank-scenario.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Inner and outer perspectives of the lift-intervention.</p></caption>
<graphic xlink:href="fpsyg-12-671871-g001.tif"/>
</fig>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>Inner and outer perspectives of the plank-intervention.</p></caption>
<graphic xlink:href="fpsyg-12-671871-g002.tif"/>
</fig>
<p>In the Plank-scenario, the participants were initially standing outside of an elevator (see <xref ref-type="fig" rid="F2">Figure 2</xref>). The door was opened by reaching out a hand to the left of the elevator and pressing the red button. The participants then walked inside and pressed another red button, which caused the elevator to go up. The elevator door opened at the 20th floor of a tall building, approximately 60 m above ground (without incremental elevation). The participants were then presented with a narrow plank without railings and were encouraged to move out onto the plank at their own pace. After reaching their peak discomfort, the participants were encouraged to stay in the virtual environment for 2 min or more. The audio consisted of the sound of button pressed, the door opening/closing, and music while the elevator was moving. While on the plank, the audio consisted of strong winds.</p>
<p>Participants were guided through both scenarios while simultaneously rating their subjective discomfort. Various strategies were implemented by the test administrators to induce discomfort. The strategies utilized were mainly the same between participants, but some variation was necessary as it was contingent on the individual participants&#x2019; willingness to engage in the given challenges. Several participants were encouraged to jump up and down or move off the lift/plank to see if the discomfort would increase when their feet were not firmly planted to the ground. After experiencing &#x201C;walking on air,&#x201D; participants were asked to move back to the plank and remain there for a short while to see if their anxiety would subside. Some of the more anxiety prone participants were not inclined to walk off the lift or plank and were instead asked to visualize moving off the plank or the lift or just to feel the &#x201C;air&#x201D; with their foot or their hands. If the height experience became too overwhelming, participants were encouraged to take their time, breathe, or feel the wall or the floor. Some felt it safer to crawl out on the plank, others preferred to walk fast, while a few did not want to walk on to the plank at all. Most of the participants moved carefully onto the plank and were eventually able to comply with any given challenge. None of the participants were forced to do anything they did not want to do, but all were encouraged to try.</p>
</sec>
<sec id="S2.SS4">
<title>Data Analyses</title>
<p>The first hypothesis (VRET will induce SUD ratings comparable to participants&#x2019; experience of heights in real life) and the sub-hypothesis (repeated exposure to the height scenarios will reduce SUD ratings) was tested using repeated measures ANOVA. The dependent variable was the SUD ratings and the ANOVA was repeated four times in chronological order of the interventions, specifically: Footstool, Lift (peak), Plank (peak), and Plank (end). The effect of time across the interventions was tested using Wilks&#x2019; lambda and pairwise comparisons. The second hypothesis (young age, male sex, few years of experience as a clinician, previous experience with VR and VRET, favorable attitudes toward novel technology and exposure therapy, and high technological literacy will predict a favorable general attitude toward use of VR in therapy) was tested using regression and correlation analyses. The third hypothesis (attitudes toward VR in therapy will become more favorable after the VR intervention) was tested using a paired <italic>T</italic>-test comparing pre-intervention scores with post-intervention scores. Change in mean scores following the intervention was also evaluated using Cohen&#x2019;s <italic>d</italic> effect size using pooled standard deviations. The fourth hypothesis (clinicians can see pros and cons of using VR in therapy) was explored by categorizing and counting responses provided by the clinicians.</p>
<p>For the repeated measures ANOVA, 12 participants were excluded due to missing SUD ratings. For the correlation and regression analyses there was one missing value. Missing data was not replaced. The study protocol was approved by the Norwegian Centre for Research Data (NSD), reference number: 386880. Additionally, the protocol was approved by the Regional Committee for Medical and Health Research Ethics (REK; reference number: 100564).</p>
</sec>
</sec>
<sec id="S3">
<title>Results</title>
<p>Comparisons between non-clinicians and clinicians are presented in <xref ref-type="table" rid="T1">Table 1</xref>. Non-clinicians had a significantly more favorable general attitude toward novel technology than clinicians (<italic>d</italic> = 0.61). Other differences between the subsamples were insignificant. Moreover, mean ratings of general attitude toward novel technology, immersion, and altitude perception were notably high for both subsamples (see <xref ref-type="table" rid="T1">Table 1</xref>). Some dizziness (i.e., cybersickness) were reported by three participants (2.3%).</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Comparisons of clinician (<italic>n</italic> = 74) and non-clinician (<italic>n</italic> = 54) samples.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><bold>Clinicians</bold></td>
<td valign="top" align="center"><bold>Non-clinicians</bold></td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="center"></td>
<td valign="top" align="center" colspan="2"><hr/></td>
<td valign="top" align="center" colspan="3"></td>
</tr>
<tr>
<td valign="top" align="justify"/>
<td valign="top" align="center" colspan="2"><bold><italic>M</italic> (SD)/% (<italic>n</italic>)</bold></td>
<td valign="top" align="center"><bold><italic>t</italic>/<italic>x</italic><sup>2</sup></bold></td>
<td valign="top" align="center"><bold><italic>p</italic></bold></td>
<td valign="top" align="center"><bold><italic>d</italic></bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. Age</td>
<td valign="top" align="center">34.64 (11.85)</td>
<td valign="top" align="center">34.63 (13.07)</td>
<td valign="top" align="center">&#x2212;0.00</td>
<td valign="top" align="center">0.998</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">2. Female sex</td>
<td valign="top" align="center">66.22%(49)</td>
<td valign="top" align="center">62.96%(34)</td>
<td valign="top" align="center">0.15</td>
<td valign="top" align="center">0.703</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">3. Attitude novel technology</td>
<td valign="top" align="center">4.12 (0.70)</td>
<td valign="top" align="center">4.52 (0.61)</td>
<td valign="top" align="center">3.35</td>
<td valign="top" align="center">0.001</td>
<td valign="top" align="center">0.61</td>
</tr>
<tr>
<td valign="top" align="left">4. Immersion</td>
<td valign="top" align="center">4.00 (0.99)</td>
<td valign="top" align="center">4.19 (0.75)</td>
<td valign="top" align="center">1.15</td>
<td valign="top" align="center">0.253</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">5. Altitude perception</td>
<td valign="top" align="center">4.22 (0.83)</td>
<td valign="top" align="center">4.35 (0.73)</td>
<td valign="top" align="center">0.96</td>
<td valign="top" align="center">0.340</td>
<td/>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>Variable 3 was scored on a scale from 0 (extremely negative) to 5 (extremely positive). Variables 4 and 5 were scored on a scale from 0 (not at all) to 5 (to a very great extent).</italic></attrib>
</table-wrap-foot>
</table-wrap>
<sec id="S3.SS1">
<title>Did the VR Interventions Induce and Reduce SUD?</title>
<p>There was a significant effect of the interventions, Wilks&#x2019; Lambda = 0.15, <italic>F</italic>(3, 113) = 215.13, <italic>p</italic> &#x003C; 0.001. SUD ratings were significantly higher in the Lift (peak)-intervention (<italic>M</italic> = 50.73, SD = 29.64) compared to the Footstool-intervention (<italic>M</italic> = 5.23, SD = 11.53), <italic>t</italic>(115) = &#x2212;16.95, <italic>p</italic> &#x003C; 0.001; <italic>d</italic> = 2.02. Furthermore, SUD ratings were significantly higher in the Plank (peak)-intervention (<italic>M</italic> = 68.57, SD = 28.66) compared to the Lift (peak)-intervention, <italic>t</italic>(115) = &#x2212;7.57, <italic>p</italic> &#x003C; 0.001; <italic>d</italic> = 0.61. Finally, SUD ratings were significantly lower in the Plank (end)-intervention (<italic>M</italic> = 32.87, SD = 29.19) compared to the Plank (peak)-intervention, <italic>t</italic>(115) = 15.78, <italic>p</italic> &#x003C; 0.001; <italic>d</italic> = 1.23. It is also worth noting that the highest level of mean SUD ratings surpassed the mean suggested maximum fear of heights in real life (<italic>M</italic> = 64.99, SD = 28.07; see <xref ref-type="fig" rid="F3">Figure 3</xref>).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>Visualization of SUD ratings throughout the interventions for all participants.</p></caption>
<graphic xlink:href="fpsyg-12-671871-g003.tif"/>
</fig>
</sec>
<sec id="S3.SS2">
<title>What Factors Are Associated With Positive Attitudes Toward VR in Therapy?</title>
<p>Correlations between the study variables are presented in <xref ref-type="table" rid="T2">Table 2</xref>. General attitude toward use of VR in therapy was significantly correlated general attitude toward novel technology (<italic>r</italic> = 0.37), and general attitude toward exposure therapy (<italic>r</italic> = 0.28). Men had higher scores than women on general attitude toward novel technology (<italic>t</italic> = &#x2212;2.50, <italic>p</italic> = 0.015) and technological literacy (<italic>t</italic> = &#x2212;3.93, <italic>p</italic> &#x003C; 0.001). Furthermore, clinicians that had tried VR before had a more favorable attitude toward using VR in therapy (<italic>t</italic> = 2.18, <italic>p</italic> = 0.033).</p>
<table-wrap position="float" id="T2">
<label>TABLE 2</label>
<caption><p>Pearson&#x2019;s correlation coefficients of the study variables for the clinician sample.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="left"><bold>1</bold></td>
<td valign="top" align="left"><bold>2</bold></td>
<td valign="top" align="left"><bold>3</bold></td>
<td valign="top" align="left"><bold>4</bold></td>
<td valign="top" align="left"><bold>5</bold></td>
<td valign="top" align="left"><bold>6</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. Att. VR therapy</td>
<td valign="top" align="center">&#x2013;</td>
<td/>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">2. Age</td>
<td valign="top" align="center">&#x2212;0.08</td>
<td valign="top" align="center">&#x2013;</td>
<td/>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">3. Clinical exp.</td>
<td valign="top" align="center">&#x2212;0.07</td>
<td valign="top" align="center">0.94&#x002A;&#x002A;</td>
<td valign="top" align="center">&#x2013;</td>
<td/>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">4. Att. novel tech.</td>
<td valign="top" align="center">0.37&#x002A;&#x002A;</td>
<td valign="top" align="center">0.15</td>
<td valign="top" align="center">0.13</td>
<td valign="top" align="center">&#x2013;</td>
<td/>
<td/>
</tr>
<tr>
<td valign="top" align="left">5. Attitude ET</td>
<td valign="top" align="center">0.28&#x002A;</td>
<td valign="top" align="center">&#x2212;0.14</td>
<td valign="top" align="center">&#x2212;0.15</td>
<td valign="top" align="center">0.17</td>
<td valign="top" align="center">&#x2013;</td>
<td/>
</tr>
<tr>
<td valign="top" align="left">6. Tech. literacy</td>
<td valign="top" align="center">0.14</td>
<td valign="top" align="center">&#x2212;0.10</td>
<td valign="top" align="center">&#x2212;0.13</td>
<td valign="top" align="center">0.31&#x002A;&#x002A;</td>
<td valign="top" align="center">0.11</td>
<td valign="top" align="center">&#x2013;</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>VR, virtual reality; VRET, virtual reality exposure therapy; Att. VR therapy, general attitude toward use of VR in therapy; Att. novel tech., general attitude toward novel technology; ET, exposure therapy; Tech. literacy, technological literacy.</italic></attrib>
<attrib><italic>&#x002A;<italic>p</italic> &#x003C; 0.05. &#x002A;&#x002A;<italic>p</italic> &#x003C; 0.01.</italic></attrib>
</table-wrap-foot>
</table-wrap>
<p>An overview of a multiple linear regression predicting general attitudes toward use of VR in therapy (pre-intervention) is presented in <xref ref-type="table" rid="T3">Table 3</xref>. The explanatory variables in the regression analysis were sex, age, years of experience as a clinician, previous (non-clinical) experience with VR, previous experience with VRET, general attitude toward novel technology, general attitude toward exposure therapy, and technological literacy. Results of the multiple linear regression indicated that there was a collective significant effect between the aforementioned explanatory variables, <italic>F</italic>(8, 64) = 3.36, <italic>p</italic> = 0.003, <italic>R</italic><sup>2</sup><sub>Adjusted</sub> = 0.21. Variables associated with a positive general attitude to use of VR in therapy were previous (non-clinical) experience with VR, a positive general attitude toward novel technology, and a positive general attitude toward exposure therapy.</p>
<table-wrap position="float" id="T3">
<label>TABLE 3</label>
<caption><p>Predictors of general attitude to use of VR in therapy in the clinician sample.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><bold>&#x03B2;</bold></td>
<td valign="top" align="center"><bold><italic>t</italic></bold></td>
<td valign="top" align="center"><bold><italic>p</italic></bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Sex</td>
<td valign="top" align="center">&#x2212;0.12</td>
<td valign="top" align="center">&#x2212;0.90</td>
<td valign="top" align="center">0.371</td>
</tr>
<tr>
<td valign="top" align="left">Age</td>
<td valign="top" align="center">&#x2212;0.31</td>
<td valign="top" align="center">&#x2212;0.97</td>
<td valign="top" align="center">0.334</td>
</tr>
<tr>
<td valign="top" align="left">Clinical experience</td>
<td valign="top" align="center">0.31</td>
<td valign="top" align="center">0.93</td>
<td valign="top" align="center">0.355</td>
</tr>
<tr>
<td valign="top" align="left">Tried VR</td>
<td valign="top" align="center">0.36</td>
<td valign="top" align="center">3.04</td>
<td valign="top" align="center">0.003</td>
</tr>
<tr>
<td valign="top" align="left">Tried VRET</td>
<td valign="top" align="center">&#x2212;0.17</td>
<td valign="top" align="center">&#x2212;1.35</td>
<td valign="top" align="center">0.183</td>
</tr>
<tr>
<td valign="top" align="left">Attitude novel technology</td>
<td valign="top" align="center">0.42</td>
<td valign="top" align="center">3.52</td>
<td valign="top" align="center">0.001</td>
</tr>
<tr>
<td valign="top" align="left">Attitude exposure therapy</td>
<td valign="top" align="center">0.23</td>
<td valign="top" align="center">2.09</td>
<td valign="top" align="center">0.041</td>
</tr>
<tr>
<td valign="top" align="left">Technological literacy</td>
<td valign="top" align="center">&#x2212;0.02</td>
<td valign="top" align="center">&#x2212;0.15</td>
<td valign="top" align="center">0.882</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>VR, virtual reality; VRET, virtual reality exposure therapy; Sex, 0 = female, 1 = male; Clinical Experience, is the number of years as a clinician; Tried VR, 0 = no, 1 = yes.</italic></attrib>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS3">
<title>Do Attitudes Toward VR in Therapy Become More Favorable After Trying VRET?</title>
<p><xref ref-type="table" rid="T4">Table 4</xref> presents changes in attitudes pre-intervention and post-intervention. This analysis pertains exclusively to clinicians. General attitude toward use of VR in therapy was significantly more favorable post-intervention compared to pre-intervention (<italic>d</italic> = 0.86). Next, the usefulness of VR in therapy was rated significantly higher post-intervention compared to pre-intervention (<italic>d</italic> = 0.89). Furthermore, VR as a supplemental tool in therapy was also rated significantly higher post-intervention compared to pre-intervention (<italic>d</italic> = 0.46). Lastly, the feasibility of VR in therapy was also rated significantly higher post-intervention compared to pre-intervention (<italic>d</italic> = 0.70). All of these changes can be considered large effect sizes, with the exception of the supplemental nature of VR in therapy, which corresponds to a medium effect size. The ratings were markedly high both pre- and post-intervention.</p>
<table-wrap position="float" id="T4">
<label>TABLE 4</label>
<caption><p>Clinicians&#x2019; attitudes to using VRET pre- and post-intervention (<italic>n</italic> = 74).</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left"></td>
<td valign="top" align="center"><bold>Pre</bold></td>
<td valign="top" align="center"><bold>Post</bold></td>
<td valign="top" align="center"><bold><italic>t</italic></bold></td>
<td valign="top" align="center"><bold><italic>p</italic></bold></td>
<td valign="top" align="center"><bold><italic>d</italic></bold></td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">1. General</td>
<td valign="top" align="center">3.92 (0.74)</td>
<td valign="top" align="center">4.49 (0.58)</td>
<td valign="top" align="center">&#x2212;6.75</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">0.86</td>
</tr>
<tr>
<td valign="top" align="left">2. Useful</td>
<td valign="top" align="center">3.99 (0.65)</td>
<td valign="top" align="center">4.54 (0.58)</td>
<td valign="top" align="center">&#x2212;6.76</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">0.89</td>
</tr>
<tr>
<td valign="top" align="left">3. Supplemental</td>
<td valign="top" align="center">4.35 (0.65)</td>
<td valign="top" align="center">4.64 (0.59)</td>
<td valign="top" align="center">&#x2212;3.74</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">0.46</td>
</tr>
<tr>
<td valign="top" align="left">4. Feasible</td>
<td valign="top" align="center">4.23 (0.73)</td>
<td valign="top" align="center">4.69 (0.57)</td>
<td valign="top" align="center">&#x2212;5.76</td>
<td valign="top" align="center">&#x003C;0.001</td>
<td valign="top" align="center">0.70</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<attrib><italic>Variables were scored on a 0&#x2013;5 scale.</italic></attrib>
</table-wrap-foot>
</table-wrap>
</sec>
<sec id="S3.SS4">
<title>What Are the Perceived Pros and Cons of VR in Therapy?</title>
<p>In the pre-intervention questionnaire, the clinicians reported suggestions of benefits and drawbacks of using VR in therapy. The questions were open ended, and participants were asked to elaborate. The majority gave detailed accounts of perceived advantages and disadvantages, but eight respondents did not report advantages and 20 respondents did not report disadvantages. <xref ref-type="fig" rid="F4">Figures 4</xref>, <xref ref-type="fig" rid="F5">5</xref> illustrate a summary of their answers. The most frequently reported advantages of using VR in therapy included accessibility to different objects, situations, and tasks that can only be done in a virtual setting as well as always having exposure material at hand. Furthermore, factors relating to motivation and engagement were frequently mentioned. Other frequently emphasized advantages were resource and time efficiency, and the ability to control and tailor the exposure sessions to individual needs.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Clinicians&#x2019; perceived advantages of using VR in therapy before the intervention. Accessibility, easy implementation and accessibility of different scenarios and stimuli without having to move out of the therapist office; Motivational and engaging, lower dropout rates, more engaging for youth and adolescence, gamification; Resource efficient, can be done solely by the therapist with no need to procure <italic>in vivo</italic> anxiety evoking stimuli; Time efficient, saving time by not having to seek out anxiety evoking stimuli. More time in therapy and less time spent on arranging exposure experiments; Economical, no expenses regarding <italic>in vivo</italic> exposure stimuli (e.g., airplane tickets, dental appointments, etc.) and reduced time related expenses; Control, all variables can be manipulated by clinicians and a greater degree of patient agency (e.g., the HMD can be removed at any time); Other, a residual category for items with low frequency of occurrence; relaxation training (<italic>n</italic> = 1), between session training (<italic>n</italic> = 3), standardized approaches (<italic>n</italic> = 2).</p></caption>
<graphic xlink:href="fpsyg-12-671871-g004.tif"/>
</fig>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption><p>Clinicians&#x2019; perceived disadvantages of using VR in therapy before the intervention. Not real/immersive enough, low degree of realism and generalizability to real-world settings; Difficult to learn the technology, worries that it will be difficult learning to operate the equipment; Technological failure, worries that the equipment could malfunction; Other, a residual category for items with low frequency of occurrence; high cost of equipment (<italic>n</italic> = 3), cybersickness (<italic>n</italic> = 3), not more effective than regular <italic>in vivo</italic> treatment (<italic>n</italic> = 1), not enough research on VRET (<italic>n</italic> = 1), few patients with specific phobias are treated at general outpatient clinics (<italic>n</italic> = 1); Difficult to regulate anxiety, no easy way to control the degree of exposure; Morbidity, unfit to use on people with diagnoses like psychosis or other limitations like impaired hearing and/or vision; Threat to therapeutic alliance, potential barrier between clinician and client; A way to avoid <italic>in vivo</italic> exposure, allowing the patient to avoid exposure to real-world stimuli.</p></caption>
<graphic xlink:href="fpsyg-12-671871-g005.tif"/>
</fig>
<p>Concerns that the program and VR environment would not be experienced as real enough was the most frequent suggested disadvantage. Difficulties in learning how to use the technology and the possibility of technical failure were also frequently mentioned.</p>
</sec>
</sec>
<sec id="S4">
<title>Discussion</title>
<p>The VRET interventions designed for fear of heights induced discomfort in the participants. On account of verbal reports during the interventions and the measures of immersion and altitude perception, we interpret the results as evidence that the reported discomfort is due to the participants&#x2019; varying degrees of fear of heights. Taking into account that SUD ratings exceeded their self-reported maximum discomfort of heights in real life, this suggests that VR is able to simulate phobic stimuli to induce discomfort in this undiagnosed sample, comparably to real-world stimuli. Considering the tenable need for accessible stimuli in exposure therapy, this demonstrates the value of VR as a therapeutic tool. Additionally, we found a decrease in levels of discomfort when participants were given a short period of time to desensitize to the anxiety inducing situation in VR. This finding is in line with studies on VRET using clinical samples (<xref ref-type="bibr" rid="B7">Carl et al., 2019</xref>).</p>
<p>Also, in accordance with previous research by <xref ref-type="bibr" rid="B28">Lindner et al. (2019)</xref> and <xref ref-type="bibr" rid="B41">Segal et al. (2011)</xref>, we found that previous experience with VR, a favorable attitude toward novel technology, and attitude toward exposure therapy predicted favorable general attitude to the use of VR in therapy. We did not find support for an effect of sex or age, which seems to verify the findings of <xref ref-type="bibr" rid="B41">Segal et al. (2011)</xref>. Therefore, it seems that VR might have broad appeal among clinicians. The increasingly positive attitudes after experiencing VRET is in line with prior research establishing a link between VR experience and attitudes (<xref ref-type="bibr" rid="B34">Ose et al., 2019</xref>). As reported by <xref ref-type="bibr" rid="B28">Lindner et al. (2019)</xref> and <xref ref-type="bibr" rid="B34">Ose et al. (2019)</xref>, we also found that clinicians have an overall positive attitude toward VR in therapy. Moreover, this pre-intervention positivity did not prevent clinicians&#x2019; attitudes to become significantly more favorable post-intervention. This initial positivity could partially be due to a sampling bias.</p>
<p>The clinicians&#x2019; perceived advantages of using VR in therapy seem to be in line with the findings of <xref ref-type="bibr" rid="B28">Lindner et al. (2019)</xref> and <xref ref-type="bibr" rid="B41">Segal et al. (2011)</xref>. These include the benefits of high accessibility to different objects, situations, and tasks; motivation and engagement; resource and time efficiency; and tailored experiences with increased levels of patients&#x2019; and therapist control, as well as agency. In light of the distinctly positive attitudes of our sample, these considerations are presumably representative of the thoughts of positively inclined clinicians.</p>
<p>Additionally, perceived disadvantages are also in accordance with <xref ref-type="bibr" rid="B28">Lindner et al. (2019)</xref> and <xref ref-type="bibr" rid="B41">Segal et al. (2011)</xref>, which similarly include concerns regarding technical failure, difficulties in learning the technology, and low realism/immersion with therapeutic improvements not being generalizable to real-world settings. Despite the concerns regarding graphic fidelity, immersion, and <italic>in vivo</italic> generalizability, there is negligible empirical support for these suggested downsides (<xref ref-type="bibr" rid="B29">Ling et al., 2014</xref>; <xref ref-type="bibr" rid="B31">Morina et al., 2015</xref>). Technological barriers such as issues with technical difficulties, low graphic fidelity, cybersickness, and expenses, are becoming increasingly inconsequential with the wider availability of consumer VR products, but human barriers still prevail.</p>
<p>Importantly, as demonstrated by <xref ref-type="bibr" rid="B28">Lindner et al. (2019)</xref> and <xref ref-type="bibr" rid="B41">Segal et al. (2011)</xref>, the existence of negative attitudes is likely to be a bigger obstacle to the implementation of VR in clinical settings than the absence of positive attitudes. Consequently, negative concerns seem to be primary targets that need to be addressed in order for a large-scale implementation of VRET to take place. Our study highlights similar negative concerns and solidifies the potential targets in efforts to facilitate implementation of VR in clinical settings. Some concerns may be alleviated through training programs, with validated protocols, but it seems to be just as important to let clinicians experience the new VR technology for themselves.</p>
<p>The generalizability of this study&#x2019;s findings to clinical settings may be limited due to the use of an undiagnosed sample, which is often a limitation in the current literature (<xref ref-type="bibr" rid="B4">Botella et al., 2017</xref>; <xref ref-type="bibr" rid="B17">Garrett et al., 2018</xref>). The study would have benefited from more extensive assessment such as the Acrophobia Questionnaire (<xref ref-type="bibr" rid="B8">Cohen, 1977</xref>) or the Visual Height Intolerance Severity Scale (<xref ref-type="bibr" rid="B23">Huppert et al., 2017</xref>), and diagnostic interviews. The study could also have benefited from using physiological measures during testing. Considering we did not have any exclusion criteria beyond age, the inclusive sampling method may have benefited sample diversity. However, by employing convenience and snowball sampling, the sample was non-randomized and may have been biased toward more cooperative and interested participants and clinicians with positive inclinations toward VR and/or VRET. This may have resulted in a sample with more favorable attitudes than the general population of clinicians. Also, further studies are needed to determine the value of this solution for fear of heights in clinical samples using controlled designs. Further refining the scenarios could also be helpful. The lift scenario had the lift floating free in a street environment without any connection to relevant object such as a building or a construction vehicle. Further adjusting the scenarios could potentially increase the scenarios&#x2019; ecological validity. Another limitation is that the clinicians&#x2019; attitudes were not subjected to a systematic thematic analysis. The study-design did not allow for comparison of older vs. newer hardware. Therefore it is unknown whether the newer hardware is more effective, more immersive, or less associated with cybersickness. Future studies should take this into account and test for possible differences in treatment outcomes as well as differences in clinician&#x2019;s attitudes toward newer and older hardware.</p>
<p>We propose that future work should investigate the clinical utility of up-to-date hardware and software. This may include testing if hardware with different features such as hand-tracking vs. controllers is associated with better treatment outcomes, as well as investigation of how different software may yield different treatment outcomes in clinical samples. Furthermore, the potential of VR as an authoring tool in clinical settings is a topic for further studies.</p>
<p>This study demonstrated that VRET for fear of heights can induce and reduce discomfort in a sample of clinicians and non-clinicians, and that clinicians&#x2019; attitudes toward VR in therapy become more positive after trying VRET for themselves. We suggest that dispelling negative beliefs among clinicians may increase the likelihood of wide-scale implementation of VR. Follow-up studies should further investigate if experience with VR dissuade concerns such as low realism/immersion and technological difficulties. Additionally, studies should further explore how newer VRET programs can be implemented and disseminated in clinical settings, and possibly as home-based training or self-help solutions.</p>
</sec>
<sec id="S5">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="S6">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Regional Committee for Medical and Health Research Ethics. The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.</p>
</sec>
<sec id="S7">
<title>Author Contributions</title>
<p>ER, LH, and SS contributed to conception and design of the study. SS was the principal investigator. LH and ER were responsible for the data collection and wrote the first draft of the manuscript. All authors were responsible for the statistical analysis and contributed to manuscript revision, read, and approved the submitted version.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<sec id="S8" sec-type="supplementary material"><title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyg.2021.671871/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpsyg.2021.671871/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.docx" id="DS1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anderson</surname> <given-names>P.</given-names></name> <name><surname>Jacobs</surname> <given-names>C.</given-names></name> <name><surname>Rothbaum</surname> <given-names>B. O.</given-names></name></person-group> (<year>2004</year>). <article-title>Computer-supported cognitive behavioral treatment of anxiety disorders.</article-title> <source><italic>J. Clin. Psychol.</italic></source> <volume>60</volume>, <fpage>253</fpage>&#x2013;<lpage>267</lpage>. <pub-id pub-id-type="doi">10.1002/jclp.10262</pub-id> <pub-id pub-id-type="pmid">14981790</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Anton</surname> <given-names>M. T.</given-names></name> <name><surname>Jones</surname> <given-names>D. J.</given-names></name></person-group> (<year>2017</year>). <article-title>Adoption of technology-enhanced treatments: conceptual and practical considerations.</article-title> <source><italic>Clin. Psychol. Sci. Pract.</italic></source> <volume>24</volume> <fpage>223</fpage>&#x2013;<lpage>240</lpage>. <pub-id pub-id-type="doi">10.1111/cpsp.12197</pub-id> <pub-id pub-id-type="pmid">28966479</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boeldt</surname> <given-names>D. L.</given-names></name> <name><surname>McMahon</surname> <given-names>E.</given-names></name> <name><surname>McFaul</surname> <given-names>M.</given-names></name> <name><surname>Greenleaf</surname> <given-names>W.</given-names></name></person-group> (<year>2019</year>). <article-title>Using virtual reality exposure therapy (VRET) to enhance treatment of anxiety disorders: Identifying areas of clinical adoption and potential obstacles.</article-title> <source><italic>Front. Psychiatry</italic></source> <volume>10</volume>:<issue>773</issue>. <pub-id pub-id-type="doi">10.3389/fpsyt.2019.00773</pub-id> <pub-id pub-id-type="pmid">31708821</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Botella</surname> <given-names>C.</given-names></name> <name><surname>Fern&#x00E1;ndez-&#x00C1;lvarez</surname> <given-names>J.</given-names></name> <name><surname>Guill&#x00E9;n</surname> <given-names>V.</given-names></name> <name><surname>Garc&#x00ED;a-Palacios</surname> <given-names>A.</given-names></name> <name><surname>Ba&#x00F1;os</surname> <given-names>R.</given-names></name></person-group> (<year>2017</year>). <article-title>Recent progress in virtual reality exposure therapy for phobias: a systematic review.</article-title> <source><italic>Curr. Psychiatry Rep.</italic></source> <volume>19</volume>:<issue>42</issue>. <pub-id pub-id-type="doi">10.1007/s11920-017-0788-4</pub-id> <pub-id pub-id-type="pmid">28540594</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bouchard</surname> <given-names>S.</given-names></name> <name><surname>Dumoulin</surname> <given-names>S.</given-names></name> <name><surname>Robillard</surname> <given-names>G.</given-names></name> <name><surname>Guitard</surname> <given-names>T.</given-names></name> <name><surname>Klinger</surname> <given-names>&#x00C9;</given-names></name> <name><surname>Forget</surname> <given-names>H.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Virtual reality compared with in vivo exposure in the treatment of social anxiety disorder: a three-arm randomised controlled trial.</article-title> <source><italic>Br. J. Psychiatry</italic></source> <volume>210</volume> <fpage>276</fpage>&#x2013;<lpage>283</lpage>. <pub-id pub-id-type="doi">10.1192/bjp.bp.116.184234</pub-id> <pub-id pub-id-type="pmid">27979818</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bouchard</surname> <given-names>S.</given-names></name> <name><surname>St-Jacques</surname> <given-names>J.</given-names></name> <name><surname>Robillard</surname> <given-names>G.</given-names></name> <name><surname>Renaud</surname> <given-names>P.</given-names></name></person-group> (<year>2008</year>). <article-title>Anxiety increases the feeling of presence in virtual reality.</article-title> <source><italic>Presence Teleoper. Virt. Environ.</italic></source> <volume>17</volume> <fpage>376</fpage>&#x2013;<lpage>391</lpage>. <pub-id pub-id-type="doi">10.1162/pres.17.4.376</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carl</surname> <given-names>E.</given-names></name> <name><surname>Stein</surname> <given-names>A. T.</given-names></name> <name><surname>Levihn-Coon</surname> <given-names>A.</given-names></name> <name><surname>Pogue</surname> <given-names>J. R.</given-names></name> <name><surname>Rothbaum</surname> <given-names>B.</given-names></name> <name><surname>Emmelkamp</surname> <given-names>P.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Virtual reality exposure therapy for anxiety and related disorders: A meta-analysis of randomized controlled trials.</article-title> <source><italic>J. Anxiety Disord.</italic></source> <volume>61</volume> <fpage>27</fpage>&#x2013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2018.08.003</pub-id> <pub-id pub-id-type="pmid">30287083</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>D. C.</given-names></name></person-group> (<year>1977</year>). <article-title>Comparison of self-report and overt-behavioral procedures for assessing acrophobia.</article-title> <source><italic>Behav. Ther.</italic></source> <volume>8</volume> <fpage>17</fpage>&#x2013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1016/S0005-7894(77)80116-0</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deacon</surname> <given-names>B. J.</given-names></name> <name><surname>Abramowitz</surname> <given-names>J. S.</given-names></name></person-group> (<year>2004</year>). <article-title>Cognitive and behavioral treatments for anxiety disorders: a review of meta-analytic findings.</article-title> <source><italic>J. Clin. Psychol.</italic></source> <volume>60</volume> <fpage>429</fpage>&#x2013;<lpage>441</lpage>. <pub-id pub-id-type="doi">10.1002/jclp.10255</pub-id> <pub-id pub-id-type="pmid">15022272</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deacon</surname> <given-names>B. J.</given-names></name> <name><surname>Farrell</surname> <given-names>N. R.</given-names></name></person-group> (<year>2013</year>). &#x201C;<article-title>Therapist barriers to the dissemination of exposure therapy</article-title>,&#x201D; in <source><italic>Handbook of Treating Variants and Complications in Anxiety Disorders</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Storch</surname> <given-names>E. A.</given-names></name> <name><surname>McKay</surname> <given-names>D.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>363</fpage>&#x2013;<lpage>373</lpage>. <pub-id pub-id-type="doi">10.1007/978-1-4614-6458-7_23</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deacon</surname> <given-names>B. J.</given-names></name> <name><surname>Farrell</surname> <given-names>N. R.</given-names></name> <name><surname>Kemp</surname> <given-names>J. J.</given-names></name> <name><surname>Dixon</surname> <given-names>L. J.</given-names></name> <name><surname>Sy</surname> <given-names>J. T.</given-names></name> <name><surname>Zhang</surname> <given-names>A. R.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>Assessing therapist reservations about exposure therapy for anxiety disorders: the therapist beliefs about exposure scale.</article-title> <source><italic>J. Anxiety Disord.</italic></source> <volume>27</volume> <fpage>772</fpage>&#x2013;<lpage>780</lpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2013.04.006</pub-id> <pub-id pub-id-type="pmid">23816349</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Emmelkamp</surname> <given-names>P. M.</given-names></name></person-group> (<year>2005</year>). <article-title>Technological innovations in clinical assessment and psychotherapy.</article-title> <source><italic>Psychother. Psychosom.</italic></source> <volume>74</volume> <fpage>336</fpage>&#x2013;<lpage>343</lpage>. <pub-id pub-id-type="doi">10.1159/000087780</pub-id> <pub-id pub-id-type="pmid">16244509</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fern&#x00E1;ndez-&#x00C1;lvarez</surname> <given-names>J.</given-names></name> <name><surname>Rozental</surname> <given-names>A.</given-names></name> <name><surname>Carlbring</surname> <given-names>P.</given-names></name> <name><surname>Colombo</surname> <given-names>D.</given-names></name> <name><surname>Riva</surname> <given-names>G.</given-names></name> <name><surname>Anderson</surname> <given-names>P. L.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Deterioration rates in virtual reality therapy: an individual patient data level meta-analysis.</article-title> <source><italic>J. Anxiety Disord.</italic></source> <volume>61</volume> <fpage>3</fpage>&#x2013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2018.06.005</pub-id> <pub-id pub-id-type="pmid">30057346</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Freeman</surname> <given-names>D.</given-names></name> <name><surname>Reeve</surname> <given-names>S.</given-names></name> <name><surname>Robinson</surname> <given-names>A.</given-names></name> <name><surname>Ehlers</surname> <given-names>A.</given-names></name> <name><surname>Clark</surname> <given-names>D.</given-names></name> <name><surname>Spanlang</surname> <given-names>B.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Virtual reality in the assessment, understanding, and treatment of mental health disorders.</article-title> <source><italic>Psychol. Med.</italic></source> <volume>47</volume> <fpage>2393</fpage>&#x2013;<lpage>2400</lpage>. <pub-id pub-id-type="doi">10.1017/S003329171700040X</pub-id> <pub-id pub-id-type="pmid">28325167</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garcia-Palacios</surname> <given-names>A.</given-names></name> <name><surname>Botella</surname> <given-names>C.</given-names></name> <name><surname>Hoffman</surname> <given-names>H.</given-names></name> <name><surname>Fabregat</surname> <given-names>S.</given-names></name></person-group> (<year>2007</year>). <article-title>Comparing acceptance and refusal rates of virtual reality exposure vs. in vivo exposure by patients with specific phobias.</article-title> <source><italic>Cyberpsychol. Behav.</italic></source> <volume>10</volume> <fpage>722</fpage>&#x2013;<lpage>724</lpage>. <pub-id pub-id-type="doi">10.1089/cpb.2007.9962</pub-id> <pub-id pub-id-type="pmid">17927544</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garcia-Palacios</surname> <given-names>A.</given-names></name> <name><surname>Hoffman</surname> <given-names>H. G.</given-names></name> <name><surname>Kwong See</surname> <given-names>S.</given-names></name> <name><surname>Tsai</surname> <given-names>A. M. Y.</given-names></name> <name><surname>Botella</surname> <given-names>C.</given-names></name></person-group> (<year>2001</year>). <article-title>Redefining therapeutic success with virtual reality exposure therapy.</article-title> <source><italic>CyberPsychol. Behav.</italic></source> <volume>4</volume> <fpage>341</fpage>&#x2013;<lpage>348</lpage>. <pub-id pub-id-type="doi">10.1089/109493101300210231</pub-id> <pub-id pub-id-type="pmid">11710258</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garrett</surname> <given-names>B.</given-names></name> <name><surname>Taverner</surname> <given-names>T.</given-names></name> <name><surname>Gromala</surname> <given-names>D.</given-names></name> <name><surname>Tao</surname> <given-names>G.</given-names></name> <name><surname>Cordingley</surname> <given-names>E.</given-names></name> <name><surname>Sun</surname> <given-names>C.</given-names></name></person-group> (<year>2018</year>). <article-title>Virtual reality clinical research: promises and challenges.</article-title> <source><italic>JMIR Serious Games</italic></source> <volume>6</volume> <issue>e10839</issue>. <pub-id pub-id-type="doi">10.2196/10839</pub-id> <pub-id pub-id-type="pmid">30333096</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gega</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>The virtues of virtual reality in exposure therapy.</article-title> <source><italic>Br. J. Psychiatry</italic></source> <volume>210</volume> <fpage>245</fpage>&#x2013;<lpage>246</lpage>. <pub-id pub-id-type="doi">10.1192/bjp.bp.116.193300</pub-id> <pub-id pub-id-type="pmid">28373222</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Glegg</surname> <given-names>S. M. N.</given-names></name> <name><surname>Levac</surname> <given-names>D. E.</given-names></name></person-group> (<year>2018</year>). <article-title>Barriers, facilitators and interventions to support virtual reality implementation in rehabilitation: a scoping review.</article-title> <source><italic>Phys. Med. Rehabil.</italic></source> <volume>10</volume> <fpage>1237</fpage>&#x2013;<lpage>1251</lpage>. <pub-id pub-id-type="doi">10.1016/j.pmrj.2018.07.004</pub-id> <pub-id pub-id-type="pmid">30503231</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gromer</surname> <given-names>D.</given-names></name> <name><surname>Madeira</surname> <given-names>O.</given-names></name> <name><surname>Gast</surname> <given-names>P.</given-names></name> <name><surname>Nehfischer</surname> <given-names>M.</given-names></name> <name><surname>Jost</surname> <given-names>M.</given-names></name> <name><surname>M&#x00FC;ller</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Height simulation in a virtual reality CAVE system: validity of fear responses and effects of an immersion manipulation.</article-title> <source><italic>Front. Hum. Neurosc.</italic></source> <volume>12</volume>:<issue>372</issue>. <pub-id pub-id-type="doi">10.3389/fnhum.2018.00372</pub-id> <pub-id pub-id-type="pmid">30319376</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gunter</surname> <given-names>R. W.</given-names></name> <name><surname>Whittal</surname> <given-names>M. L.</given-names></name></person-group> (<year>2010</year>). <article-title>Dissemination of cognitive-behavioral treatments for anxiety disorders: overcoming barriers and improving patient access.</article-title> <source><italic>Clin. Psychol. Rev.</italic></source> <volume>30</volume> <fpage>194</fpage>&#x2013;<lpage>202</lpage>. <pub-id pub-id-type="doi">10.1016/j.cpr.2009.11.001</pub-id> <pub-id pub-id-type="pmid">19942331</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hipol</surname> <given-names>L. J.</given-names></name> <name><surname>Deacon</surname> <given-names>B. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Dissemination of evidence-based practices for anxiety disorders in Wyoming: a survey of practicing psychotherapists.</article-title> <source><italic>Behav. Modific.</italic></source> <volume>37</volume> <fpage>170</fpage>&#x2013;<lpage>188</lpage>. <pub-id pub-id-type="doi">10.1177/0145445512458794</pub-id> <pub-id pub-id-type="pmid">23012685</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huppert</surname> <given-names>D.</given-names></name> <name><surname>Grill</surname> <given-names>E.</given-names></name> <name><surname>Brandt</surname> <given-names>T.</given-names></name></person-group> (<year>2017</year>). <article-title>A new questionnaire for estimating the severity of visual height intolerance and acrophobia by a metric interval scale.</article-title> <source><italic>Front. Neurol.</italic></source> <volume>8</volume>:<issue>211</issue>. <pub-id pub-id-type="doi">10.3389/fneur.2017.00211</pub-id> <pub-id pub-id-type="pmid">28620340</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huppert</surname> <given-names>D.</given-names></name> <name><surname>Wuehr</surname> <given-names>M.</given-names></name> <name><surname>Brandt</surname> <given-names>T.</given-names></name></person-group> (<year>2020</year>). <article-title>Acrophobia and visual height intolerance: advances in epidemiology and mechanisms.</article-title> <source><italic>J. Neurol.</italic></source> <volume>267(Suppl.1)</volume> <fpage>231</fpage>&#x2013;<lpage>240</lpage>. <pub-id pub-id-type="doi">10.1007/s00415-020-09805-4</pub-id> <pub-id pub-id-type="pmid">32444982</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jerdan</surname> <given-names>S. W.</given-names></name> <name><surname>Grindle</surname> <given-names>M.</given-names></name> <name><surname>van Woerden</surname> <given-names>H. C.</given-names></name> <name><surname>Boulos</surname> <given-names>M. N. K.</given-names></name></person-group> (<year>2018</year>). <article-title>Head-mounted virtual reality and mental health: critical review of current research.</article-title> <source><italic>JMIR Serious Games</italic></source> <volume>6</volume>:<issue>E14</issue>. <pub-id pub-id-type="doi">10.2196/games.9226</pub-id> <pub-id pub-id-type="pmid">29980500</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>J.</given-names></name> <name><surname>Luu</surname> <given-names>W.</given-names></name> <name><surname>Palmisano</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>Multisensory integration and the experience of scene instability, presence and cybersickness in virtual environments.</article-title> <source><italic>Comput. Hum. Behav.</italic></source> <volume>113</volume>:<issue>106484</issue>. <pub-id pub-id-type="doi">10.1016/j.chb.2020.106484</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindner</surname> <given-names>P.</given-names></name> <name><surname>Miloff</surname> <given-names>A.</given-names></name> <name><surname>Hamilton</surname> <given-names>W.</given-names></name> <name><surname>Reuterski&#x00F6;ld</surname> <given-names>L.</given-names></name> <name><surname>Andersson</surname> <given-names>G.</given-names></name> <name><surname>Powers</surname> <given-names>M. B.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Creating state of the art, next-generation Virtual Reality exposure therapies for anxiety disorders using consumer hardware platforms: design considerations and future directions.</article-title> <source><italic>Cogn. Behav. Ther.</italic></source> <volume>46</volume> <fpage>404</fpage>&#x2013;<lpage>420</lpage>. <pub-id pub-id-type="doi">10.1080/16506073.2017.1280843</pub-id> <pub-id pub-id-type="pmid">28270059</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindner</surname> <given-names>P.</given-names></name> <name><surname>Miloff</surname> <given-names>A.</given-names></name> <name><surname>Zetterlund</surname> <given-names>E.</given-names></name> <name><surname>Reuterski&#x00F6;ld</surname> <given-names>L.</given-names></name> <name><surname>Andersson</surname> <given-names>G.</given-names></name> <name><surname>Carlbring</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). <article-title>Attitudes toward and familiarity with virtual reality therapy among practicing cognitive behavior therapists: a cross-sectional survey study in the era of consumer VR platforms.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>10</volume>:<issue>176</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.00176</pub-id> <pub-id pub-id-type="pmid">30800086</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ling</surname> <given-names>Y.</given-names></name> <name><surname>Nefs</surname> <given-names>H. T.</given-names></name> <name><surname>Morina</surname> <given-names>N.</given-names></name> <name><surname>Heynderickx</surname> <given-names>I.</given-names></name> <name><surname>Brinkman</surname> <given-names>W. P.</given-names></name></person-group> (<year>2014</year>). <article-title>A meta-analysis on the relationship between self-reported presence and anxiety in virtual reality exposure therapy for anxiety disorders.</article-title> <source><italic>PLoS One</italic></source> <volume>9</volume>:<issue>e96144</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0096144</pub-id> <pub-id pub-id-type="pmid">24801324</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mishkind</surname> <given-names>M. C.</given-names></name> <name><surname>Norr</surname> <given-names>A. M.</given-names></name> <name><surname>Katz</surname> <given-names>A. C.</given-names></name> <name><surname>Reger</surname> <given-names>G. M.</given-names></name></person-group> (<year>2017</year>). <article-title>Review of virtual reality treatment in psychiatry: evidence versus current diffusion and use.</article-title> <source><italic>Curr. Psychiatry Rep.</italic></source> <volume>19</volume>:<issue>80</issue>. <pub-id pub-id-type="doi">10.1007/s11920-017-0836-0</pub-id> <pub-id pub-id-type="pmid">28920179</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morina</surname> <given-names>N.</given-names></name> <name><surname>Ijntema</surname> <given-names>H.</given-names></name> <name><surname>Meyerbr&#x00F6;ker</surname> <given-names>K.</given-names></name> <name><surname>Emmelkamp</surname> <given-names>P. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Can virtual reality exposure therapy gains be generalized to real-life? A meta-analysis of studies applying behavioral assessments.</article-title> <source><italic>Behav. Res. Ther.</italic></source> <volume>74</volume> <fpage>18</fpage>&#x2013;<lpage>24</lpage>. <pub-id pub-id-type="doi">10.1016/j.brat.2015.08.010</pub-id> <pub-id pub-id-type="pmid">26355646</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Neudeck</surname> <given-names>P.</given-names></name> <name><surname>Einsle</surname> <given-names>F.</given-names></name></person-group> (<year>2012</year>). &#x201C;<article-title>Dissemination of exposure therapy in clinical practice: How to handle the barriers?</article-title>,&#x201D; in <source><italic>Exposure therapy</italic></source>, <role>eds</role> <person-group person-group-type="editor"><name><surname>Neudeck</surname> <given-names>P.</given-names></name> <name><surname>Wittchen</surname> <given-names>H. U.</given-names></name></person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>23</fpage>&#x2013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.1007/978-1-4614-3342-2_3</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Opri&#x015F;</surname> <given-names>D.</given-names></name> <name><surname>Pintea</surname> <given-names>S.</given-names></name> <name><surname>Garc&#x00ED;a-Palacios</surname> <given-names>A.</given-names></name> <name><surname>Botella</surname> <given-names>C.</given-names></name> <name><surname>Szamosk&#x00F6;zi</surname> <given-names>&#x015E;</given-names></name> <name><surname>David</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). <article-title>Virtual reality exposure therapy in anxiety disorders: a quantitative meta-analysis.</article-title> <source><italic>Depr. Anxiety</italic></source> <volume>29</volume> <fpage>85</fpage>&#x2013;<lpage>93</lpage>. <pub-id pub-id-type="doi">10.1002/da.20910</pub-id> <pub-id pub-id-type="pmid">22065564</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ose</surname> <given-names>S. O.</given-names></name> <name><surname>F&#x00E6;revik</surname> <given-names>H.</given-names></name> <name><surname>Kaasb&#x00F8;ll</surname> <given-names>J.</given-names></name> <name><surname>Lindgren</surname> <given-names>M.</given-names></name> <name><surname>Thaulow</surname> <given-names>K.</given-names></name> <name><surname>Antonsen</surname> <given-names>S.</given-names></name><etal/></person-group> (<year>2019</year>). <article-title>Exploring the potential for use of virtual reality technology in the treatment of severe mental illness among adults in mid-Norway: Collaborative research between clinicians and researchers.</article-title> <source><italic>JMIR Form. Res.</italic></source> <volume>3</volume>:<issue>e13633</issue>. <pub-id pub-id-type="doi">10.2196/13633</pub-id> <pub-id pub-id-type="pmid">31199315</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Park</surname> <given-names>W.</given-names></name> <name><surname>Heo</surname> <given-names>H.</given-names></name> <name><surname>Park</surname> <given-names>S.</given-names></name> <name><surname>Kim</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>A study on the presence of immersive user interface in collaborative virtual environments application.</article-title> <source><italic>Symmetry</italic></source> <volume>11</volume>:<issue>476</issue>. <pub-id pub-id-type="doi">10.3390/sym11040476</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Parsons</surname> <given-names>T. D.</given-names></name> <name><surname>Rizzo</surname> <given-names>A. A.</given-names></name></person-group> (<year>2008</year>). <article-title>Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: A meta-analysis.</article-title> <source><italic>J. Behav. Ther. Exp. Psychiatry</italic></source> <volume>39</volume> <fpage>250</fpage>&#x2013;<lpage>261</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbtep.2007.07.007</pub-id> <pub-id pub-id-type="pmid">17720136</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Powers</surname> <given-names>M. B.</given-names></name> <name><surname>Emmelkamp</surname> <given-names>P. M.</given-names></name></person-group> (<year>2008</year>). <article-title>Virtual reality exposure therapy for anxiety disorders: a meta-analysis.</article-title> <source><italic>J. Anxiety Disord.</italic></source> <volume>22</volume> <fpage>561</fpage>&#x2013;<lpage>569</lpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2007.04.006</pub-id> <pub-id pub-id-type="pmid">17544252</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Price</surname> <given-names>M.</given-names></name> <name><surname>Anderson</surname> <given-names>P.</given-names></name></person-group> (<year>2007</year>). <article-title>The role of presence in virtual reality exposure therapy.</article-title> <source><italic>J. Anxiety Disord.</italic></source> <volume>21</volume> <fpage>742</fpage>&#x2013;<lpage>751</lpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2006.11.002</pub-id> <pub-id pub-id-type="pmid">17145164</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ramsey</surname> <given-names>A.</given-names></name> <name><surname>Lord</surname> <given-names>S.</given-names></name> <name><surname>Torrey</surname> <given-names>J.</given-names></name> <name><surname>Marsch</surname> <given-names>L.</given-names></name> <name><surname>Lardiere</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Paving the way to successful implementation: Identifying key barriers to use of technology-based therapeutic tools for behavioral health care.</article-title> <source><italic>J. Behav. Health Serv. Res.</italic></source> <volume>43</volume> <fpage>54</fpage>&#x2013;<lpage>70</lpage>. <pub-id pub-id-type="doi">10.1007/s11414-014-9436-5</pub-id> <pub-id pub-id-type="pmid">25192755</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rebenitsch</surname> <given-names>L.</given-names></name> <name><surname>Owen</surname> <given-names>C.</given-names></name></person-group> (<year>2016</year>). <article-title>Review on cybersickness in applications and visual displays.</article-title> <source><italic>Virt. Reality</italic></source> <volume>20</volume> <fpage>101</fpage>&#x2013;<lpage>125</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-016-0285-9</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Segal</surname> <given-names>R.</given-names></name> <name><surname>Bhatia</surname> <given-names>M.</given-names></name> <name><surname>Drapeau</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Therapists&#x2019; perception of benefits and costs of using virtual reality treatments.</article-title> <source><italic>Cyberpsychol. Behav. Soc. Netw.</italic></source> <volume>14</volume> <fpage>29</fpage>&#x2013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.1089/cyber.2009.0398</pub-id> <pub-id pub-id-type="pmid">21329440</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Slater</surname> <given-names>M.</given-names></name> <name><surname>Sanchez-Vives</surname> <given-names>M. V.</given-names></name></person-group> (<year>2016</year>). <article-title>Enhancing our lives with immersive virtual reality.</article-title> <source><italic>Front. Robot AI</italic></source> <volume>3</volume>:<issue>74</issue>. <pub-id pub-id-type="doi">10.3389/frobt.2016.00074</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taffou</surname> <given-names>M.</given-names></name> <name><surname>Guerchouche</surname> <given-names>R.</given-names></name> <name><surname>Drettakis</surname> <given-names>G.</given-names></name> <name><surname>Viaud-Delmon</surname> <given-names>I.</given-names></name></person-group> (<year>2013</year>). <article-title>Auditory&#x2013;visual aversive stimuli modulate the conscious experience of fear.</article-title> <source><italic>Multisens. Res.</italic></source> <volume>26</volume> <fpage>347</fpage>&#x2013;<lpage>370</lpage>. <pub-id pub-id-type="doi">10.1163/22134808-00002424</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weech</surname> <given-names>S.</given-names></name> <name><surname>Kenny</surname> <given-names>S.</given-names></name> <name><surname>Barnett-Cowan</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Presence and cybersickness in virtual reality are negatively related: a review.</article-title> <source><italic>Front. Psychol.</italic></source> <volume>10</volume>:<issue>158</issue>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.00158</pub-id> <pub-id pub-id-type="pmid">30778320</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wiederhold</surname> <given-names>B. K.</given-names></name> <name><surname>Riva</surname> <given-names>G.</given-names></name></person-group> (<year>2019</year>). <article-title>Virtual reality therapy: emerging topics and future challenges.</article-title> <source><italic>Cyberpsychol. Behav. Soc. Netw.</italic></source> <volume>22</volume>, <fpage>3</fpage>&#x2013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1089/cyber.2018.29136.bkw</pub-id> <pub-id pub-id-type="pmid">30649958</pub-id></citation></ref>
</ref-list>
</back>
</article>
