<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Virtual Real.</journal-id>
<journal-title>Frontiers in Virtual Reality</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Virtual Real.</abbrev-journal-title>
<issn pub-type="epub">2673-4192</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">1130864</article-id>
<article-id pub-id-type="doi">10.3389/frvir.2023.1130864</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Virtual Reality</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Comparing cybersickness in virtual reality and mixed reality head-mounted displays</article-title>
<alt-title alt-title-type="left-running-head">Kirollos and Merchant</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/frvir.2023.1130864">10.3389/frvir.2023.1130864</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Kirollos</surname>
<given-names>Ramy</given-names>
</name>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/2149492/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Merchant</surname>
<given-names>Wasim</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/2150648/overview"/>
</contrib>
</contrib-group>
<aff>
<institution>Defence Research and Development Canada</institution>, <institution>Toronto Research Centre</institution>, <addr-line>Toronto</addr-line>, <addr-line>ON</addr-line>, <country>Canada</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/972783/overview">Xiaosong Yang</ext-link>, Bournemouth University, United Kingdom</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1833839/overview">Junjun Pan</ext-link>, Beihang University, China</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1838025/overview">Kun Qian</ext-link>, King&#x2019;s College London, United Kingdom</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Ramy Kirollos, <email>Ramy.Kirollos@drdc-rddc.gc.ca</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted toAugmented Reality, a section of the journal Frontiers in Virtual Reality</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>13</day>
<month>02</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>4</volume>
<elocation-id>1130864</elocation-id>
<history>
<date date-type="received">
<day>23</day>
<month>12</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>02</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2023 Kirollos and Merchant.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Kirollos and Merchant</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>
<bold>Introduction:</bold> Defence Research and Development Canada is developing guidance on the use of Mixed Reality head-mounted displays for naval operations in the Royal Canadian Navy. Virtual reality head-mounted displays display graphics to the user in 3D and completely occlude the user&#x2019;s view of the real world. Mixed Reality head-mounted displays overlay and integrate graphics onto the real world allowing the user to perceive the real world and rich 3D graphic elements simultaneously. Nausea and other debilitating symptoms caused by the use of head-mounted displays, known as &#x2018;cybersickness&#x2019;, is well documented during Virtual reality head-mounted display exposure and can be quite severe. However, it is not yet clear from the literature on Mixed Reality head-mounted displays whether CS differs in Virtual reality vs. Mixed Reality head-mounted displays. The objective of this study was to determine the impact of MR HMDs on CS.</p>
<p>
<bold>Method:</bold> This was done by modulating the quantity of graphics in two Mixed Reality conditions and one Virtual reality condition. Only foreground objects were graphically rendered in the first Mixed Reality condition (called &#x2018;Mixed Reality&#x2019; condition), while the entire scene was graphically rendered in the second Mixed Reality condition (called &#x2018;Mixed Reality &#x2b;&#x2019; condition). The Virtual reality condition simulated the Mixed Reality &#x2b; condition but was displayed in a Virtual reality head-mounted display. Participants observed the virtually rendered scene in one of the three conditions and reported their CS with the simulator sickness questionnaire six times throughout the 30-min experiment. We hypothesized that CS severity would increase as quantity of graphics in the display increased.</p>
<p>
<bold>Results and Discussion:</bold> Findings indicated that CS was significantly greater in the &#x2018;Mixed Reality &#x2b;&#x2019; condition compared to the &#x2018;Mixed Reality&#x2019; and &#x2018;Virtual reality&#x2019; conditions, providing partial evidence for our main hypothesis. Moreover, CS increased significantly and meaningfully after 25&#xa0;min in the &#x2018;Mixed Reality &#x2b;&#x2019; condition. These findings indicate safe use of Mixed Reality head-mounted displays by the RCN for shore-based applications provided quantity of graphics is limited.</p>
</abstract>
<kwd-group>
<kwd>virtual reality</kwd>
<kwd>mixed reality</kwd>
<kwd>head-mounted display (HMD)</kwd>
<kwd>cybersickness</kwd>
<kwd>simulator sickness questionnaire (SSQ)</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>Defence Research and Development Canada (DRDC) is developing guidance on the use of mixed reality (MR) head-mounted displays (HMDs) for naval operations within the Royal Canadian Navy (RCN). These MR HMDs can allow for enhanced and augmented visualization of the underwater battlespace while retaining user situational awareness of the physical world. Existing research on cybersickness (CS) focuses primarily on virtual reality (VR) HMDs; repeatedly showing that it can provoke sometimes severe CS, especially over extended use (<xref ref-type="bibr" rid="B64">Yildirim, 2019</xref>; <xref ref-type="bibr" rid="B45">Palmisano et al., 2020</xref>; <xref ref-type="bibr" rid="B51">Rebenitsch and Owen, 2021</xref>). However, less research has focused on CS in MR HMDs. The objective of the current study was to investigate the severity of CS in MR to advise the RCN on whether these HMDs are safe for operational naval use. This was done by modulating graphic quantity in an MR HMD, and comparing sickness scores across 2&#xa0;MR conditions, and one VR condition.</p>
<sec id="s1-1">
<title>1.1 Cybersickness in VR and MR HMDs</title>
<p>We define augmented reality (AR) as the display of virtual graphics overlaid onto the physical world. In VR, virtual graphics completely occlude the physical world. MR integrates virtual graphics with physical properties of the physical world, allowing interactive and integrated use of graphics. We use the term extended reality (xR) as an umbrella term encompassing VR, AR and MR (<xref ref-type="bibr" rid="B41">Milgram and Kishino, 1994</xref>; <xref ref-type="bibr" rid="B16">He et al., 2019</xref>; <xref ref-type="bibr" rid="B30">Kirollos and Harriott, 2021</xref>; <xref ref-type="bibr" rid="B63">XR Collaboration, 2021</xref>; <xref ref-type="bibr" rid="B40">Merchant and Kirollos, 2022</xref>).</p>
<p>Motion sickness (MS) is malaise characterized by vomiting, retching, pallor, sweating, nausea, ocular fatigue, incapacitation, discomfort, irritability and trouble communicating (<xref ref-type="bibr" rid="B24">Kennedy et al., 2010</xref>). The feeling of MS can arise in a variety of environments, and thus symptom and sign severity may vary slightly accordingly (<xref ref-type="bibr" rid="B9">Casali and Frank, 1986</xref>; <xref ref-type="bibr" rid="B52">Rebenitsch and Owen, 2016</xref>; <xref ref-type="bibr" rid="B42">Mittelstaedt et al., 2018</xref>; <xref ref-type="bibr" rid="B6">Bos et al., 2021</xref>). Airsickness, carsickness, seasickness and simulator sickness are some examples of the various types of MS resulting from different environments. There is debate on the definition of CS, and if it should be limited to sickness associated with head-fixed displays such as xR HMDs (<xref ref-type="bibr" rid="B2">Arcioni et al., 2018</xref>; <xref ref-type="bibr" rid="B31">Kirollos and Jarmasz, 2021</xref>), or if it should also include sickness from world-fixed displays such as 2D monitors and 3D stereoscopic projection systems (<xref ref-type="bibr" rid="B25">Kennedy et al., 2003</xref>; <xref ref-type="bibr" rid="B12">Gallagher and Ferr&#xe8;, 2018</xref>). Here we define CS as a variation of MS that emerges from the use of xR HMDs specifically (<xref ref-type="bibr" rid="B2">Arcioni et al., 2018</xref>; <xref ref-type="bibr" rid="B31">Kirollos and Jarmasz, 2021</xref>).</p>
</sec>
<sec id="s1-2">
<title>1.2 Measuring cybersickness</title>
<p>There are many self-report, behavioural and physiological measures to index sickness susceptibility and sickness state (see <xref ref-type="bibr" rid="B40">Merchant and Kirollos (2022)</xref> for a recent review). Importantly, many physiological measures continue to be scrutinized for their reported unreliability in predicting or detecting sickness across individuals (<xref ref-type="bibr" rid="B7">Bos and Lawson, 2021</xref>). On the hand, self-report measures capture participant perceived sickness severity and ability to perform their duties&#x2013;the most important consideration for use within military.</p>
<p>Motion sickness susceptibility methods are used to index past episodes of sickness. An example of this includes the motion sickness susceptibility questionnaire (MSSQ) (<xref ref-type="bibr" rid="B14">Golding, 1998</xref>; <xref ref-type="bibr" rid="B13">Golding, 2006</xref>). Some research has shown that scores from sickness susceptibility questionnaires correlate significantly with sickness state questionnaires, demonstrating that past sickness events can predict future sickness (<xref ref-type="bibr" rid="B4">Beadle et al., 2021</xref>; <xref ref-type="bibr" rid="B15">Golding et al., 2021</xref>).</p>
<p>Sickness state questionnaires determine how sick an individual is in their current state. Examples of sickness state questionnaires include the simulator sickness questionnaire (SSQ), the fast motion sickness scale (FMS) and the virtual reality sickness questionnaire (VRSQ) (<xref ref-type="bibr" rid="B26">Kennedy et al., 1993</xref>; <xref ref-type="bibr" rid="B27">Keshavarz and Hecht, 2011</xref>; <xref ref-type="bibr" rid="B28">Kim et al., 2018</xref>). Among all of them, the SSQ is the most well-established and well-validated sickness state questionnaire (<xref ref-type="bibr" rid="B61">Weech et al., 2019</xref>; <xref ref-type="bibr" rid="B22">Kemeny et al., 2020</xref>). The SSQ has a maximum total severity score (TS) of approximately 235 (<xref ref-type="bibr" rid="B5">Bimberg et al., 2020</xref>). The TS consists of three non-mutually exclusive subscales: nausea <italic>N</italic>), oculomotor discomfort <italic>O</italic>), and disorientation <italic>D</italic>).</p>
</sec>
<sec id="s1-3">
<title>1.3 Motion sickness theories</title>
<p>There are various theories attempting to explain, predict and reduce incidence of MS. The neural mismatch theory is the most accepted theory of motion sickness (<xref ref-type="bibr" rid="B50">Reason, 1978</xref>). It posits that MS occurs because of a sustained conflict between visual and vestibular inputs. Rest frame hypothesis (RFH) predicts that in the absence of a visually stable cue such as the horizon (i.e., the point at which the sky and the Earth&#x2019;s surface appear to meet), MS becomes proportionally severe (<xref ref-type="bibr" rid="B47">Parker and Prothero, 2003</xref>). RFH is arguably related to the neural mismatch theory as it infers that a lack of cues for spatial orientation aggravates the visual-vestibular conflict (<xref ref-type="bibr" rid="B17">Hemmerich et al., 2020</xref>). However, when clear and reliable reference cues such as the horizon are present, MS can be far less severe as these provide relative spatial orientation cues to an observer.</p>
<p>The poison theory posits that signs and symptoms of MS are an evolutionary by-product of a toxin detection and expulsion mechanism (<xref ref-type="bibr" rid="B59">Treisman, 1977</xref>). Lastly, the postural instability theory suggests that MS can be predicted based on the difficulty in maintaining postural stability by an individual before MS occurs (<xref ref-type="bibr" rid="B53">Riccio and Stoffregen, 1991</xref>). Despite the attempts to explain, predict and mitigate MS and CS, there is no universally accepted theory or solution (<xref ref-type="bibr" rid="B36">Lawson, 2014</xref>).</p>
</sec>
<sec id="s1-4">
<title>1.4 Contributors to CS</title>
<p>Vergence-accommodation mismatch (VAM) is a visual conflict that contributes to CS (<xref ref-type="bibr" rid="B18">Hoffman et al., 2008</xref>). When viewing objects in nature, as the angle of the convergence of each eye approaches infinity, the lenses of each eye become proportionally convex to fixate far targets. Stereoscopic displays such as xR HMDs do not allow for vergence-accommodation, causing visual fatigue, and discomfort&#x2013;factors associated with CS (<xref ref-type="bibr" rid="B18">Hoffman et al., 2008</xref>). Mitigating VAM in xR HMDs would involve physically altering the focal distances from the user&#x2019;s head in order for the lens of the eyes to accommodate appropriately and match the depth of objects in the virtual scene. Alternatively, depth of field blurring is a method used to blur non-fixated objects to eliminate depth cues that may be in conflict with depth cues from a fixated object (<xref ref-type="bibr" rid="B33">Langbehn et al., 2016</xref>). A second known visual conflict contributing to CS is interpupillary distance (IPD) mismatches between the individual and HMD (<xref ref-type="bibr" rid="B56">Stanney et al., 2020</xref>). <xref ref-type="bibr" rid="B56">Stanney et al. (2020)</xref> demonstrated that IPD discrepancies between the individual and HMD significantly affect CS.</p>
<p>In addition to visual conflicts, visual-vestibular conflicts contribute to CS. For instance, delay between virtual head position and actual head position, and their corresponding visual display is termed motion-to-photon lag (<xref ref-type="bibr" rid="B1">Allison et al., 2001</xref>; <xref ref-type="bibr" rid="B44">Moss et al., 2011</xref>; <xref ref-type="bibr" rid="B65">Zhao et al., 2017</xref>). This delay creates a discrepancy in perceived head position between the visual and vestibular systems, which contributes to CS. <xref ref-type="bibr" rid="B29">Kim et al. (2020)</xref> found that CS scores were negligible (i.e., below a score of 1/20 on the FMS) in their native lag condition (&#x223c;4&#xa0;m) for a VR HMD. Generally, native motion-to-photon lag of modern xR HMDs for yaw-axis head movement, the most common type of head movement, is becoming increasingly negligible (<xref ref-type="bibr" rid="B29">Kim et al., 2020</xref>).</p>
<p>A lack of rest frames (RFs), or fixed visual cues, is also a source of visual-vestibular conflict that contributes to CS. In MR HMDs, fixed visual cues of the physical world should serve as RFs as they act as stable orientation cues when displaying graphic content. <xref ref-type="bibr" rid="B43">Moro et al. (2017)</xref> compared the use of VR HMDs, MR HMDs and tablets as anatomy training tools. Participants reported higher symptoms of CS when using VR compared with MR HMDs and tablets. This finding is consistent with RFH because VR occludes the physical world completely and therefore provides no real-world RFs in contrast to MR HMDs where physical world RFs are visible. A caveat of <xref ref-type="bibr" rid="B43">Moro et al. (2017)</xref> is that the authors did not use a recognized measure of CS. Work by <xref ref-type="bibr" rid="B23">Kemeny et al. (2017)</xref>; <xref ref-type="bibr" rid="B8">Cao et al. (2018)</xref>; <xref ref-type="bibr" rid="B17">Hemmerich et al. (2020)</xref>; <xref ref-type="bibr" rid="B62">Whittinghill et al. (2015)</xref> all found that the presence of RFs reduced symptoms of CS. Thus, CS is thought to be less severe in MR compared to VR because MR devices permit the user to perceive a physical reference cue (<xref ref-type="bibr" rid="B35">Lawson, 2005</xref>; <xref ref-type="bibr" rid="B32">Kuiper et al., 2019</xref>; <xref ref-type="bibr" rid="B54">Risi and Palmisano, 2019</xref>).</p>
<p>
<xref ref-type="bibr" rid="B60">Van Benthem et al. (2021)</xref> identified a few studies demonstrating that CS was milder in MR than in VR during a review of CS in MR HMDs. However, a limited number of studies have reported specifically on CS in MR HMDs, and even fewer studies have focused on CS resulting from MR HMDs. The report by Van Benthem et al. concluded that studies using MR HMDs generally indicated less severe CS than studies employing VR HMDs.</p>
</sec>
<sec id="s1-5">
<title>1.5 Present study</title>
<p>We have identified a gap in the literature wherein the severity of CS in MR HMDs has not been directly investigated. Additionally, the relative difference in CS severity caused by VR HMDs and MR HMDs has not been directly investigated. To fill this research gap, we conducted an experiment using MR and VR HMDs to investigate how graphic quantity in these HMDs impact CS. Graphic element quantity was modulated in this experiment to determine its effect on CS. We evaluated CS in three conditions: two conditions employed an MR HMD, and one condition employed a VR HMD. In 1&#xa0;MR condition, only foreground objects were graphically rendered. This was called the &#x2018;MR&#x2019; condition and presented limited graphic elements. In the second&#xa0;MR condition, foreground and background objects were graphically rendered. This was the &#x2018;MR&#x2b;&#x2019; condition and was entirely graphically generated. The &#x2018;MR&#x2b;&#x2019; condition therefore simulates VR. In a third condition, a VR HMD was used to present graphic objects approximating the MR &#x2b; condition. This was called the &#x2018;VR&#x2019; condition.</p>
</sec>
<sec id="s1-6">
<title>1.6 Hypotheses</title>
<p>Our first hypothesis was that graphic quantity would directly impact CS severity, consistent with RFH. Therefore, we hypothesized that the MR condition would produce the lowest CS scores, while the MR&#x2b; and VR condition would produce higher CS scores. Our second hypothesis was that increased exposure times in the experiment would result in increased CS scores across all three conditions as many previous studies have found (<xref ref-type="bibr" rid="B17">Hemmerich et al., 2020</xref>; <xref ref-type="bibr" rid="B20">Jasper et al., 2020</xref>; <xref ref-type="bibr" rid="B45">Palmisano et al., 2020</xref>; <xref ref-type="bibr" rid="B34">Lawson et al., 2021</xref>; <xref ref-type="bibr" rid="B48">Porcino et al., 2021</xref>). Our third hypothesis was that individuals reporting severe motion sickness in the past would report more CS in the present study compared to participants that reported negligible motion sickness in the past. Some researchers have found a significant correlation between history of motion sickness and present CS (<xref ref-type="bibr" rid="B4">Beadle et al., 2021</xref>; <xref ref-type="bibr" rid="B15">Golding et al., 2021</xref>). We therefore hypothesized that participants with high motion sickness susceptibility questionnaire (MSSQ) scores would have high SSQ scores in the current experiment.</p>
</sec>
</sec>
<sec sec-type="materials|methods" id="s2">
<title>2 Materials and methods</title>
<sec id="s2-1">
<title>2.1 Participants</title>
<p>Participants were healthy Canadian Armed Forces (CAF) members. Forty-one adults (M<sub>age</sub> &#x3d; 28, SD<sub>age</sub> &#x3d; 9) participated in the study. Three participants were female. Participants wore their spectacles while wearing the MR or VR HMD. Participants were recruited from the 32 Brigade and Canadian Forces Environmental Medicine Establishment. All participants were briefed on the experiment and provided informed written consent to participate in the experiment. Participants were informed that they were free to withdraw from the study at any point during experimentation. Individuals were excluded from participating if they reported uncorrected vision, visual deficits, balance/vestibular disorders and neurological conditions assessed with a self-reporting questionnaire. Remuneration was provided to all participants. Three participants in the experiment were naval personnel. All participants completed the study.</p>
</sec>
<sec id="s2-2">
<title>2.2 Materials</title>
<p>An in-house application was developed in Unity (version 2019.2), a cross-platform game engine, created by Unity Technologies. The application generates visual stimuli for conditions of the experiment through custom scripts written in C&#x23;.</p>
<p>The Microsoft HoloLens 2&#xa0;MR HMD displayed visual stimuli in the MR and MR &#x2b; conditions. The HoloLens two can render graphics overlaid onto the physical environment and allows for viewing of virtual objects in 3D. This HMD has a native 1,440 &#xd7; 936-pixel resolution per eye, 60&#xa0;Hz refresh rate, and 43 horizontal by 29 vertical field of view (FOV), providing a 52 diagonal FOV per eye.</p>
<p>The Oculus Rift S VR HMD displayed visual stimuli in the VR condition. The Oculus Rift S completely occludes the physical environment to present an entirely graphically rendered scene to the user. This HMD has a native 1,280 &#xd7; 1440-pixel resolution per eye, 80&#xa0;Hz refresh rate, and a 102 diagonal FOV per eye.</p>
</sec>
<sec id="s2-3">
<title>2.3 Stimuli and conditions</title>
<p>A virtual office space was generated in Unity to match the physical dimensions of the experimental room: 2.72 &#xd7; 6.62 &#xd7; 2.57&#xa0;m. Furniture such as a computer desk, a chair, shelves and portraits populated the virtual space. <xref ref-type="fig" rid="F1">Figure 1</xref> displays approximations of the stimuli used for all three conditions. The &#x2018;MR&#x2019; condition displayed graphically generated foreground objects, such as furniture and portraits. Background objects such as the walls and ceiling were not represented graphically in the &#x2018;MR&#x2019; condition. The &#x2018;MR&#x2b;&#x2019; condition displayed all objects in the MR condition as well as graphically rendered walls. The contents of the &#x2018;MR&#x2b;&#x2019; condition and the &#x2018;VR&#x2019; condition were identical but presented in an MR HMD and a VR HMD, respectively. Participants were randomly assigned to one of the three conditions. FOV in all conditions across both HMDs was set to 43&#xb0; horizontally by 29&#xb0; vertically. Average framerate over the course of a 5-min block was calculated for each condition. The Hololens two rendered at approximately 60 frames per second (fps) in the MR and MR &#x2b; condition and the Oculus Rift S rendered at approximately 80 fps in the VR condition.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Simplified approximations of the MR condition (left), and the MR &#x2b; and VR conditions (right).</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g001.tif"/>
</fig>
</sec>
<sec id="s2-4">
<title>2.4 Design</title>
<p>This experiment had a mixed factors design. The between-subjects factor was visual condition with three levels: VR, MR and MR&#x2b;. The within-subjects factor was time, with six-levels: time 1&#x2013;6. Each within-subjects level represents a 5-min increase in exposure time for a maximum of 25-min. Time one represents the baseline assessment, prior to exposure, while time six represents the final assessment after the last exposure. The primary dependent variable was CS severity, indexed with the SSQ (<xref ref-type="bibr" rid="B26">Kennedy et al., 1993</xref>).</p>
</sec>
<sec id="s2-5">
<title>2.5 Measures</title>
<sec id="s2-5-1">
<title>2.5.1 Visual assessment tests</title>
<p>The Random Dot Stereo Acuity Test (Stereo Optical Company Inc, Stereo Acuity Test Version 2012) was used to assess stereoacuity in all participants. IPD was also measured using the Reichert PDM Digital PD Meter prior to experimentation (Model &#x23;15020).</p>
</sec>
<sec id="s2-5-2">
<title>2.5.2 Demographic questionnaire</title>
<p>The demographic questionnaire recorded each participant&#x2019;s sex, age, experience aboard Navy vessels, video game and simulator experience, recent use of any substance that can impact nausea (e.g., anti-nauseogenics, medications, alcohol, and recreational drugs), history of neurological and vestibular disorders as well as any visual impairments.</p>
</sec>
<sec id="s2-5-3">
<title>2.5.3 Motion sickness susceptibility questionnaire</title>
<p>The short form of the MSSQ (<xref ref-type="bibr" rid="B13">Golding, 2006</xref>) was used to measure participant susceptibility to MS. The MSSQ was administered prior to experimentation to capture previous experiences with MS when using different modes of transportation (e.g., car, roller coaster) both as a child and as an adult. Participants rated each transportation item on a scale of zero <italic>(never got sick</italic>) to three (<italic>often got motion sick</italic>) on the MSSQ.</p>
</sec>
<sec id="s2-5-4">
<title>2.5.4 Simulator sickness questionnaire</title>
<p>The SSQ (<xref ref-type="bibr" rid="B26">Kennedy et al., 1993</xref>) contains 16 symptoms (e.g., nausea, fatigue, discomfort). The intensity of each symptom is rated on a four-point Likert scale (<italic>not at all</italic> &#x3d; 0, <italic>mild</italic> &#x3d; 1, <italic>moderate</italic> &#x3d; 2, and <italic>severe</italic> &#x3d; 3). The SSQ is comprised of three subscales to measure the three most common symptoms of motion sickness: Nausea N), Oculomotor Discomfort O), and Disorientation D). The <italic>TS</italic> is computed as the weighted average of the sum of these three subscale scores, multiplied by a constant value (see <xref ref-type="bibr" rid="B26">Kennedy et al. (1993)</xref>; <xref ref-type="bibr" rid="B40">Merchant and Kirollos (2022)</xref> for details on the SSQ).</p>
</sec>
</sec>
<sec id="s2-6">
<title>2.6 Procedure</title>
<p>Upon arrival at the lab, participants first provided informed consent. Participants completed the demographic questionnaire, the MSSQ and the baseline SSQ. Experimenters measured participant IPD and stereoacuity. Participants were then set-up in either the HoloLens two if assigned the &#x2018;MR&#x2019; or &#x2018;MR&#x2b;&#x2019; conditions, or the Rift S if assigned the &#x2018;VR&#x2019; condition. The experimenter confirmed the correct fit and placement of either device on the participant&#x2019;s head, followed by a calibration of IPD. The lights of the experimental room were dimmed to approximately 2.5 Lux for the duration of the experiment (Extech Instruments Light Meter, LT300).</p>
<p>After configuration and calibration of either the HoloLens two or the Rift S, a 30-s practice session took place to familiarize participants with the required task. The first of five, 5-min blocks then began. In all conditions, participants viewed a virtual representation of the office room depicted in <xref ref-type="fig" rid="F1">Figure 1</xref>. They were required to make yaw-axis head movements to the left-and-right every 3s while seated. The sound of a metronome generated by the HMD every 3s cued participants to make the angular yaw-axis movements with their heads, from shoulder-to-shoulder repeatedly as shown in <xref ref-type="fig" rid="F2">Figure 2</xref>. Participants were instructed to look at the virtual objects within the scene that were aligned with their head orientation throughout the task. This task was chosen as it closely replicates the visual scanning and head movements pattern that would be required by users in the RCN.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Depiction of the experimental task. Participants were seated while observing the visual stimuli within the HMD and turning their head left-to-right at the 3-s constant interval of an auditory cue.</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g002.tif"/>
</fig>
<p>The SSQ was administered <italic>via</italic> paper and pen at the end of each block during a 1-min break. Overall, six SSQ questionnaires were administered to each participant. The experimental procedure is outlined in <xref ref-type="fig" rid="F3">Figure 3</xref>.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Summary of experimental procedure.</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g003.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3 Results</title>
<sec id="s3-1">
<title>3.1 Data analysis</title>
<p>Kruskal&#x2013;Wallis tests exploring the effect of condition (MR, MR&#x2b;, and VR) were performed on SSQ TS scores. Post-hoc analyses were performed using the Dunn&#x2019;s test with a Bonferroni correction for multiple comparisons to determine significance between condition groups. Effect sizes for each comparison were measured using Epsilon squared (&#x2107;<sup>2</sup>) (<xref ref-type="bibr" rid="B58">Tomczak and Tomczak, 2014</xref>).</p>
<p>Friedman tests exploring the impact of exposure duration on SSQ TS scores were also performed. Post-hoc analyses were performed using the Wilcoxon Signed Rank Test with a Bonferroni correction to determine significance between time points. Effect sizes for each comparison were measured using Kendall&#x2019;s W W) (<xref ref-type="bibr" rid="B49">Rea and Parker, 2014</xref>). The relationships between motion sickness susceptibility, stereoacuity, IPD and cybersickness were evaluated using Spearman&#x2019;s and Pearson correlations where appropriate.</p>
</sec>
<sec id="s3-2">
<title>3.2 Between-subjects analyses on SSQ TS scores</title>
<p>A Kruskal&#x2013;Wallis test was performed to compare SSQ TS scores across all three conditions within a respective block from times 2&#x2013;6, totaling five Kruskal&#x2013;Wallis tests. For instance, one Kruskal&#x2013;Wallis test compared MR (time &#x23;2), MR&#x2b; (time &#x23;2), and VR (time &#x23;2) to determine if there was any significant difference between TS scores of each condition in the second block of the experiment. Data for these analyses are displayed in <xref ref-type="fig" rid="F4">Figure 4</xref>.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Mean TS scores across all participants from baseline (Time &#x23;1) to experiment completion (Time &#x23;6). Error bars represent standard error rates.</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g004.tif"/>
</fig>
<p>Findings indicated a significant difference in TS scores for time &#x23;5: H 2) &#x3d; 7.135, <italic>p</italic> &#x3d; 0.028, &#x2107;<sup>2</sup> &#x3d; 0.178. This demonstrates a strong effect size according to <xref ref-type="bibr" rid="B49">Rea &#x26; Parker (2014)</xref>. A Dunn&#x2019;s <italic>post hoc</italic> comparison was carried out for the three pairs of groups (MR&#x2013;MR&#x2b;, MR&#x2b;&#x2014;VR&#x2b;, VR&#x2013;MR) for time &#x23;5. There was a significant difference (<italic>p</italic> &#x3c; 0.05, adjusted for Bonferroni correction) between the MR and MR &#x2b; groups at time &#x23;5. The remaining two comparisons were not significant (<italic>p</italic> &#x3e; 0.05).</p>
</sec>
<sec id="s3-3">
<title>3.3 Within-subjects analyses on SSQ TS scores</title>
<p>To assess the impact of exposure duration on SSQ TS scores, a within-subject analysis was conducted to analyze the difference in SSQ scores within each respective condition. Three Friedman&#x2019;s tests were conducted on the MR, MR&#x2b; and VR data separately.</p>
<p>Findings indicated a significant difference in TS scores across times one to six in the MR condition W) X<sup>2</sup> (14) &#x3d; 14.730, <italic>p</italic> &#x3c; 0.05, W &#x3d; 0.210. According to <xref ref-type="bibr" rid="B49">Rea &#x26; Parker (2014)</xref>, this represents a fair effect size. A <italic>post hoc</italic> Wilcoxon Signed Rank Test with a Bonferroni correction was used to compare scores from all six time-points. As such, 15 pairwise comparisons were conducted. After employing the Bonferroni correction (<italic>adjusted p-value cut-off</italic> &#x3d; 0.05/15 &#x3d; 0.0033), results suggested no significant differences between SSQ TS scores within the MR condition.</p>
<p>The Friedman test comparing times one to six in the MR &#x2b; condition also indicated a significant difference W), X<sup>2</sup> (13) &#x3d; 32.487, <italic>p</italic> &#x3c; 0.001, W &#x3d; 0.500. According to <xref ref-type="bibr" rid="B49">Rea and Parker (2014)</xref>, this result represents a strong effect size. A <italic>post hoc</italic> Wilcoxon Signed Rank Test with a Bonferroni correction was used to compare TS scores from all six time-points in the MR &#x2b; condition. After employing a Bonferroni correction (<italic>adjusted p-value cut off</italic> &#x3d; 0.05/15 &#x3d; 0.0033), results suggested a significant difference in TS scores between time &#x23;1 and time &#x23;5 (<italic>p</italic> &#x3d; 0.002). There were no significant differences between SSQ TS scores in the VR condition.</p>
</sec>
<sec id="s3-4">
<title>3.4 SSQ subscales: N, O and D scores</title>
<p>Across the MR, MR&#x2b; and VR conditions, the SSQ scores were separated into their respective subscales of Nausea N), Oculomotor Discomfort O), and Disorientation D). SSQ score for each subscale, across all three conditions is displayed in <xref ref-type="fig" rid="F5">Figure 5</xref>; <xref ref-type="fig" rid="F6">Figure 6</xref>; <xref ref-type="fig" rid="F7">Figure 7</xref>, respectively. This analysis was done in order to 1) determine any difference in symptom profile within a respective condition, and 2) determine any difference in symptom profile across the three conditions.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Mean Nausea subscale scores for all participants from baseline (Time &#x23;1) to experiment completion (Time &#x23;6). Error bars represent standard error rates.</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g005.tif"/>
</fig>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Mean Oculomotor Discomfort subscale scores for all participants from baseline (Time &#x23;1) to experiment completion (Time &#x23;6). Error bars represent standard error rates.</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g006.tif"/>
</fig>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Mean Disorientation subscale scores for all participants from baseline (Time &#x23;1) to experiment completion (Time &#x23;6). Error bars represent standard error rates.</p>
</caption>
<graphic xlink:href="frvir-04-1130864-g007.tif"/>
</fig>
<p>Friedman tests were conducted to compare the average N, O and D subscale scores for each participant across all six SSQs in each condition separately. None of the comparisons were significant (MR: X (14) &#x3d; 2.579, <italic>p</italic> &#x3d; 0.275; MR&#x2b;: X (13) &#x3d; 5.692, <italic>p</italic> &#x3d; 0.058; VR: X (14) &#x3d; 0.760, <italic>p</italic> &#x3d; 0.684). Kruskal&#x2013;Wallis tests were then conducted to compare the average N, O and D subscale scores across the three conditions. There were no significant differences in the average subscale score across the different conditions (N: H 2) &#x3d; 1.496, <italic>p</italic> &#x3d; 0.473; O: H 2) &#x3d; 3.499, <italic>p</italic> &#x3d; 0.174; D: H 2) &#x3d; 0.168, <italic>p</italic> &#x3d; 0.919).</p>
</sec>
<sec id="s3-5">
<title>3.5 Correlation between MSSQ and SSQ scores</title>
<p>A Spearman correlation was performed to determine if there was a relationship between history of motion sickness (total MSSQ) and CS in the current experiment (mean SSQ TS scores). For all conditions, there were no significant interactions between MSSQ, and average TS scores (<italic>p</italic> &#x3e; 0.05). Each condition was examined separately (MR: <italic>&#x3c1;</italic> (14) &#x3d; 0.084, <italic>p</italic> &#x3d; 0.776; MR&#x2b;: <italic>&#x3c1;</italic> (13) &#x3d; 0.065, <italic>p</italic> &#x3d; 0.832; VR: <italic>&#x3c1;</italic> (14) &#x3d; 0.048, <italic>p</italic> &#x3d; 0.869).</p>
</sec>
<sec id="s3-6">
<title>3.6 Effect of stereoacuity on SSQ scores</title>
<p>Stereoacuity measures were categorized into &#x2018;good&#x2019; stereoacuity (&#x2264; 25 arc sec (&#x201c;)) (<italic>M</italic> &#x3d; 12.5, <italic>SD</italic> &#x3d; 13.7, <italic>n</italic> &#x3d; 20) vs. &#x2018;bad&#x2019; stereoacuity (&#x3e;25 arc sec (&#x201c;)) (<italic>M</italic> &#x3d; 8.9, <italic>SD</italic> &#x3d; 9.9, <italic>n</italic> &#x3d; 21) approximating categorizations by <xref ref-type="bibr" rid="B10">Deepa et al. (2019)</xref>. A Kruskal&#x2013;Wallis test comparing <italic>TS</italic> for these two groups found no significant difference, H 1) &#x3d; .443, <italic>p</italic> &#x3d; .506. Further to this, a Spearman correlation test comparing stereoacuity (<italic>M</italic> &#x3d; 120.9&#x2033;, <italic>SD</italic> &#x3d; 216.8&#x2033;) and mean <italic>TS</italic> scores (<italic>M</italic> &#x3d; 10.9, <italic>SD</italic> &#x3d; 11.9) yielded no significant difference, <italic>&#x3c1;</italic> (41) &#x3d; .049, <italic>p</italic> &#x3d; .759. We investigated the relationship between participant IPD (M &#x3d; 63.7 mm, SD &#x3d; 3.5&#xa0;mm) and stereo acuity (M &#x3d; 120.9&#x2033;, SD &#x3d; 216.8&#x201d;) with a Pearson correlation. There was no significant relationship between the two measures, r (41) &#x3d; .019, <italic>p</italic> &#x3d; .907.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4 Discussion</title>
<p>A literature review investigating AR and MR human factors and safety considerations by <xref ref-type="bibr" rid="B60">Van Benthem et al. (2021)</xref> indicated that the impact of MR HMD use on CS had not been directly examined. The limited research on this topic suggested that MR HMDs generally produce minimal CS. Based on that report, there has not been a thorough analysis thus far on CS with MR HMDs. Here we have directly examined the impact of MR HMD use on CS and further expanded findings by Van Benthem and others indicating that MR HMDs can produce CS when the visual display is saturated with 3D graphics.</p>
<sec id="s4-1">
<title>4.1 Impact of extended reality condition on cybersickness (hypothesis 1)</title>
<p>The primary objective of this experiment was to determine the impact of MR HMDs on CS. We did so by varying the quantity of graphically rendered objects in an MR HMD and comparing findings to CS in VR HMDs. A mixed design was used whereby participants completed one of the three conditions to prevent potential adaptation effects when exposed to a similar display and protocol across multiple sessions (<xref ref-type="bibr" rid="B19">Howarth and Hodder, 2008</xref>; <xref ref-type="bibr" rid="B4">Beadle et al., 2021</xref>). We found significant differences in TS scores between time &#x23;5 in the MR condition and time &#x23;5 in the MR &#x2b; condition with a relatively strong effect size. MR &#x2b; TS scores were higher than MR TS scores in all blocks (<xref ref-type="fig" rid="F4">Figure 4</xref>). Results comparing SSQ TS scores in the MR vs MR &#x2b; conditions are partially consistent with our hypothesis that MR &#x2b; scores would be greater than MR scores. These results indicate that generating 3D graphic scenes that occupy the entire visual scene in MR HMDs produce greater CS than when there are limited graphics presented. Based on these findings, the amount of graphically rendered elements in MR HMDs should be limited to mitigate CS.</p>
<p>We hypothesized that TS scores would increase as a function of quantity of graphically rendered elements within the participant&#x2019;s FOV. In other words, we predicted the MR&#x2b; and VR conditions to have the highest TS scores, followed by the MR condition. However, we only found partial evidence supporting this hypothesis as the MR &#x2b; condition showed higher scores than the MR and the VR conditions. Though every attempt was made at keeping the VR and MR &#x2b; condition identical, including controlling FOV, recruiting participants from the same pool, consistent task, stimuli, procedures and measures, checking that motion-to-photon lag was negligible and that framerates were consistent and similar throughout the experiment and across conditions - the HMDs are different and thus may have resulted in some unforeseen variability. For instance, framerates for the Hololens two were consistent across the MR and MR &#x2b; condition at approximately 60 fps. However, framerates for the Oculus Rift S in the VR condition was approximately 80 fps, likely contributing to the associated lower TS scores relative to the MR &#x2b; condition (<xref ref-type="bibr" rid="B21">Jennings et al., 2004</xref>).</p>
<p>According to <xref ref-type="bibr" rid="B25">Kennedy et al. (2003)</xref>, a TS score greater than 20 on the SSQ is indicative of a &#x2018;problem simulator&#x2019; and should be avoided. TS scores of 15&#x2013;20 suggest that symptoms are concerning, scores of 10&#x2013;15 are significant symptoms while anything below that is considered to be of negligible concern (<xref ref-type="bibr" rid="B25">Kennedy et al., 2003</xref>). This criterion is especially relevant in assessing the military population wherein warfighters dependant on MR HMDs must perform duties while cybersick. Our results in the MR &#x2b; condition indicate that peak mean TS scores exceeded 20 after the fifth experimental block (<xref ref-type="fig" rid="F3">Figure 3</xref>). In contrast, at time &#x23;6, the TS mean score for the MR condition was below 11.5. Based on these findings, we conclude that MR HMDs are safe for use if there are only limited graphics displayed.</p>
</sec>
<sec id="s4-2">
<title>4.2 Impact of exposure time on cybersickness (hypothesis 2)</title>
<p>The second objective of this experiment was to determine the impact of duration on CS during MR HMD use. Findings from the MR &#x2b; condition indicated that SSQ TS scores increased significantly over exposure time, with TS scores exceeding 20. This supports the notion that saturating the MR HMD with graphics can produce severe CS over time. Results in the MR condition with limited graphics were significant, though Bonferroni correction in the <italic>post hoc</italic> analyses could not reveal the specific comparison(s). Critically, CS scores remained low according to criteria in <xref ref-type="bibr" rid="B24">Kennedy et al. (2010)</xref>, and the MR condition did not produce severe CS over prolonged use. Many studies have reported on the use of VR HMDs and have indicated that CS severity increases as a function of time, consistent with our findings in the MR &#x2b; condition (<xref ref-type="bibr" rid="B17">Hemmerich et al., 2020</xref>; <xref ref-type="bibr" rid="B20">Jasper et al., 2020</xref>; <xref ref-type="bibr" rid="B45">Palmisano et al., 2020</xref>; <xref ref-type="bibr" rid="B34">Lawson et al., 2021</xref>; <xref ref-type="bibr" rid="B48">Porcino et al., 2021</xref>) but not consistent with our findings in the VR condition. Most of these studies report peak CS within 10&#x2013;15&#xa0;min of exposure. In the current study however, participants used the MR HMD for a total of 25&#xa0;min and results indicated that CS increased significantly and meaningfully over the 25-min session in the MR &#x2b; condition. Based on these findings, we recommend use of MR HMDs with limited graphic elements for up to 25&#xa0;min, and further anticipate longer durations of use to be acceptable.</p>
</sec>
<sec id="s4-3">
<title>4.3 Impact of past sickness on cybersickness (hypothesis 3)</title>
<p>Recently, <xref ref-type="bibr" rid="B4">Beadle et al. (2021)</xref> and <xref ref-type="bibr" rid="B15">Golding et al. (2021)</xref> found significant positive correlations between MSSQ scores and SSQ TS scores. These findings make sense as they suggest that participants with a history of MS were most likely to feel sick using VR HMDs. Thus, we performed a correlational analysis on MSSQ data and SSQ TS data to replicate these findings but did not find a significant correlation between the two measures. Our findings indicate no evidence for a relationship between past MS and present CS with MR or VR HMDs.</p>
</sec>
<sec id="s4-4">
<title>4.4 Discussion of SSQ subscales, stereoacuity, VAM and IPD</title>
<p>
<xref ref-type="bibr" rid="B57">Stanney et al. (2003)</xref> compared SSQ subscale scores in simulators and VR HMDs. They found that VR HMDs produced greater scores on the D subscale than the N and O subscales. They also found that participants in simulators had greater O subscale scores than N and D subscale scores. We compared SSQ subscales N, O and D to determine if MR HMDs provide a distinct symptom profile in contrast to our VR condition, and to compare with Stanney et al.&#x2018;s findings. Although the MR &#x2b; condition had greater scores for each subscale on average, these differences were not significant. This allows us to conclude that the use of MR HMDs does not produce a distinct CS symptom profile from VR HMDs.</p>
<p>
<xref ref-type="bibr" rid="B2">Arcioni et al. (2018)</xref> findings suggest that stereoacuity does not appear to influence CS. We categorized participants into two groups: &#x2018;good&#x2019; (less than 25&#x2033;) and &#x2018;bad&#x2019; (greater than 25&#x201d;) stereoacuity (approximating <xref ref-type="bibr" rid="B10">Deepa et al. (2019)</xref> stereoacuity categorization) to explore the impact of stereoacuity on CS. SSQ TS scores were compared for both groups but did not produce a significant relationship. Our findings therefore support those by Arcioni et al. that stereoacuity does not appear to influence CS.</p>
<p>
<xref ref-type="bibr" rid="B38">Luu et al. (2021)</xref> indicated that participant with stereopsis experience more severe CS than participants without stereopsis (consistent with <xref ref-type="bibr" rid="B46">Palmisano et al. (2019)</xref>). This may initially appear to contrast our current findings in which &#x2018;good&#x2019; and &#x2018;bad&#x2019; stereoacuity did not affect CS. However, some important differences exist between the current study and <xref ref-type="bibr" rid="B38">Luu et al. (2021)</xref>. First, stereopsis which was investigated in <xref ref-type="bibr" rid="B38">Luu et al. (2021)</xref> is the ability to perceive in depth. This differs from stereoacuity, which is a measure of how <italic>well</italic> one can perceive in depth. Second, <xref ref-type="bibr" rid="B38">Luu et al. (2021)</xref> showed a correlation between vection and indexed sickness. Therefore, it is not clear, if vection resulted in CS, which has been sometimes linked to CS, or if stereopsis solely contributed to increased sickness. Third, the authors do not mention if an adjustment to the FOV in their monocular vs stereopsis condition was made, as larger FOVs typically produce more severe CS than smaller FOVs (<xref ref-type="bibr" rid="B37">Lin et al., 2002</xref>). Fourth, Luu et al. used a VR HMD in their respective study, in contrast to the current study where both VR and MR HMDs were used, creating a challenge in comparing results. A final difference between our study and Luu et al. is that Luu et al. employed the FMS to index CS, whereas the current study used the SSQ.</p>
<p>
<xref ref-type="bibr" rid="B18">Hoffman et al. (2008)</xref> developed a scale to assess fatigue from VAM. Some of the questions on this scale deal directly with ocular fatigue and headache, thereby overlapping with questions in the SSQ. However, Hoffman et al. do not report directly on CS or any form of MS. We have not come across any research that directly investigated the relationship between any form of MS and VAM. This is likely because VAM is difficult to isolate and measure since it requires continuous altering of the headset&#x2019;s focal distance, which is unsuitable with commercial off-the-shelf HMDs. In the current experiment, VAM was not isolated as it was not our primary research interest. However, it is plausible that the MR&#x2b; and VR conditions that have more virtually rendered elements, and therefore more depth cues create more conflict (i.e., VAM) and greater sickness than the MR condition. Based on our findings and the current literature, the relationship between VAM, stereoacuity and CS is unclear.</p>
<p>We were also interested in determining any correlation between IPD and stereoacuity. Some research has shown a relationship between IPD and stereoacuity where greater IPDs are associate with better stereoacuity (<xref ref-type="bibr" rid="B3">Aslankurt et al., 2013</xref>; <xref ref-type="bibr" rid="B11">Eom et al., 2013</xref>). This makes sense, as a greater separation between the two eyes should yield stronger disparity between the left and right retinal image, and thus, greater depth perception. However, one study demonstrated that smaller IPD results in better stereoacuity (<xref ref-type="bibr" rid="B55">Shafiee et al., 2014</xref>) and two studies demonstrated that IPD had no impact on stereoacuity (<xref ref-type="bibr" rid="B39">Mai and Schlueter, 2010</xref>; <xref ref-type="bibr" rid="B2">Arcioni et al., 2018</xref>). In the current study, there was no significant relationship between IPD and stereoacuity, consistent with findings by <xref ref-type="bibr" rid="B2">Arcioni et al. (2018)</xref> and <xref ref-type="bibr" rid="B39">Mai and Schlueter (2010)</xref> although we acknowledge that stereoacuity measures in our study were large and variable. These findings taken together led us to conclude that the relationship between IPD, stereoacuity and CS is unclear.</p>
</sec>
</sec>
<sec sec-type="conclusion" id="s5">
<title>5 Conclusion</title>
<p>The objective of the current study was to understand the characteristics of CS in MR HMDs. We modulated the quantity of graphically rendered elements in the Microsoft HoloLens two and Oculus Rift S while indexing sickness six times throughout exposure. Results showed that the addition of graphic elements in an MR HMD significantly and meaningfully increased CS over time compared to low-graphic MR HMD condition and a VR HMD condition. Overall exposure time was also a contributing factor to increased sickness. These results demonstrate that limiting graphics in an MR HMD can allow for safe use over periods of 25&#xa0;min or greater for shore-based applications by the RCN. A future planned experiment will test the MR condition at sea to determine whether MR HMDs can be safely used aboard Navy vessels.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s6">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s7">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Human Research Ethics Board&#x2014;DRDC. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="s8">
<title>Author contributions</title>
<p>RK contributed to the conception and design of the experiment, data collection, writing of the original and revised version of the manuscript, and formatting of the manuscript. WM contributed to data collection, data analysis, revision, editing and formatting of the manuscript.</p>
</sec>
<sec id="s9">
<title>Funding</title>
<p>Funding was provided internally by DRDC Toronto.</p>
</sec>
<ack>
<p>The authors would like to thank Chris Apostoli for developing the experimental conditions, Elaine Maceda and Captain Igor Da Silva for their assistance with participant recruitment, the participants from 32 Brigade and Canadian Forces Environmental Medicine Establishment for their time in completing this experiment and Tania Randall for her scientific input and guidance throughout this experiment.</p>
</ack>
<sec sec-type="COI-statement" id="s10">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s11">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Allison</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Harris</surname>
<given-names>L. R.</given-names>
</name>
<name>
<surname>Jenkin</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Jasiobedzka</surname>
<given-names>U.</given-names>
</name>
<name>
<surname>Zacher</surname>
<given-names>J. E.</given-names>
</name>
</person-group> (<year>2001</year>). &#x201c;<article-title>Tolerance of temporal delay in virtual environments</article-title>,&#x201d; in <conf-name>Proceedings IEEE Virtual Reality 2001</conf-name>, <conf-loc>Yokohama, Japan</conf-loc>, <conf-date>13-17 March 2001</conf-date>.</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Arcioni</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Palmisano</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Apthorp</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Postural stability predicts the likelihood of cybersickness in active HMD-based virtual reality</article-title>. <source>Displays</source> <volume>58</volume>, <fpage>3</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2018.07.001</pub-id>
</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Aslankurt</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Aslan</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Aksoy</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>&#xd6;zdemir</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Dane</surname>
<given-names>&#x15e;.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Laterality does not affect the depth perception, but interpupillary distance</article-title>. <source>J. Ophthalmol.</source> <volume>2013</volume>, <fpage>1</fpage>&#x2013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1155/2013/485059</pub-id>
</citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Beadle</surname>
<given-names>S. C.</given-names>
</name>
<name>
<surname>Muth</surname>
<given-names>E. R.</given-names>
</name>
<name>
<surname>Pagano</surname>
<given-names>C. C.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Using head-mounted displays to examine adaptation and calibration under varying perturbations</article-title>. <source>Displays</source> <volume>66</volume>, <fpage>101985</fpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2020.101985</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Bimberg</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Weissker</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kulik</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>On the usage of the simulator sickness questionnaire for virtual reality research</article-title>,&#x201d; in <conf-name>2020 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW)</conf-name>, <conf-loc>Atlanta, GA, USA</conf-loc>, <conf-date>22-26 March 2020</conf-date> (<publisher-name>IEEE</publisher-name>), <fpage>464</fpage>&#x2013;<lpage>467</lpage>.</citation>
</ref>
<ref id="B6">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bos</surname>
<given-names>J. E.</given-names>
</name>
<name>
<surname>Lawson</surname>
<given-names>B. D.</given-names>
</name>
<name>
<surname>Allsop</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Rigato</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Secci</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2021</year>). &#x201c;<article-title>Introduction. Guidelines for mitigating cybersickness in virtual reality systems</article-title>,&#x201d; in <source>Peer-reviewed final report of the human factors and medicine panel/modeling and simulations group</source>. <comment>Activity Number 323, NATO STO-TR-HFM-MSG-323</comment>.</citation>
</ref>
<ref id="B7">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bos</surname>
<given-names>J. E.</given-names>
</name>
<name>
<surname>Lawson</surname>
<given-names>B. D.</given-names>
</name>
</person-group> (<year>2021</year>). &#x201c;<article-title>Chapter 4: Symptoms and measurement. Guidelines for mitigating cybersickness in virtual reality systems</article-title>,&#x201d; in <source>Peer-reviewed final report of the human factors and medicine panel/modeling and simulations group</source>. <comment>Activity Number 323, NATO STO-TR-HFM-MSG-323</comment>.</citation>
</ref>
<ref id="B8">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Cao</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Jerald</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kopper</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>Visually-induced motion sickness reduction via static and dynamic rest frames</article-title>,&#x201d; in <conf-name>2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)</conf-name>, <conf-loc>Tuebingen/Reutlingen, Germany</conf-loc>, <conf-date>18-22 March 2018</conf-date> (<publisher-name>IEEE</publisher-name>), <fpage>105</fpage>&#x2013;<lpage>112</lpage>.</citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Casali</surname>
<given-names>J. G.</given-names>
</name>
<name>
<surname>Frank</surname>
<given-names>L. H.</given-names>
</name>
</person-group> (<year>1986</year>). <article-title>Perceptual distortion and its consequences in vehicular simulation: Basic theory and incidence of simulator sickness</article-title>. <source>Transp. Res. Rec.</source> <volume>1059</volume>, <fpage>57</fpage>&#x2013;<lpage>65</lpage>.</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Deepa</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Valarmathi</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Benita</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Assessment of stereo acuity levels using random dot stereo acuity chart in college students</article-title>. <source>J. Fam. Med. Prim. care</source> <volume>8</volume>, <fpage>3850</fpage>. <pub-id pub-id-type="doi">10.4103/jfmpc.jfmpc_755_19</pub-id>
</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Eom</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Song</surname>
<given-names>J.-S.</given-names>
</name>
<name>
<surname>Ahn</surname>
<given-names>S.-E.</given-names>
</name>
<name>
<surname>Kang</surname>
<given-names>S.-Y.</given-names>
</name>
<name>
<surname>Suh</surname>
<given-names>Y.-W.</given-names>
</name>
<name>
<surname>Oh</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2013</year>). <article-title>Effects of interpupillary distance on stereoacuity: The frisby davis distance stereotest versus a 3-dimensional distance stereotest</article-title>. <source>Jpn. J. Ophthalmol.</source> <volume>57</volume>, <fpage>486</fpage>&#x2013;<lpage>492</lpage>. <pub-id pub-id-type="doi">10.1007/s10384-013-0253-9</pub-id>
</citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gallagher</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Ferr&#xe8;</surname>
<given-names>E. R.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Cybersickness: A multisensory integration perspective</article-title>. <source>Multisensory Res.</source> <volume>31</volume>, <fpage>645</fpage>&#x2013;<lpage>674</lpage>. <pub-id pub-id-type="doi">10.1163/22134808-20181293</pub-id>
</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Golding</surname>
<given-names>J. F.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Motion sickness susceptibility</article-title>. <source>Aut. Neurosci.</source> <volume>129</volume>, <fpage>67</fpage>&#x2013;<lpage>76</lpage>. <pub-id pub-id-type="doi">10.1016/j.autneu.2006.07.019</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Golding</surname>
<given-names>J. F.</given-names>
</name>
</person-group> (<year>1998</year>). <article-title>Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness</article-title>. <source>Brain Res. Bull.</source> <volume>47</volume>, <fpage>507</fpage>&#x2013;<lpage>516</lpage>. <pub-id pub-id-type="doi">10.1016/s0361-9230(98)00091-4</pub-id>
</citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Golding</surname>
<given-names>J. F.</given-names>
</name>
<name>
<surname>Rafiq</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Keshavarz</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Predicting individual susceptibility to visually induced motion sickness by questionnaire</article-title>. <source>Front. Virtual Real.</source> <volume>2</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2021.576871</pub-id>
</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>He</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Sui</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Jin</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Cao</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Progress in virtual reality and augmented reality based on holographic display</article-title>. <source>Appl. Opt.</source> <volume>58</volume>, <fpage>A74</fpage>&#x2013;<lpage>A81</lpage>. <pub-id pub-id-type="doi">10.1364/ao.58.000a74</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hemmerich</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Keshavarz</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Hecht</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Visually induced motion sickness on the horizon</article-title>. <source>Front. Virtual Real.</source> <volume>1</volume>, <fpage>30</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2020.582095</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hoffman</surname>
<given-names>D. M.</given-names>
</name>
<name>
<surname>Girshick</surname>
<given-names>A. R.</given-names>
</name>
<name>
<surname>Akeley</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Banks</surname>
<given-names>M. S.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Vergence&#x2013;accommodation conflicts hinder visual performance and cause visual fatigue</article-title>. <source>J. Vis.</source> <volume>8</volume> (<issue>3</issue>), <fpage>33</fpage>&#x2013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.1167/8.3.33</pub-id>
</citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Howarth</surname>
<given-names>P. A.</given-names>
</name>
<name>
<surname>Hodder</surname>
<given-names>S. G.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Characteristics of habituation to motion in a virtual environment</article-title>. <source>Displays</source> <volume>29</volume>, <fpage>117</fpage>&#x2013;<lpage>123</lpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2007.09.009</pub-id>
</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jasper</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Cone</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Meusel</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Curtis</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Dorneich</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Gilbert</surname>
<given-names>S. B.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Visually induced motion sickness susceptibility and recovery based on four mitigation techniques</article-title>. <source>Front. Virtual Real.</source> <volume>1</volume>, <fpage>22</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2020.582108</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jennings</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Reid</surname>
<given-names>L. D.</given-names>
</name>
<name>
<surname>Craig</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Kruk</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Time delays in visually coupled systems during flight test and simulation</article-title>. <source>J. Aircr.</source> <volume>41</volume>, <fpage>1327</fpage>&#x2013;<lpage>1335</lpage>. <pub-id pub-id-type="doi">10.2514/1.449</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kemeny</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Chardonnet</surname>
<given-names>J.-R.</given-names>
</name>
<name>
<surname>Colombet</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2020</year>). <source>Getting rid of cybersickness</source>. <publisher-loc>Switzerland</publisher-loc>: <publisher-name>Springer Nature</publisher-name>.</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kemeny</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>George</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>M&#xe9;rienne</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Colombet</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>New vr navigation techniques to reduce cybersickness</article-title>. <source>Electron. Imaging</source> <volume>29</volume>, <fpage>48</fpage>&#x2013;<lpage>53</lpage>. <pub-id pub-id-type="doi">10.2352/issn.2470-1173.2017.3.ervr-097</pub-id>
</citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kennedy</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Drexler</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>R. C.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Research in visually induced motion sickness</article-title>. <source>Appl. Ergon.</source> <volume>41</volume>, <fpage>494</fpage>&#x2013;<lpage>503</lpage>. <pub-id pub-id-type="doi">10.1016/j.apergo.2009.11.006</pub-id>
</citation>
</ref>
<ref id="B25">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kennedy</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Drexler</surname>
<given-names>J. M.</given-names>
</name>
<name>
<surname>Compton</surname>
<given-names>D. E.</given-names>
</name>
<name>
<surname>Stanney</surname>
<given-names>K. M.</given-names>
</name>
<name>
<surname>Lanham</surname>
<given-names>D. S.</given-names>
</name>
<name>
<surname>Harm</surname>
<given-names>D. L.</given-names>
</name>
</person-group> (<year>2003</year>). &#x201c;<article-title>Configural scoring of simulator SicknessCybersickness and space adaptation syndrome: Similarities and differences</article-title>,&#x201d; in <source>Virtual and adaptive environments: Applications, implications, and human performance issues</source>, <fpage>247</fpage>.</citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kennedy</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Lane</surname>
<given-names>N. E.</given-names>
</name>
<name>
<surname>Berbaum</surname>
<given-names>K. S.</given-names>
</name>
<name>
<surname>Lilienthal</surname>
<given-names>M. G.</given-names>
</name>
</person-group> (<year>1993</year>). <article-title>Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness</article-title>. <source>Int. J. Aviat. Psychol.</source> <volume>3</volume>, <fpage>203</fpage>&#x2013;<lpage>220</lpage>. <pub-id pub-id-type="doi">10.1207/s15327108ijap0303_3</pub-id>
</citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Keshavarz</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Hecht</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Axis rotation and visually induced motion sickness: The role of combined roll, pitch, and yaw motion</article-title>. <source>Aviat. space, Environ. Med.</source> <volume>82</volume>, <fpage>1023</fpage>&#x2013;<lpage>1029</lpage>. <pub-id pub-id-type="doi">10.3357/asem.3078.2011</pub-id>
</citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kim</surname>
<given-names>H. K.</given-names>
</name>
<name>
<surname>Park</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Choi</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Choe</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment</article-title>. <source>Appl. Ergon.</source> <volume>69</volume>, <fpage>66</fpage>&#x2013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1016/j.apergo.2017.12.016</pub-id>
</citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Luu</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Palmisano</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Multisensory integration and the experience of scene instability, presence and cybersickness in virtual environments</article-title>. <source>Comput. Hum. Behav.</source> <volume>113</volume>, <fpage>106484</fpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2020.106484</pub-id>
</citation>
</ref>
<ref id="B30">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Kirollos</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Harriott</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2021</year>). &#x201c;<article-title>Virtual reality to mixed reality graphic conversion in unity</article-title>,&#x201d; in <conf-name>International Conference on Human-Computer Interaction</conf-name>, <conf-loc>Springer, Cham</conf-loc>, <conf-date>06 November 2021</conf-date>. <comment>Springer</comment>.</citation>
</ref>
<ref id="B31">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kirollos</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Jarmasz</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <source>Safety considerations for the land vehicle crew training system (LVCTS): An analysis of the literature</source>. <publisher-loc>Ottawa, Canada</publisher-loc>: <publisher-name>Defence Research and Development Canada</publisher-name>. <comment>DEFENCE, D. O. N. (ed.)</comment>.</citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kuiper</surname>
<given-names>O. X.</given-names>
</name>
<name>
<surname>Bos</surname>
<given-names>J. E.</given-names>
</name>
<name>
<surname>Diels</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Vection does not necessitate visually induced motion sickness</article-title>. <source>Displays</source> <volume>58</volume>, <fpage>82</fpage>&#x2013;<lpage>87</lpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2018.10.001</pub-id>
</citation>
</ref>
<ref id="B33">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Langbehn</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Raupp</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Bruder</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Steinicke</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Bolte</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Lappe</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>Visual blur in immersive virtual environments: Does depth of field or motion blur affect distance and speed estimation?</article-title>,&#x201d; in <conf-name>Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology</conf-name>, <conf-loc>Munich, Germany</conf-loc>, <conf-date>November 2 - 4, 2016</conf-date> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>241</fpage>&#x2013;<lpage>250</lpage>.</citation>
</ref>
<ref id="B34">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Lawson</surname>
<given-names>B. D.</given-names>
</name>
<name>
<surname>Proietti</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Burov</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Sj&#xf6;lund</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Rodabaugh</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kirollos</surname>
<given-names>R.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). &#x201c;<article-title>Factors impacting cybersickness. Guidelines for mitigating, cybersickness in virtual reality systems</article-title>,&#x201d; in <source>Peer-reviewed final report of the human factors and medicine panel/modeling and simulations group</source>. <comment>Activity Number 323, NATO STO-TR-HFM-MSG-323</comment>.</citation>
</ref>
<ref id="B35">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Lawson</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2005</year>). &#x201c;<article-title>Exploiting the illusion of self-motion (vection) to achieve a feeling of &#x2018;virtual acceleration&#x2019;in an immersive display</article-title>,&#x201d; in <conf-name>Proceedings of the 11th international conference on human&#x2013;computer interaction</conf-name>, <fpage>1</fpage>&#x2013;<lpage>10</lpage>.</citation>
</ref>
<ref id="B36">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Lawson</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2014</year>). &#x201c;<article-title>Motion sickness symptomatology and origins</article-title>,&#x201d; in <source>Handbook of virtual, environment: Design, implementation, and applications</source>. <edition>2 ed.</edition> (<publisher-loc>Boca Raton, FL</publisher-loc>: <publisher-name>CRC Press</publisher-name>).</citation>
</ref>
<ref id="B37">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Lin</surname>
<given-names>J.-W.</given-names>
</name>
<name>
<surname>Duh</surname>
<given-names>H. B.-L.</given-names>
</name>
<name>
<surname>Parker</surname>
<given-names>D. E.</given-names>
</name>
<name>
<surname>Abi-Rached</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Furness</surname>
<given-names>T. A.</given-names>
</name>
</person-group> (<year>2002</year>). &#x201c;<article-title>Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment</article-title>,&#x201d; in <conf-name>Proceedings of the IEEE Virtual Reality 2002</conf-name>, <conf-loc>Orlando, FL, USA</conf-loc>, <conf-date>24-28 March 2002</conf-date>. <comment>IEEE</comment>.</citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Luu</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Zangerl</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Kalloniatis</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Effects of stereopsis on vection, presence and cybersickness in head-mounted display (HMD) virtual reality</article-title>. <source>Sci. Rep.</source> <volume>11</volume>, <fpage>1</fpage>&#x2013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.1038/s41598-021-89751-x</pub-id>
</citation>
</ref>
<ref id="B39">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mai</surname>
<given-names>M. N.</given-names>
</name>
<name>
<surname>Schlueter</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>The relationship between pupillary distance and depth perception in humans</article-title>. <source>Investigative Ophthalmol. Vis. Sci.</source> <volume>51</volume>, <fpage>4359</fpage>.</citation>
</ref>
<ref id="B40">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Merchant</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Kirollos</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2022</year>). in <source>An overview of cybersickness self report measures for use in DRDC experiments</source>. Editor <person-group person-group-type="editor">
<name>
<surname>DEFENCE</surname>
<given-names>D. O. N.</given-names>
</name>
</person-group> (<publisher-loc>Toronto, ON</publisher-loc>: <publisher-name>DRDC</publisher-name>).</citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Milgram</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Kishino</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>1994</year>). <article-title>A taxonomy of mixed reality visual displays</article-title>. <source>IEICE Trans. Inf. Syst.</source> <volume>77</volume>, <fpage>1321</fpage>&#x2013;<lpage>1329</lpage>.</citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mittelstaedt</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Wacker</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Stelling</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Effects of display type and motion control on cybersickness in a virtual bike simulator</article-title>. <source>Displays</source> <volume>51</volume>, <fpage>43</fpage>&#x2013;<lpage>50</lpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2018.01.002</pub-id>
</citation>
</ref>
<ref id="B43">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Moro</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>&#x160;tromberga</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Raikos</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Stirling</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>The effectiveness of virtual and augmented reality in health sciences and medical anatomy</article-title>. <source>Anat. Sci. Educ.</source> <volume>10</volume>, <fpage>549</fpage>&#x2013;<lpage>559</lpage>. <pub-id pub-id-type="doi">10.1002/ase.1696</pub-id>
</citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Moss</surname>
<given-names>J. D.</given-names>
</name>
<name>
<surname>Austin</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Salley</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Coats</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Williams</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Muth</surname>
<given-names>E. R.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>The effects of display delay on simulator sickness</article-title>. <source>Displays</source> <volume>32</volume>, <fpage>159</fpage>&#x2013;<lpage>168</lpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2011.05.010</pub-id>
</citation>
</ref>
<ref id="B45">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Palmisano</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Allison</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Cybersickness in head-mounted displays is caused by differences in the user&#x27;s virtual and physical head pose</article-title>. <source>Front. Virtual Real.</source> <volume>1</volume>, <fpage>24</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2020.587698</pub-id>
</citation>
</ref>
<ref id="B46">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Palmisano</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Szalla</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2019</year>). <source>Monocular viewing protects against cybersickness produced by head movements in the Oculus Rift. 25th ACM symposium on virtual reality software and technology</source>. <publisher-loc>New York, United States</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>, <fpage>81</fpage>.</citation>
</ref>
<ref id="B47">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Parker</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Prothero</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2003</year>). <source>A unified approach to presence and motion sickness. <italic>Virtual and adaptive environments</italic>
</source>. <publisher-loc>Mahwah, New Jersey</publisher-loc>: <publisher-name>CRC Press</publisher-name>.</citation>
</ref>
<ref id="B48">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Porcino</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Trevisan</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Clua</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>A cybersickness review: Causes, strategies, and classification methods</article-title>. <source>J. Interact. Syst.</source> <volume>12</volume>, <fpage>269</fpage>&#x2013;<lpage>282</lpage>. <pub-id pub-id-type="doi">10.5753/jis.2021.2058</pub-id>
</citation>
</ref>
<ref id="B49">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rea</surname>
<given-names>L. M.</given-names>
</name>
<name>
<surname>Parker</surname>
<given-names>R. A.</given-names>
</name>
</person-group> (<year>2014</year>). <source>Designing and conducting survey research: A comprehensive guide</source>. <publisher-name>John Wiley and Sons</publisher-name>.</citation>
</ref>
<ref id="B50">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Reason</surname>
<given-names>J. T.</given-names>
</name>
</person-group> (<year>1978</year>). <article-title>Motion sickness adaptation: A neural mismatch model</article-title>. <source>J. R. Soc. Med.</source> <volume>71</volume>, <fpage>819</fpage>&#x2013;<lpage>829</lpage>. <pub-id pub-id-type="doi">10.1177/014107687807101109</pub-id>
</citation>
</ref>
<ref id="B51">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rebenitsch</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Owen</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Estimating cybersickness from virtual reality applications</article-title>. <source>Virtual Real.</source> <volume>25</volume>, <fpage>165</fpage>&#x2013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-020-00446-6</pub-id>
</citation>
</ref>
<ref id="B52">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rebenitsch</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Owen</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Review on cybersickness in applications and visual displays</article-title>. <source>Virtual Real.</source> <volume>20</volume>, <fpage>101</fpage>&#x2013;<lpage>125</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-016-0285-9</pub-id>
</citation>
</ref>
<ref id="B53">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Riccio</surname>
<given-names>G. E.</given-names>
</name>
<name>
<surname>Stoffregen</surname>
<given-names>T. A.</given-names>
</name>
</person-group> (<year>1991</year>). <article-title>An ecological theory of motion sickness and postural instability</article-title>. <source>Ecol. Psychol.</source> <volume>3</volume>, <fpage>195</fpage>&#x2013;<lpage>240</lpage>. <pub-id pub-id-type="doi">10.1207/s15326969eco0303_2</pub-id>
</citation>
</ref>
<ref id="B54">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Risi</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Palmisano</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Effects of postural stability, active control, exposure duration and repeated exposures on HMD induced cybersickness</article-title>. <source>Displays</source> <volume>60</volume>, <fpage>9</fpage>&#x2013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1016/j.displa.2019.08.003</pub-id>
</citation>
</ref>
<ref id="B55">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shafiee</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Jafari</surname>
<given-names>A. R.</given-names>
</name>
<name>
<surname>Shafiee</surname>
<given-names>A. A.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Correlation between interpupillary distance and stereo acuity</article-title>. <source>Bull. Environ. Pharmacol. Life Sci.</source> <volume>3</volume>, <fpage>26</fpage>&#x2013;<lpage>33</lpage>.</citation>
</ref>
<ref id="B56">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stanney</surname>
<given-names>K. M.</given-names>
</name>
<name>
<surname>Fidopiastis</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Foster</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Virtual reality is sexist: But it does not have to be</article-title>. <source>Front. Robotics AI</source> <volume>7</volume>, <fpage>4</fpage>. <pub-id pub-id-type="doi">10.3389/frobt.2020.00004</pub-id>
</citation>
</ref>
<ref id="B57">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stanney</surname>
<given-names>K. M.</given-names>
</name>
<name>
<surname>Hale</surname>
<given-names>K. S.</given-names>
</name>
<name>
<surname>Nahmens</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>R. S.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>What to expect from immersive virtual environment exposure: Influences of gender, body mass index, and past experience</article-title>. <source>Hum. factors</source> <volume>45</volume>, <fpage>504</fpage>&#x2013;<lpage>520</lpage>. <pub-id pub-id-type="doi">10.1518/hfes.45.3.504.27254</pub-id>
</citation>
</ref>
<ref id="B58">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tomczak</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Tomczak</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>The need to report effect size estimates revisited. An overview of some recommended measures of effect size</article-title>. <source>Trends sport Sci.</source> <volume>1</volume>, <fpage>19</fpage>&#x2013;<lpage>25</lpage>.</citation>
</ref>
<ref id="B59">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Treisman</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>1977</year>). <article-title>Motion sickness: An evolutionary hypothesis</article-title>. <source>Science</source> <volume>197</volume>, <fpage>493</fpage>&#x2013;<lpage>495</lpage>. <pub-id pub-id-type="doi">10.1126/science.301659</pub-id>
</citation>
</ref>
<ref id="B60">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Van Benthem</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Cobert</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Zoberich</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2021</year>). in <source>Human factors and ergonomics considerations when using augmented reality head mounted displays &#x2013; literature analysis report</source>. Editor <person-group person-group-type="editor">
<name>
<surname>DEFENCE</surname>
<given-names>D. O. N.</given-names>
</name>
</person-group> (<publisher-loc>Ontario, Canada</publisher-loc>: <publisher-name>Calian</publisher-name>).</citation>
</ref>
<ref id="B61">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Weech</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Kenny</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Barnett-Cowan</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Presence and cybersickness in virtual reality are negatively related: A review</article-title>. <source>Front. Psychol.</source> <volume>10</volume>, <fpage>158</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2019.00158</pub-id>
</citation>
</ref>
<ref id="B62">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Whittinghill</surname>
<given-names>D. M.</given-names>
</name>
<name>
<surname>Ziegler</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Case</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Moore</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2015</year>). <source>Nasum virtualis: A simple technique for reducing simulator sickness</source>. <publisher-loc>San Francisco, California</publisher-loc>: <publisher-name>Games Developers Conference</publisher-name>.</citation>
</ref>
<ref id="B63">
<citation citation-type="web">
<collab>XR Collaboration</collab> (<year>2021</year>). <article-title>XR glossary. XR ignite Inc</article-title>. <comment>Available: <ext-link ext-link-type="uri" xlink:href="https://xrcollaboration.com/guide/a-global-resource-guide-to-xr-collaboration/xr-glossary/">https://xrcollaboration.com/guide/a-global-resource-guide-to-xr-collaboration/xr-glossary/</ext-link>(Accessed June 03, 2021)</comment>.</citation>
</ref>
<ref id="B64">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yildirim</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Don&#x2019;t make me sick: Investigating the incidence of cybersickness in commercial virtual reality headsets</article-title>. <source>Virtual Real.</source> <volume>24</volume>, <fpage>231</fpage>&#x2013;<lpage>239</lpage>. <pub-id pub-id-type="doi">10.1007/s10055-019-00401-0</pub-id>
</citation>
</ref>
<ref id="B65">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Zhao</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Allison</surname>
<given-names>R. S.</given-names>
</name>
<name>
<surname>Vinnikov</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Jennings</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Estimating the motion-to-photon latency in head mounted displays</article-title>,&#x201d; in <conf-name>2017 IEEE Virtual Reality (VR)</conf-name>, <conf-loc>Los Angeles, CA, USA</conf-loc>, <conf-date>18-22 March 2017</conf-date>, <fpage>313</fpage>&#x2013;<lpage>314</lpage>. <comment>IEEE</comment>.</citation>
</ref>
</ref-list>
</back>
</article>