<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="brief-report">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Hum. Neurosci.</journal-id>
<journal-title>Frontiers in Human Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Hum. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5161</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnhum.2022.859519</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Brief Research Report</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Influence of the Modulation Index on Frequency-Modulated Steady-State Visual Evoked Potentials</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Dreyer</surname> <given-names>Alexander M.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/388324/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Heikkinen</surname> <given-names>Benjamin L. A.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1685581/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Herrmann</surname> <given-names>Christoph S.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/494/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Applied Neurocognitive Psychology Lab, Department of Psychology, European Medical School, Carl von Ossietzky University</institution>, <addr-line>Oldenburg</addr-line>, <country>Germany</country></aff>
<aff id="aff2"><sup>2</sup><institution>Experimental Psychology Lab, Department of Psychology, European Medical School, Cluster for Excellence &#x201C;Hearing for All&#x201D;, Carl von Ossietzky University</institution>, <addr-line>Oldenburg</addr-line>, <country>Germany</country></aff>
<aff id="aff3"><sup>3</sup><institution>Neuroimaging Unit, European Medical School, Carl von Ossietzky University</institution>, <addr-line>Oldenburg</addr-line>, <country>Germany</country></aff>
<aff id="aff4"><sup>4</sup><institution>Research Center Neurosensory Science, Carl von Ossietzky University</institution>, <addr-line>Oldenburg</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Bradley Jay Edelman, Max Planck Institute of Neurobiology (MPIN), Germany</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Chengcheng Han, Xi&#x2019;an Jiaotong University, China; Ulla Martens, Osnabr&#x00FC;ck University, Germany</p></fn>
<corresp id="c001">&#x002A;Correspondence: Christoph S. Herrmann, <email>christoph.herrmann@uni-oldenburg.de</email></corresp>
<fn fn-type="other" id="fn004"><p>This article was submitted to Brain-Computer Interfaces, a section of the journal Frontiers in Human Neuroscience</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>10</day>
<month>03</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>16</volume>
<elocation-id>859519</elocation-id>
<history>
<date date-type="received">
<day>21</day>
<month>01</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>18</day>
<month>02</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2022 Dreyer, Heikkinen and Herrmann.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Dreyer, Heikkinen and Herrmann</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Based on increased user experience during stimulation, frequency-modulated steady-state visual evoked potentials (FM-SSVEPs) have been suggested as an improved stimulation method for brain-computer interfaces. Adapting such a novel stimulation paradigm requires in-depth analyses of all different stimulation parameters and their influence on brain responses as well as the user experience during the stimulation. In the current manuscript, we assess the influence of different values for the modulation index, which determine the spectral distribution in the stimulation signal on FM-SSVEPs. We visually stimulated 14 participants at different target frequencies with four different values for the modulation index. Our results reveal that changing the modulation index in a way that elevates the stimulation power in the targeted sideband leads to increased FM-SSVEP responses. There is, however, a tradeoff with user experience as increased modulation indices also lead to increased perceived flicker intensity as well as decreased stimulation comfort in our participants. Our results can guide the choice of parameters in future FM-SSVEP implementations.</p>
</abstract>
<kwd-group>
<kwd>steady-state visual evoked potentials (SSVEP)</kwd>
<kwd>brain-computer interface (BCI)</kwd>
<kwd>electroencephalography (EEG)</kwd>
<kwd>frequency modulation</kwd>
<kwd>user experience</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="1"/>
<equation-count count="1"/>
<ref-count count="22"/>
<page-count count="6"/>
<word-count count="3817"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="intro">
<title>Introduction</title>
<p>Rhythmic light stimulation with a constant frequency elicits steady-state visual evoked potentials (SSVEPS) measurable with electroencephalography (EEG) over the occipital cortex (<xref ref-type="bibr" rid="B20">Silberstein, 1995</xref>; <xref ref-type="bibr" rid="B17">Notbohm et al., 2016</xref>). Frequency-modulated (FM)-SSVEPs have been introduced as a novel stimulation method for brain-computer interfaces (<xref ref-type="bibr" rid="B6">Dreyer and Herrmann, 2015</xref>) which uses a sinusoidal carrier modulated by a second frequency as stimulation signals to evoked SSVEP responses at the difference between carrier and modulation frequency. Traditionally used SSVEPs can be evoked in a wide range of frequencies (<xref ref-type="bibr" rid="B8">Herrmann, 2001</xref>) and different stimulation parameters have been investigated in depth (<xref ref-type="bibr" rid="B15">Ng et al., 2012</xref>; <xref ref-type="bibr" rid="B10">Ku&#x015B; et al., 2013</xref>; <xref ref-type="bibr" rid="B16">Norcia et al., 2015</xref>) along with detailed investigations into brain-computer interface (BCI) applications (<xref ref-type="bibr" rid="B21">Vialatte et al., 2010</xref>) as well as their potential user base (<xref ref-type="bibr" rid="B1">Allison et al., 2010</xref>). In contrast, detailed comparisons for different stimulation parameters that are required for FM-SSVEP stimulation are missing. In prior research, FM-SSVEPs have been shown in a variety of frequencies with simultaneously flickering light sources (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>) as well as in different attention and perceptibility conditions (<xref ref-type="bibr" rid="B11">Lingelbach et al., 2021a</xref>). Other FM-SSVEP stimulation parameters have not been investigated in detail, especially the modulation index. <xref ref-type="bibr" rid="B6">Dreyer and Herrmann (2015)</xref> used a modulation index of 0.5 whereas more recent studies used a modulation index of 2.0 (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>; <xref ref-type="bibr" rid="B12">Lingelbach et al., 2021b</xref>). The intuitive reasoning behind this increase was that it elevates the signal power in the targeted frequency in the stimulation signal and should therefore equally increase the measured FM-SSVEP power in EEG electrodes over occipital cortex. While this sounds straight-forward, an empirical investigation of this effect is so far missing.</p>
<p>Additionally, an argument against the use of SSVEPs in general is how rhythmic light stimulation affects the potential users. Constant attention to flickering light sources results in user discomfort (<xref ref-type="bibr" rid="B18">Ortner et al., 2011</xref>) and increased fatigue levels (<xref ref-type="bibr" rid="B3">Cao et al., 2014</xref>). Such effects can be reduced with high frequency stimulation paradigms (<xref ref-type="bibr" rid="B19">Sakurada et al., 2015</xref>) but high frequency stimulation can in turn reduce BCI performance (<xref ref-type="bibr" rid="B22">Volosyak et al., 2011</xref>). Other methods like amplitude modulated signals (<xref ref-type="bibr" rid="B4">Chang et al., 2014</xref>) or specific low frequency signals (<xref ref-type="bibr" rid="B9">Jiang et al., 2022</xref>) have been reported to increase user experience as well. In addition, we have previously shown that FM stimulation signals with a high carrier frequency are less perceptible (<xref ref-type="bibr" rid="B6">Dreyer and Herrmann, 2015</xref>) and more comfortable (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>) than traditionally used stimulation signals. Similar to the FM-SSVEP power mentioned above, the effect of the modulation index on such subjective user experience factors has to the best of our knowledge not been empirically investigated.</p>
<p>In the current study, our goal was to investigate the effect of changing the modulation index on FM-SSVEP power to guide parameter decisions in future research. We tested four different modulation conditions in three different frequencies. Our results reveal that increasing the signal power in the target frequency through the modulation index does in fact lead to increased FM-SSVEP power in the EEG. In addition, we found a tradeoff between increased modulation index and user-comfort during the stimulation.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="S2.SS1">
<title>Participants</title>
<p>We recorded the EEG of 14 participants (11 female) with a mean age of 24.4 years, who were paid for participation. All participants had normal or corrected-to-normal vision. They reported not to have ever suffered from epilepsy and were informed about the risk of seizures in epileptics due to the visual stimulation. All participants gave their written informed consent and the overall study procedures was approved by the ethics committee of the University of Oldenburg.</p>
</sec>
<sec id="S2.SS2">
<title>Stimuli</title>
<p>We used a green LED with a diameter of 1 cm to visually stimulate the participants and evoked the FM-SSVEPs. The LED was placed about 50 cm in front of the participants&#x2019; eyes, consequentially covering around 1.15&#x00B0; of the visual field. It was placed on top of a black plastic frame against a black cloth screen. In order to drive the LED, we used a custom signal amplifier connected to a digital-to-analog converter (NI USB-6229 BNC, National Instruments, Austin, Texas, United States) with a 10 kHz sampling rate which was fed by a stimulation computer running MATLAB (The MathWorks Inc., Natick, MA, United States). To generate the driving signal we used the same formular used in previous FM-SSVEP publications (<xref ref-type="bibr" rid="B6">Dreyer and Herrmann, 2015</xref>):</p>
<disp-formula id="S2.Ex2">
<mml:math id="M1">
<mml:mrow>
<mml:mrow>
<mml:mi>signal</mml:mi>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mi>A</mml:mi>
<mml:mo>+</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2062;</mml:mo>
<mml:mpadded width="+3.3pt">
<mml:mi>V</mml:mi>
</mml:mpadded>
</mml:mrow>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mtext>sin</mml:mtext>
</mml:mrow>
<mml:mo>&#x2062;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mpadded width="+3.3pt">
<mml:mn>2</mml:mn>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mpadded width="+3.3pt">
<mml:mi mathvariant="normal">&#x03C0;</mml:mi>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mpadded width="+3.3pt">
<mml:mtext>Fc</mml:mtext>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mtext>t</mml:mtext>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mpadded width="+3.3pt">
<mml:mtext>M</mml:mtext>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mrow>
<mml:mi>sin</mml:mi>
<mml:mo>&#x2061;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mpadded width="+3.3pt">
<mml:mn>2</mml:mn>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mpadded width="+3.3pt">
<mml:mi mathvariant="normal">&#x03C0;</mml:mi>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mpadded width="+3.3pt">
<mml:mtext>Fm</mml:mtext>
</mml:mpadded>
<mml:mo rspace="5.8pt">&#x002A;</mml:mo>
<mml:mtext>t</mml:mtext>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:mrow>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
<p>Here, A is the DC bias (2.5 V), FV is the flicker voltage span (1.8 V), Fc is the carrier frequency (100 Hz), Fm is the modulation frequency (71, 74, 77 Hz), M is the modulation index (0.25, 0.5, 0.78, 1.14), and t is the time vector. Parenthesized values represent the values used for stimulation. Note that the difference between Fc and Fm is where the FM-SSVEPs signals are to be expected (23, 26, 29 Hz). The signal amplitude in these bands depends on the given modulation index. <xref ref-type="fig" rid="F1">Figure 1</xref> depicts exemplary stimulation signals with their respective frequency spectra. The modulation index values we chose were based on the signal amplitude in the target frequency, with the amplitude in the higher conditions (0.5, 0.78, 1.14) being multiples of the amplitude in the lowest conditions (0.25). For the exemplary stimulation signal presented in <xref ref-type="fig" rid="F1">Figure 1</xref>, the target amplitudes using the four modulation indices are 0.12, 0.24, 0.36, and 0.48 V.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Exemplary Stimulation Signals. Top row depicts frequency-modulated signals with a carrier frequency of 100 Hz and a modulation frequency of 71 Hz. Bottom row depicts the corresponding amplitude spectra. Each column depicts a signal with one of the four different modulation indices used. Note that target frequency amplitudes at 29 Hz increase with increasing modulation indices (from left to right: 0.12, 0.24, 0.36, 0.48).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnhum-16-859519-g001.tif"/>
</fig>
<p>All stimulation signals were tested and recorded with a photodiode to assure proper transfer of the signal generated in MALAB to the LED and that there was no clipping at the lower / upper boundaries of the brightness of the actual light output of the LED.</p>
</sec>
<sec id="S2.SS3">
<title>Data Acquisition and Experimental Procedure</title>
<p>The recordings took place in an electrically shielded, dimly lit recording chamber. We used a BrainAmp EEG amplifier and the software Brain Vision Recorder (Brain Products GmbH, Gilching, Germany) for EEG acquisition. The sampling rate was 1000 Hz. Thirty-two electrodes (10-10 system locations: FP1, FP2, F7, F3, Fz, F4, F8, FT9, FC5, FC1, FC2, FC6, FT10, T7, C3, Cz, C4, T8, CP5, CP1, CP2, CP6, POz, P7, P3, Pz, P4, P8, O1, O2, and Oz) attached to size-appropriate EEG caps, including one EOG electrode below the right eye were recorded. Additionally, one reference electrode was placed on the tip of the nose and FCz was used as ground.</p>
<p>The participants were instructed to focus their gaze and attention on the center of the LED during the whole stimulation period. The twelve stimulation conditions (3 frequencies &#x00D7; 4 modulation indices) were presented in a randomized order. Each individual condition lasted 110 s after which the participants gave oral feedback using a 5-point Likert-Scale on the perceived flicker intensity (1 &#x2013; no flicker to 5 &#x2013; strong flicker) and their comfort during the stimulation (1 &#x2013; very uncomfortable to 5 &#x2013; very comfortable) which was noted by the experimenter.</p>
</sec>
<sec id="S2.SS4">
<title>Data Analysis</title>
<p>The EEG data was analyzed using MATLAB and the EEGLAB toolbox (<xref ref-type="bibr" rid="B5">Delorme and Makeig, 2004</xref>). The data was re-referenced to a common-average reference. All further analysis were done on four occipital channels of interest (O1, O2, Oz, and POz) in which FM-SSVEP responses can be expected. Data in these channels was zero-phase bandpass filtered between 1 Hz and 200 Hz. In order to avoid influence of the start or end of the stimulation, the first and last 5 s of the data were discarded. The resulting 100 s of stimulation data were split into 1 s long epochs which were corrected by their respective means. For the average amplitude spectra (see <xref ref-type="fig" rid="F2">Figure 2A</xref>), we averaged the data over all participants, epochs and channels, respectively, for each stimulation condition, and then calculated the fast-Fourier transform of the resulting SSVEPs. Signal-to-noise ratios (SNRs) in the target frequencies were calculated by dividing the amplitudes in the target frequencies by the average amplitude of the two neighboring frequencies (<xref ref-type="bibr" rid="B2">Bach and Meigen, 1999</xref>). As our main effect of interest is the influence of the modulation index on the FM-SSVEPs, we then averaged the data over the three target frequencies for the statistical analyses.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p><bold>(A)</bold> Amplitude Spectra averaged over participants, channels and trials. Twelve individual lines depict stimulation conditions (frequency x modulation index). <bold>(B)</bold> Linear regression fit using modulation index (independent of frequency and subject) as predictor for the SSVEP-Amplitude [<italic>R</italic><sup>2</sup> = 0.2, <italic>F</italic>(1,166) = 42.55, <italic>p</italic> &#x003C; 0.001]. Crosses depict all individual values for subjects &#x00D7; frequencies.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnhum-16-859519-g002.tif"/>
</fig>
</sec>
</sec>
<sec id="S3" sec-type="results">
<title>Results</title>
<p>We were able to reliably evoked FM-SSVEPS in all three target frequencies with all four modulation indices (see <xref ref-type="fig" rid="F2">Figure 2A</xref>) as well as in their first harmonics. The respective amplitudes and SNRs increased with increasing modulation index. Individual subject data can be found in the <xref ref-type="supplementary-material" rid="DS1">Supplementary Materials Data Sheet 1</xref>. The SNRs in increasing modulation index order and averaged over frequencies were 4.25, 5.41, 7.08, and 10.6. For individual frequencies, the minimal SNR was 3.0 and the maximum SNR was 13.77. This means we were able to evoke statistically significant FM-SSVEPs at all frequency x modulation index combinations, as based on the SNR estimation approach we used (<xref ref-type="bibr" rid="B13">Meigen and Bach, 1999</xref>), SNR significance thresholds are 2.82 (<italic>p</italic> = 0.05) / 4.55 (<italic>p</italic> = 0.01). Analysis of variance with a single within-subject factor design with repeated measure revealed significant main effects of the modulation index levels on FM-SSVEP SNR [<italic>F</italic>(3,39) = 10.73, <italic>p</italic> &#x003C; 0.0001] as well as amplitude [<italic>F</italic>(3,39) = 18.68, <italic>p</italic> &#x003C; 0.0001]. Post-hoc pairwise <italic>t</italic>-tests with false-discovery rate (FDR) adjusted <italic>p</italic>-values revealed that amplitudes in all combinations significantly (<italic>p</italic> &#x003C; 0.01) differed from each other except for the difference between 0.5 and 0.78. All statistical comparisons can be found in the <xref ref-type="supplementary-material" rid="TS1">Supplementary Material Tables 1</xref>, <xref ref-type="supplementary-material" rid="TS2">2</xref>. Additionally, we used a simple linear regression to fit the relationship between our modulation index values and the SSVEP amplitudes combined over frequencies (see <xref ref-type="fig" rid="F2">Figure 2B</xref>) and found a significant relationship [<italic>R</italic><sup>2</sup> = 0.204, <italic>F</italic>(1,166) = 42.44, <italic>p</italic> &#x003C; 0.0001].</p>
<p>These findings empirically confirm the intuitive notion that increased power in the targeted frequency in a frequency-modulated stimulation signal results in increased FM-SSVEP responses.</p>
<sec id="S3.SS1">
<title>Flicker Intensity and User Comfort</title>
<p>Averaged user experience data can be found in <xref ref-type="table" rid="T1">Table 1</xref>. The perceived flicker intensity increased with increasing modulation indices while the perceived stimulation comfort decreased with increasing modulation indices.</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>User-experience data averaged over participants and frequencies.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Modulation index</td>
<td valign="top" align="center">Perceived flicker intensity (SD)</td>
<td valign="top" align="center">Perceived stimulation comfort (SD)</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">0.25</td>
<td valign="top" align="center">1.36 (0.36)</td>
<td valign="top" align="center">4.40 (0.49)</td>
</tr>
<tr>
<td valign="top" align="left">0.50</td>
<td valign="top" align="center">2.48 (0.69)</td>
<td valign="top" align="center">3.71 (0.58)</td>
</tr>
<tr>
<td valign="top" align="left">0.78</td>
<td valign="top" align="center">3.19 (0.79)</td>
<td valign="top" align="center">3.36 (0.58)</td>
</tr>
<tr>
<td valign="top" align="left">1.14</td>
<td valign="top" align="center">3.52 (0.50)</td>
<td valign="top" align="center">3.00 (0.64)</td>
</tr>
</tbody>
</table></table-wrap>
<p>We used single within-subject factor designs with repeated measures (14 subjects &#x00D7; 4 modulation indices) for flicker intensity and stimulation comfort, respectively. Analysis of variance revealed highly significant main effects of the modulation index levels on perceived flicker intensity [<italic>F</italic>(3,39) = 74.13, <italic>p</italic> &#x003C; 0.0001] as well as on stimulation comfort [<italic>F</italic>(3,39) = 22.46, <italic>p</italic> &#x003C; 0.0001]. Post-hoc pairwise <italic>t</italic>-tests with false-discovery rate (FDR) adjusted <italic>p</italic>-values revealed that all combinations significantly (<italic>p</italic> &#x003C; 0.05) differed from each other except for the comfort rating difference between 0.5 and 0.78. Combined with the FM-SSVEP results above, we found a tradeoff where increased modulation indices increase the signal SNR but in turn decrease user experience.</p>
</sec>
</sec>
<sec id="S4" sec-type="discussion">
<title>Discussion</title>
<p>Our goal in the current study was to assess the effect of different values for the modulation index on the FM-SSVEP response as well as the user experience during stimulation. We used four different values for the modulation index with increasing values leading to elevated sideband power in the target SSVEP frequencies. Our results reveal that these increases translate to stronger FM-SSVEP responses. These stronger responses go along with a rise in the perceived flicker intensity as well as a decrease in comfort during the stimulation.</p>
<p>We provide the missing empirical evidence for this intuitive notion that has already guided the choice of the modulation index in prior literature (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>). Regarding the FM-SSVEP response, it seems plausible to suggest the use of a modulation index which leads to a relatively large amplitude in the first FM sideband especially for BCI applications where a high performance is wanted. It has to be noted, however, that sideband amplitudes in FM signals do not constantly increase with increasing modulation indices, but actually decrease above a certain modulation index threshold (&#x2248; 2), as the power gets distributed to additional sidebands. Exact sideband amplitudes can be calculated using Bessel functions.</p>
<p>Overall, we found visible FM-SSVEP peaks with all modulation indices in all tested frequencies (23, 26, 29 Hz) with significant SNRs (<xref ref-type="bibr" rid="B13">Meigen and Bach, 1999</xref>) even though the FM-SSVEP amplitudes were rather small. Prior research has shown that FM-SSVEPs can be reliably classified even at relatively small amplitudes (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>). It has to be taken into account that our stimulus LED only covered a small part of the visual field. For actual BCI implementations, larger stimuli of at least 2&#x00B0; visual angle have been suggested (<xref ref-type="bibr" rid="B15">Ng et al., 2012</xref>). Additionally, we also found peaks at the first harmonics of the target frequencies which could be useful for classification approaches (<xref ref-type="bibr" rid="B14">M&#x00FC;ller-Putz et al., 2005</xref>).</p>
<p>Our results also show that increasing FM-SSVEP power <italic>via</italic> the modulation index comes with the tradeoff of increased flicker perceptibility and decreased comfort. Depending on the goal of the implementation and the target population, such factors have to be considered. It is quite intriguing to see that the least intrusive stimulation signal (modulation index = 0.25) already results in significant FM-SSVEPs. When user comfort is the highest priority, tweaking other stimulation parameters, stimulation size for example, might be preferable. Whether an increase in FM-SSVEP power <italic>via</italic> larger stimuli would lead to a similar tradeoff with user experience or not remains to be tested in future research, however.</p>
<p>The current manuscript complements a growing body of research on FM-SSVEPs for which we now have evidence that:</p>
<list list-type="simple">
<list-item>
<label>-</label>
<p>They reduce flicker perceptibility compared to traditional sinusoidal or rectangular stimulation while retaining SNRs in the target frequency (<xref ref-type="bibr" rid="B6">Dreyer and Herrmann, 2015</xref>).</p>
</list-item>
<list-item>
<label>-</label>
<p>They can be classified reliably at variable frequencies even with multiple, simultaneously flickering light sources (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>).</p>
</list-item>
<list-item>
<label>-</label>
<p>They are perceived as more comfortable than traditionally used sinusoidal stimuli (<xref ref-type="bibr" rid="B7">Dreyer et al., 2017</xref>).</p>
</list-item>
<list-item>
<label>-</label>
<p>They can be evoked reliably even with an intensity below the individual perceptibility threshold and in covert attention conditions without direct fixation of the flickering light source (<xref ref-type="bibr" rid="B11">Lingelbach et al., 2021a</xref>; <xref ref-type="bibr" rid="B12">Lingelbach et al., 2021b</xref>).</p>
</list-item>
<list-item>
<label>-</label>
<p>Their amplitude, their perceived flicker intensity, as well as the user comfort during the stimulation are affected by the modulation depths <italic>via</italic> the modulation index (current manuscript).</p>
</list-item>
</list>
<p>Together, these findings provide a foundation for future FM-SSVEP implementations into BCI applications as well as neurophysiological research approaches.</p>
</sec>
<sec id="S5" sec-type="data-availability">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="S6">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Research Ethics Committee, University of Oldenburg, Germany. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="S7">
<title>Author Contributions</title>
<p>AD: study design, manuscript preparation, and data analysis. BH: manuscript preparation, data acquisition, and analysis. CH: study design, manuscript preparation, and study supervision. All authors read and approved the final manuscript.</p>
</sec>
<sec id="conf1" sec-type="COI-statement">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="pudiscl1" sec-type="disclaimer">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec id="S8" sec-type="funding-information">
<title>Funding</title>
<p>AD was supported by the &#x201C;Forschungspool&#x201D; of the School of Medicine and Health Sciences, University of Oldenburg (Grant 2017-006). CH was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany&#x2019;s Excellence Strategy &#x2013; EXC 2177/1 - Project ID 390895286.</p>
</sec>
<sec id="S9" sec-type="supplementary-material">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fnhum.2022.859519/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fnhum.2022.859519/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.CSV" id="DS1" mimetype="text/csv" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_1.XLSX" id="TS1" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table_2.XLSX" id="TS2" mimetype="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Allison</surname> <given-names>B.</given-names></name> <name><surname>Luth</surname> <given-names>T.</given-names></name> <name><surname>Valbuena</surname> <given-names>D.</given-names></name> <name><surname>Teymourian</surname> <given-names>A.</given-names></name> <name><surname>Volosyak</surname> <given-names>I.</given-names></name> <name><surname>Graser</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>BCI demographics: how many (and what kinds of) people can use an SSVEP BCI?</article-title> <source><italic>IEEE Trans. Neural Syst. Rehabil. Eng.</italic></source> <volume>18</volume> <fpage>107</fpage>&#x2013;<lpage>116</lpage>. <pub-id pub-id-type="doi">10.1109/TNSRE.2009.2039495</pub-id> <pub-id pub-id-type="pmid">20083463</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bach</surname> <given-names>M.</given-names></name> <name><surname>Meigen</surname> <given-names>T.</given-names></name></person-group> (<year>1999</year>). <article-title>Do&#x2019;s and don&#x2019;ts in Fourier analysis of steady-state potentials.</article-title> <source><italic>Doc. Ophthalmol.</italic></source> <volume>99</volume> <fpage>69</fpage>&#x2013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1023/a:1002648202420</pub-id> <pub-id pub-id-type="pmid">10947010</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>T.</given-names></name> <name><surname>Wan</surname> <given-names>F.</given-names></name> <name><surname>Wong</surname> <given-names>C. M.</given-names></name> <name><surname>da Cruz</surname> <given-names>J. N.</given-names></name> <name><surname>Hu</surname> <given-names>Y.</given-names></name></person-group> (<year>2014</year>). <article-title>Objective evaluation of fatigue by EEG spectral analysis in steady-state visual evoked potential-based brain-computer interfaces.</article-title> <source><italic>Biomed. Eng. Online</italic></source> <volume>13</volume>:<issue>28</issue>. <pub-id pub-id-type="doi">10.1186/1475-925X-13-28</pub-id> <pub-id pub-id-type="pmid">24621009</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chang</surname> <given-names>M. H.</given-names></name> <name><surname>Baek</surname> <given-names>H. J.</given-names></name> <name><surname>Lee</surname> <given-names>S. M.</given-names></name> <name><surname>Park</surname> <given-names>K. S.</given-names></name></person-group> (<year>2014</year>). <article-title>An amplitude-modulated visual stimulation for reducing eye fatigue in SSVEP-based brain-computer interfaces.</article-title> <source><italic>Clin. Neurophysiol.</italic></source> <volume>125</volume> <fpage>1380</fpage>&#x2013;<lpage>1391</lpage>. <pub-id pub-id-type="doi">10.1016/j.clinph.2013.11.016</pub-id> <pub-id pub-id-type="pmid">24368034</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Delorme</surname> <given-names>A.</given-names></name> <name><surname>Makeig</surname> <given-names>S.</given-names></name></person-group> (<year>2004</year>). <article-title>EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>134</volume> <fpage>9</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2003.10.009</pub-id> <pub-id pub-id-type="pmid">15102499</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dreyer</surname> <given-names>A. M.</given-names></name> <name><surname>Herrmann</surname> <given-names>C. S.</given-names></name></person-group> (<year>2015</year>). <article-title>Frequency-modulated steady-state visual evoked potentials: a new stimulation method for brain-computer interfaces.</article-title> <source><italic>J. Neurosci. Methods</italic></source> <volume>241</volume> <fpage>1</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2014.12.004</pub-id> <pub-id pub-id-type="pmid">25522824</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dreyer</surname> <given-names>A. M.</given-names></name> <name><surname>Herrmann</surname> <given-names>C. S.</given-names></name> <name><surname>Rieger</surname> <given-names>J. W.</given-names></name></person-group> (<year>2017</year>). <article-title>Tradeoff between user experience and BCI classification accuracy with frequency modulated steady-state visual evoked potentials.</article-title> <source><italic>Front. Hum. Neurosci.</italic></source> <volume>11</volume>:<issue>391</issue>. <pub-id pub-id-type="doi">10.3389/fnhum.2017.00391</pub-id> <pub-id pub-id-type="pmid">28798676</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Herrmann</surname> <given-names>C. S.</given-names></name></person-group> (<year>2001</year>). <article-title>Human EEG responses to 1-100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena.</article-title> <source><italic>Exp. Brain Res.</italic></source> <volume>137</volume> <fpage>346</fpage>&#x2013;<lpage>353</lpage>. <pub-id pub-id-type="doi">10.1007/s002210100682</pub-id> <pub-id pub-id-type="pmid">11355381</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jiang</surname> <given-names>L.</given-names></name> <name><surname>Li</surname> <given-names>X.</given-names></name> <name><surname>Pei</surname> <given-names>W.</given-names></name> <name><surname>Gao</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name></person-group> (<year>2022</year>). <article-title>A hybrid brain-computer interface based on visual evoked potential and pupillary response.</article-title> <source><italic>Front. Hum. Neurosci.</italic></source> <volume>16</volume>:<issue>834959</issue>. <pub-id pub-id-type="doi">10.3389/fnhum.2022.834959</pub-id> <pub-id pub-id-type="pmid">35185500</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ku&#x015B;</surname> <given-names>R.</given-names></name> <name><surname>Duszyk</surname> <given-names>A.</given-names></name> <name><surname>Milanowski</surname> <given-names>P.</given-names></name> <name><surname>Lab&#x00EA;cki</surname> <given-names>M.</given-names></name> <name><surname>Bierzy&#x0144;ska</surname> <given-names>M.</given-names></name> <name><surname>Radzikowska</surname> <given-names>Z.</given-names></name><etal/></person-group> (<year>2013</year>). <article-title>On the quantification of SSVEP frequency responses in human EEG in realistic BCI conditions.</article-title> <source><italic>PLoS One</italic></source> <volume>8</volume>:<issue>e77536</issue>. <pub-id pub-id-type="doi">10.1371/journal.pone.0077536</pub-id> <pub-id pub-id-type="pmid">24204862</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lingelbach</surname> <given-names>K.</given-names></name> <name><surname>Dreyer</surname> <given-names>A. M.</given-names></name> <name><surname>Sch&#x00F6;llhorn</surname> <given-names>I.</given-names></name> <name><surname>Bui</surname> <given-names>M.</given-names></name> <name><surname>Weng</surname> <given-names>M.</given-names></name> <name><surname>Diederichs</surname> <given-names>F.</given-names></name><etal/></person-group> (<year>2021a</year>). <article-title>Brain oscillation entrainment by perceptible and non-perceptible rhythmic light stimulation.</article-title> <source><italic>Front. Neuroergon.</italic></source> <volume>2</volume>:<issue>646225</issue>. <pub-id pub-id-type="doi">10.3389/fnrgo.2021.646225</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lingelbach</surname> <given-names>K.</given-names></name> <name><surname>Sch&#x00F6;llhorn</surname> <given-names>I.</given-names></name> <name><surname>Dreyer</surname> <given-names>A. M.</given-names></name> <name><surname>Diederichs</surname> <given-names>F.</given-names></name> <name><surname>Bui</surname> <given-names>M.</given-names></name> <name><surname>Weng</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2021b</year>). <article-title>Investigating the modulation of spatio-temporal and oscillatory power dynamics by perceptible and non-perceptible rhythmic light stimulation.</article-title> <source><italic>Lect. Notes Netw. Syst.</italic></source> <volume>259</volume> <fpage>11</fpage>&#x2013;<lpage>19</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-80285-1_2</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meigen</surname> <given-names>T.</given-names></name> <name><surname>Bach</surname> <given-names>M.</given-names></name></person-group> (<year>1999</year>). <article-title>On the statistical significance of electrophysiological steady-state responses.</article-title> <source><italic>Doc. Ophthalmol.</italic></source> <volume>98</volume> <fpage>207</fpage>&#x2013;<lpage>232</lpage>. <pub-id pub-id-type="doi">10.1023/a:1002097208337</pub-id> <pub-id pub-id-type="pmid">10945442</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x00FC;ller-Putz</surname> <given-names>G. R.</given-names></name> <name><surname>Scherer</surname> <given-names>R.</given-names></name> <name><surname>Brauneis</surname> <given-names>C.</given-names></name> <name><surname>Pfurtscheller</surname> <given-names>G.</given-names></name></person-group> (<year>2005</year>). <article-title>Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components.</article-title> <source><italic>J. Neural Eng.</italic></source> <volume>2</volume> <fpage>123</fpage>&#x2013;<lpage>130</lpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/2/4/008</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ng</surname> <given-names>K. B.</given-names></name> <name><surname>Bradley</surname> <given-names>A. P.</given-names></name> <name><surname>Cunnington</surname> <given-names>R.</given-names></name></person-group> (<year>2012</year>). <article-title>Stimulus specificity of a steady-state visual-evoked potential-based brain-computer interface.</article-title> <source><italic>J. Neural Eng.</italic></source> <volume>9</volume>:<issue>036008</issue>. <pub-id pub-id-type="doi">10.1088/1741-2560/9/3/036008</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Norcia</surname> <given-names>A. M.</given-names></name> <name><surname>Gregory Appelbaum</surname> <given-names>L.</given-names></name> <name><surname>Ales</surname> <given-names>J. M.</given-names></name> <name><surname>Cottereau</surname> <given-names>B. R.</given-names></name> <name><surname>Rossion</surname> <given-names>B.</given-names></name></person-group> (<year>2015</year>). <article-title>The steady-state visual evoked potential in vision research: a review.</article-title> <source><italic>J. Vis.</italic></source> <volume>15</volume>:<issue>4</issue>. <pub-id pub-id-type="doi">10.1167/15.6.4</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Notbohm</surname> <given-names>A.</given-names></name> <name><surname>Kurths</surname> <given-names>J.</given-names></name> <name><surname>Herrmann</surname> <given-names>C. S.</given-names></name></person-group> (<year>2016</year>). <article-title>Modification of brain oscillations <italic>via</italic> rhythmic light stimulation provides evidence for entrainment but not for superposition of event-related responses.</article-title> <source><italic>Front. Hum. Neurosci.</italic></source> <volume>10</volume>:<issue>10</issue>. <pub-id pub-id-type="doi">10.3389/fnhum.2016.00010</pub-id> <pub-id pub-id-type="pmid">26869898</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ortner</surname> <given-names>R.</given-names></name> <name><surname>Allison</surname> <given-names>B. Z.</given-names></name> <name><surname>Korisek</surname> <given-names>G.</given-names></name> <name><surname>Gaggl</surname> <given-names>H.</given-names></name> <name><surname>Pfurtscheller</surname> <given-names>G.</given-names></name></person-group> (<year>2011</year>). <article-title>An SSVEP BCI to control a hand orthosis for persons with tetraplegia.</article-title> <source><italic>IEEE Trans. Neural Syst. Rehabil. Eng.</italic></source> <volume>19</volume> <fpage>1</fpage>&#x2013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1109/TNSRE.2010.2076364</pub-id> <pub-id pub-id-type="pmid">20875978</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sakurada</surname> <given-names>T.</given-names></name> <name><surname>Kawase</surname> <given-names>T.</given-names></name> <name><surname>Komatsu</surname> <given-names>T.</given-names></name> <name><surname>Kansaku</surname> <given-names>K.</given-names></name></person-group> (<year>2015</year>). <article-title>Use of high-frequency visual stimuli above the critical flicker frequency in a SSVEP-based BMI.</article-title> <source><italic>Clin. Neurophysiol.</italic></source> <volume>126</volume> <fpage>1972</fpage>&#x2013;<lpage>1978</lpage>. <pub-id pub-id-type="doi">10.1016/j.clinph.2014.12.010</pub-id> <pub-id pub-id-type="pmid">25577407</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Silberstein</surname> <given-names>R. B.</given-names></name></person-group> (<year>1995</year>). <article-title>&#x201C;Steady-state visually evoked potentials, brain resonances, and cognitive processes</article-title>,&#x201D; in <source><italic>Neocortical Dynamics and Human EEG Rhythms</italic></source>, <role>ed.</role> <person-group person-group-type="editor"><name><surname>Nunez</surname> <given-names>P. L.</given-names></name></person-group> (<publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>), <fpage>272</fpage>&#x2013;<lpage>303</lpage>.</citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vialatte</surname> <given-names>F.-B.</given-names></name> <name><surname>Maurice</surname> <given-names>M.</given-names></name> <name><surname>Dauwels</surname> <given-names>J.</given-names></name> <name><surname>Cichocki</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>Steady-state visually evoked potentials: focus on essential paradigms and future perspectives.</article-title> <source><italic>Prog. Neurobiol.</italic></source> <volume>90</volume> <fpage>418</fpage>&#x2013;<lpage>438</lpage>. <pub-id pub-id-type="doi">10.1016/j.pneurobio.2009.11.005</pub-id> <pub-id pub-id-type="pmid">19963032</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Volosyak</surname> <given-names>I.</given-names></name> <name><surname>Valbuena</surname> <given-names>D.</given-names></name> <name><surname>L&#x00FC;th</surname> <given-names>T.</given-names></name> <name><surname>Malechka</surname> <given-names>T.</given-names></name> <name><surname>Gr&#x00E4;ser</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>BCI demographics II: how many (and what kinds of) people can use a high-frequency SSVEP BCI?</article-title> <source><italic>IEEE Trans. Neural Syst. Rehabil. Eng.</italic></source> <volume>19</volume> <fpage>232</fpage>&#x2013;<lpage>239</lpage>.</citation></ref>
</ref-list>
</back>
</article>
