<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="editorial">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2023.1213207</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Editorial</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Editorial: Multimodal fusion technologies and applications in the context of neuroscience</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Fan</surname> <given-names>Xiaomao</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1362654/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Qiu</surname> <given-names>Meiyu</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Gao</surname> <given-names>Weidong</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c002"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1643595/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ma</surname> <given-names>Wenjun</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1914321/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Cai</surname> <given-names>Yunpeng</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/730705/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhou</surname> <given-names>Hui</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/943195/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhang</surname> <given-names>Dingguo</given-names></name>
<xref ref-type="aff" rid="aff6"><sup>6</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/135184/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Gravina</surname> <given-names>Raffaele</given-names></name>
<xref ref-type="aff" rid="aff7"><sup>7</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/888076/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Huang</surname> <given-names>Jian</given-names></name>
<xref ref-type="aff" rid="aff8"><sup>8</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/381632/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>College of Big Data and Internet, Shenzhen Technology University</institution>, <addr-line>Shenzhen</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>School of Information and Communication Engineering, Beijing University of Posts and Telecommunications</institution>, <addr-line>Beijing</addr-line>, <country>China</country></aff>
<aff id="aff3"><sup>3</sup><institution>School of Computer Science, South China Normal University</institution>, <addr-line>Guangzhou</addr-line>, <country>China</country></aff>
<aff id="aff4"><sup>4</sup><institution>Research Center for Biomedical Information Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences</institution>, <addr-line>Shenzhen</addr-line>, <country>China</country></aff>
<aff id="aff5"><sup>5</sup><institution>School of Automation, Nanjing University of Science and Technology</institution>, <addr-line>Nanjing</addr-line>, <country>China</country></aff>
<aff id="aff6"><sup>6</sup><institution>Center for Biosensors, Bioelectronics and Biodevices, University of Bath</institution>, <addr-line>Bath</addr-line>, <country>United Kingdom</country></aff>
<aff id="aff7"><sup>7</sup><institution>Department of Informatics, Modeling, Electronics and Systems, University of Calabria</institution>, <addr-line>Rende</addr-line>, <country>Italy</country></aff>
<aff id="aff8"><sup>8</sup><institution>School of Artificial Intelligence and Automation, Huazhong University of Science and Technology</institution>, <addr-line>Wuhan</addr-line>, <country>China</country></aff>
<author-notes>

<fn fn-type="edited-by"><p>Edited and reviewed by: Michele Giugliano, International School for Advanced Studies (SISSA), Italy</p></fn>

<corresp id="c001">&#x0002A;Correspondence: Xiaomao Fan <email>fanxiaomao&#x00040;sztu.edu.cn</email></corresp>
<corresp id="c002">Weidong Gao <email>gaoweidong&#x00040;bupt.edu.cn</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>16</day>
<month>05</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>17</volume>
<elocation-id>1213207</elocation-id>
<history>
<date date-type="received">
<day>27</day>
<month>04</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>03</day>
<month>05</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Fan, Qiu, Gao, Ma, Cai, Zhou, Zhang, Gravina and Huang.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Fan, Qiu, Gao, Ma, Cai, Zhou, Zhang, Gravina and Huang</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<related-article id="RA1" related-article-type="commentary-article" xlink:href="https://www.frontiersin.org/research-topics/33381/multimodal-fusion-technologies-and-applications-in-the-context-of-neuroscience" ext-link-type="uri">Editorial on the Research Topic <article-title>Multimodal fusion technologies and applications in the context of neuroscience</article-title></related-article>
<kwd-group>
<kwd>multimodal data fusion</kwd>
<kwd>biomedical signals</kwd>
<kwd>data mining and knowledge discovery</kwd>
<kwd>deep learning applications</kwd>
<kwd>neuroscience</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="0"/>
<page-count count="2"/>
<word-count count="1712"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Neural Technology</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<p>In recent years, sensor and information technologies have greatly boosted the wearable/portal/medical devices development. A large number of multimodal biomedical signals such as electroencephalography (EEG), electrocardiography (ECG), electrooculogram (EOG), and electromyography (EMG), have been recorded for rehabilitation analysis, mental disorders evaluation, emotion recognition, cardiovascular disease diagnosis, etc. In these research fields, most researchers often use single-modal biomedical signals to build the corresponding analysis models. However, many clinical practice tasks, such as disease diagnosis, arrhythmias detection, and sleep condition monitoring, require multimodal biomedical signals together to make correct diagnoses, decisions, identifications, and predictions. It is noted that learning from multimodal biomedical signals can offer the possibility of capturing corresponded information and gaining an in-depth understanding of the relationship among different modalities.</p>
<p>The aim of this topic is to present recent research works to advance the fundamental theory and technologies in biomedical signal processing methods, multimodal fusion algorithms, and biomedical signal-based clinical applications. The special section began with several original researches about the applications of the biomedical signals in specified diseases such as stroke, dysphonia, and visual-spatial neglect (VSN). Three papers explored the applications of EMG signals. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.886909">Sheng et al.</ext-link> explored the relevance between the increased muscle co-contraction and the corticospinal tract (CST) function in stroke survivors via EMG signals. It demonstrated that the CST and peripheral muscle co-contraction were closely related in stroke survivors. And increasing the intervention of the CST excitability would facilitate the recovery of muscle coordination in the upper limb after stroke. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.941594">Zhu et al.</ext-link> have measured the speech and the high-density surface EMG signals of the subjects, which suggested that the muscle contraction patterns would be used as a reference of pitch-related phonation functions evaluation. It was a potential alternative method to improve the clinical method for evaluating muscle functions of dysphonia diagnoses, facial paralysis, and other neuromuscular-inclined diseases. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2023.1018037">Asogbon et al.</ext-link> used KNN, LDA, and RF algorithms to study the impact of various EMG-signal recording duration (SRD) on the characterization of motor intents related with multiple kinds of finger gestures. It demonstrated that choosing a optimal signal length was crucial to characterize multiple classes of targeted limb motions.</p>
<p>The applications of EEG signals in stroke have been explored in three papers. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.968928">Liang et al.</ext-link> were the first who considered the EEG and functional near-infrared spectroscopy (fNIRS) features as the biomarkers for stroke assessment. The authors have established a linear regression model to predict Berg Balance Scale (BBS) values and used an eightfold cross validation to test the model. It got a result that the EEG features including stroke-related desynchronization (ERD), oxygenated hemoglobin (HBO), and the age were the promising biomarkers for stroke motor recovery. Two researches explored a most common cognitive impairment named visual-spatial neglect (VSN) of poststroke patients. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.974653">Cao et al.</ext-link> explored the recovery neural substrates of VSN. The study had demonstrated that the dorsal attention networks played a more significant role in recovery from VSN instead of ventral attention networks and the cerebellum was also involved in recovery. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.974712">Zhang et al.</ext-link> explored the resting-state EEG (rsEEG) features in stroke patients with VSN, which suggested that the resting-state DARAH could differentiate the patient with VSN or not. They demonstrated the resting-state EEG signals would be a useful tool for VSN stroke patients&#x00027; monitoring and DAR and pdBSI alpha parameters in resting-state EEG could be useful biomarkers.</p>
<p>Aside from EEG and EMG signals, ECG signals are also critical indicators of disease detection. Existing measuring methods of ECG signals don&#x00027;t meet the demands of dynamic measurement. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.900146">Wang et al.</ext-link> have developed a wearable biosensors system for dynamic ECG monitoring which used a flexible electrode. This system was able to collect high quality ECG signals when subjects exercised. It showed that the proposed electrode could be a potential tool used in long time detection for physiological signal measurements for patients and athletes.</p>
<p>To overcome the effect of physiological signals noises and the single signals&#x00027; low accuracy, <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.1000716">Fu et al.</ext-link> proposed a substructure-based joint probability domain adaptation algorithm (SSJPDA) with bi-projection matrix (BPM) algorithm. The authors used these algorithms to recognize the emotion of subjects based on multimodal fusion physiological data. Compared with other algorithms, the proposed SSJPDA and SSJPDA-BPM algorithms could better deal with noises in data and had improved the performance of emotion recognition.</p>
<p>Deep learning algorithms based on physiological signals were explored in four papers. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.971039">Li et al.</ext-link> have constructed a centralized steady-state visually evoked potential collaborative brain computer interface (SSVEP-cBCI) system which studied the multi- person EEG features. The system used a transfer learning-based convolutional neural network and three feature fusion methods, which showed the multi-person fusion features achieve more competitive results than single person&#x00027;s. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.971829">Hu et al.</ext-link> have proposed a generative adversarial network E2SGAN based on EEG-to-stereoelectroencephalography (SEEG), which was aim to synthesize SEEG data from the simultaneous EEG data. E2SGAN is superior to the baseline methods on the real-patient experiments, which demonstrated that the synthesized results had the potential to capture abnormal discharges of the epileptic patients before seizures.</p>
<p>The algorithms about diagnosing the sleep disorders were explored in the other two papers. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.972581">Chen et al.</ext-link> have creatively proposed a novel method named CNN-BiGRU which consists of considerable spatio-temporal blocks. It was used to classify the sleep apnea (SA) events based on ECG signals. Compared with the state-of-art ECG-based detection methods, CNN-BiGRU demonstrated an obviously competitive result, which could provide sleep monitoring service for the SA detection. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2022.973761">Yubo et al.</ext-link> have explored a multimodal attention network MMASleepNet for sleep staging, which can extract the effective features from the multimodal electrophysiological information. Compared with the baseline methods, MMASleepNet performs better in the accuracy and the training speed aspects. It provides a good solution for multimodal sleep monitoring.</p>
<sec id="s1">
<title>Conclusion and further considerations</title>
<p>To sum up, the papers accepted by this Research Topic mainly explored the biomedical signals applications or novel algorithms based on the detection of diseases in neural science. It enriches the present research studies, some of papers proposed novel methods that achieved better results than baselines. By issuing this Research Topic, it greatly boosts the advancement of multimodal fusion technologies for neuroscience applications based on biomedical signals.</p></sec>
<sec sec-type="author-contributions" id="s2">
<title>Author contributions</title>
<p>XF conceptualized this editorial and MQ wrote it. XF, WG, YC, and WM revised this editorial and others significantly contributed to it.</p></sec>
</body>
<back>
<sec sec-type="funding-information" id="s3">
<title>Funding</title>
<p>This work was partially supported by the Basic and Applied Research Project of Guangdong Province under Grant No. 2022B1515130009, the Special Subject on Agriculture and Social Development, Key Research and Development Plan in Guangzhou under Grant No. 2023B03J0172, and Key Projects of National Social Science Foundation of China under Grant No. 19ZDA041.</p>
</sec>

<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s4">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</back>
</article>