<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="editorial">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2022.876969</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Editorial</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Editorial: Computational Neuroscience for Perceptual Quality Assessment</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Min</surname> <given-names>Xiongkuo</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1725299/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Gu</surname> <given-names>Ke</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/552411/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhang</surname> <given-names>Lu</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1184155/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Jakhetiya</surname> <given-names>Vinit</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1199052/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhai</surname> <given-names>Guangtao</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/944223/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Electronic Engineering, Shanghai Jiao Tong University</institution>, <addr-line>Shanghai</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Faculty of Information Technology, Beijing University of Technology</institution>, <addr-line>Beijing</addr-line>, <country>China</country></aff>
<aff id="aff3"><sup>3</sup><institution>Univ Rennes, INSA Rennes, CNRS, IETR - UMR 6164</institution>, <addr-line>Rennes</addr-line>, <country>France</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Computer Science Engineering, Indian Institute of Technology</institution>, <addr-line>Jammu</addr-line>, <country>India</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited and reviewed by: Rufin VanRullen, Centre National de la Recherche Scientifique (CNRS), France</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Xiongkuo Min <email>minxiongkuo&#x00040;sjtu.edu.cn</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Perception Science, a section of the journal Frontiers in Neuroscience</p></fn></author-notes>
<pub-date pub-type="epub">
<day>28</day>
<month>03</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>16</volume>
<elocation-id>876969</elocation-id>
<history>
<date date-type="received">
<day>16</day>
<month>02</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>01</day>
<month>03</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2022 Min, Gu, Zhang, Jakhetiya and Zhai.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Min, Gu, Zhang, Jakhetiya and Zhai</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<related-article id="RA1" related-article-type="commentary-article" xlink:href="https://www.frontiersin.org/research-topics/19148/computational-neuroscience-for-perceptual-quality-assessment" ext-link-type="uri">Editorial on the Research Topic <article-title>Computational Neuroscience for Perceptual Quality Assessment</article-title>
</related-article>
<kwd-group>
<kwd>computational neuroscience</kwd>
<kwd>perceptual quality assessment</kwd>
<kwd>perception</kwd>
<kwd>multimedia</kwd>
<kwd>image processing</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="11"/>
<page-count count="3"/>
<word-count count="1736"/>
</counts>
</article-meta>
</front>
<body>
<p>Quality assessment aims to measure the degree of delight or annoyance of the users when experiencing an application or service. With the quick improvement of content acquisition, processing, transmission, and display techniques, the end-users are expecting and demanding continuously improved quality of experience (QoE) from the service providers. To guarantee a good QoE to end-users, perceptual quality assessment is introduced and widely studied in recent years (Brunnstr&#x000F6;m et al., <xref ref-type="bibr" rid="B2">2013</xref>; Zhai and Min, <xref ref-type="bibr" rid="B11">2020</xref>; Min et al., <xref ref-type="bibr" rid="B4">2022</xref>). Since the ultimate receiver of the processed signal is usually human, it is reasonable and beneficial to take human perception properties into consideration. Though we still have limited knowledge of the intrinsic neuroscience working mechanism of human perception, it is worthwhile to study and take inspiration from neuroscience and utilize these properties for computational modeling of perceptual quality.</p>
<p>Many of the current quality assessment models have already attempted to include human perception properties at some level, however, the majority of these models only take simplified concepts of human perception, and use &#x0201C;black box&#x0201D; machine learning techniques to model the QoE. The rapid development of neuroscience and computer science have provided opportunities for deeper explorations of the intrinsic neuroscience working mechanism of quality perception, and to utilize computational neuroscience theories and models for more efficient and explainable quality assessment. Specifically, on one hand the underlying biological bases of human perception especially those related to quality perception can be further explored on the basis of the recent advancement of neurobiology. While on the other hand, it is worthwhile to seek better ways to apply the relevant neuroscience working mechanisms for quality assessment and to build more accurate brain-inspired computational quality assessment models.</p>
<p>This Research Topic is a collection of articles concerning computational neuroscience studies for perceptual quality assessment and the potential applications in artificial systems. The final list of accepted articles can be categorized into four groups: 1. Neuroscience studies of human perception, especially those related to quality perception; 2. Neuroscience inspired perceptual quality modeling; 3. Perceptual quality assessment for emerging and advanced multimedia technologies; 4. Applications of perceptual quality modeling. The below is an overview and discussion of the accepted articles.</p>
<sec id="s1">
<title>Neuroscience Studies of Human Perception, Especially Those Related to Quality Perception</title>
<p>In recent years, a large amount of perceptual quality assessment studies has taken human perception properties into consideration, since human is usually the ultimate judger of signal quality. To study the intrinsic neuroscience working mechanism of human perception, subjective neuroscience and perceptual studies are usually necessary.</p>
<p>The influence of audio on perceptual QoE has been studied and verified by some previous studies (You et al., <xref ref-type="bibr" rid="B10">2010</xref>; Akhtar and Falk, <xref ref-type="bibr" rid="B1">2017</xref>; Min et al., <xref ref-type="bibr" rid="B6">2017</xref>, <xref ref-type="bibr" rid="B7">2020a</xref>,<xref ref-type="bibr" rid="B8">b</xref>). In this Research Topic, <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fpsyg.2021.767840">Sun and Hines</ext-link> give an overview for the audiology and cognitive science researches which study how cognitive processes influence the quality of listening experience. Moreover, they also propose to introduce these mechanisms from audiology and cognitive science into the current QoE framework, through which we can better incorporate cognitive load in speech listening. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.771533">Pieper et al.</ext-link> use electroencephalogram and some other questionnaire-based subjective measures to study if noise-canceling technologies can reduce the influence of external distractions and free up mental resources. Results partially verify that an assumed lower mental load is observed in no noise and noise-canceling environment compared to that of in the noise environment. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.757679">Han et al.</ext-link> study the influence of the refresh rate of a display on the motion perception response. Moreover, they introduce an objective visual electrophysiological assessment model to better select the display parameters.</p>
</sec>
<sec id="s2">
<title>Neuroscience Inspired Perceptual Quality Modeling</title>
<p>Full understanding of the intrinsic neuroscience working mechanism of human perception is difficult in the current stage, however it is worthwhile to study and take inspiration from neuroscience and utilize these properties for computational modeling of perceptual quality.</p>
<p>Over the last two decades, many perceptual quality assessment models have been proposed (Wang et al., <xref ref-type="bibr" rid="B9">2004</xref>; Brunnstr&#x000F6;m et al., <xref ref-type="bibr" rid="B2">2013</xref>; Min et al., <xref ref-type="bibr" rid="B3">2018a</xref>,<xref ref-type="bibr" rid="B5">b</xref>, <xref ref-type="bibr" rid="B4">2022</xref>; Zhai and Min, <xref ref-type="bibr" rid="B11">2020</xref>), and many of them have taken inspirations from neuroscience. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.739138">Song et al.</ext-link> introduce a blind quality assessment model for authentically distorted images by considering both distortion degree and intelligibility. Specifically, they analyze the relation between intelligibility and image quality, and then incorporate such intelligibility into a highly generalizable image quality prediction model. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.767977">Feng et al.</ext-link> introduce an end-to-end cross-domain feature similarity guided deep neural network for perceptual quality assessment. This model is built based on the observation that features for the object recognition task and features for the quality prediction task are highly correlated in terms of characteristics of the human visual system. Experimental results have verified the effectiveness of the proposed model.</p>
</sec>
<sec id="s3">
<title>Perceptual Quality Assessment for Emerging and Advanced Multimedia Technologies</title>
<p>Recently, a growing number of emerging and advanced multimedia technologies or systems have invaded into our daily lives, for example light field, virtual reality, etc. Such emerging multimedia applications also call for new quality perception models, since traditional quality perception models are not good at such contents.</p>
<p>In this Research Topic, <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fncom.2021.768021">Meng et al.</ext-link> propose a light field image quality assessment model by predicting the global angular-spatial distortion of macro-pixels as well as the local angular-spatial quality of the focus stack. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.761610">Wang et al.</ext-link> present a quality metric for depth-image-based rendering images by jointly measuring the synthesized image&#x00027;s colorfulness, texture structure, and depth structure. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fncom.2021.746549">Hu et al.</ext-link> first introduce a method to simulate the wrap-around artifact on the artifact-free MRI image to increase the quantity of MRI data, and then propose an image restoration method to reduce the wrap-around artifact.</p>
</sec>
<sec id="s4">
<title>Applications of Perceptual Quality Modeling</title>
<p>The research of perceptual quality modeling applications has also aroused increasing attention in recent years, since perceptual quality modeling can play an important role in the quality control and optimization of multimedia communication systems. In this Research Topic, <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.766762">Lei et al.</ext-link> first introduce a new quality assessment database for swimming pool images, and then propose an objective swimming pool image quality measure by detecting the main target and integrating multiple quality-aware features. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fnins.2021.766396">Yu et al.</ext-link> first construct a new image database by collecting 1,000 pictures from the official social network accounts of nine well-known universities, as well as the corresponding number of page views.</p>
<p>We hope that readers find this Research Topic useful, timely and informative, in addressing the important topics in Computational Neuroscience for Perceptual Quality Assessment.</p>
</sec>
<sec id="s5">
<title>Author Contributions</title>
<p>All authors wrote, and equally contributed to the article, and approved the submitted version.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s6">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Akhtar</surname> <given-names>Z.</given-names></name> <name><surname>Falk</surname> <given-names>T. H.</given-names></name></person-group> (<year>2017</year>). <article-title>Audio-visual multimedia quality assessment: a comprehensive survey</article-title>. <source>IEEE Access</source> <volume>5</volume>, <fpage>21090</fpage>&#x02013;<lpage>21117</lpage>. <pub-id pub-id-type="doi">10.1109/ACCESS.2017.2750918</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brunnstr&#x000F6;m</surname> <given-names>K.</given-names></name> <name><surname>Beker</surname> <given-names>S. A.</given-names></name> <name><surname>De Moor</surname> <given-names>K.</given-names></name> <name><surname>Dooms</surname> <given-names>A.</given-names></name> <name><surname>Egger</surname> <given-names>S.</given-names></name> <name><surname>Garcia</surname> <given-names>M. N.</given-names></name> <etal/></person-group>. (<year>2013</year>). <source>Qualinet White Paper on Definitions of Quality of Experience</source>.</citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Min</surname> <given-names>X.</given-names></name> <name><surname>Gu</surname> <given-names>K.</given-names></name> <name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name> <name><surname>Chen</surname> <given-names>C. W.</given-names></name></person-group> (<year>2018a</year>). <article-title>Blind quality assessment based on pseudo-reference image</article-title>. <source>IEEE Trans. Multimedia</source> <volume>20</volume>, <fpage>2049</fpage>&#x02013;<lpage>2062</lpage>. <pub-id pub-id-type="doi">10.1109/TMM.2017.2788206</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Min</surname> <given-names>X.</given-names></name> <name><surname>Gu</surname> <given-names>K.</given-names></name> <name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>W.</given-names></name> <name><surname>Le Callet</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Screen content quality assessment: overview, benchmark, and beyond</article-title>. <source>ACM Comput. Surv</source>. <volume>54</volume>, <fpage>1</fpage>&#x02013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.1145/3470970</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Min</surname> <given-names>X.</given-names></name> <name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Gu</surname> <given-names>K.</given-names></name> <name><surname>Liu</surname> <given-names>Y.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name></person-group> (<year>2018b</year>). <article-title>Blind image quality estimation via distortion aggravation</article-title>. <source>IEEE Trans. Broadcast</source>. <volume>64</volume>, <fpage>508</fpage>&#x02013;<lpage>517</lpage>. <pub-id pub-id-type="doi">10.1109/TBC.2018.2816783</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Min</surname> <given-names>X.</given-names></name> <name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Gu</surname> <given-names>K.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name></person-group> (<year>2017</year>). <article-title>Fixation prediction through multimodal analysis</article-title>. <source>ACM Trans. Multimedia Comput. Commun. Appl</source>. 13, <volume>6</volume>:<fpage>1</fpage>&#x02013;<lpage>6</lpage>:23. <pub-id pub-id-type="doi">10.1145/2996463</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Min</surname> <given-names>X.</given-names></name> <name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Zhou</surname> <given-names>J.</given-names></name> <name><surname>Farias</surname> <given-names>M. C.</given-names></name> <name><surname>Bovik</surname> <given-names>A. C.</given-names></name></person-group> (<year>2020a</year>). <article-title>Study of subjective and objective quality assessment of audio-visual signals</article-title>. <source>IEEE Trans. Image Proces</source>. <volume>29</volume>, <fpage>6054</fpage>&#x02013;<lpage>6068</lpage>. <pub-id pub-id-type="doi">10.1109/TIP.2020.2988148</pub-id><pub-id pub-id-type="pmid">32324554</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Min</surname> <given-names>X.</given-names></name> <name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Zhou</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>X. P.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name> <name><surname>Guan</surname> <given-names>X.</given-names></name></person-group> (<year>2020b</year>). <article-title>A multimodal saliency model for videos with high audio-visual correspondence</article-title>. <source>IEEE Trans. Image Proces.</source> <volume>29</volume>, <fpage>3805</fpage>&#x02013;<lpage>3819</lpage>. <pub-id pub-id-type="doi">10.1109/TIP.2020.2966082</pub-id><pub-id pub-id-type="pmid">31976898</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Bovik</surname> <given-names>A. C.</given-names></name> <name><surname>Sheikh</surname> <given-names>H. R.</given-names></name> <name><surname>Simoncelli</surname> <given-names>E. P.</given-names></name></person-group> (<year>2004</year>). <article-title>Image quality assessment: from error visibility to structural similarity</article-title>. <source>IEEE Trans. Image Proces</source>. <volume>13</volume>, <fpage>600</fpage>&#x02013;<lpage>612</lpage>. <pub-id pub-id-type="doi">10.1109/TIP.2003.819861</pub-id><pub-id pub-id-type="pmid">15376593</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>You</surname> <given-names>J.</given-names></name> <name><surname>Reiter</surname> <given-names>U.</given-names></name> <name><surname>Hannuksela</surname> <given-names>M. M.</given-names></name> <name><surname>Gabbouj</surname> <given-names>M.</given-names></name> <name><surname>Perkis</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>Perceptual-based quality assessment for audio-visual services: a survey</article-title>. <source>Signal Proces. Image Commun</source>. <volume>25</volume>, <fpage>482</fpage>&#x02013;<lpage>501</lpage>. <pub-id pub-id-type="doi">10.1016/j.image.2010.02.002</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhai</surname> <given-names>G.</given-names></name> <name><surname>Min</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Perceptual image quality assessment: a survey</article-title>. <source>Sci. China Inform. Sci</source>. <volume>63</volume>, <fpage>211301</fpage>. <pub-id pub-id-type="doi">10.1007/s11432-019-2757-1</pub-id><pub-id pub-id-type="pmid">24557715</pub-id></citation></ref>
</ref-list> 
</back>
</article>