<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Earth Sci.</journal-id>
<journal-title>Frontiers in Earth Science</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Earth Sci.</abbrev-journal-title>
<issn pub-type="epub">2296-6463</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">1104488</article-id>
<article-id pub-id-type="doi">10.3389/feart.2023.1104488</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Earth Science</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Multichannel seismic impedance inversion based on Attention U-Net</article-title>
<alt-title alt-title-type="left-running-head">Ning et al.</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/feart.2023.1104488">10.3389/feart.2023.1104488</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Ning</surname>
<given-names>Juan</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/2108297/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Li</surname>
<given-names>Shu</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Wei</surname>
<given-names>Zong</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/2108778/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Yang</surname>
<given-names>Xi</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
</contrib-group>
<aff id="aff1">
<sup>1</sup>
<institution>School of Communication and Electronic Engineering</institution>, <institution>Jishou University</institution>, <addr-line>Jishou</addr-line>, <country>China</country>
</aff>
<aff id="aff2">
<sup>2</sup>
<institution>School of Biomedical Engineering</institution>, <institution>Guangzhou Medical University</institution>, <addr-line>Guangzhou</addr-line>, <country>China</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1894508/overview">Peng Zhenming</ext-link>, University of Electronic Science and Technology of China, China</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/987126/overview">Gulan Zhang</ext-link>, Southwest Petroleum University, China</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/2158372/overview">Bibo Yue</ext-link>, Southwest Petroleum University, China</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1591013/overview">Cai Hanpeng</ext-link>, University of Electronic Science and Technology of China, China</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Shu Li, <email>shuli@jsu.edu.cn</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Environmental Informatics and Remote Sensing, a section of the journal Frontiers in Earth Science</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>02</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>11</volume>
<elocation-id>1104488</elocation-id>
<history>
<date date-type="received">
<day>21</day>
<month>11</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>13</day>
<month>02</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2023 Ning, Li, Wei and Yang.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Ning, Li, Wei and Yang</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Recently, seismic inversion has made extensive use of supervised learning methods. The traditional deep learning inversion network can utilize the temporal correlation in the vertical direction. Still, it does not consider the spatial correlation in the horizontal direction of seismic data. Each seismic trace is inverted independently, which leads to noise and large geological variations in seismic data, thus leading to lateral discontinuity. Given this, the proposed method uses the spatial correlation of the seismic data in the horizontal direction. In the network training stage, several seismic traces centered on the well-side trace and the corresponding logging curve form a set of training sample pairs for training, to enhance the lateral continuity and anti-noise performance. Additionally, Attention U-Net is introduced in acoustic impedance inversion. Attention U-Net adds attention gate (AG) model to the skip connection between the encoding and decoding layers of the U-Net network, which can give different weights to different features, so the model can focus on the features related to the inversion task and avoid the influence of irrelevant data and noise during the inversion process. The performance of the proposed method is evaluated using the Marmousi2 model and the SEAM model and compared with other methods. The experimental results show that the proposed method has the advantages of high accuracy of acoustic impedance value inversion, good transverse continuity of inversion results, and strong anti-noise performance.</p>
</abstract>
<kwd-group>
<kwd>Attention U-Net</kwd>
<kwd>acoustic impedance inversion</kwd>
<kwd>spatial correlation</kwd>
<kwd>deep learning</kwd>
<kwd>multichannel inversion</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>Seismic inversion can be defined as the process of obtaining subsurface model parameters, such as formation velocity, density, or impedance, from seismic data by comprehensively available geological and logging data (<xref ref-type="bibr" rid="B18">Treitel and Lines, 2001</xref>). For conventional seismic inversion methods, i.e., model-driven inversion methods, the mathematical theory is based on the convolution model or other mathematical and physical models. The convolution model is essentially a simplification and approximation of the seismic wave transmission process. The subsurface structure is usually very complex, and errors will inevitably arise when describing the wave propagation with the convolution model, which leads to inaccurate inversion results. On the other hand, in order to get a good inversion result, the model-driven method needs a better initial model and an accurate wavelet. In practical applications, it is usually challenging to obtain good initial models and accurate wavelets. In addition, problems such as limited data bandwidth, data noise, and incomplete data coverage cause various troubles for model-driven inversion methods.</p>
<p>Unlike traditional model-driven seismic inversion, deep learning is a data-driven approach that can learn complex non-linear mappings between inputs and outputs based on training datasets, and the parameters are adjustable. Deep learning is a subset of machine learning that has recently made breakthroughs in image classification (<xref ref-type="bibr" rid="B10">Krizhevsky et al., 2017</xref>), object detection (<xref ref-type="bibr" rid="B16">Ren et al., 2015</xref>), image segmentation (<xref ref-type="bibr" rid="B4">Chen et al., 2017</xref>), image and video captioning (<xref ref-type="bibr" rid="B19">Vinyals et al., 2022</xref>), speech recognition (<xref ref-type="bibr" rid="B8">Graves et al., 2013</xref>), and machine translation (<xref ref-type="bibr" rid="B5">Cho et al., 2014</xref>). The success of deep learning in the fields of computer vision and natural language processing has led to widespread interest among scholars in data-driven intelligent seismic inversion methods. This class of methods does not require an initial model and does not require the estimation of seismic wavelets. Using the powerful learning ability of deep neural networks to establish non-linear mapping relationships between seismic data and parameters to be inverted has become a trendy research direction in the field of seismic inversion.</p>
<p>Currently, the application of deep learning methods in the field of seismic inversion is expanding, involving acoustic impedance inversion, pre-stack elastic and lithological parameter inversion, full waveform inversion, and so on. Recently, seismic inversion has made extensive use of supervised learning methods. <xref ref-type="bibr" rid="B2">Alfarraj and AlRegib (2018)</xref> used recurrent neural networks for petrophysical parameter estimation. <xref ref-type="bibr" rid="B6">Das et al. (2019)</xref> and <xref ref-type="bibr" rid="B21">Wu et al. (2020)</xref> trained the convolutional neural networks (CNNs) to invert seismic impedance using synthetic seismic records on the earth model constrained by petrophysical relationships. The results show that the type of sediment phase and source wavelet parameters used in the training dataset affect the inversion process of the network. <xref ref-type="bibr" rid="B12">Mustafa et al. (2019)</xref> used the temporal convolution network (TCN) to estimate the acoustic impedance. This method not only successfully captured the long-term trend but also preserved the local patterns while overcoming the gradient disappearance problem in the inversion of recurrent neural network (RNN) and the overfitting problem in convolutional neural networks. <xref ref-type="bibr" rid="B7">Du et al. (2019)</xref> proposed SeisInv-ResNet for pre-stack seismic inversion to obtain p-wave impedance, s-wave impedance, and other petrophysical parameters. <xref ref-type="bibr" rid="B1">Aleardi and Salusti (2021)</xref> proposed an elastic pre-stack seismic inversion method based on CNN.</p>
<p>Although the above inversion networks based on deep learning can well utilize the temporal correlation in the vertical direction, they do not consider the spatial correlation of seismic data in the horizontal direction, and each seismic trace is inverted independently. However, in subsurface seismic profiles, adjacent traces are highly correlated. The inversion method based on trace by trace does not exploit the spatial correlation in the horizontal direction, which may lead to poor horizontal continuity of inversion results. To improve the continuity, <xref ref-type="bibr" rid="B22">Wu et al. (2021)</xref> proposed a 2D network-based inversion method.</p>
<p>Traditional CNN networks take a long time to train and need a lot of labeled data. To address these drawbacks of classical CNN networks, <xref ref-type="bibr" rid="B17">Ronneberger et al. (2015)</xref> proposed the U-Net network in their study of biomedical image segmentation problems. Their research shows that U-Net can reduce the need for labeled data to a certain extent while improving training efficiency. Seismic inversion also faces the problem of a small number of labels (few logging data) and a very large amount of seismic data. In view of this, <xref ref-type="bibr" rid="B3">Cao et al. (2022)</xref> proposed an inversion network consisting of a U-Net combined with three fully connected networks and named it the UCNN, which was used to predict elastic parameters from pre-stack seismic data. To further reduce the reliance on labeled data, they use Sequential Gaussian Co-Simulation and Elastic Distortion algorithms to generate adequate and diverse pre-stack seismic inversion datasets. Similarly, <xref ref-type="bibr" rid="B20">Wang et al. (2020)</xref> proposed a closed-loop CNN structure with a U-Net network as the main body to make CNN less dependent on the amount of labeled data in seismic inversion. The proposed closed-loop CNN can simulate both seismic forward and inversion processes from the training dataset.</p>
<p>Given the excessive and repeated extraction and utilization of similar features for each cascaded CNN structure in U-Net, this results in a significant computational effort and network parameter scale. <xref ref-type="bibr" rid="B15">Oktay et al. (2018)</xref> proposed the Attention Gate (AG) model and integrated it into U-Net to obtain the Attention U-Net network. The AG model can implicitly learn to emphasize prominent features that are helpful for inversion while suppressing irrelevant regions in the input data. In addition, AG is easily integrated into standard CNN architectures such as U-Net, which can reduce the computational overhead while improving the sensitivity and prediction accuracy of the network.</p>
<p>In conclusion, this paper proposes a multichannel acoustic impedance inversion based on Attention U-Net to address the issues with conventional deep learning inversion networks, such as poor continuity of inversion results and susceptibility to noise due to the trace-by-trace inversion method. The horizontal spatial correlation is applied to the inversion network by mapping multiple seismic traces to one logging curve. Under the supervision of limited logging data, the inversion network is trained. The training samples consist of several seismic traces centered on the well-side traces and associated well-logging curves. The inversion network simultaneously performs the duties of predicting acoustic impedance and forwarding seismic data. This paper is structured as follows: In <xref ref-type="sec" rid="s2">Section 2</xref>, the theory and network structure of Attention U-Net are briefly introduced, and then the architecture of the inversion network consisting of three modules and their specific internal parameter settings are presented. In <xref ref-type="sec" rid="s3">Section 3</xref>, the experimental results of the inversion of two typical seismic models (the Marmousi2 model and the SEAM model) are presented, analyzed, and discussed. The experimental results are compared with other deep learning inversion methods, and the noise immunity of the inversion network is discussed in this paper. Finally, <xref ref-type="sec" rid="s4">Section 4</xref> concludes this paper.</p>
</sec>
<sec sec-type="methods" id="s2">
<title>2 Methods</title>
<sec id="s2-1">
<title>2.1 Inversion framework</title>
<p>Geological structures are spatially correlated. The closer the distance, the stronger the correlation, and conversely, the weaker the correlation. The correlation of seismic data is reflected in the temporal correlation in the vertical direction of seismic traces and the spatial correlation in the horizontal direction between the central trace and the adjacent traces. Based on the spatiotemporal characteristics of the seismic data, the inversion framework in <xref ref-type="fig" rid="F1">Figure 1</xref> is constructed using a supervised learning approach. The inversion framework shown in <xref ref-type="fig" rid="F1">Figure 1</xref> consists of three main modules: the feature extraction module, the regression module, and the forward module.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Structure of inversion network.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g001.tif"/>
</fig>
<p>In the training phase, the input of the inversion network is the seismic data of the well-side trace and the 2&#xa0;k nearby seismic data centered on it. The feature extraction module extracts the temporal and spatial features of the seismic data of the well-side trace and the 2&#xa0;k nearby seismic traces by Attention U-Net. The regression module is used to map the data from the feature domain (spatiotemporal feature series) to the target domain (predicted acoustic impedance), while the forward module is used to map the data from the feature domain to the target domain (forward 2&#xa0;k &#x2b; 1 traces seismic data). Referring to the structure of the multi-task learning of <xref ref-type="bibr" rid="B13">Mustafa et al. (2021)</xref>, the inverse network learns two tasks simultaneously: the predicted acoustic impedance data and forward seismic data. By sharing representations between the two tasks, especially if they are related to each other, we bias the network to learn more generalizable features.</p>
</sec>
<sec id="s2-2">
<title>2.2 Network model</title>
<sec id="s2-2-1">
<title>2.2.1 Feature extraction module</title>
<p>The Attention U-Net is used as a feature extraction module to extract spatial and temporal features of seismic data. The input of the feature extraction module is the seismic data of the well-side trace and the nearby 2&#xa0;k traces centered on it, and the output feature size is the same as the input size. Attention U-Net is improved by using U-Net as the base framework, as shown in <xref ref-type="fig" rid="F1">Figure 1</xref>, adding AG at the jump connection between the encoding-decoding layers of the U-Net network, so that the originally up-sampled features are connected with the encoded layer AG-processed signal. By assigning different weights to different features, the model is better able to pay attention to the features relevant to the inversion task, which improves the sensitivity and prediction accuracy of the model.</p>
<p>Attention U-Net is divided into an encoding part and a decoding part, as shown in <xref ref-type="fig" rid="F1">Figure 1</xref>. The encoding part of the Attention U-Net framework used in this paper contains four downsampling layers. The downsampling layer includes two consecutive convolutional blocks and a 2 &#xd7; 1 max-pooling layer, and each convolutional block consists of a 3 &#xd7; 3 two-dimensional convolutional layer (Conv2d), a batch normalization layer (BN) (<xref ref-type="bibr" rid="B9">Ioffe and Szegedy, 2022</xref>), and a rectified linear unit (ReLU) (<xref ref-type="bibr" rid="B14">Nair and Hinton, 2010</xref>) activation function. Batch normalization is used to accelerate the convergence of the network, and ReLU is used to enhance the non-linear approximation capability of the model. The decoding part corresponds to the encoding part, and the decoding part also contains four upsampling layers. Each upsampling layer consists of a 4 &#xd7; 3 deconvolution layer, an AG model, and two convolution blocks.</p>
<p>The input of AG is the feature in the encoding part and the feature after deconvolution in the decoding part. The specific structure of AG is shown in <xref ref-type="fig" rid="F2">Figure 2</xref>. The features extracted from the decoding part after deconvolution are used as the gating signal g, and the features from the matching layer&#x2019;s coding portion are used as x. The 1 &#xd7; 1 convolution is done for g and x, and the two results A and B are added element by element to highlight the features. Then, the non-linear ability of the added result is increased by the ReLU activation function to obtain C, and the channel of C is reduced to 1 channel by a convolution operation. D is processed using a sigmoid activation function such that its value falls within the range of (0, 1), and the result is an attention weight that is the same size as the input feature and has one channel. Finally, the attention weight is multiplied by x.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Attention gating model.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g002.tif"/>
</fig>
</sec>
<sec id="s2-2-2">
<title>2.2.2 Regression module</title>
<p>The regression module maps the output of the feature extraction module from the feature domain to the target domain. The regression module&#x2019;s structure, as shown in <xref ref-type="fig" rid="F3">Figure 3</xref>, consists of two convolutional blocks and a 2D convolutional layer. Each convolutional block consists of a 2D convolutional layer, a group normalization layer, and the ReLU activation function. Group normalization groups the outputs of the convolutional layers and normalizes each group using the learned mean and standard deviation, which have been shown to reduce covariate bias in the learned features and speed up learning (<xref ref-type="bibr" rid="B23">Wu and He, 2012</xref>).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Block diagram of the regression module.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g003.tif"/>
</fig>
<p>As shown in <xref ref-type="fig" rid="F3">Figure 3</xref>, the input of the regression module is the output of the feature extraction module, and the output is the predicted acoustic impedance. Calculate the mean square error between the actual acoustic impedance and the output of the regression module. In other words, the mean square error between the predicted and the actual acoustic impedance data is calculated to update the learnable parameters in the feature extraction module and the regression module. The following Eq. <xref ref-type="disp-formula" rid="e1">1</xref> illustrates this:<disp-formula id="e1">
<mml:math id="m1">
<mml:mrow>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">l</mml:mi>
<mml:mn mathvariant="bold">1</mml:mn>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mi mathvariant="bold-italic">M</mml:mi>
<mml:mi mathvariant="bold-italic">S</mml:mi>
<mml:mi mathvariant="bold-italic">E</mml:mi>
<mml:mrow>
<mml:mfenced open="(" close=")" separators="|">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">m</mml:mi>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">m</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:math>
<label>(1)</label>
</disp-formula>where <inline-formula id="inf1">
<mml:math id="m2">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">m</mml:mi>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is the actual acoustic impedance, <inline-formula id="inf2">
<mml:math id="m3">
<mml:mrow>
<mml:msub>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">m</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is the predicted acoustic impedance, and MSE is as in Eq. <xref ref-type="disp-formula" rid="e4">4</xref>.</p>
</sec>
<sec id="s2-2-3">
<title>2.2.3 Forward module</title>
<p>The forward module maps the output of the feature extraction module from the feature domain to the target domain. As shown in <xref ref-type="fig" rid="F4">Figure 4</xref>, the input of the forward module is the output of the feature extraction module, and the output is the predicted well-side trace and 2&#xa0;k nearby seismic data. The structure of the forward module consists of two convolutional blocks plus a 2D convolutional layer. Each convolutional block consists of a 2D convolutional layer, a group normalization layer, and a ReLU activation function to achieve reconstruction.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Block diagram of the forward module.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g004.tif"/>
</fig>
<p>Calculate the mean square error between the feature extraction module&#x2019;s input and the forward module&#x2019;s output. To put it another way, the mean square error between the 2&#xa0;k &#x2b; 1 seismic data in the well-side trace and nearby traces and the predicted 2&#xa0;k &#x2b; 1 seismic data is calculated in order to update the learnable parameters in the feature extraction module and the forward module. The following Eq. <xref ref-type="disp-formula" rid="e2">2</xref> illustrates this:<disp-formula id="e2">
<mml:math id="m4">
<mml:mrow>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">l</mml:mi>
<mml:mn mathvariant="bold">2</mml:mn>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mi mathvariant="bold-italic">M</mml:mi>
<mml:mi mathvariant="bold-italic">S</mml:mi>
<mml:mi mathvariant="bold-italic">E</mml:mi>
<mml:mrow>
<mml:mfenced open="(" close=")" separators="|">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">x</mml:mi>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">x</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:math>
<label>(2)</label>
</disp-formula>where <inline-formula id="inf3">
<mml:math id="m5">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">x</mml:mi>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is the seismic data of the well-side and nearby 2&#xa0;k traces, and <inline-formula id="inf4">
<mml:math id="m6">
<mml:mrow>
<mml:msub>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">x</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi mathvariant="bold-italic">t</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> is the predicted 2&#xa0;k &#x2b; 1 seismic data.</p>
</sec>
</sec>
<sec id="s2-3">
<title>2.3 Loss function</title>
<p>The loss of the entire inversion network is the mean square error between the predicted acoustic impedance data and the actual acoustic impedance (<inline-formula id="inf5">
<mml:math id="m7">
<mml:mrow>
<mml:msub>
<mml:mi>l</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>), and the mean square error between the 2&#xa0;k seismic data in and around the well-side traces and the predicted 2&#xa0;k &#x2b; 1 seismic data (<inline-formula id="inf6">
<mml:math id="m8">
<mml:mrow>
<mml:msub>
<mml:mi>l</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>), with the total loss shown in Eq. <xref ref-type="disp-formula" rid="e3">3</xref>:<disp-formula id="e3">
<mml:math id="m9">
<mml:mrow>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi mathvariant="bold-italic">l</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi mathvariant="bold-italic">&#x3b1;</mml:mi>
<mml:msub>
<mml:mi mathvariant="bold-italic">l</mml:mi>
<mml:mn mathvariant="bold">1</mml:mn>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:mi mathvariant="bold-italic">&#x3b2;</mml:mi>
<mml:msub>
<mml:mi mathvariant="bold-italic">l</mml:mi>
<mml:mn mathvariant="bold">2</mml:mn>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:math>
<label>(3)</label>
</disp-formula>where <inline-formula id="inf7">
<mml:math id="m10">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf8">
<mml:math id="m11">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:math>
</inline-formula> are weighting factors that control the effects of acoustic impedance losses and seismic losses, respectively.</p>
</sec>
<sec id="s2-4">
<title>2.4 Evaluation of inversion results</title>
<p>The inversion results are evaluated quantitatively by calculating the mean square error (MSE) and the coefficient of determination (<italic>R</italic>
<sup>2</sup>) of the actual and predicted acoustic impedance.</p>
<p>Mean Squared Error (MSE): MSE is the average of the squared sum of the errors of the corresponding points of the predicted data and the real data, and the smaller the value indicates that the predicted data fits better with the original data, which is defined as:<disp-formula id="e4">
<mml:math id="m12">
<mml:mrow>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi mathvariant="bold-italic">M</mml:mi>
<mml:mi mathvariant="bold-italic">S</mml:mi>
<mml:mi mathvariant="bold-italic">E</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn mathvariant="bold">1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="bold-italic">N</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mrow>
<mml:munderover>
<mml:mstyle displaystyle="true">
<mml:mo>&#x2211;</mml:mo>
</mml:mstyle>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn mathvariant="bold">1</mml:mn>
</mml:mrow>
<mml:mi mathvariant="bold-italic">N</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:mrow>
<mml:mfenced open="&#x2016;" close="" separators="|">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mi mathvariant="bold-italic">i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:msubsup>
<mml:mrow>
<mml:mfenced open="" close="&#x2016;" separators="|">
<mml:mrow>
<mml:msub>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mi mathvariant="bold-italic">i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mn mathvariant="bold">2</mml:mn>
<mml:mn mathvariant="bold">2</mml:mn>
</mml:msubsup>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:math>
<label>(4)</label>
</disp-formula>where <inline-formula id="inf9">
<mml:math id="m13">
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>, <inline-formula id="inf10">
<mml:math id="m14">
<mml:mrow>
<mml:msub>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> denote the actual acoustic impedance and predicted impedance, respectively, and N is the number of data.</p>
<p>Determination Coefficient (<italic>R</italic>
<sup>2</sup>): <italic>R</italic>
<sup>2</sup> is a measure of the goodness of fit between variables that takes into account the mean square error between predicted and actual data. Its range of values is [0, 1], and the larger the value, the better the fit between the variables, the more the independent variable explains the dependent variable, and the more the independent variable contributes to the overall variation. It is defined as:<disp-formula id="e5">
<mml:math id="m15">
<mml:mrow>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msup>
<mml:mi mathvariant="bold-italic">R</mml:mi>
<mml:mn mathvariant="bold">2</mml:mn>
</mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")" separators="|">
<mml:mrow>
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mo>,</mml:mo>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn mathvariant="bold">1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msubsup>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn mathvariant="bold">1</mml:mn>
</mml:mrow>
<mml:mi mathvariant="bold-italic">N</mml:mi>
</mml:msubsup>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")" separators="|">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mi mathvariant="bold-italic">i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mover accent="true">
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mi mathvariant="bold-italic">i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mn mathvariant="bold">2</mml:mn>
</mml:msup>
</mml:mrow>
<mml:mrow>
<mml:msubsup>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi mathvariant="bold-italic">i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn mathvariant="bold">1</mml:mn>
</mml:mrow>
<mml:mi mathvariant="bold-italic">N</mml:mi>
</mml:msubsup>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")" separators="|">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold-italic">y</mml:mi>
<mml:mi mathvariant="bold-italic">i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold-italic">&#x3bc;</mml:mi>
<mml:mi mathvariant="bold-italic">y</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mn mathvariant="bold">2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:math>
<label>(5)</label>
</disp-formula>where <inline-formula id="inf11">
<mml:math id="m16">
<mml:mrow>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>, <inline-formula id="inf12">
<mml:math id="m17">
<mml:mrow>
<mml:msub>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>, and <inline-formula id="inf13">
<mml:math id="m18">
<mml:mrow>
<mml:msub>
<mml:mi>&#x3bc;</mml:mi>
<mml:mi>y</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> represent the actual acoustic impedance, predicted acoustic impedance, and the average of the actual acoustic impedance, respectively. When <italic>R</italic>
<sup>2</sup> is closer to 1, the stronger the correlation between the predicted and actual acoustic impedance is.</p>
</sec>
</sec>
<sec id="s3">
<title>3 Experiments</title>
<p>The Marmousi2 and the SEAM models are widely used to validate the performance of deep learning inversion methods. This subsection will use these two models to validate the performance of the inversion network architecture proposed in this paper for acoustic impedance inversion.</p>
<sec id="s3-1">
<title>3.1 Marmousi2 model inversion experiments</title>
<p>The Marmousi2 model is an extension of the original Marmousi model for amplitude variation with offset (AVO) analysis (<xref ref-type="bibr" rid="B11">Martin et al., 2002</xref>). The original Marmousi model has been widely used to validate inversion and imaging algorithms. The researchers added more complex structures representing hydrocarbon regions to the model and increased the number of strata, resulting in a new model, the Marmousi2 model, which has a width of 17&#xa0;km and a depth of 3.5&#xa0;km. The model is accompanied by synthetic seismic data, which are obtained by convolutional forward simulations of the model&#x2019;s reflection coefficients using seismic wavelets.</p>
<p>The acoustic impedance model was obtained by multiplying the density and p-velocity models of the Marmousi2 data. The seismic data and acoustic impedance profiles are shown in <xref ref-type="fig" rid="F5">Figures 5A, B</xref>, with 2,721 traces and 688 sampling points per trace in the seismic profile and 2,721 traces and 688 sampling points per trace in the acoustic impedance profile. The colors in <xref ref-type="fig" rid="F5">Figure 5A</xref> represent seismic amplitude values, and the colors in <xref ref-type="fig" rid="F5">Figure 5B</xref> represent the acoustic impedance values. Twenty traces of acoustic impedance are uniformly extracted as pseudo-well data, and for each pseudo-logging curve, 2&#xa0;k &#x2b; 1 seismic traces centered on the well-side trace and with k as the radius will be obtained. This paper sets k to 3, and each pseudo-logging curve corresponds to 7 seismic traces with a depth of 688 sampling points. The inverse network is trained using seismic data and pseudo-well data, the training epoch is set to 700, and the batch size is 20 for each iteration. In each training iteration, the weight coefficients in the loss function <inline-formula id="inf14">
<mml:math id="m19">
<mml:mrow>
<mml:mi>&#x3b1;</mml:mi>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf15">
<mml:math id="m20">
<mml:mrow>
<mml:mi>&#x3b2;</mml:mi>
</mml:mrow>
</mml:math>
</inline-formula> are set to 1. The total training loss of the previously described inverse network is calculated and back-propagated through the network.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>The Marmousi2 model. <bold>(A)</bold> Seismic data profile; <bold>(B)</bold> real acoustic impedance profile.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g005.tif"/>
</fig>
<p>The Marmousi2 model has a complex stratigraphic structure and contains many different subsurface layered media models. The mean square error function is chosen as the loss function to measure the mean square error of the predicted and real acoustic impedance. ADAM is chosen as the optimizer, and ADAM adaptively sets the learning rate during training, with the initial learning rate set to 0.001. A weight decay of 0.0001 is chosen to limit the L<sub>2</sub> norm of the weights from becoming too large, reducing the risk of overfitting the network. The network&#x2019;s training is implemented in the PyTorch framework, and GPUs are applied to accelerate the computation. Finally, the trained inverse network is used for acoustic impedance inversion.</p>
<p>In order to prove the effectiveness of this paper&#x2019;s method, the inversion results of this paper&#x2019;s inversion method are compared with the inversion results of the commonly used deep learning inversion methods, including the inversion method based on CNN (<xref ref-type="bibr" rid="B6">Das et al., 2019</xref>), the inversion method based on 1D TCN (<xref ref-type="bibr" rid="B12">Mustafa et al., 2019</xref>), and the inversion method based on 1D U-Net. This 1D U-net model is constructed into the same network structure as the U-net proposed in this paper, but it lacks an attention mechanism. These inverse networks are set up with the same training conditions, training data, and hyperparameters. The inversion result of the method based on CNN is shown in <xref ref-type="fig" rid="F6">Figure 6A</xref>, the inversion result of the method based on 1D TCN is shown in <xref ref-type="fig" rid="F6">Figure 6C</xref>, the inversion result of the method based on 1D U-Net is shown in <xref ref-type="fig" rid="F6">Figure 6E</xref>, and the inversion result of the method proposed in this paper is shown in <xref ref-type="fig" rid="F6">Figure 6G</xref>. <xref ref-type="fig" rid="F6">Figures 6B, D, F, H</xref> correspond to the residual difference between each network&#x2019;s inverse acoustic impedance and the real acoustic impedance.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Acoustic impedance inversion profiles and residual profiles on the Marmousi2 model. <bold>(A)</bold> Inversion result of CNN method and its residual <bold>(B)</bold>. <bold>(C)</bold> Inversion result of TCN method and its residual <bold>(D)</bold>. <bold>(E)</bold> Inversion result of U-Net method and its residual <bold>(F)</bold>. <bold>(G)</bold> Inversion result of the method in this paper and its residual <bold>(H)</bold>.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g006.tif"/>
</fig>
<p>As shown in <xref ref-type="fig" rid="F6">Figure 6</xref>, the inversion results shown in <xref ref-type="fig" rid="F6">Figures 6E, G</xref> have a higher similarity to the real model than the inversion results in <xref ref-type="fig" rid="F6">Figures 6A, C</xref>. Moreover, <xref ref-type="fig" rid="F6">Figure 6G</xref> has stronger horizontal continuity and weaker visible jitter in both horizontal and vertical directions for the inverse acoustic impedance profile than <xref ref-type="fig" rid="F6">Figure 6E</xref>, the water layer at the top of the figure also clearly shows a relatively better inversion of <xref ref-type="fig" rid="F6">Figure 6G</xref>. The partition interface and fault location in different strata are the main locations where the inversion results show errors, according to the residual profiles. In comparison to other figures in <xref ref-type="fig" rid="F6">Figure 6</xref>, the inversion method in this paper can also invert the convolution structure in the model well, and the inversion results are more continuous and closer to the actual acoustic impedance, as well as more accurate in predicting the location of the faults. In most locations, the error is lower than that of other inversion methods. This is due to the effective use of the inversion network proposed in this paper for the spatial correlation of seismic data&#x2019;s horizontal direction.</p>
<p>In order to compare the details of the inversion results of different methods from the microscopic level, the representative Trace No. 570 (corresponding to the position around x &#x3d; 3,565&#xa0;m) and Trace No. 1400 (corresponding to the position around x &#x3d; 8,747&#xa0;m) are selected for inversion.</p>
<p>At these two locations, the acoustic impedance values obtained by four inversion methods were compared. <xref ref-type="fig" rid="F7">Figures 7A&#x2013;D</xref> shows the inversion results of Trace No. 570 using the conventional CNN inversion method, the 1D TCN inversion method, the 1D U-Net inversion method, and the method proposed in this paper, with the red and black lines representing the true impedance and acoustic impedance inversion results, respectively. Similar to the inversion results of the four networks mentioned above for all seismic traces, the inversion result of the method in this paper is relatively better. The inversion result in <xref ref-type="fig" rid="F7">Figure 7A</xref> has a large inversion error at a large depth, the inversion result in <xref ref-type="fig" rid="F7">Figure 7B</xref> is very different from the true value, and the inversion result in <xref ref-type="fig" rid="F7">Figure 7C</xref> changes too drastically, whereas the difference between the inversion result and the actual acoustic impedance in <xref ref-type="fig" rid="F7">Figure 7D</xref> is very small, with the two curves almost overlapping.</p>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Acoustic impedance inversion results of trace no. 570. <bold>(A)</bold> Inversion result of the CNN method. <bold>(B)</bold> Inversion result of the TCN method. <bold>(C)</bold> Inversion result of the 1D U-Net method. <bold>(D)</bold> Inversion result of the method in this paper.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g007.tif"/>
</fig>
<p>
<xref ref-type="fig" rid="F8">Figures 8A&#x2013;D</xref> corresponds to the inversion results of the above four methods for Trace No. 1400 seismic trace, respectively, and the conclusions are consistent with <xref ref-type="fig" rid="F7">Figure 7</xref>. The inversion results of <xref ref-type="fig" rid="F8">Figures 8A, B</xref> in the figure deviate more from the true values. The inversion results of <xref ref-type="fig" rid="F8">Figures 8C, D</xref> are in better agreement with the actual curves, but between sampling points 0 and 100, the inversion of <xref ref-type="fig" rid="F8">Figure 8D</xref> is better, while the curve change of the inversion result of <xref ref-type="fig" rid="F8">Figure 8C</xref> is too drastic. This further validates the performance of the inversion network proposed in this paper.</p>
<fig id="F8" position="float">
<label>FIGURE 8</label>
<caption>
<p>Acoustic impedance inversion results of trace no. 1400. <bold>(A)</bold> Inversion result of the CNN method. <bold>(B)</bold> Inversion result of the TCN method. <bold>(C)</bold> Inversion result of the 1D U-Net method. <bold>(D)</bold> Inversion result of the method in this paper.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g008.tif"/>
</fig>
<p>In order to objectively and quantitatively evaluate the reliability of the inversion results of the four methods, the coefficients <italic>R</italic>
<sup>2</sup> and MSE are used as evaluation criteria. <xref ref-type="table" rid="T1">Table 1</xref> shows the MSE and <italic>R</italic>
<sup>2</sup> between the acoustic impedance inversion results of different methods in <xref ref-type="fig" rid="F6">Figure 6</xref> and the actual acoustic impedance.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>MSE, <italic>R</italic>
<sup>2</sup> between inversion results and actual acoustic impedance.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center">Methods</th>
<th align="center">MSE</th>
<th align="center">
<italic>R</italic>
<sup>2</sup>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">CNN</td>
<td align="center">0.0897</td>
<td align="center">0.9090</td>
</tr>
<tr>
<td align="center">TCN</td>
<td align="center">0.0540</td>
<td align="center">0.9452</td>
</tr>
<tr>
<td align="center">U-Net</td>
<td align="center">0.0343</td>
<td align="center">0.9653</td>
</tr>
<tr>
<td align="center">Attention U-Net</td>
<td align="center">0.0199</td>
<td align="center">0.9800</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>
<xref ref-type="table" rid="T1">Table 1</xref> shows that this paper employs multichannel inversion, and the method of acoustic impedance inversion by Attention U-Net using spatial correlation performs best in terms of MSE and <italic>R</italic>
<sup>2</sup>, demonstrating the method&#x2019;s efficacy.</p>
<p>Gaussian noise of 4%, 8%, and 12% was added to the seismic data to test the adaptability of the method proposed in this paper to noise. <xref ref-type="table" rid="T2">Table 2</xref> shows the quantitative evaluation of the inversion results obtained from the different inversion networks in <xref ref-type="fig" rid="F6">Figure 6</xref> under different noise conditions. As shown in <xref ref-type="table" rid="T2">Table 2</xref>, the performance of each method&#x2019;s inversion results decreases as noise increases relative to a noiseless environment, but the performance index of the method proposed in this paper decreases the least. For example, when the noise of the seismic data increases from 4% to 12%, the <italic>R</italic>
<sup>2</sup> coefficients of the inversion results of CNN, TCN, U-Net, and the proposed method decreased by 7.43%, 2.85%, 4.83%, and 1.38%, respectively. Observing the changes in MSE data leads to a similar conclusion. It can be seen that the proposed method in this paper has better noise immunity performance compared with other methods.</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>MSE, <italic>R</italic>
<sup>2</sup> between inversion results and actual acoustic impedance under different noise conditions.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th rowspan="2" align="center">Indicator&#x3001;SNR methods</th>
<th colspan="3" align="center">MSE</th>
<th colspan="3" align="center">
<italic>R</italic>
<sup>2</sup>
</th>
</tr>
<tr>
<th align="center">4%</th>
<th align="center">8%</th>
<th align="center">12%</th>
<th align="center">4%</th>
<th align="center">8%</th>
<th align="center">12%</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">CNN</td>
<td align="center">0.1146</td>
<td align="center">0.1404</td>
<td align="center">0.1787</td>
<td align="center">0.8836</td>
<td align="center">0.8571</td>
<td align="center">0.8180</td>
</tr>
<tr>
<td align="center">TCN</td>
<td align="center">0.0622</td>
<td align="center">0.0742</td>
<td align="center">0.0886</td>
<td align="center">0.9375</td>
<td align="center">0.9253</td>
<td align="center">0.9108</td>
</tr>
<tr>
<td align="center">U-Net</td>
<td align="center">0.0454</td>
<td align="center">0.0729</td>
<td align="center">0.0911</td>
<td align="center">0.9540</td>
<td align="center">0.9261</td>
<td align="center">0.9079</td>
</tr>
<tr>
<td align="center">Attention U-Net</td>
<td align="center">0.0244</td>
<td align="center">0.0285</td>
<td align="center">0.0375</td>
<td align="center">0.9751</td>
<td align="center">0.9711</td>
<td align="center">0.9616</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s3-2">
<title>3.2 SEAM model inversion experiments</title>
<p>To further verify the feasibility of the method, this paper conducts experiments with the SEAM model. The SEAM model is open source and also widely used for the validation of deep learning inversion methods (<xref ref-type="bibr" rid="B13">Mustafa et al., 2021</xref>). The SEAM model is a 3D seismic survey with very drastic lateral variations in density and longitudinal wave velocity, which is challenging for the inversion algorithm. The SEAM model is constructed based on basic rock properties, such as the volume of shale and sand. It follows the changing trend of shale porosity characteristics in the Gulf of Mexico, which is a better simulation of the actual geological conditions. The density of the SEAM model and the longitudinal wave velocity model are multiplied to obtain the real acoustic impedance model. The seismic data and the real acoustic impedance profiles are shown in <xref ref-type="fig" rid="F9">Figures 9A, B</xref>, respectively, with 501 traces and 688 sampling points per trace in the seismic profile and 501 traces and 688 sampling points per trace in the acoustic impedance profile. 12 traces of acoustic impedance are uniformly extracted from the acoustic impedance model as pseudo-well data, and k is also set to 3, so that each pseudo-logging curve corresponds to 7 seismic traces with a depth of 688 sampling points. The training epoch is set to 400, and the batch size is 12 for each iteration. The network is then trained in the same way as the Marmousi2 model, and the trained network is used to perform acoustic impedance inversion on all seismic traces.</p>
<fig id="F9" position="float">
<label>FIGURE 9</label>
<caption>
<p>SEAM model. <bold>(A)</bold> Seismic data profile. <bold>(B)</bold> Real acoustic impedance profile.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g009.tif"/>
</fig>
<p>The inversion results are shown in <xref ref-type="fig" rid="F10">Figure 10</xref>. <xref ref-type="fig" rid="F10">Figures 10A, C, E</xref> correspond to the results of the inversion based on the conventional CNN inversion method, the 1D U-Net inversion method, and the inversion of the proposed method in this paper, respectively. <xref ref-type="fig" rid="F10">Figures 10B, D, F</xref> correspond to the residuals between the acoustic impedance and the real acoustic impedance inverted by each method, respectively. As can be seen from the figure, compared with <xref ref-type="fig" rid="F10">Figures 10C, E</xref> has a better effect in displaying the stratigraphic interface in the left half of the depth range of 10,000&#xa0;m to 14,000&#xa0;m, and the strata are clearer. Some thin stratigraphic variations can be clearly observed in the upper left part of <xref ref-type="fig" rid="F10">Figure 10E</xref> diagram between 5,000 and 9,000&#xa0;m depth. For example, at 2,500&#xa0;m depth in the real model, there is a thin arc-shaped stratigraphy that can be seen more clearly in <xref ref-type="fig" rid="F10">Figure 10E</xref>, whereas it is difficult to see in <xref ref-type="fig" rid="F10">Figures 10A, C</xref>, and <xref ref-type="fig" rid="F10">Figure 10A</xref> does not outline the central uplifted area in the real model better. Although the method in this paper has some errors in the inversion of the SEAM model, the overall effect is better than the other two methods.</p>
<fig id="F10" position="float">
<label>FIGURE 10</label>
<caption>
<p>Acoustic impedance inversion profiles and residual profiles on the SEAM model. <bold>(A)</bold> Inversion result of CNN method and its residual <bold>(B)</bold>. <bold>(C)</bold> Inversion result of U-Net method and its residual <bold>(D)</bold>. <bold>(E)</bold> Inversion result of the method in this paper and its residual <bold>(F)</bold>.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g010.tif"/>
</fig>
<p>Trace No. 179 (corresponding to the vicinity of x &#x3d; 12,500&#xa0;m) was selected for the inversion experiment, and the acoustic impedance inversion results of the three inversion methods are shown in <xref ref-type="fig" rid="F11">Figure 11</xref>. <xref ref-type="fig" rid="F11">Figures 11A&#x2013;C</xref> shows the inversion results of Trace No. 179 using the conventional CNN inversion method, the 1D U-Net inversion method, and the method proposed in this paper, with the red and black lines representing the true impedance and acoustic impedance inversion results, respectively. The proposed method has better inversion results compared with other methods. From <xref ref-type="fig" rid="F11">Figure 11C</xref>, we can see that the inversion result obtained by the proposed method almost completely overlaps with the true impedance, while the inversion result of the CNN deviates from the true value, and the result obtained by the 1D U-Net inversion method also has large deviations, with a large deviation at a small depth.</p>
<fig id="F11" position="float">
<label>FIGURE 11</label>
<caption>
<p>Acoustic impedance inversion results of trace no. 179. <bold>(A)</bold> Inversion result of the CNN method. <bold>(B)</bold> Inversion result of the 1D U-net method. <bold>(C)</bold> Inversion result of the method in this paper.</p>
</caption>
<graphic xlink:href="feart-11-1104488-g011.tif"/>
</fig>
<p>To quantitatively evaluate the performance of the method proposed in this paper, the MSE and the <italic>R</italic>
<sup>2</sup> between the acoustic impedance inversion results and the true acoustic impedance are calculated and presented in <xref ref-type="table" rid="T3">Table 3</xref>. The data are the MSE and R<sup>2</sup> between the acoustic impedance and the true acoustic impedance obtained by the inversion of different inversion methods in <xref ref-type="fig" rid="F10">Figure 10</xref>. The data in the table show that the inversion result of the proposed method performs best in terms of MSE and <italic>R</italic>
<sup>2</sup>, which verifies the effectiveness of the method.</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>MSE, <italic>R</italic>
<sup>2</sup> between inversion results and actual acoustic impedance.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="center">Methods</th>
<th align="center">MSE</th>
<th align="center">
<italic>R</italic>
<sup>2</sup>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="center">CNN</td>
<td align="center">0.2659</td>
<td align="center">0.5436</td>
</tr>
<tr>
<td align="center">U-Net</td>
<td align="center">0.1549</td>
<td align="center">0.7991</td>
</tr>
<tr>
<td align="center">Attention U-Net</td>
<td align="center">0.1182</td>
<td align="center">0.8250</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec sec-type="conclusion" id="s4">
<title>4 Conclusion</title>
<p>This paper proposes a multichannel seismic acoustic impedance inversion method based on the Attention U-Net network. Different from the conventional supervised learning inversion method, this inversion method applies the spatial correlation in the horizontal direction to the inversion network, and trains the network with 2&#xa0;k &#x2b; 1 seismic traces centered on the well-side trace and the corresponding logging curve to enhance the lateral continuity. In addition, the Attention U-Net network is used as a feature extraction module in the inversion network, and the attention gating model is added to the traditional U-Net-based inversion network. The AG is used to implicitly learn to suppress irrelevant regions in the input data while emphasizing salient features useful for inversion results, and it can be easily integrated into the standard CNN architecture to reduce computational overhead while improving the model&#x2019;s sensitivity and prediction accuracy. The method&#x2019;s performance is evaluated using the Marmousi2 and SEAM models, and it is also compared to several other commonly used deep learning inversion methods. The results show that the inversion results of the method proposed in this paper are more consistent with the actual acoustic impedance values, and the anti-noise performance is the best. In the SEAM model, where the lateral velocity and density vary drastically, the proposed method can better obtain the stratigraphic structure and details in the true model. These are attributed to the combined application of the attention gating model and methods such as multichannel simultaneous inversion.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s5">
<title>Data availability statement</title>
<p>Publicly available datasets were analyzed in this study. This data can be found here: <ext-link ext-link-type="uri" xlink:href="https://github.com/amustafa9/Geophysics-2021-Joint-learning-for-spatial-context-based-inversion/blob/master/data.zip">https://github.com/amustafa9/Geophysics-2021-Joint-learning-for-spatial-context-based-inversion/blob/master/data.zip</ext-link>.</p>
</sec>
<sec id="s6">
<title>Author contributions</title>
<p>JN responses for the experiments of the work and drafting papers. SL responses for the concept and design of the work and revisions to the paper. ZW and XY responses for important revisions to the papers.</p>
</sec>
<sec id="s7">
<title>Funding</title>
<p>This research was funded by the National Natural Science Foundation of China (Nos. 42164006 and 62161012), the Hunan Provincial Natural Science Foundation of China (No. 2022JJ30474), the China Postdoctoral Science Foundation (No. 2021M700682) and the Scientific Research Fund of Hunan Provincial Education Department (No. 21B0507).</p>
</sec>
<sec sec-type="COI-statement" id="s8">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Aleardi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Salusti</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Elastic prestack seismic inversion through discrete cosine transform reparameterization and convolutional neural networks</article-title>. <source>Geophysics</source> <volume>86</volume> (<issue>1</issue>), <fpage>R129</fpage>&#x2013;<lpage>R146</lpage>. <pub-id pub-id-type="doi">10.1190/geo2020-0313.1</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Alfarraj</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>AlRegib</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2018</year>). &#x201c;<article-title>Petrophysical property estimation from seismic data using recurrent neural networks</article-title>,&#x201d; in <source>SEG technical program expanded abstracts 2018</source> (<publisher-loc>United States</publisher-loc>: <publisher-name>Society of Exploration Geophysicists</publisher-name>). .</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cao</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Su</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Cui</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Multi-parameter pre-stack seismic inversion based on deep learning with sparse reflection coefficient constraints</article-title>. <source>J. Petroleum Sci. Eng.</source> <volume>209</volume>, <fpage>109836</fpage>. <pub-id pub-id-type="doi">10.1016/j.petrol.2021.109836</pub-id>
</citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen</surname>
<given-names>L.-C.</given-names>
</name>
<name>
<surname>Papandreou</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Kokkinos</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Murphy</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Yuille</surname>
<given-names>A. L.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs</article-title>. <source>IEEE Trans. pattern analysis Mach. Intell.</source> <volume>40</volume> (<issue>4</issue>), <fpage>834</fpage>&#x2013;<lpage>848</lpage>. <pub-id pub-id-type="doi">10.1109/tpami.2017.2699184</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="thesis">
<person-group person-group-type="author">
<name>
<surname>Cho</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Van Merri&#xeb;nboer</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Gulcehre</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Bahdanau</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Bougares</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Schwenk</surname>
<given-names>H.</given-names>
</name>
<etal/>
</person-group> (<year>2014</year>). &#x201c;<article-title>Learning phrase representations using RNN encoder-decoder for statistical machine translation</article-title>,&#x201d;. <comment>arXiv preprint arXiv:1406.1078</comment>.</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Das</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Pollack</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Wollner</surname>
<given-names>U.</given-names>
</name>
<name>
<surname>Mukerji</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Convolutional neural network for seismic impedance inversion</article-title>. <source>Geophysics</source> <volume>84</volume> (<issue>6</issue>), <fpage>R869</fpage>&#x2013;<lpage>R880</lpage>. <pub-id pub-id-type="doi">10.1190/geo2018-0838.1</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Du</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Han</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Pre-stack seismic inversion using SeisInv-ResNet</article-title>,&#x201d; in <source>SEG technical program expanded abstracts 2019</source> (<publisher-loc>United States</publisher-loc>: <publisher-name>Society of Exploration Geophysicists</publisher-name>).</citation>
</ref>
<ref id="B8">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Graves</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Mohamed</surname>
<given-names>A.-r.</given-names>
</name>
<name>
<surname>Hinton</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Speech recognition with deep recurrent neural networks</article-title>,&#x201d; in <conf-name>IEEE international conference on acoustics, speech and signal processing</conf-name>, <conf-loc>Singapore</conf-loc>, <conf-date>22-27 May 2022</conf-date>.</citation>
</ref>
<ref id="B9">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Ioffe</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Szegedy</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2022</year>). &#x201c;<article-title>Batch normalization: Accelerating deep network training by reducing internal covariate shift</article-title>,&#x201d; in <conf-name>International conference on machine learning: PMLR</conf-name>, <conf-loc>USA</conf-loc>, <conf-date>25-27 July 2022</conf-date>, <fpage>448</fpage>&#x2013;<lpage>456</lpage>.</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krizhevsky</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Sutskever</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Hinton</surname>
<given-names>G. E.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Imagenet classification with deep convolutional neural networks</article-title>. <source>Commun. ACM</source> <volume>60</volume> (<issue>6</issue>), <fpage>84</fpage>&#x2013;<lpage>90</lpage>. <pub-id pub-id-type="doi">10.1145/3065386</pub-id>
</citation>
</ref>
<ref id="B11">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Martin</surname>
<given-names>G. S.</given-names>
</name>
<name>
<surname>Larsen</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Marfurt</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2002</year>). <source>Marmousi-2: An updated model for the investigation of AVO in structurally complex areas</source>. <publisher-loc>Salt Lake City</publisher-loc>: <publisher-name>SEG Annual Meeting: OnePetro</publisher-name>.</citation>
</ref>
<ref id="B12">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Mustafa</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Alfarraj</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>AlRegib</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Estimation of acoustic impedance from seismic data using temporal convolutional network</article-title>,&#x201d; in <source>SEG technical program expanded abstracts 2019</source> (<publisher-loc>United States</publisher-loc>: <publisher-name>Society of Exploration Geophysicists</publisher-name>). .</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mustafa</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Alfarraj</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>AlRegib</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Joint learning for spatial context-based seismic inversion of multiple data sets for improved generalizability and robustness</article-title>. <source>Geophysics</source> <volume>86</volume> (<issue>4</issue>), <fpage>O37</fpage>&#x2013;<lpage>O48</lpage>. <pub-id pub-id-type="doi">10.1190/geo2020-0432.1</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Nair</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Hinton</surname>
<given-names>G. E.</given-names>
</name>
</person-group> (<year>2010</year>). &#x201c;<article-title>Rectified linear units improve restricted Boltzmann machines</article-title>,&#x201d; in <conf-name>Proceedings of the 27th International Conference on Machine Learning</conf-name>, <conf-loc>Haifa, Israel</conf-loc>, <conf-date>June 21-24, 2010</conf-date>.</citation>
</ref>
<ref id="B15">
<citation citation-type="thesis">
<person-group person-group-type="author">
<name>
<surname>Oktay</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Schlemper</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Folgoc</surname>
<given-names>L. L.</given-names>
</name>
<name>
<surname>Lee</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Heinrich</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Misawa</surname>
<given-names>K.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). &#x201c;<article-title>Attention u-net: Learning where to look for the pancreas</article-title>,&#x201d;. <comment>arXiv preprint arXiv:1804.03999</comment>.</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ren</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>He</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Girshick</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Faster r-cnn: Towards real-time object detection with region proposal networks</article-title>. <source>Adv. neural Inf. Process. Syst.</source> <volume>28</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1109/TPAMI.2016.2577031</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Ronneberger</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Fischer</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Brox</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2015</year>). &#x201c;<article-title>U-net: Convolutional networks for biomedical image segmentation</article-title>,&#x201d; in <conf-name>International Conference on Medical image computing and computer-assisted intervention</conf-name>, <conf-loc>Germany</conf-loc>, <conf-date>October 8-12, 2023</conf-date>.</citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Treitel</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Lines</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Past, present, and future of geophysical inversion&#x2014;a new millennium analysis</article-title>. <source>Geophysics</source> <volume>66</volume> (<issue>1</issue>), <fpage>21</fpage>&#x2013;<lpage>24</lpage>. <pub-id pub-id-type="doi">10.1190/1.1444898</pub-id>
</citation>
</ref>
<ref id="B19">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Vinyals</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Toshev</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Bengio</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Erhan</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2022</year>). &#x201c;<article-title>"Show and tell: A neural image caption generator</article-title>,&#x201d; in <conf-name>Proceedings of the IEEE conference on computer vision and pattern recognition</conf-name>, <conf-loc>San Juan, PR, USA</conf-loc>, <conf-date>17-19 June 1997</conf-date>.</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Ge</surname>
<given-names>Q.</given-names>
</name>
<name>
<surname>Lu</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Yan</surname>
<given-names>X.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Well-logging constrained seismic inversion based on closed-loop convolutional neural network</article-title>. <source>IEEE Trans. Geoscience Remote Sens.</source> <volume>58</volume> (<issue>8</issue>), <fpage>5564</fpage>&#x2013;<lpage>5574</lpage>. <pub-id pub-id-type="doi">10.1109/tgrs.2020.2967344</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wu</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Meng</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Seismic impedance inversion using fully convolutional residual network and transfer learning</article-title>. <source>IEEE Geoscience Remote Sens. Lett.</source> <volume>17</volume> (<issue>12</issue>), <fpage>2140</fpage>&#x2013;<lpage>2144</lpage>. <pub-id pub-id-type="doi">10.1109/lgrs.2019.2963106</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wu</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Yan</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Bi</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Si</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Deep learning for multidimensional seismi impedance inversion</article-title>. <source>Geophysics</source> <volume>86</volume> (<issue>5</issue>), <fpage>R735</fpage>&#x2013;<lpage>R745</lpage>. <pub-id pub-id-type="doi">10.1190/geo2020-0564.1</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Wu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>He</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2012</year>). &#x201c;<article-title>Group normalization</article-title>,&#x201d; in <conf-name>Proceedings of the European conference on computer vision (ECCV))</conf-name>, <conf-loc>Florence Italy</conf-loc>, <conf-date>October 7 - 13</conf-date>, <fpage>3</fpage>&#x2013;<lpage>19</lpage>.,</citation>
</ref>
</ref-list>
</back>
</article>