<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Genet.</journal-id>
<journal-title>Frontiers in Genetics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Genet.</abbrev-journal-title>
<issn pub-type="epub">1664-8021</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">957718</article-id>
<article-id pub-id-type="doi">10.3389/fgene.2022.957718</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Genetics</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Development of a joint diagnostic model of thyroid papillary carcinoma with artificial neural network and random forest</article-title>
<alt-title alt-title-type="left-running-head">Wang et al.</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fgene.2022.957718">10.3389/fgene.2022.957718</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Wang</surname>
<given-names>Shoufei</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Liu</surname>
<given-names>Wenfei</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ye</surname>
<given-names>Ziheng</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Xia</surname>
<given-names>Xiaotian</given-names>
</name>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Guo</surname>
<given-names>Minggao</given-names>
</name>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/775961/overview"/>
</contrib>
</contrib-group>
<aff>
<institution>Department of Thyroid, Parathyroid, Breast, and Hernia Surgery</institution>, <institution>Shanghai Sixth People&#x2019;s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine</institution>, <addr-line>Shanghai</addr-line>, <country>China</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/644381/overview">Manal S. Fawzy</ext-link>, Suez Canal University, Egypt</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1108585/overview">Eman Toraih</ext-link>, Tulane University, United States</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/745193/overview">Bailing Zhou</ext-link>, Dezhou University, China</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Minggao Guo, <email>guominggao203@163.com</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Cancer Genetics and Oncogenomics, a section of the journal Frontiers in Genetics</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>07</day>
<month>10</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>957718</elocation-id>
<history>
<date date-type="received">
<day>31</day>
<month>05</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>21</day>
<month>09</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2022 Wang, Liu, Ye, Xia and Guo.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Wang, Liu, Ye, Xia and Guo</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>
<bold>Objective:</bold> Papillary thyroid carcinoma (PTC) accounts for 80% of thyroid malignancy, and the occurrence of PTC is increasing rapidly. The present study was conducted with the purpose of identifying novel and important gene panels and developing an early diagnostic model for PTC by combining artificial neural network (ANN) and random forest (RF).</p>
<p>
<bold>Methods and results:</bold> Samples were searched from the Gene Expression Omnibus (GEO) database, and gene expression datasets (GSE27155, GSE60542, and GSE33630) were collected and processed. GSE27155 and GSE60542 were merged into the training set, and GSE33630 was defined as the validation set. Differentially expressed genes (DEGs) in the training set were obtained by &#x201c;limma&#x201d; of R software. Then, Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) enrichment analysis as well as immune cell infiltration analysis were conducted based on DEGs. Important genes were identified from the DEGs by random forest. Finally, an artificial neural network was used to develop a diagnostic model. Also, the diagnostic model was validated by the validation set, and the area under the receiver operating characteristic curve (AUC) value was satisfactory.</p>
<p>
<bold>Conclusion:</bold> A diagnostic model was established by a joint of random forest and artificial neural network based on a novel gene panel. The AUC showed that the diagnostic model had significantly excellent performance.</p>
</abstract>
<kwd-group>
<kwd>papillary thyroid carcinoma</kwd>
<kwd>random forest</kwd>
<kwd>artificial neural network</kwd>
<kwd>early diagnostic</kwd>
<kwd>biomarker</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>Thyroid cancer (TC), accounting for 3.4% of all cancers diagnosed annually, is the most common endocrine malignancy (<xref ref-type="bibr" rid="B19">Seib and Sosa, 2019</xref>). TC was divided into three types: differentiated thyroid cancer, representing over 90% of thyroid cancer, consists of papillary thyroid carcinoma (PTC) and follicular thyroid carcinoma (FTC). In addition, anaplastic thyroid cancer (ATC, 1%) and poorly differentiated thyroid cancer (PDTC, 5%) are rare tumors (<xref ref-type="bibr" rid="B18">Prete et al., 2020</xref>). With the popularization of physical examination, the incidence of PTC has increased rapidly (<xref ref-type="bibr" rid="B29">Wang and Sosa, 2018</xref>). PTC is usually an inert and curable tumor with a 10-year survival rate&#x3e;90% (<xref ref-type="bibr" rid="B1">Alvarado et al., 2009</xref>). However, more than 25% of advanced-stage PTC patients are characterized by their invasiveness and metastasis; these traits usually result in poor prognosis (<xref ref-type="bibr" rid="B8">Huang et al., 2021</xref>). Among PTC patients, cervical lymph node metastasis (LNM) occurs in 50%&#x2013;80% of patients, which is a tested risk factor for recurrence and a reduced survival rate (<xref ref-type="bibr" rid="B16">Ling et al., 2021</xref>). Distant metastasis occurs in 2% of advanced-stage PTC, which is the main reason for death. Lung is the most common metastatic site (53.4%), and 26.3% presented with the multiple-organ metastasis (<xref ref-type="bibr" rid="B23">Toraih et al., 2021</xref>). So, we intended to discover novel and important gene panels and develop a diagnostic model for PTC of early stage.</p>
<p>The availability of microarray technology and more precise RNA-sequencing technology improves the research of disease pathogenesis (<xref ref-type="bibr" rid="B32">Xie et al., 2020</xref>). Discovering the most meaningful variables for classification is the primary question about developing a classification model using gene expression data. To resolve this, a variety of machine learning algorithm, including random forest (RF) (<xref ref-type="bibr" rid="B12">Kursa, 2014</xref>; <xref ref-type="bibr" rid="B2">Cai et al., 2015</xref>) and artificial neural network (ANN) (<xref ref-type="bibr" rid="B3">Chen et al., 2014</xref>), were used. Differing from common statistical methods, machine learning involves learning from cases (<xref ref-type="bibr" rid="B24">Van Calster et al., 2019</xref>). Therefore, RF and ANN were joined to develop a novel diagnostic model of PTC by learning from the training set and then testing the model in the validation set. The results of this study reveal a novel gene panel for early clinical diagnosis of PTC.</p>
</sec>
<sec sec-type="materials|methods" id="s2">
<title>Materials and methods</title>
<sec id="s2-1">
<title>Research design</title>
<p>The study flowchart is shown in <xref ref-type="fig" rid="F1">Figure 1</xref>. Three gene expression datasets (GSE27155, GSE60542 and GSE33630) were collected from the GEO database. GSE27155 and GSE60542 were integrated into the training set, and GSE33630 was selected as the validation set. Differentially expressed genes (DEGs) were defined by the R package &#x201c;limma.&#x201d; Gene Ontology (GO) function enrichment analyses and Kyoto Encyclopedia of Genes and Genomes (KEGG) pathway enrichment analyses were conducted through the &#x201c;clusterProfiler&#x201d; package of R based on the DEGs in the training set. Also, immune cell infiltration analysis was performed by R. We determined 10 important genes through random forest from the DEGs by the &#x201c;randomForest&#x201d; package. Further, an artificial neural network diagnostic model was established through the &#x201c;neuralnet&#x201d; package using the 10 important genes and was assessed by AUC. Finally, the validity of the ANN diagnostic model was validated with the performance of a validation set.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Flowchart.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g001.tif"/>
</fig>
</sec>
<sec id="s2-2">
<title>Data download and process</title>
<p>The GSE27155, GSE60542, and GSE33630 datasets were collected <italic>via</italic> the Gene Expression Omnibus database (GEO; <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/geo/">https://www.ncbi.nlm.nih.gov/geo/</ext-link>). Then, gene names were obtained by transforming probe names by R software. If several probes could be matched to identical gene, the expression data with gene was replaced by its mean expression value. Finally, 55 samples (4 normal samples and 51 PTC samples) in GSE27155, 63 samples (30 normal samples and 33 PTC samples) in GSE60542 and 94 samples (45 normal samples and 49 PTC samples) in GSE33630 were utilized in this research (<xref ref-type="table" rid="T1">Table 1</xref>). GSE27155 and GSE60542 were combined into a training set, and GSE33630 as a validation set.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Source of datasets.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Datasets</th>
<th align="left">Platform</th>
<th align="left">Normal</th>
<th align="left">PTC</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">GSE27155</td>
<td align="left">GPL96</td>
<td align="left">4</td>
<td align="left">51</td>
</tr>
<tr>
<td align="left">GSE60542</td>
<td align="left">GPL570</td>
<td align="left">30</td>
<td align="left">33</td>
</tr>
<tr>
<td align="left">GSE33630</td>
<td align="left">GPL570</td>
<td align="left">45</td>
<td align="left">49</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2-3">
<title>Screening for differentially expressed genes</title>
<p>Differentially expressed genes (DEGs) were identified in 34 normal samples and 84 PTC samples of the training set through the R package &#x201c;limma&#x201d; using the classic Bayesian data analysis. &#x7c;log2FC&#x7c; &#x3e;1.5 and adjusted <italic>p</italic> Value &#x3c;0.05 were set as threshold. Then, we obtained 94 DEGs involving 53 up-regulated genes and 41 down-regulated genes. R package &#x201c;pheatmap&#x201d; and &#x201c;ggplot2&#x201d; were utilized to conduct the heatmap and volcano plot.</p>
</sec>
<sec id="s2-4">
<title>Gene Ontology function and Kyoto Encyclopedia of Genes and Genomes pathway enrichment analysis</title>
<p>To explore the biological significance of these DEGs, Gene Ontology (GO) enrichment analysis (adjusted <italic>p</italic> value &#x3c; 0.05) categorizing genes into biological process (BP), cellular component (CC), and molecular function (MF) was performed. Meantime, Kyoto Encyclopedia of Genes and Genomes (KEGG) enrichment analysis was used to describe metabolic pathways (<italic>p</italic> value &#x3c; 0.05). Enrichment analysis of DEGs was conducted through the R package &#x201c;clusterProfiler.&#x201d;</p>
</sec>
<sec id="s2-5">
<title>Immune cell infiltration analysis</title>
<p>As a crucial component of the tumor environment, immune cells impacted the development and prognosis of tumors, their composition as well as function in various types of tumors were different. On the one hand, some immune cells have the roles to be favorable targets for immunotherapy. On the other hand, some may react negatively, even resulting in drug resistance. Given these causes, figuring out the ingredient and possible influence of immune cells in PTC was beneficial to identify valuable therapeutic targets. We downloaded a reference including human gene expression in immune cells. Then, we exploited the reference and a file including the gene expression of each sample to complete immune cell infiltration analysis and obtain the result involving the expression of immune cells of each sample by R software. Based on the result, we performed correlation analysis of immune cell by the &#x201c;corrplot&#x201d; package and difference analysis of immune cells by the &#x201c;vioplot&#x201d; package.</p>
</sec>
<sec id="s2-6">
<title>Random forest analysis to determine important genes</title>
<p>The important genes were identified by a random forest classifier <italic>via</italic> &#x201c;randomForest&#x201d; package of R. Firstly, the parameter &#x201c;ntree&#x201d; was set as 500 to find the best number of trees. By calculating the error of cross validation, 15 was selected as the best number of trees represented the minimum error of cross validation. Then, parameter 15 was used to reconduct random forest and the importance score of genes was obtained. Genes with an importance score greater than 2 were seen as PTC significantly related genes. The R package &#x201c;heatmap&#x201d; was utilized to draw a heatmap based on important genes.</p>
</sec>
<sec id="s2-7">
<title>Development and validation of an artificial neural network model</title>
<p>Based on 10 important genes identified by RF, an artificial neural network model was developed <italic>via</italic> the R package &#x201c;neuralnet.&#x201d; At first, the expression of 10 important genes was converted into &#x201c;gene tag&#x201d; based on their expression levels. In the case of a certain sample, the expression level of a specific gene was compared to the median of all sample expression level. Among the up-regulated genes, if the expression level is higher than the median, it will be valued as 1, otherwise 0. Among the down-regulated gene, if expression level is higher than median, it will be valued as 0, otherwise 1. Then, we finished a &#x201c;gene tag&#x201d; sheet. Next, the hidden layers of ANN were set as 5 to obtain a gene weight calculated by &#x201c;gene tag&#x201d;. Finally, the ANN diagnostic model was established. We assessed the model in the training set. Also, we validated the model in the validation set, and its diagnostic performance was evaluated by AUC.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec id="s3-1">
<title>Differential expression analysis</title>
<p>In total, 53 significantly up-regulated genes and 41 significantly down-regulated genes were determined between normal samples and PTC samples based on &#x7c;log2FC&#x7c; &#x3e;1.5 and adjusted <italic>p</italic> value &#x3c;0.05 as threshold in training sets GSE27155 and GSE60542. Heatmaps (<xref ref-type="fig" rid="F2">Figure 2A</xref>) and volcano plots (<xref ref-type="fig" rid="F2">Figure 2B</xref>) of DEGs showed favorable discrimination of gene expression.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Heatmap and volcano plot of DEGs. <bold>(A)</bold> The heatmap of differential expression analysis result. The colors of the heatmap, from red to blue, indicate high to low expression of genes in normal and PTC samples. On the upper part of the heatmap, the blue band represents normal samples and the red band stands for PTC samples. <bold>(B)</bold> The volcano plot of DEGs. The <italic>X</italic>-axis is logFC, and the <italic>Y</italic>-axis is &#x2013;log10 (adj.<italic>p</italic> value). The high-expression genes&#x2019; adj. <italic>p</italic> value &#x3c;0.05 and logFC &#x3e;1.5 are located on the top-right. The down-regulated genes&#x2019; adj. <italic>p</italic> value &#x3c;0.05 and logFC &#x3c; -1.5 are located on the top-left. In addition, the black dots indicate the remaining stable genes.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g002.tif"/>
</fig>
</sec>
<sec id="s3-2">
<title>Gene Ontology/Kyoto Encyclopedia of Genes and Genomes enrichment analysis</title>
<p>To reveal the biological importance of DEGs in the mechanism of PTC, we conducted GO and KEGG enrichment analysis using the package &#x201c;clusterProfiler&#x201d; of R software. Amid GO enrichment analysis results (adjusted <italic>p</italic> value cutoff &#x3d; 0.05), concerning BP included wound healing, regulation of body fluid levels, blood coagulation and hemostasis; CC involved collagen-containing extracellular matrix; MF contained extracellular matrix structural constituents and other important functions (<xref ref-type="fig" rid="F3">Figure 3A</xref>). KEGG pathway enrichment analysis (<italic>p</italic> value cutoff &#x3d; 0.05) indicated that the DEGs were significantly related to tyrosine metabolism, complement and coagulation cascades, ECM&#x2013;receptor interaction, and cell adhesion molecules (<xref ref-type="fig" rid="F3">Figure 3B</xref>).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>The results of GO and KEGG enrichment analysis. <bold>(A)</bold> The GO function enrichment analysis of DEGs. The <italic>X</italic>-axis stands for count of genes. The <italic>Y</italic>-axis represents BP, CC, and MF. <bold>(B)</bold> The KEGG pathways enrichment analysis of DEGs. The abscissa shows the count of genes, and the ordinate exhibits pathways.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g003.tif"/>
</fig>
</sec>
<sec id="s3-3">
<title>Immune cell infiltration analysis</title>
<p>We utilized a reference including human gene expression in immune cells and a file involving gene expression of each sample to perform immune cell infiltration analysis. Then, we conducted difference analysis of immune cells by the &#x201c;vioplot&#x201d; package and correlation analysis of immune cells by the &#x201c;corrplot&#x201d; package. Compared with normal samples, T cells gamma delta, macrophages M2, dendritic cells resting, dendritic cells activated and mast cells resting were higher in PTC samples (<italic>p</italic> &#x3c; 0.05). Conversely, macrophages M1, mast cells activated, and eosinophils were lower in PTC(<italic>p</italic> &#x3c; 0.05) (<xref ref-type="fig" rid="F4">Figure 4A</xref>). And macrophages M1 were correlated with dendritic cells activated and T cells gamma delta (correlation, 0.46 and 0.47) (<xref ref-type="fig" rid="F4">Figure 4B</xref>).</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>The results of immune cell infiltration analysis. <bold>(A)</bold> The distribution of immune cells between normal samples and PTC samples. The abscissa shows various immune cells, and the ordinate shows fraction. <italic>p</italic> &#x3c; 0.05 was regarded as statistically significant. <bold>(B)</bold> Correlation analysis of immune cells. The abscissa and ordinate are on behalf of immune cells, and the number stands for correlation. Red color represents a positive correlation, and blue color represents a negative correlation. The larger absolute value or deeper color explains the higher correlation.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g004.tif"/>
</fig>
</sec>
<sec id="s3-4">
<title>Diagnosis-related important genes with random forest</title>
<p>We performed a random forest based on 94 DEGs to determine important genes. Considering the relationship plot between error of cross validation and the number of decision trees, we chose 15 trees as the parameter of the final model, which revealed a minimum error of cross validation in the model (<xref ref-type="fig" rid="F5">Figure 5A</xref>). Eventually, 10 important genes were determined on the condition that their importance score was greater than 2 for the following analysis (<xref ref-type="fig" rid="F5">Figure 5B</xref>). Amid the 10 important genes, GALNT7 was the most important. With heatmap, 10 important genes could be differed from normal samples and PTC samples. Among them, CITED1, AMIGO2, PSD3, GALNT7, and PROS1 were down-regulated in normal samples and up-regulated in PTC samples. TFF3, SLC4A4, AOX1, IPCEF1, and TFCP2L1 were up-regulated in normal samples and down-regulated in PTC samples (<xref ref-type="fig" rid="F5">Figure 5C</xref>).</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>
<bold>(A)</bold> Correlation between the number of decision trees and the error of cross validation. The number of decision trees is shown on the abscissa; the error of cross validation is exhibited on the ordinate. The best number of decision trees was 15 for which the error of cross validation was minimum. <bold>(B)</bold> The <italic>X</italic>-axis stands for the importance score of genes calculated by the Gini coefficient method. The <italic>Y</italic>-axis represents the names of genes. <bold>(C)</bold> The heatmap of 10 important genes determined by random forest. Red color represents up-regulated genes in both samples, and blue color is on behalf of down-regulated genes in both samples. Above the picture, PTC samples are showed as a red band, and blue band indicates normal samples.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g005.tif"/>
</fig>
</sec>
<sec id="s3-5">
<title>Development and validation of an artificial neural network model</title>
<p>Expression of important genes determined by RF was transformed into &#x201c;gene tag&#x201d; marked as 0/1. The weight of all genes was calculated for optimal discrimination between normal samples and PTC samples. Then, an ANN diagnostic model based on gene weight was established (<xref ref-type="fig" rid="F6">Figure 6</xref>). Performance of the model had an AUC of 0.988 (<xref ref-type="fig" rid="F7">Figure 7A</xref>) in the training set and 0.968 (<xref ref-type="fig" rid="F7">Figure 7B</xref>) in the validation set, indicating that the model was very satisfactory in diagnosing PTC. The results demonstrated that we had developed a precise diagnostic model between PTC and normal samples.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>The visualization of the ANN diagnostic model. The neural network topology with 10 input layers consists of important genes; 5 hidden layers; and 2 output layers, including normal and PTC.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g006.tif"/>
</fig>
<fig id="F7" position="float">
<label>FIGURE 7</label>
<caption>
<p>Assessment and testification of the ANN diagnostic model by the ROC curve. <bold>(A)</bold> The assessment result of the training set; <bold>(B)</bold> the testification result of the validation set.</p>
</caption>
<graphic xlink:href="fgene-13-957718-g007.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>To date, employment of machine learning algorithms and wide application of gene expression data in public databases offer methods to find biomarkers for cancer diagnosis in a list of fields (<xref ref-type="bibr" rid="B27">Wang et al., 2018</xref>; <xref ref-type="bibr" rid="B21">Tabl et al., 2019</xref>). The integration of RF and ANN can be employed to establish a stable diagnostic model for some diseases, like ulcerative colitis and abdominal aortic aneurysm (<xref ref-type="bibr" rid="B14">Li et al., 2020</xref>; <xref ref-type="bibr" rid="B5">Duan et al., 2022</xref>). Papillary thyroid carcinoma is characterized by slow progression and good prognosis. Early-stage PTC patients have a high postoperative survival rate, but advanced-stage PTC patients still have the risk of lymph node metastasis and distant metastasis, which seriously affect treatment and prognosis. Though ultrasound is viewed as primary screening approach for PTC, the diagnostic accuracy relying on node size is changeable, especially for nodules &#x2264;10&#xa0;mm (<xref ref-type="bibr" rid="B20">Sutherland et al., 2021</xref>). Other factors such as equipment, scan gain, dynamic range, frequency, and doctors also significantly impact the accuracy of ultrasound diagnosis (<xref ref-type="bibr" rid="B6">Gong et al., 2022</xref>). Owing to the absence of a perfect diagnostic approach and a lack of potential biomarkers that can be utilized in clinical practice, it is critical to establish a model for early diagnosis and screening of PTC.</p>
<p>Among 10 important genes identified by RF, CITED1, AMIGO2, PSD3, GALNT7, and PROS1 were down-up-regulated in normal samples and up-regulated in PTC samples, TFF3, SLC4A4, AOX1, IPCEF1, and TFCP2L1 were up-regulated in normal samples and down-regulated in PTC samples. Then, an ANN diagnostic model was established, and the performance was assessed by AUC (0.988). Also, we testified the diagnostic ability in the validation set and the AUC was 0.968, which had great efficiency. Together, the developed diagnostic model could offer a novel perspective on our research of the mechanism of PTC.</p>
<p>In a previous study, 9 genes have been verified among 10 important genes related to PTC. The incidence and progression of a series of malignancies are relevant to the high expression of Polypeptide N-Acetylgalactosaminyltransferase7 (GALNT7) and its family members (<xref ref-type="bibr" rid="B17">Nakagawa et al., 2017</xref>; <xref ref-type="bibr" rid="B4">Detarya et al., 2020</xref>). Wang argued that GALNT7 by activating EGFR/PI3K/AKT kinase pathway to promote cell proliferation and invasion of papillary thyroid cancer (<xref ref-type="bibr" rid="B31">Wang et al., 2021a</xref>). In recent years, various human Pleckstrin and sec7 domain-containing 3 (PSD3) have been believed to be related to some tumors, like acute myeloid leukemia (<xref ref-type="bibr" rid="B26">Walker et al., 2021</xref>), breast cancer metastasis (<xref ref-type="bibr" rid="B22">Thomassen et al., 2009</xref>), astrocytoma progression (<xref ref-type="bibr" rid="B25">van den Boom et al., 2006</xref>). PSD3 inhibits apoptosis in papillary thyroid cancer by promoting proliferation, migration, invasion and G1/S transition (<xref ref-type="bibr" rid="B9">Jin et al., 2021</xref>). Abnormal expression of Protein S (PROS1) affects human papillary thyroid cancer progression, especially associated with lymph node metastasis (<xref ref-type="bibr" rid="B28">Wang et al., 2021b</xref>). Low expression of SLC4A4 affects invasion, metastasis, and the MAPK signaling pathway in PTC. Huang argued the down-regulation of SLC4A4 might be on account of the excessive iodine intakes of patients (<xref ref-type="bibr" rid="B8">Huang et al., 2021</xref>). Glu/Asp rich carboxy-terminal domain 1 (CITED1) <italic>via</italic> Wnt/&#x3b2;-catenin signaling pathway results in the development of PTC (<xref ref-type="bibr" rid="B30">Wang et al., 2019</xref>). Li showed that CITED1 increased phosphorylation of pRb as well as E2F1 transcriptional activity when p21 and p27 were expressed at low levels, and verified CITED1 was involved in PTC cell proliferation and tumorigenesis (<xref ref-type="bibr" rid="B13">Li et al., 2018</xref>). Yu reported that aldehyde oxidase 1 (AOX1) protein level in blood plasma was lower in patients with PTC, which indicated that AOX1 level in blood plasma had the potential to differ in PTC from healthy humans. Furthermore, low levels of AOX1 were highly related to poor survival of PTC (<xref ref-type="bibr" rid="B33">Yu et al., 2021</xref>). IPCEF1 was viewed as a significant biomarker for PTC. Moreover, a study showed that the hsa_circ_IPCEF1/hsa-miR-3619&#x2013;5p axis was associated with the mechanism of PTC, which offers a new idea for further diagnosis and treatment of PTC (<xref ref-type="bibr" rid="B7">Guo et al., 2021</xref>). Several researchers revealed noticeable differences in Trefoil factor 3 (TFF3) between benign thyroid nodules and thyroid malignancy (<xref ref-type="bibr" rid="B11">Krause et al., 2008</xref>; <xref ref-type="bibr" rid="B10">Karger et al., 2012</xref>). Low expression of TFCP2L1 can promote the progression of PTC and CircHACE1 curbs PTC development by upregulating TFCP2L1 through adsorbing miR-346 (<xref ref-type="bibr" rid="B15">Li et al., 2021</xref>). Interestingly, we identified another important gene, Adhesion Molecule With Ig Like Domain 2 (AMIGO2), which has never been reported to be associated with PTC.</p>
<p>In addition, the research also has several limitations. Firstly, though we have validated 10 significantly PTC-related genes, the sample size is relatively small. Secondly, the ANN diagnostic model was conducted using datasets from the GEO database, so it should be tested in laboratory experiments and clinical practice.</p>
</sec>
<sec sec-type="conclusion" id="s5">
<title>Conclusion</title>
<p>In this study, 10 genetic biomarkers related to PTC were determined and the ANN model established by the 10-gene panel displayed satisfactory performance when diagnosing PTC. Moreover, the present research offers a useful basis for early screening of PTC and promotes further study for development of PTC as well as provides potential genes as targets for clinical treatment. In conclusion, our finding has a certain clinical value that can be valuable for early diagnosis of PTC.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s6">
<title>Data availability statement</title>
<p>The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/<xref ref-type="sec" rid="s1">Supplementary Material</xref>.</p>
</sec>
<sec id="s7">
<title>Author contributions</title>
<p>SW and MG conceived of and designed this study. WL, ZY, and XX made literature searches. SW performed figures and tables. WL and ZY conducted data analysis. SW wrote the manuscript, and MG critically reviewed it. MG supervised the research. All authors have read and approved the final manuscript.</p>
</sec>
<sec sec-type="COI-statement" id="s8">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec id="s10">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fgene.2022.957718/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fgene.2022.957718/full&#x23;supplementary-material</ext-link>
</p>
<supplementary-material xlink:href="Table1.XLS" id="SM1" mimetype="application/XLS" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table4.XLS" id="SM2" mimetype="application/XLS" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table2.XLS" id="SM3" mimetype="application/XLS" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table5.XLS" id="SM4" mimetype="application/XLS" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table3.XLS" id="SM5" mimetype="application/XLS" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Table6.XLS" id="SM6" mimetype="application/XLS" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Alvarado</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Sywak</surname>
<given-names>M. S.</given-names>
</name>
<name>
<surname>Delbridge</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Sidhu</surname>
<given-names>S. B.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Central lymph node dissection as a secondary procedure for papillary thyroid cancer: Is there added morbidity?</article-title> <source>Surgery</source> <volume>145</volume>, <fpage>514</fpage>&#x2013;<lpage>518</lpage>. <pub-id pub-id-type="doi">10.1016/j.surg.2009.01.013</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cai</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Xu</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>Q.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Ngai</surname>
<given-names>S. M.</given-names>
</name>
<name>
<surname>Shao</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Classification of lung cancer using ensemble-based feature selection and machine learning methods</article-title>. <source>Mol. Biosyst.</source> <volume>11</volume>, <fpage>791</fpage>&#x2013;<lpage>800</lpage>. <pub-id pub-id-type="doi">10.1039/c4mb00659c</pub-id> </citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen</surname>
<given-names>Y. C.</given-names>
</name>
<name>
<surname>Ke</surname>
<given-names>W. C.</given-names>
</name>
<name>
<surname>Chiu</surname>
<given-names>H. W.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Risk classification of cancer survival using ANN with gene expression data from multiple laboratories</article-title>. <source>Comput. Biol. Med.</source> <volume>48</volume>, <fpage>1</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1016/j.compbiomed.2014.02.006</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Detarya</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Sawanyawisuth</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Aphivatanasiri</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Chuangchaiya</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Saranaruk</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Sukprasert</surname>
<given-names>L.</given-names>
</name>
<etal/>
</person-group> (<year>2020</year>). <article-title>The O-GalNAcylating enzyme GALNT5 mediates carcinogenesis and progression of cholangiocarcinoma via activation of AKT/ERK signaling</article-title>. <source>Glycobiology</source> <volume>30</volume>, <fpage>312</fpage>&#x2013;<lpage>324</lpage>. <pub-id pub-id-type="doi">10.1093/glycob/cwz098</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Duan</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Xie</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Deng</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Establishment of a combined diagnostic model of abdominal aortic aneurysm with random forest and artificial neural network</article-title>. <source>Biomed. Res. Int.</source> <volume>2022</volume>, <fpage>7173972</fpage>. <pub-id pub-id-type="doi">10.1155/2022/7173972</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gong</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yao</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Yu</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Wei</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Han</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Fang</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2022</year>). <article-title>Ultrasound grayscale ratio: A reliable parameter for differentiating between papillary thyroid microcarcinoma and micronodular goiter</article-title>. <source>BMC Endocr. Disord.</source> <volume>22</volume>, <fpage>75</fpage>. <pub-id pub-id-type="doi">10.1186/s12902-022-00994-9</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Guo</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Ding</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>Y.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Circular RNA profiling reveals a potential role of hsa_circ_IPCEF1 in papillary thyroid carcinoma</article-title>. <source>Mol. Med. Rep.</source> <volume>24</volume>, <fpage>603</fpage>. <pub-id pub-id-type="doi">10.3892/mmr.2021.12241</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huang</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Xiao</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Shao</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Zhou</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Cong</surname>
<given-names>W.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>SLC34A2 up-regulation and SLC4A4 down-regulation correlates with invasion, metastasis, and the MAPK signaling pathway in papillary thyroid carcinomas</article-title>. <source>J. Cancer</source> <volume>12</volume>, <fpage>5439</fpage>&#x2013;<lpage>5453</lpage>. <pub-id pub-id-type="doi">10.7150/jca.56730</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jin</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Zheng</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Bhandari</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Chen</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Xia</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Guan</surname>
<given-names>Y.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>PSD3 is an oncogene that promotes proliferation, migration, invasion, and G1/S transition while inhibits apoptotic in papillary thyroid cancer</article-title>. <source>J. Cancer</source> <volume>12</volume>, <fpage>5413</fpage>&#x2013;<lpage>5422</lpage>. <pub-id pub-id-type="doi">10.7150/jca.60885</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Karger</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Krause</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>GutknechtM.</surname>
</name>
<name>
<surname>Schierle</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Graf</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>SteinertF.</surname>
</name>
<etal/>
</person-group> (<year>2012</year>). <article-title>ADM3, TFF3 and LGALS3 are discriminative molecular markers in fine-needle aspiration biopsies of benign and malignant thyroid tumours</article-title>. <source>Br. J. Cancer</source> <volume>106</volume>, <fpage>562</fpage>&#x2013;<lpage>568</lpage>. <pub-id pub-id-type="doi">10.1038/bjc.2011.578</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Krause</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Eszlinger</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gimm</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Karger</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Engelhardt</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Dralle</surname>
<given-names>H.</given-names>
</name>
<etal/>
</person-group> (<year>2008</year>). <article-title>TFF3-based candidate gene discrimination of benign and malignant thyroid tumors in a region with borderline iodine deficiency</article-title>. <source>J. Clin. Endocrinol. Metab.</source> <volume>93</volume>, <fpage>1390</fpage>&#x2013;<lpage>1393</lpage>. <pub-id pub-id-type="doi">10.1210/jc.2006-1255</pub-id> </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kursa</surname>
<given-names>M. B.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Robustness of Random Forest-based gene selection methods</article-title>. <source>BMC Bioinforma.</source> <volume>15</volume>, <fpage>8</fpage>. <pub-id pub-id-type="doi">10.1186/1471-2105-15-8</pub-id> </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Li</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Guan</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Guo</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Liang</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>He</surname>
<given-names>X.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>CITED1 promotes proliferation of papillary thyroid cancer cells via the regulation of p21 and p27</article-title>. <source>Cell Biosci.</source> <volume>8</volume>, <fpage>57</fpage>. <pub-id pub-id-type="doi">10.1186/s13578-018-0256-9</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Li</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Lai</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Shen</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Development of a susceptibility gene based novel predictive model for the diagnosis of ulcerative colitis using random forest and artificial neural network</article-title>. <source>Aging (Albany NY)</source> <volume>12</volume>, <fpage>20471</fpage>&#x2013;<lpage>20482</lpage>. <pub-id pub-id-type="doi">10.18632/aging.103861</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Li</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Shen</surname>
<given-names>W.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>CircHACE1 functions as a competitive endogenous RNA to curb differentiated thyroid cancer progression by upregulating Tfcp2L1 through adsorbing miR-346</article-title>. <source>Endocr. J.</source> <volume>68</volume>, <fpage>1011</fpage>&#x2013;<lpage>1025</lpage>. <pub-id pub-id-type="doi">10.1507/endocrj.EJ20-0806</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ling</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Jia</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Kang</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Development and validation of a novel 14-gene signature for predicting lymph node metastasis in papillary thyroid carcinoma</article-title>. <source>Gland. Surg.</source> <volume>10</volume>, <fpage>2644</fpage>&#x2013;<lpage>2655</lpage>. <pub-id pub-id-type="doi">10.21037/gs-21-361</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nakagawa</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Nishikimi</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kuwahara</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Fujishima</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Oka</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Tsutamoto</surname>
<given-names>T.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>MiR30-GALNT1/2 axis-mediated glycosylation contributes to the increased secretion of inactive human prohormone for brain natriuretic peptide (proBNP) from failing hearts</article-title>. <source>J. Am. Heart Assoc.</source> <volume>6</volume>, <fpage>e003601</fpage>. <pub-id pub-id-type="doi">10.1161/JAHA.116.003601</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Prete</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Borges de Souza</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Censi</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Muzza</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Nucci</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Sponziello</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Update on fundamental mechanisms of thyroid cancer</article-title>. <source>Front. Endocrinol.</source> <volume>11</volume>, <fpage>102</fpage>. <pub-id pub-id-type="doi">10.3389/fendo.2020.00102</pub-id> </citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Seib</surname>
<given-names>C. D.</given-names>
</name>
<name>
<surname>Sosa</surname>
<given-names>J. A.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Evolving understanding of the epidemiology of thyroid cancer</article-title>. <source>Endocrinol. Metab. Clin. North Am.</source> <volume>48</volume>, <fpage>23</fpage>&#x2013;<lpage>35</lpage>. <pub-id pub-id-type="doi">10.1016/j.ecl.2018.10.002</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sutherland</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Tsang</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Clifton-Bligh</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Gild</surname>
<given-names>M. L.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Papillary thyroid microcarcinoma: Is active surveillance always enough?</article-title> <source>Clin. Endocrinol.</source> <volume>95</volume>, <fpage>811</fpage>&#x2013;<lpage>817</lpage>. <pub-id pub-id-type="doi">10.1111/cen.14529</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tabl</surname>
<given-names>A. A.</given-names>
</name>
<name>
<surname>Alkhateeb</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>ElMaraghy</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Rueda</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Ngom</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>A machine learning approach for identifying gene biomarkers guiding the treatment of breast cancer</article-title>. <source>Front. Genet.</source> <volume>10</volume>, <fpage>256</fpage>. <pub-id pub-id-type="doi">10.3389/fgene.2019.00256</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Thomassen</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Tan</surname>
<given-names>Q.</given-names>
</name>
<name>
<surname>Kruse</surname>
<given-names>T. A.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Gene expression meta-analysis identifies chromosomal regions and candidate genes involved in breast cancer metastasis</article-title>. <source>Breast Cancer Res. Treat.</source> <volume>113</volume>, <fpage>239</fpage>&#x2013;<lpage>249</lpage>. <pub-id pub-id-type="doi">10.1007/s10549-008-9927-2</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Toraih</surname>
<given-names>E. A.</given-names>
</name>
<name>
<surname>Hussein</surname>
<given-names>M. H.</given-names>
</name>
<name>
<surname>Zerfaoui</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Attia</surname>
<given-names>A. S.</given-names>
</name>
<name>
<surname>Ellythy</surname>
<given-names>A. M.</given-names>
</name>
<name>
<surname>Mostafa</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Site-specific metastasis and survival in papillary thyroid cancer: The importance of brain and multi-organ disease</article-title>. <source>Cancers (Basel)</source> <volume>13</volume>, <fpage>1625</fpage>. <pub-id pub-id-type="doi">10.3390/cancers13071625</pub-id> </citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Van Calster</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Wynants</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Mamdani</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Machine learning in medicine</article-title>. <source>N. Engl. J. Med.</source> <volume>380</volume>, <fpage>2588</fpage>&#x2013;<lpage>2589</lpage>. <pub-id pub-id-type="doi">10.1056/NEJMc1906060</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>van den Boom</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Wolter</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Blaschke</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Knobbe</surname>
<given-names>C. B.</given-names>
</name>
<name>
<surname>Reifenberger</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Identification of novel genes associated with astrocytoma progression using suppression subtractive hybridization and real-time reverse transcription-polymerase chain reaction</article-title>. <source>Int. J. Cancer</source> <volume>119</volume>, <fpage>2330</fpage>&#x2013;<lpage>2338</lpage>. <pub-id pub-id-type="doi">10.1002/ijc.22108</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Walker</surname>
<given-names>C. J.</given-names>
</name>
<name>
<surname>Mrozek</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Ozer</surname>
<given-names>H. G.</given-names>
</name>
<name>
<surname>Nicolet</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Kohlschmidt</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Papaioannou</surname>
<given-names>D.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Gene expression signature predicts relapse in adult patients with cytogenetically normal acute myeloid leukemia</article-title>. <source>Blood Adv.</source> <volume>5</volume>, <fpage>1474</fpage>&#x2013;<lpage>1482</lpage>. <pub-id pub-id-type="doi">10.1182/bloodadvances.2020003727</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>J. R.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>Y. H.</given-names>
</name>
<name>
<surname>Chen</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Huang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Cai</surname>
<given-names>Y. D.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Identification of differentially expressed genes between original breast cancer and xenograft using machine learning algorithms</article-title>. <source>Genes (Basel)</source> <volume>9</volume>, <fpage>E155</fpage>. <pub-id pub-id-type="doi">10.3390/genes9030155</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Lei</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Xu</surname>
<given-names>Z.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Aberrant expression of PROS1 correlates with human papillary thyroid cancer progression</article-title>. <source>PeerJ</source> <volume>9</volume>, <fpage>e11813</fpage>. <pub-id pub-id-type="doi">10.7717/peerj.11813</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>T. S.</given-names>
</name>
<name>
<surname>Sosa</surname>
<given-names>J. A.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Thyroid surgery for differentiated thyroid cancer - recent advances and future directions</article-title>. <source>Nat. Rev. Endocrinol.</source> <volume>14</volume>, <fpage>670</fpage>&#x2013;<lpage>683</lpage>. <pub-id pub-id-type="doi">10.1038/s41574-018-0080-7</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Huang</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Hu</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Pang</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>CITED1 contributes to the progression of papillary thyroid carcinoma via the Wnt/&#x3b2;-catenin signaling pathway.</article-title> <source>Onco. Targets. Ther.</source> <volume>12</volume>, <fpage>6769</fpage>&#x2013;<lpage>6777</lpage>. <pub-id pub-id-type="doi">10.2147/OTT.S215025</pub-id> </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Fu</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Chen</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>miR-30b-5p inhibits proliferation, invasion, and migration of papillary thyroid cancer by targeting GALNT7 via the EGFR/PI3K/AKT pathway</article-title>. <source>Cancer Cell Int.</source> <volume>21</volume>, <fpage>618</fpage>. <pub-id pub-id-type="doi">10.1186/s12935-021-02323-x</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Xie</surname>
<given-names>N. N.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>F. F.</given-names>
</name>
<name>
<surname>Zhou</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Qu</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Establishment and analysis of a combined diagnostic model of polycystic ovary syndrome with random forest and artificial neural network</article-title>. <source>Biomed. Res. Int.</source> <volume>2020</volume>, <fpage>2613091</fpage>. <pub-id pub-id-type="doi">10.1155/2020/2613091</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yu</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Xu</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>Q.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). <article-title>Clinical implications of TPO and AOX1 in pediatric papillary thyroid carcinoma</article-title>. <source>Transl. Pediatr.</source> <volume>10</volume>, <fpage>723</fpage>&#x2013;<lpage>732</lpage>. <pub-id pub-id-type="doi">10.21037/tp-20-301</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>