<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Cell Dev. Biol.</journal-id>
<journal-title>Frontiers in Cell and Developmental Biology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Cell Dev. Biol.</abbrev-journal-title>
<issn pub-type="epub">2296-634X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fcell.2021.755511</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Cell and Developmental Biology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Large Scale Identification of Osteosarcoma Pathogenic Genes by Multiple Extreme Learning Machine</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Zhao</surname> <given-names>Zhipeng</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x2020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Shi</surname> <given-names>Jijun</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x2020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhao</surname> <given-names>Guang</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Gao</surname> <given-names>Yanjun</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Jiang</surname> <given-names>Zhigang</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Yuan</surname> <given-names>Fusheng</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1435566/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Basic Medical Sciences, Taizhou University</institution>, <addr-line>Taizhou</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Orthopedics, Songyuan Central Hospital</institution>, <addr-line>Songyuan</addr-line>, <country>China</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Orthopedics, The Fourth Affiliated Hospital of China Medical University</institution>, <addr-line>Shenyang</addr-line>, <country>China</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Hand Surgery, Changchun Central Hospital</institution>, <addr-line>Changchun</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Lei Deng, Central South University, China</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Ningyi Zhang, Harbin Institute of Technology, China; Hong Ju, Heilongjiang Vocational College of Biology Science and Technology, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Fusheng Yuan, <email>yuanfs07@mails.jlu.edu.cn</email></corresp>
<fn fn-type="equal" id="fn002"><p><sup>&#x2020;</sup>These authors have contributed equally to this work</p></fn>
<fn fn-type="other" id="fn004"><p>This article was submitted to Molecular and Cellular Pathology, a section of the journal Frontiers in Cell and Developmental Biology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>09</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>9</volume>
<elocation-id>755511</elocation-id>
<history>
<date date-type="received">
<day>09</day>
<month>08</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>09</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2021 Zhao, Shi, Zhao, Gao, Jiang and Yuan.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Zhao, Shi, Zhao, Gao, Jiang and Yuan</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>At present, the main treatment methods of osteosarcoma are chemotherapy and surgery. Its 5-year survival rate has not been significantly improved in the past decades. Osteosarcoma has extremely complex multigenomic heterogeneity and lacks universally applicable signal blocking targets. Osteosarcoma is often found in adolescents or children under the age of 20, so it is very important to explore its genetic pathogenic factors. We used known osteosarcoma-related genes and computer algorithms to find more osteosarcoma pathogenic genes, laying the foundation for the treatment of osteosarcoma immune microenvironment-related treatments, so as to carry out further explorations on these genes. It is a traditional method to identify osteosarcoma related genes by collecting clinical samples, measuring gene expressions by RNA-seq technology and comparing differentially expressed gene. The high cost and time consumption make it difficult to carry out research on a large scale. In this paper, we developed a novel method &#x201C;RELM&#x201D; which fuses multiple extreme learning machines (ELM) to identify osteosarcoma pathogenic genes. The AUC and AUPR of RELM are 0.91 and 0.88, respectively, in 10-cross validation, which illustrates the reliability of RELM.</p>
</abstract>
<kwd-group>
<kwd>Index Term-osteosarcoma</kwd>
<kwd>pathogenic genes</kwd>
<kwd>fuses multiple extreme learning machine</kwd>
<kwd>machine learning</kwd>
<kwd>large scale identification</kwd>
</kwd-group>
<counts>
<fig-count count="4"/>
<table-count count="1"/>
<equation-count count="4"/>
<ref-count count="35"/>
<page-count count="6"/>
<word-count count="4268"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="S1">
<title>Introduction</title>
<p>Osteosarcoma is the most common malignant bone tumor in clinic (<xref ref-type="bibr" rid="B15">Marko et al., 2016</xref>), which is mostly seen in children and adolescents. Although surgery combined with neoadjuvant chemotherapy significantly improves the 5-year survival rate of patients with local tumors (<xref ref-type="bibr" rid="B28">Yang et al., 2018</xref>), most patients with osteosarcoma will metastasize, and the 5-year survival rate of patients with metastatic osteosarcoma is only 20 &#x223C; 30% (<xref ref-type="bibr" rid="B18">Murakami et al., 2017</xref>). At present, osteosarcoma is still the second leading cause of cancer-related death in adolescents (<xref ref-type="bibr" rid="B3">Chen et al., 2020</xref>). Considering the complex intra - and inter tumor heterogeneity, a suitable specific target for osteosarcoma has not been found. However, based on previous studies on the heterogeneity of other tumors, the immune microenvironment may have relatively low heterogeneity and become a more appropriate direction of intervention (<xref ref-type="bibr" rid="B9">Koirala et al., 2016</xref>). Therefore, identifying genes related to osteosarcoma immune microenvironment may provide a robust and effective target for clinical application (<xref ref-type="bibr" rid="B16">Mirabello et al., 2020</xref>).</p>
<p>According to the age at which osteosarcoma occurs suddenly increases with the onset of puberty, and its largest growth site is shown to be related to the rapid proliferation of bones, it indicates that osteosarcoma is significantly related to the rapid growth of bones (<xref ref-type="bibr" rid="B7">Ho et al., 2017</xref>). At the same time, exposure to alkylating agents may also promote the development of osteosarcoma (<xref ref-type="bibr" rid="B29">Zhang et al., 2021</xref>). In addition, radiotherapy is one of the few identified environmental risk factors for osteosarcoma. Studies have shown that increasing the radiation dose of primary cancer is linearly related to the risk of secondary osteosarcoma. Another study based on American adults also found that radiotherapy is significantly associated with an increased risk of osteosarcoma diagnosis in the future (<xref ref-type="bibr" rid="B26">Wu et al., 2012</xref>).</p>
<p>Whole-exome and whole-genome sequencing analysis of the germline DNA of patients with osteosarcoma showed that the prevalence of pathogenic variants in genes associated with known cancer susceptibility syndromes was higher than expected (<xref ref-type="bibr" rid="B6">Gianferante et al., 2017</xref>). Chromosomal abnormalities, pathogenic variants of tumor suppressor genes, transcription factors and growth factors, and abnormalities of WWOX and miRNA all play an important role in the occurrence and development of osteosarcoma (<xref ref-type="bibr" rid="B11">Lin et al., 2017</xref>). The frequency of osteosarcoma in individuals with mutations in the RB1 gene is higher than that in the population. Studies have shown that there is an interaction between primary inheritance and genes in the pathogenesis of the disease (<xref ref-type="bibr" rid="B24">Spritz, 2007</xref>). A 2016 study found that among individuals with pathogenic mutations in the germline tumor suppressor gene TP53, the cumulative incidence of osteosarcoma reached 5&#x2013;11% (<xref ref-type="bibr" rid="B14">Mai et al., 2016</xref>). Transforming growth factor &#x03B2; (TGF-&#x03B2;) protein affects cell growth and metabolism, and the expression of TGF-&#x03B2;1 is significantly increased in highly malignant osteosarcoma. Insulin growth factors IGF-I and IGF-II can bind to the corresponding receptors to play a role, and they are overexpressed in osteosarcoma. The overexpression of CCN3 in osteosarcoma is related to its poor prognosis. Parathyroid hormone (PTH), parathyroid hormone related peptide (PTHrP) and parathyroid hormone receptor (PTHR1) have been shown to be related to the progression and metastasis of osteosarcoma (<xref ref-type="bibr" rid="B1">Berdiaki et al., 2010</xref>). Various molecular changes and genomes closely related to the occurrence and progress of osteosarcoma have been identified. These changes include gene amplification, deletion and germline mutation, overexpression and RTK activation, abnormal cell proliferation, metastasis, apoptosis, drug tolerance genes and miRNAs (<xref ref-type="bibr" rid="B23">Saraf et al., 2018</xref>). Osteosarcoma is characterized by complex and unbalanced karyotypes and abnormal gene expression profiles. Abnormalities of chromosome structure and value can be detected in most osteosarcoma (<xref ref-type="bibr" rid="B8">Isakoff et al., 2015</xref>). Common chromosome numerical abnormalities include germline mutation, deletion, polyploidy, aneuploidy, duplication and unbalanced ectopic errors (<xref ref-type="bibr" rid="B17">Morrow and Khanna, 2015</xref>). TP53 tumor gene and retinoblastoma tumor suppressor gene RB1 are the most prominent genes of germline mutation (<xref ref-type="bibr" rid="B19">Oliveira et al., 2005</xref>). They are the key detection sites of mitosis and the root cause of chromosome instability. Most osteosarcoma contains inactivation of both p53 and Rb pathways (<xref ref-type="bibr" rid="B10">Levine and Fleischli, 2000</xref>). In essence, the main causes of osteosarcoma are the inactivation of tumor suppressor gene expression and the abnormal doubling of oncogenes (<xref ref-type="bibr" rid="B20">Orr and Compton, 2013</xref>). Common oncogenes, such as avian cell homolog Myc, purine / pyrimidine exonuclease 1 (APEX1), action associated vascular endothelial growth factor A (VEGFA) and RecQ protein analog 4 (RecQL4). These amplified genes are closely related to the biological processes of osteosarcoma cell proliferation, growth and angiogenesis. <xref ref-type="bibr" rid="B12">Liu et al. (2019)</xref> identified 125 genes which are related to osteosarcoma and can be used to predict survival of osteosarcoma. <xref ref-type="bibr" rid="B5">Deng et al. (2021)</xref> used univariate, Lasso, and machine learning algorithm-iterative Lasso Cox regression analyses to predict survival of osteosarcoma by lncRNAs.</p>
<p>At present, there are two common biological methods for discovering disease-related genes. First, collect disease samples and health samples, respectively, conduct RNA-seq sequencing to obtain the expression of genes in different health states, and then obtain the genes significantly differentially expressed in disease and health populations through differential expression analysis (<xref ref-type="bibr" rid="B34">Zhao et al., 2021b</xref>). Second, through genome-wide association analysis, collect a large number of disease and healthy people, sequence the whole genome, and then compare the sequences to obtain sites with significant differences in mutation frequency (<xref ref-type="bibr" rid="B21">Peng and Zhao, 2020</xref>; <xref ref-type="bibr" rid="B32">Zhao et al., 2020c</xref>). However, both of them need a large number of samples to support in order to ensure the accuracy, which results in a large consumption of time and money (<xref ref-type="bibr" rid="B2">Bhakta and Tsukahara, 2020</xref>). With the continuous accumulation of biological data and the continuous improvement of calculation methods, bioinformatics experts find biological laws through calculation methods, and then infer more biological conclusions (<xref ref-type="bibr" rid="B4">Chen et al., 2019</xref>; <xref ref-type="bibr" rid="B13">Liu et al., 2020</xref>; <xref ref-type="bibr" rid="B30">Zhao et al., 2020a</xref>). The calculation methods have identified disease-related genes and drugs on a large scale (<xref ref-type="bibr" rid="B25">Tianyi et al., 2020</xref>; <xref ref-type="bibr" rid="B31">Zhao et al., 2020b</xref>). Although some conclusions are not completely accurate, they greatly reduce the scope of research and save time and money (<xref ref-type="bibr" rid="B27">Wu et al., 2021</xref>). Moreover, the models constructed by deep learning and machine learning can be used for reference by other research problems (<xref ref-type="bibr" rid="B33">Zhao et al., 2021a</xref>). Therefore, we developed a machine learning method to identify osteosarcoma-related genes in this paper. Using the idea of random forest for reference, we fused multiple Extreme Learning Machines (ELM) to build a model through the known osteosarcoma related genes to predict more genes potentially associated with osteosarcoma.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<title>Materials and Methods</title>
<sec id="S2.SS1">
<title>Workflow</title>
<p>Firstly, we obtained 2,339 genes which are reported to be related to osteosarcoma in DisGeNET (<xref ref-type="bibr" rid="B22">Pi&#x00F1;ero et al., 2020</xref>). Then, we constructed gene interaction network based on these genes. More genes are included in this network since many genes can interact with these 2,339 genes. We extracted the features of this network by random walk and used Random Extreme Learning Machine (RELM) to identify osteosarcoma-related genes. The way of constructing RELM is to build multiple ELM models and the output of each model is attached with weight, and the final result is obtained by voting. The whole workflow is shown in <xref ref-type="fig" rid="F1">Figure 1</xref>.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption><p>Workflow of our method.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcell-09-755511-g001.tif"/>
</fig>
</sec>
<sec id="S2.SS2">
<title>Extreme Learning Machine</title>
<p>The calculation process of single hidden layer neural network is as follows:</p>
<list list-type="simple">
<list-item>
<label>1.</label>
<p>The input value is multiplied by the weight value</p>
</list-item>
<list-item>
<label>2.</label>
<p>Add bias value</p>
</list-item>
<list-item>
<label>3.</label>
<p>Calculation of activation function</p>
</list-item>
<list-item>
<label>4.</label>
<p>Repeat steps 1 to 3 for each layer</p>
</list-item>
<list-item>
<label>5.</label>
<p>Calculate output value</p>
</list-item>
<list-item>
<label>6.</label>
<p>Error back propagation</p>
</list-item>
<list-item>
<label>7.</label>
<p>Repeat steps 1 to 6.</p>
</list-item>
</list>
<p>Extreme learning machines improves it by removing step 4 and replacing step 6 with a primary matrix inverse operation and removing step 7.</p>
<p>The process of ELM is to construct the formula (1):</p>
<disp-formula id="S2.E1">
<label>(1)</label>
<mml:math id="M1">
<mml:mrow>
<mml:msub>
<mml:mi>f</mml:mi>
<mml:mi>L</mml:mi>
</mml:msub>
<mml:mo stretchy='false'>(</mml:mo><mml:mi>x</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'>
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>L</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:msub>
<mml:mi>&#x03B2;</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:msub>
<mml:mi>g</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy='false'>(</mml:mo><mml:mi>x</mml:mi><mml:mo stretchy='false'>)</mml:mo>
</mml:mrow>
</mml:mstyle><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'>
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>L</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:msub>
<mml:mi>&#x03B2;</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mi>g</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:msub>
<mml:mi>w</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>*</mml:mo><mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo><mml:msub>
<mml:mi>b</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mo stretchy='false'>)</mml:mo>
</mml:mrow>
</mml:mstyle><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mtext>&#x2026;</mml:mtext><mml:mo>,</mml:mo><mml:mi>N</mml:mi>
</mml:mrow>
</mml:math>
</disp-formula>
<p>L is the number of hidden units. N is the number of training samples. <italic>&#x03B2;</italic><sub><italic>i</italic></sub> is the weight between <italic>i</italic>th hidden layer and output. <italic>w</italic><sub><italic>i</italic></sub> is the weight between input and output. <italic>g</italic>(<italic>x</italic>) is activation function. b is bias and x is the input. Since ELM only has one hidden layer, i is 1 in our model.</p>
<p>The calculation process of the extreme learning machine is very similar to the standard back-propagation neural network, but the weight matrix between the hidden layer and the output is a pseudo-inverse matrix. The above formula can be abbreviated as:</p>
<disp-formula id="S2.E2">
<label>(2)</label>
<mml:math id="M2">
<mml:mrow>
<mml:mi>T</mml:mi>
<mml:mo>=</mml:mo>
<mml:mrow>
<mml:mi>H</mml:mi>
<mml:mi>&#x03B2;</mml:mi>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula id="S2.E3">
<label>(3)</label>
<mml:math id="M3">
<mml:mrow>
<mml:mi>H</mml:mi>
<mml:mo>=</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mtable displaystyle="true" rowspacing="0pt">
<mml:mtr>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mo>&#x002A;</mml:mo>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:msub>
<mml:mi>b</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
<mml:mo rspace="8.1pt" stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mpadded width="+8.3pt">
<mml:mi mathvariant="normal">&#x2026;</mml:mi>
</mml:mpadded>
<mml:mi>g</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mi>L</mml:mi>
</mml:msub>
<mml:mo>&#x002A;</mml:mo>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>L</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:msub>
<mml:mi>b</mml:mi>
<mml:mi>L</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mpadded lspace="30.6pt" width="+30.6pt">
<mml:mi mathvariant="normal">&#x22EE;</mml:mi>
</mml:mpadded>
<mml:mo mathvariant="italic" separator="true">&#x2003;&#x2003;&#x2003;&#x2003;&#x2003;&#x2003;&#x2002;&#x2003;</mml:mo>
<mml:mi mathvariant="normal">&#x22EE;</mml:mi>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd columnalign="left">
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mo>&#x002A;</mml:mo>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>N</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:msub>
<mml:mi>b</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
<mml:mo rspace="8.1pt" stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mpadded width="+8.3pt">
<mml:mi mathvariant="normal">&#x2026;</mml:mi>
</mml:mpadded>
<mml:mi>g</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mi>L</mml:mi>
</mml:msub>
<mml:mo>&#x002A;</mml:mo>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>N</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>+</mml:mo>
<mml:msub>
<mml:mi>b</mml:mi>
<mml:mi>L</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x00D7;</mml:mo>
<mml:mi>L</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</disp-formula>
<p>m is the number of outputs; H is the hidden layer output matrix; T is the target matrix of the training set.</p>
</sec>
<sec id="S2.SS3">
<title>Random Extreme Learning Machine (RELM)</title>
<p>Extreme learning machines is a special artificial neural network with only one hidden layer, which causes its accuracy to be low. However, the calculation speed of ELM is extremely fast. Therefore, we can use this advantage to build multiple ELM models and use weighted voting to improve accuracy.</p>
<p>Random extreme learning machine draws on the idea of random forest (RF), regards ELM as a simple decision tree, and trains multiple ELMs to form an ELM forest to achieve the goal of improving accuracy.</p>
<p>The idea of RELM is to randomly extract the multi-dimensional features of genes, and then randomly extract the training set to form a simple ELM. Through repeated extraction with replacement, new ELMs are continuously trained. After getting enough ELM models, the final result is obtained by weighting and averaging the output results of the 500 models.</p>
<p>The number of features for each ELM model is selected as (<xref ref-type="bibr" rid="B35">Zhao et al., 2017</xref>):</p>
<disp-formula id="S2.E4">
<label>(4)</label>
<mml:math id="M4">
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mo>=</mml:mo>
<mml:msqrt>
<mml:mi>N</mml:mi>
</mml:msqrt>
</mml:mrow>
</mml:math>
</disp-formula>
<p>N is the whole dimension of features. n is the number of features for each ELM model.</p>
<p>In the meanwhile, we randomly selected samples for each ELM model too. After each modeling, we will also put the sample back. We choose one-tenth of the samples for modeling each time.</p>
</sec>
</sec>
<sec sec-type="results" id="S3">
<title>Results</title>
<sec id="S3.SS1">
<title>Selection of Extreme Learning Machine Model Number</title>
<p>We should construct multiple ELM models to obtain RELM, but the number of ELM models is not sure. Therefore, we tried 10, 20, 50, 100, 200 ELM models and used 10-cross validation to obtain the final number.</p>
<p>The AUC curves of 10, 20, 50, 100, 200 ELM models are shown in <xref ref-type="fig" rid="F2">Figure 2</xref>. The AUC values of these models are 0.66, 0.72, 0.82, 0.92, 0.92, respectively. The AUC of 100 models and 200 models are similar.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption><p>ROC curves of different ELM model number.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcell-09-755511-g002.tif"/>
</fig>
<p>The PR curves of 10, 20, 50, 100, 200 ELM models are shown in <xref ref-type="fig" rid="F3">Figure 3</xref>. The AUPR values of these models are 0.46, 0.54, 0.72, 0.88, 0.88, respectively. The AUPR of 100 models and 200 models are similar too. Therefore, we chose 100 ELM models to construct RELM.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption><p>PR curves of different ELM model number.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcell-09-755511-g003.tif"/>
</fig>
</sec>
<sec id="S3.SS2">
<title>Performance of Random Extreme Learning Machine</title>
<p>Because the unknown genes are far more than known osteosarcoma-related genes, we randomly selected negative samples to build RELM model. For each time, the number of negative samples is as same as positive samples. We repeated to select negative samples 5 times and did 10-cross validation for each time. The AUC and AUPR is shown as <xref ref-type="fig" rid="F4">Figure 4</xref>.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption><p>Five times 10-cross validation by randomly sampling.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fcell-09-755511-g004.tif"/>
</fig>
<p>The mean AUC is 0.889 and standard deviation is 0.009. The mean AUPR is 0.887 and standard deviation is 0.011.</p>
<p>In order to further explore the advantages of RELM, we compared RELM with ELM, RSVM, RANN. RSVM is to replace the ELM of RELM by SVM and RANN is to replace ELM of RELM with ANN. The experiments results are shown in <xref ref-type="table" rid="T1">Table 1</xref>.</p>
<table-wrap position="float" id="T1">
<label>TABLE 1</label>
<caption><p>Comparison result.</p></caption>
<table cellspacing="5" cellpadding="5" frame="hsides" rules="groups">
<thead>
<tr>
<td valign="top" align="left">Method</td>
<td valign="top" align="center">AUC</td>
<td valign="top" align="center">AUPR</td>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">RELM</td>
<td valign="top" align="center">0.889</td>
<td valign="top" align="center">0.887</td>
</tr>
<tr>
<td valign="top" align="left">ELM</td>
<td valign="top" align="center">0.761</td>
<td valign="top" align="center">0.684</td>
</tr>
<tr>
<td valign="top" align="left">RSVM</td>
<td valign="top" align="center">0.865</td>
<td valign="top" align="center">0.841</td>
</tr>
<tr>
<td valign="top" align="left">RANN</td>
<td valign="top" align="center">0.876</td>
<td valign="top" align="center">0.849</td>
</tr>
</tbody>
</table></table-wrap>
<p>As we can see in <xref ref-type="table" rid="T1">Table 1</xref>, RELM performed best among these method. SVM is more suitable for small sample modeling and ANN needs large sample set to build a precise model. Therefore, these two methods are not suitable for our case.</p>
</sec>
</sec>
<sec sec-type="conclusion" id="S4">
<title>Conclusion</title>
<p>Whole-exome and whole-genome sequencing analysis of the germline DNA of patients with osteosarcoma showed that the prevalence of pathogenic variants in genes associated with known cancer susceptibility syndromes was higher than expected. Osteosarcoma is highly aggressive and progresses rapidly. In all age groups, as many as 25% of patients have metastasized at the time of diagnosis, so its early diagnosis is necessary for the long-term prognosis of patients. At present, the diagnosis of osteosarcoma is still based on the patient&#x2019;s clinical manifestations, imaging examinations and biopsy. Gene therapy includes tumor suppressor gene therapy, antisense gene therapy, suicide gene therapy and combined gene therapy. Although the research of gene therapy has made great progress and it has good therapeutic prospects, the clinical application of gene therapy still has a long way to go. In recent years, with continuous research on the key genes of osteosarcoma, its application value as a gene therapy target has gradually revealed.</p>
<p>To identify osteosarcoma-related genes in large scale, in this paper, we developed an ELM-based method for identifying osteosarcoma-related genes. 100 ELM models have been constructed to build a final RELM model. By constantly randomly selecting negative sets, we performed five times of 10-cross validation. The accuracy of RELM is stable and high in all experiments.</p>
<p>Overall, we purposed a reliable method for identifying osteosarcoma-related genes in large-scale. This method could help understand the pathogenesis of osteosarcoma and develop drug targets.</p>
</sec>
<sec sec-type="data-availability" id="S5">
<title>Data Availability Statement</title>
<p>The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: gene-disease associations: <ext-link ext-link-type="uri" xlink:href="https://www.disgenet.org/">https://www.disgenet.org/</ext-link> and gene interaction: <ext-link ext-link-type="uri" xlink:href="http://www.inetbio.org/humannet">http://www.inetbio.org/humannet</ext-link>.</p>
</sec>
<sec id="S6">
<title>Ethics Statement</title>
<p>Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.</p>
</sec>
<sec id="S7">
<title>Author Contributions</title>
<p>ZZ, JS, and FY conceived and designed this study. ZZ, JS, GZ, YG, and ZJ analyzed the data. ZZ, JS, and GZ wrote the manuscript. All authors read and approved the final version of the manuscript.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="S8">
<title>Funding</title>
<p>This work was supported by the Natural Science Foundation of China (NSFC) (No. 82060458).</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berdiaki</surname> <given-names>A.</given-names></name> <name><surname>Datsis</surname> <given-names>G. A.</given-names></name> <name><surname>Nikitovic</surname> <given-names>D.</given-names></name> <name><surname>Tsatsakis</surname> <given-names>A.</given-names></name> <name><surname>Katonis</surname> <given-names>P.</given-names></name> <name><surname>Karamanos</surname> <given-names>N. K.</given-names></name><etal/></person-group> (<year>2010</year>). <article-title>Parathyroid hormone (PTH) peptides through the regulation of hyaluronan metabolism affect osteosarcoma cell migration.</article-title> <source><italic>IUBMB Life</italic></source> <volume>62</volume> <fpage>377</fpage>&#x2013;<lpage>386</lpage>. <pub-id pub-id-type="doi">10.1002/iub.320</pub-id> <pub-id pub-id-type="pmid">20222016</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bhakta</surname> <given-names>S.</given-names></name> <name><surname>Tsukahara</surname> <given-names>T.</given-names></name></person-group> (<year>2020</year>). <article-title>Artificial RNA editing with ADAR for gene therapy.</article-title> <source><italic>Curr. Gene Ther.</italic></source> <volume>20</volume> <fpage>44</fpage>&#x2013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.2174/1566523220666200516170137</pub-id> <pub-id pub-id-type="pmid">32416688</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>L.</given-names></name> <name><surname>Wang</surname> <given-names>M.</given-names></name> <name><surname>Lin</surname> <given-names>Z.</given-names></name> <name><surname>Yao</surname> <given-names>M.</given-names></name> <name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Cheng</surname> <given-names>S.</given-names></name><etal/></person-group> (<year>2020</year>). <article-title>Mild microwave ablation combined with HSP90 and TGF-&#x03B2;1 inhibitors enhances the therapeutic effect on osteosarcoma.</article-title> <source><italic>Mol. Med. Rep.</italic></source> <volume>22</volume> <fpage>906</fpage>&#x2013;<lpage>914</lpage>. <pub-id pub-id-type="doi">10.3892/mmr.2020.11173</pub-id> <pub-id pub-id-type="pmid">32468060</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>X. G.</given-names></name> <name><surname>Shi</surname> <given-names>W. W.</given-names></name> <name><surname>Deng</surname> <given-names>L.</given-names></name></person-group> (<year>2019</year>). <article-title>Prediction of disease comorbidity using hetesim scores based on multiple heterogeneous networks.</article-title> <source><italic>Curr. Gene Ther.</italic></source> <volume>19</volume> <fpage>232</fpage>&#x2013;<lpage>241</lpage>. <pub-id pub-id-type="doi">10.2174/1566523219666190917155959</pub-id> <pub-id pub-id-type="pmid">31530261</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deng</surname> <given-names>Y.</given-names></name> <name><surname>Yuan</surname> <given-names>W.</given-names></name> <name><surname>Ren</surname> <given-names>E.</given-names></name> <name><surname>Wu</surname> <given-names>Z.</given-names></name> <name><surname>Zhang</surname> <given-names>G.</given-names></name> <name><surname>Xie</surname> <given-names>Q.</given-names></name></person-group> (<year>2021</year>). <article-title>A four-methylated LncRNA signature predicts survival of osteosarcoma patients based on machine learning.</article-title> <source><italic>Genomics</italic></source> <volume>113</volume> <fpage>785</fpage>&#x2013;<lpage>794</lpage>. <pub-id pub-id-type="doi">10.1016/j.ygeno.2020.10.010</pub-id> <pub-id pub-id-type="pmid">33069828</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gianferante</surname> <given-names>D. M.</given-names></name> <name><surname>Mirabello</surname> <given-names>L.</given-names></name> <name><surname>Savage</surname> <given-names>S. A.</given-names></name></person-group> (<year>2017</year>). <article-title>Germline and somatic genetics of osteosarcoma&#x2014;connecting aetiology, biology and therapy.</article-title> <source><italic>Nat. Rev. Endocrinol.</italic></source> <volume>13</volume> <fpage>480</fpage>&#x2013;<lpage>491</lpage>. <pub-id pub-id-type="doi">10.1038/nrendo.2017.16</pub-id> <pub-id pub-id-type="pmid">28338660</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ho</surname> <given-names>X. D.</given-names></name> <name><surname>Phung</surname> <given-names>P.</given-names></name> <name><surname>Le</surname> <given-names>V. Q.</given-names></name> <name><surname>Nguyen</surname> <given-names>V. H.</given-names></name> <name><surname>Reimann</surname> <given-names>E.</given-names></name> <name><surname>Prans</surname> <given-names>E.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Whole transcriptome analysis identifies differentially regulated networks between osteosarcoma and normal bone samples.</article-title> <source><italic>Exp. Biol. Med.</italic></source> <volume>242</volume> <fpage>1802</fpage>&#x2013;<lpage>1811</lpage>. <pub-id pub-id-type="doi">10.1177/1535370217736512</pub-id> <pub-id pub-id-type="pmid">29050494</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Isakoff</surname> <given-names>M. S.</given-names></name> <name><surname>Bielack</surname> <given-names>S. S.</given-names></name> <name><surname>Meltzer</surname> <given-names>P.</given-names></name> <name><surname>Gorlick</surname> <given-names>R.</given-names></name></person-group> (<year>2015</year>). <article-title>Osteosarcoma: current treatment and a collaborative pathway to success.</article-title> <source><italic>J. Clin. Oncol.</italic></source> <volume>33</volume> <fpage>3029</fpage>&#x2013;<lpage>3035</lpage>. <pub-id pub-id-type="doi">10.1200/jco.2014.59.4895</pub-id> <pub-id pub-id-type="pmid">26304877</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koirala</surname> <given-names>P.</given-names></name> <name><surname>Roth</surname> <given-names>M. E.</given-names></name> <name><surname>Gill</surname> <given-names>J.</given-names></name> <name><surname>Piperdi</surname> <given-names>S.</given-names></name> <name><surname>Chinai</surname> <given-names>J. M.</given-names></name> <name><surname>Geller</surname> <given-names>D. S.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Immune infiltration and PD-L1 expression in the tumor microenvironment are prognostic in osteosarcoma.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>6</volume>:<issue>30093</issue>.</citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Levine</surname> <given-names>R.</given-names></name> <name><surname>Fleischli</surname> <given-names>M.</given-names></name></person-group> (<year>2000</year>). <article-title>Inactivation of p53 and retinoblastoma family pathways in canine osteosarcoma cell lines.</article-title> <source><italic>Vet. Pathol.</italic></source> <volume>37</volume> <fpage>54</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1354/vp.37-1-54</pub-id> <pub-id pub-id-type="pmid">10643981</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>W.</given-names></name> <name><surname>Zhu</surname> <given-names>X.</given-names></name> <name><surname>Yang</surname> <given-names>S.</given-names></name> <name><surname>Chen</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>L.</given-names></name> <name><surname>Huang</surname> <given-names>Z.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>MicroRNA-203 inhibits proliferation and invasion, and promotes apoptosis of osteosarcoma cells by targeting Runt-related transcription factor 2.</article-title> <source><italic>Biomed. Pharmacother.</italic></source> <volume>91</volume> <fpage>1075</fpage>&#x2013;<lpage>1084</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopha.2017.05.034</pub-id> <pub-id pub-id-type="pmid">28525948</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>F.</given-names></name> <name><surname>Xing</surname> <given-names>L.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name></person-group> (<year>2019</year>). <article-title>A four-pseudogene classifier identified by machine learning serves as a novel prognostic marker for survival of osteosarcoma.</article-title> <source><italic>Genes</italic></source> <volume>10</volume>:<issue>414</issue>. <pub-id pub-id-type="doi">10.3390/genes10060414</pub-id> <pub-id pub-id-type="pmid">31146489</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>Y. B.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name> <name><surname>Yang</surname> <given-names>L.</given-names></name></person-group> (<year>2020</year>). <article-title>Genetic engineering of AAV capsid gene for gene therapy application.</article-title> <source><italic>Curr. Gene Ther.</italic></source> <volume>20</volume> <fpage>321</fpage>&#x2013;<lpage>332</lpage>. <pub-id pub-id-type="doi">10.2174/1566523220666200930105521</pub-id> <pub-id pub-id-type="pmid">32998676</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mai</surname> <given-names>P. L.</given-names></name> <name><surname>Best</surname> <given-names>A. F.</given-names></name> <name><surname>Peters</surname> <given-names>J. A.</given-names></name> <name><surname>DeCastro</surname> <given-names>R. M.</given-names></name> <name><surname>Khincha</surname> <given-names>P. P.</given-names></name> <name><surname>Loud</surname> <given-names>J. T.</given-names></name><etal/></person-group> (<year>2016</year>). <article-title>Risks of first and subsequent cancers among TP53 mutation carriers in the National cancer institute Li-Fraumeni syndrome cohort.</article-title> <source><italic>Cancer</italic></source> <volume>122</volume> <fpage>3673</fpage>&#x2013;<lpage>3681</lpage>. <pub-id pub-id-type="doi">10.1002/cncr.30248</pub-id> <pub-id pub-id-type="pmid">27496084</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marko</surname> <given-names>T. A.</given-names></name> <name><surname>Diessner</surname> <given-names>B. J.</given-names></name> <name><surname>Spector</surname> <given-names>L. G.</given-names></name></person-group> (<year>2016</year>). <article-title>Prevalence of metastasis at diagnosis of osteosarcoma: an international comparison.</article-title> <source><italic>Pediatr. Blood Cancer</italic></source> <volume>63</volume> <fpage>1006</fpage>&#x2013;<lpage>1011</lpage>. <pub-id pub-id-type="doi">10.1002/pbc.25963</pub-id> <pub-id pub-id-type="pmid">26929018</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mirabello</surname> <given-names>L.</given-names></name> <name><surname>Zhu</surname> <given-names>B.</given-names></name> <name><surname>Koster</surname> <given-names>R.</given-names></name> <name><surname>Karlins</surname> <given-names>E.</given-names></name> <name><surname>Dean</surname> <given-names>M.</given-names></name> <name><surname>Yeager</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2020</year>). <article-title>Frequency of pathogenic germline variants in cancer-susceptibility genes in patients with osteosarcoma.</article-title> <source><italic>JAMA Oncol.</italic></source> <volume>6</volume> <fpage>724</fpage>&#x2013;<lpage>734</lpage>. <pub-id pub-id-type="doi">10.1001/jamaoncol.2020.0197</pub-id> <pub-id pub-id-type="pmid">32191290</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morrow</surname> <given-names>J. J.</given-names></name> <name><surname>Khanna</surname> <given-names>C.</given-names></name></person-group> (<year>2015</year>). <article-title>Osteosarcoma genetics and epigenetics: emerging biology and candidate therapies.</article-title> <source><italic>Crit. Rev. Oncogen.</italic></source> <volume>20</volume> <fpage>173</fpage>&#x2013;<lpage>197</lpage>. <pub-id pub-id-type="doi">10.1615/critrevoncog.2015013713</pub-id> <pub-id pub-id-type="pmid">26349415</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murakami</surname> <given-names>T.</given-names></name> <name><surname>Igarashi</surname> <given-names>K.</given-names></name> <name><surname>Kawaguchi</surname> <given-names>K.</given-names></name> <name><surname>Kiyuna</surname> <given-names>T.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Zhao</surname> <given-names>M.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>Tumor-targeting <italic>Salmonella typhimurium</italic> A1-R regresses an osteosarcoma in a patient-derived xenograft model resistant to a molecular-targeting drug.</article-title> <source><italic>Oncotarget</italic></source> <volume>8</volume> <fpage>8035</fpage>&#x2013;<lpage>8042</lpage>. <pub-id pub-id-type="doi">10.18632/oncotarget.14040</pub-id> <pub-id pub-id-type="pmid">28030831</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Oliveira</surname> <given-names>A. M.</given-names></name> <name><surname>Ross</surname> <given-names>J. S.</given-names></name> <name><surname>Fletcher</surname> <given-names>J. A.</given-names></name></person-group> (<year>2005</year>). <article-title>Tumor suppressor genes in breast cancer: the gatekeepers and the caretakers.</article-title> <source><italic>Pathol. Patterns Rev.</italic></source> <volume>124(Suppl. 1)</volume> <fpage>S16</fpage>&#x2013;<lpage>S28</lpage>. <pub-id pub-id-type="doi">10.1309/5XW3L8LU445QWGQR</pub-id> <pub-id pub-id-type="pmid">16468415</pub-id></citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Orr</surname> <given-names>B.</given-names></name> <name><surname>Compton</surname> <given-names>D. A.</given-names></name></person-group> (<year>2013</year>). <article-title>A double-edged sword: how oncogenes and tumor suppressor genes can contribute to chromosomal instability.</article-title> <source><italic>Front. Oncol.</italic></source> <volume>3</volume>:<issue>164</issue>. <pub-id pub-id-type="doi">10.3389/fonc.2013.00164</pub-id> <pub-id pub-id-type="pmid">23825799</pub-id></citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peng</surname> <given-names>J.</given-names></name> <name><surname>Zhao</surname> <given-names>T.</given-names></name></person-group> (<year>2020</year>). <article-title>Reduction in TOM1 expression exacerbates Alzheimer&#x2019;s disease.</article-title> <source><italic>Proc. Natl. Acad. Sci. U.S.A.</italic></source> <volume>117</volume> <fpage>3915</fpage>&#x2013;<lpage>3916</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1917589117</pub-id> <pub-id pub-id-type="pmid">32047041</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pi&#x00F1;ero</surname> <given-names>J.</given-names></name> <name><surname>Ram&#x00ED;rez-Anguita</surname> <given-names>J. M.</given-names></name> <name><surname>Sa&#x00FC;ch-Pitarch</surname> <given-names>J.</given-names></name> <name><surname>Ronzano</surname> <given-names>F.</given-names></name> <name><surname>Centeno</surname> <given-names>E.</given-names></name> <name><surname>Sanz</surname> <given-names>F.</given-names></name><etal/></person-group> (<year>2020</year>). <article-title>The DisGeNET knowledge platform for disease genomics: 2019 update.</article-title> <source><italic>Nucleic Acids Res.</italic></source> <volume>48</volume> <fpage>D845</fpage>&#x2013;<lpage>D855</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkz1021</pub-id> <pub-id pub-id-type="pmid">31680165</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saraf</surname> <given-names>A. J.</given-names></name> <name><surname>Fenger</surname> <given-names>J. M.</given-names></name> <name><surname>Roberts</surname> <given-names>R. D.</given-names></name></person-group> (<year>2018</year>). <article-title>Osteosarcoma: accelerating progress makes for a hopeful future.</article-title> <source><italic>Front. Oncol.</italic></source> <volume>8</volume>:<issue>4</issue>. <pub-id pub-id-type="doi">10.3389/fonc.2018.00004</pub-id> <pub-id pub-id-type="pmid">29435436</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Spritz</surname> <given-names>R. A.</given-names></name></person-group> (<year>2007</year>). <article-title>The genetics of generalized vitiligo and associated autoimmune diseases.</article-title> <source><italic>Pigment Cell Res.</italic></source> <volume>20</volume> <fpage>271</fpage>&#x2013;<lpage>278</lpage>. <pub-id pub-id-type="doi">10.1111/j.1600-0749.2007.00384.x</pub-id> <pub-id pub-id-type="pmid">17630960</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tianyi</surname> <given-names>Z.</given-names></name> <name><surname>Yang</surname> <given-names>H.</given-names></name> <name><surname>Valsdottir</surname> <given-names>L. R.</given-names></name> <name><surname>Tianyi</surname> <given-names>Z.</given-names></name> <name><surname>Jiajie</surname> <given-names>P.</given-names></name></person-group> (<year>2020</year>). <article-title>Identifying drug&#x2013;target interactions based on graph convolutional network and deep neural network.</article-title> <source><italic>Brief. Bioinformat.</italic></source> <volume>22</volume>:<issue>bbaa044</issue>. <pub-id pub-id-type="doi">10.1093/bib/bbaa044</pub-id> <pub-id pub-id-type="pmid">32367110</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>L. C.</given-names></name> <name><surname>Kleinerman</surname> <given-names>R. A.</given-names></name> <name><surname>Curtis</surname> <given-names>R. E.</given-names></name> <name><surname>Savage</surname> <given-names>S. A.</given-names></name> <name><surname>de Gonz&#x00E1;lez</surname> <given-names>A. B.</given-names></name></person-group> (<year>2012</year>). <article-title>Patterns of bone sarcomas as a second malignancy in relation to radiotherapy in adulthood and histologic type.</article-title> <source><italic>Cancer Epidemiol. Prevent. Biomark.</italic></source> <volume>21</volume> <fpage>1993</fpage>&#x2013;<lpage>1999</lpage>. <pub-id pub-id-type="doi">10.1158/1055-9965.epi-12-0810</pub-id> <pub-id pub-id-type="pmid">22964827</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>Q.</given-names></name> <name><surname>Nasoz</surname> <given-names>F.</given-names></name> <name><surname>Jung</surname> <given-names>J.</given-names></name> <name><surname>Bhattarai</surname> <given-names>B.</given-names></name> <name><surname>Han</surname> <given-names>M. V.</given-names></name> <name><surname>Greenes</surname> <given-names>R. A.</given-names></name><etal/></person-group> (<year>2021</year>). <article-title>Machine learning approaches for the prediction of bone mineral density by using genomic and phenotypic data of 5130 older men.</article-title> <source><italic>Sci. Rep.</italic></source> <volume>11</volume>:<issue>4482</issue>. <pub-id pub-id-type="doi">10.1038/s41598-021-83828-3</pub-id> <pub-id pub-id-type="pmid">33627720</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>Y.</given-names></name> <name><surname>Han</surname> <given-names>L.</given-names></name> <name><surname>He</surname> <given-names>Z.</given-names></name> <name><surname>Li</surname> <given-names>X.</given-names></name> <name><surname>Yang</surname> <given-names>S.</given-names></name> <name><surname>Yang</surname> <given-names>J.</given-names></name><etal/></person-group> (<year>2018</year>). <article-title>Advances in limb salvage treatment of osteosarcoma.</article-title> <source><italic>J. Bone Oncol.</italic></source> <volume>10</volume> <fpage>36</fpage>&#x2013;<lpage>40</lpage>.</citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Z.</given-names></name> <name><surname>Wu</surname> <given-names>X.</given-names></name> <name><surname>Han</surname> <given-names>Q.</given-names></name> <name><surname>Huang</surname> <given-names>Z.</given-names></name></person-group> (<year>2021</year>). <article-title>Downregulation of long non-coding RNA UCA1 represses tumorigenesis and metastasis of osteosarcoma via miR-513b-5p/E2F5 axis.</article-title> <source><italic>Anti Cancer Drugs</italic></source> <volume>32</volume> <fpage>602</fpage>&#x2013;<lpage>613</lpage>. <pub-id pub-id-type="doi">10.1097/cad.0000000000001034</pub-id> <pub-id pub-id-type="pmid">33595944</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>T.</given-names></name> <name><surname>Hu</surname> <given-names>Y.</given-names></name> <name><surname>Cheng</surname> <given-names>L.</given-names></name></person-group> (<year>2020a</year>). <article-title>Deep-DRM: a computational method for identifying disease-related metabolites based on graph deep learning approaches.</article-title> <source><italic>Brief. Bioinform.</italic></source> <volume>22</volume>:<issue>bbaa212</issue>. <pub-id pub-id-type="doi">10.1093/bib/bbaa212</pub-id> <pub-id pub-id-type="pmid">33048110</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>T.</given-names></name> <name><surname>Hu</surname> <given-names>Y.</given-names></name> <name><surname>Peng</surname> <given-names>J.</given-names></name> <name><surname>Cheng</surname> <given-names>L.</given-names></name></person-group> (<year>2020b</year>). <article-title>DeepLGP: a novel deep learning method for prioritizing lncRNA target genes.</article-title> <source><italic>Bioinformatics</italic></source> <volume>36</volume> <fpage>4466</fpage>&#x2013;<lpage>4472</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btaa428</pub-id> <pub-id pub-id-type="pmid">32467970</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>T.</given-names></name> <name><surname>Hu</surname> <given-names>Y.</given-names></name> <name><surname>Zang</surname> <given-names>T.</given-names></name> <name><surname>Cheng</surname> <given-names>L.</given-names></name></person-group> (<year>2020c</year>). <article-title>MRTFB regulates the expression of NOMO1 in colon.</article-title> <source><italic>Proc. Natl. Acad. Sci. U.S.A.</italic></source> <volume>117</volume> <fpage>7568</fpage>&#x2013;<lpage>7569</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.2000499117</pub-id> <pub-id pub-id-type="pmid">32184333</pub-id></citation></ref>
<ref id="B33"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>T.</given-names></name> <name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Zeng</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Li</surname> <given-names>S.</given-names></name> <name><surname>Zang</surname> <given-names>T.</given-names></name><etal/></person-group> (<year>2021a</year>). <article-title>Prediction and collection of protein&#x2013;metabolite interactions.</article-title> <source><italic>Brief. Bioinform.</italic></source> <volume>22</volume>:<issue>bbab014</issue>. <pub-id pub-id-type="doi">10.1093/bib/bbab014</pub-id> <pub-id pub-id-type="pmid">33554247</pub-id></citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>T.</given-names></name> <name><surname>Lyu</surname> <given-names>S.</given-names></name> <name><surname>Lu</surname> <given-names>G.</given-names></name> <name><surname>Juan</surname> <given-names>L.</given-names></name> <name><surname>Zeng</surname> <given-names>X.</given-names></name> <name><surname>Wei</surname> <given-names>Z.</given-names></name><etal/></person-group> (<year>2021b</year>). <article-title>SC2disease: a manually curated database of single-cell transcriptome for human diseases.</article-title> <source><italic>Nucleic Acids Res.</italic></source> <volume>49</volume> <fpage>D1413</fpage>&#x2013;<lpage>D1419</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkaa838</pub-id> <pub-id pub-id-type="pmid">33010177</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>T.</given-names></name> <name><surname>Zhang</surname> <given-names>N.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Ren</surname> <given-names>J.</given-names></name> <name><surname>Xu</surname> <given-names>P.</given-names></name> <name><surname>Liu</surname> <given-names>Z.</given-names></name><etal/></person-group> (<year>2017</year>). <article-title>A novel method to identify pre-microRNA in various species knowledge base on various species.</article-title> <source><italic>J. Biomed. Semant.</italic></source> <volume>8(Suppl. 1)</volume>:<issue>30</issue>. <pub-id pub-id-type="doi">10.1186/s13326-017-0143-z</pub-id> <pub-id pub-id-type="pmid">29297389</pub-id></citation></ref>
</ref-list>
</back>
</article>