<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Genet.</journal-id>
<journal-title>Frontiers in Genetics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Genet.</abbrev-journal-title>
<issn pub-type="epub">1664-8021</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fgene.2019.00466</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Genetics</subject>
<subj-group>
<subject>Technology Report</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>An Effective Method to Measure Disease Similarity Using Gene and Phenotype Associations</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Su</surname> <given-names>Shuhui</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/694618/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhang</surname> <given-names>Lei</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Liu</surname> <given-names>Jian</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/688269/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Computer Science and Technology, Harbin Institute of Technology</institution>, <addr-line>Harbin</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>School of Biological and Chemical Engineering, Zhejiang University of Science and Technology</institution>, <addr-line>Hangzhou</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Quan Zou, University of Electronic Science and Technology of China, China</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Jun Wan, Indiana University, United States; Wuritu Yang, Inner Mongolia University, China</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Jian Liu <email>jianliu&#x00040;hit.edu.cn</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Bioinformatics and Computational Biology, a section of the journal Frontiers in Genetics</p></fn></author-notes>
<pub-date pub-type="epub">
<day>21</day>
<month>05</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2019</year>
</pub-date>
<volume>10</volume>
<elocation-id>466</elocation-id>
<history>
<date date-type="received">
<day>15</day>
<month>03</month>
<year>2019</year>
</date>
<date date-type="accepted">
<day>30</day>
<month>04</month>
<year>2019</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2019 Su, Zhang and Liu.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Su, Zhang and Liu</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p><bold>Motivation:</bold> In order to create controlled vocabularies for shared use in different biomedical domains, a large number of biomedical ontologies such as Disease Ontology (DO) and Human Phenotype Ontology (HPO), etc., are created in the bioinformatics community. Quantitative measures of the associations among diseases could help researchers gain a deep insight of human diseases, since similar diseases are usually caused by similar molecular origins or have similar phenotypes, which is beneficial to reveal the common attributes of diseases and improve the corresponding diagnoses and treatment plans. Some previous are proposed to measure the disease similarity using a particular biomedical ontology during the past few years, but for a newly discovered disease or a disease with few related genetic information in Disease Ontology (i.e., a disease with less disease-gene associations), these previous approaches usually ignores the joint computation of disease similarity by integrating gene and phenotype associations.</p>
<p><bold>Results:</bold> In this paper we propose a novel method called GPSim to effectively deduce the semantic similarity of diseases. In particular, GPSim calculates the similarity by jointly utilizing gene, disease and phenotype associations extracted from multiple biomedical ontologies and databases. We also explore the phenotypic factors such as the depth of HPO terms and the number of phenotypic associations that affect the evaluation performance. A final experimental evaluation is carried out to evaluate the performance of GPSim and shows its advantages over previous approaches.</p></abstract>
<kwd-group>
<kwd>disease similarity</kwd>
<kwd>phenotype association</kwd>
<kwd>genomic annotation</kwd>
<kwd>disease ontology</kwd>
<kwd>biomedical ontology</kwd>
</kwd-group>
<counts>
<fig-count count="6"/>
<table-count count="0"/>
<equation-count count="9"/>
<ref-count count="39"/>
<page-count count="8"/>
<word-count count="4777"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>The emergence of massive biomedical data offers a marvelous opportunity for the life science research and modern disease diagnosis. The wealth of knowledge contained in biomedical big data also brings great challenges, since many biologists chronically construct their biomedical database applications by using their own terms to represent biomedical knowledge. In order to create controlled vocabularies for the shared use of knowledge, a large number of biomedical ontologies such as Disease Ontology [DO (Schriml et al., <xref ref-type="bibr" rid="B31">2012</xref>; Kibbe et al., <xref ref-type="bibr" rid="B7">2014</xref>)] and Human Phenotype Ontology [HPO (K&#x000F6;hler et al., <xref ref-type="bibr" rid="B9">2014</xref>)], etc., are created in the bioinformatics community. Biomedical ontologies (Lee et al., <xref ref-type="bibr" rid="B14">2008</xref>; K&#x000F6;hler et al., <xref ref-type="bibr" rid="B10">2009</xref>; Meehan et al., <xref ref-type="bibr" rid="B22">2013</xref>; Groza et al., <xref ref-type="bibr" rid="B4">2015</xref>; Patel et al., <xref ref-type="bibr" rid="B25">2015</xref>; Denny et al., <xref ref-type="bibr" rid="B3">2018</xref>; Lovering et al., <xref ref-type="bibr" rid="B20">2018</xref>) reduce the complexity of life science&#x00027;s concepts and make innovative contributions to advance the understanding of human diseases with controllable terminology. Currently, these ontologies have been used in a variety of biomedical applications. For example, HPO-based analysis tools have been used to assist in clinical diagnosis (Westbury et al., <xref ref-type="bibr" rid="B33">2015</xref>) and exon sequencing research (Peng et al., <xref ref-type="bibr" rid="B26">2018</xref>), etc. In addition, by using DO, researchers build the chain knowledge base of etiology (Harrow et al., <xref ref-type="bibr" rid="B5">2017</xref>; Kozaki et al., <xref ref-type="bibr" rid="B11">2017</xref>) and annotate human genes to improve the coverage of disease genes&#x00027; annotations (Osborne et al., <xref ref-type="bibr" rid="B24">2009</xref>).</p>
<p>Exploring the associations (Landrum et al., <xref ref-type="bibr" rid="B12">2014</xref>) among diseases by using biomedical ontologies has attracted a significant attention in biomedical domains (Zhao and Halang, <xref ref-type="bibr" rid="B38">2006</xref>; Zhang et al., <xref ref-type="bibr" rid="B36">2008</xref>; Zeng et al., <xref ref-type="bibr" rid="B35">2017</xref>). Quantitative measures of these associations among diseases could help researchers gain a deep insight of human diseases, since similar diseases are usually caused by similar molecular origins or have similar phenotypes. Deducing the semantic similarity of disease is beneficial to reveal the common attributes (e.g., the classification of diseases, disease-related genes, disease-related symptoms, etc.) of these diseases, which could facilitate the understanding of underlying causes and improve the disease diagnoses and treatment plans. For example, the gene &#x0201C;SH2D3C&#x0201D; is one of the common genes of &#x0201C;Amnesia&#x0201D; and &#x0201C;Alzheimer&#x00027;s disease,&#x0201D; which reveals that they may involve the same biological processes. The greater similarity means that the more closely related these two concepts are, and that the more common information they have (Liu and Yan, <xref ref-type="bibr" rid="B17">2016</xref>; Liu and Zhang, <xref ref-type="bibr" rid="B18">2017</xref>; Liu et al., <xref ref-type="bibr" rid="B19">2017</xref>). A good quantitative method for computing the similarity among diseases could directly help researchers obtain the information of diseases having close relationships from massive biomedical data and do the corresponding experiments for the further analysis, which could significantly reduce the experimental cost and improve the efficiency of discovering potential pathogenic mechanism and drugs.</p>
<p>DO regulates the controlled vocabularies about diseases, and integrates the diseases&#x00027; terms and medical data through external links. It provides the accurate, non-duplicative terms with high disease coverage and has been used to compute the degree of correlation among diseases during last decade (i.e., the disease similarity) (Osborne et al., <xref ref-type="bibr" rid="B24">2009</xref>). DO is usually selected as the source of disease terms for the disease similarity calculation. Several previous approaches, including those based on information content (IC) (Resnik, <xref ref-type="bibr" rid="B28">1995</xref>; Lin, <xref ref-type="bibr" rid="B16">1998</xref>; Schlicker et al., <xref ref-type="bibr" rid="B30">2006</xref>; Wang et al., <xref ref-type="bibr" rid="B32">2007</xref>; Bandyopadhyay and Mallick, <xref ref-type="bibr" rid="B1">2014</xref>), ontology Directed Acyclic Graph (DAG) structure (Kim et al., <xref ref-type="bibr" rid="B8">1993</xref>; Zhang et al., <xref ref-type="bibr" rid="B37">2010</xref>; Santos et al., <xref ref-type="bibr" rid="B29">2012</xref>) and biological function process (Mathur and Dinakarpandian, <xref ref-type="bibr" rid="B21">2012</xref>; Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>; Jeong and Chen, <xref ref-type="bibr" rid="B6">2015</xref>; Zou et al., <xref ref-type="bibr" rid="B39">2016</xref>; Yang et al., <xref ref-type="bibr" rid="B34">2017</xref>; Ni et al., <xref ref-type="bibr" rid="B23">2018</xref>), have been proposed with the aim to measure the disease similarity by using DO. For the IC-based approaches, Resnik (<xref ref-type="bibr" rid="B28">1995</xref>) use IC of the most informative common ancestor (MICA) to measure the similarity of two diseases. To improve the efficiency of the Resnik&#x00027;s method, Lin (<xref ref-type="bibr" rid="B16">1998</xref>) propose the ratio of the amount of IC of MICA and that of two DO terms and then Schlicker et al. (<xref ref-type="bibr" rid="B30">2006</xref>) improve the Lin&#x00027;s approach through the Bernoulli probability distribution to reduce the impact of shallow annotations (Li et al., <xref ref-type="bibr" rid="B15">2010</xref>). However, IC-based approaches only focus on the semantic information of two terms in different layers of ontology DAG. They ignore the information from the ontology DAG structure, and it is difficult to reveal the semantic differences between two terms under the same MICA. DAG-based approaches are susceptible to shallow annotations since the shallow concepts are too generalized to have much information (Li et al., <xref ref-type="bibr" rid="B15">2010</xref>). For the DAG-based approaches, Kim et al. (<xref ref-type="bibr" rid="B8">1993</xref>) consider that the reciprocal of the shortest distance of two disease in DAG to measure their similarity. Zhang et al. (<xref ref-type="bibr" rid="B37">2010</xref>) take into account not only the shortest distance, but also the depth of the least common ancestor. For the methods based on biological functional processes, BOG (Mathur and Dinakarpandian, <xref ref-type="bibr" rid="B21">2012</xref>) calculates by the overlapping of related gene sets as the disease similarity. PSB (Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>) takes account of the gene similarity additionally to improve BOG&#x00027;s performance. By adding associations obtained from external databases, BOG and PSB perform better performance than previous IC-based and DAG-based approaches. Nevertheless, they ignore the joint computation of disease similarities by integrating gene and phenotype associations, and have poor performance when evaluating disease similarities for the disease with less genetic information such as viral infectious disease (Common Wart, DOID:11165) and vein disease (Esophageal Varix, DOID:112) in DO.</p>
<p>To effectively evaluate the similarities of newly discovered diseases or diseases with few genetic information in current medical research (i.e., diseases with less disease-gene associations), we propose a novel semantic similarity measure method called GPSim in this paper. GPSim takes genes, diseases and phenotypes into account, and calculates the similarities by jointly utilizing their associations extracted from multiple biomedical ontologies and databases. Besides, we explore the phenotypic factors influencing the performance of GPSim. The experimental results show that, in comparison with previous similarity evaluation methods, our proposed approach has the best performance in terms of ROC (receiver operating characteristic curve) and AUC (area under curve).</p></sec>
<sec sec-type="methods" id="s2">
<title>Methods</title>
<p>In this section, we introduce the details of our proposed method GPSim. GPSim relies on the associations of disease-gene and disease-phenotype. We firstly integrate the association data extracted from HPO, DO, and other biomedical databases, and then compute the corresponding disease similarity.</p>
<sec>
<title>Disease-Genetic and Disease-Phenotypic Relationship Integrations</title>
<p>Disease-phenotype and disease-gene-phenotype mapping relations mainly come from the HPO mapping file (Download from <ext-link ext-link-type="uri" xlink:href="http://compbio.charite.de/jenkins/job/hpo.annotations.monthly/lastStableBuild/artifact/annotation/ALL_SOURCES_ALL_FREQUENCIES_diseases_to_genes_to_phenotypes.txt">http://compbio.charite.de/jenkins/job/hpo.annotations.monthly/lastStableBuild/artifact/annotation/ALL_SOURCES_ALL_FREQUENCIES_diseases_to_genes_to_phenotypes.txt</ext-link>). The disease information is extracted from the DO, which has totally 11191 disease terms and 2,140 of them have disease-gene and disease-phenotype mapping relations, and 808 have disease-phenotype mapping relations. Additionally, we integrate the proven disease-gene relationships in the SIDD (Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>) and the Dancer databases (Download from <ext-link ext-link-type="uri" xlink:href="http://wodaklab.org/dancer/">http://wodaklab.org/dancer/</ext-link> downloads). Through the completely matching names and synonyms of DO terms, we identify the DO terms and obtain the corresponding disease-gene mapping from Dancer. In this scenario, the number of terms having disease-gene and disease-phenotype mapping relations is 2505.</p>
<p>As shown in <xref ref-type="fig" rid="F1">Figure 1</xref>, we extract the disease terms including disease&#x00027;s id, label, definition, synonyms, related databases, parents, and children from DO (Peng et al., <xref ref-type="bibr" rid="B27">2013</xref>). Then we gain the disease-gene associations from Dancer, SIDD and HPO, and their relationships among diseases and phenotypes from HPO. The format of data from Dancer is &#x0201C;Disease&#x00027;s name: GeneID.&#x0201D; We identify the disease term in Dancer through totally matching the disease&#x00027;s name, obtaining the association such as &#x0201C;DOID: GeneID.&#x0201D; The format of data obtained from SIDD and HPO is &#x0201C;OMIMID/ORPHA ID/DOID: GeneID&#x0201D;, and we get the association through matching their ID information. Similarly, we transform the disease-phenotype associations into available formats &#x0201C;DOID: HPOID&#x0201D; through the id of OMIM, Orphanet, and DO. Finally the associated data of disease-gene and disease-phenotype are loaded and integrated in the database (depicted as DGP).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Associated data integrations.</p></caption>
<graphic xlink:href="fgene-10-00466-g0001.tif"/>
</fig></sec>
<sec>
<title>Computing the Similarity</title>
<p>The similarity evaluation of any two DO terms relies on disease-gene and disease-phenotype associations. We firstly compute the similarity of disease-related gene set and the similarity of disease-related phenotype set, and then integrate them as follows:</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>G</mml:mi><mml:mi>P</mml:mi><mml:mi>S</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>d</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo></mml:mstyle><mml:mtext>&#x02009;</mml:mtext><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>d</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mo>=</mml:mo><mml:mi>&#x003B2;</mml:mi><mml:mo>&#x000D7;</mml:mo><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>G</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>e</mml:mi><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>G</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>G</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mo>+</mml:mo></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mn>1</mml:mn><mml:mo>-</mml:mo><mml:mi>&#x003B2;</mml:mi></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mo>&#x000D7;</mml:mo><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>H</mml:mi><mml:mi>P</mml:mi><mml:mi>O</mml:mi><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mo stretchy='false'>(</mml:mo><mml:mi>P</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>P</mml:mi><mml:mn>2</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mstyle></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Here, <italic>simGPSim</italic> represents the disease similarity computed by using GPSim. For two DO terms <italic>d1</italic> and <italic>d2, G1</italic>, and <italic>G2</italic> represent the disease-related gene sets of <italic>d1</italic> and <italic>d2</italic>, respectively. <italic>P1</italic> and <italic>P2</italic> represent the disease-related phenotype sets of d1 and d2, respectively. simGeneSet represents the similarity between <italic>G1</italic> and <italic>G2</italic>. <italic>simHPOSet</italic> represents the similarity between <italic>P1</italic> and <italic>P2</italic>. &#x003B2; is the weight tuning the contribution of genes and phenotypes to the similarities of diseases, and the value of &#x003B2; depends on the quality of disease-gene and disease-phenotype associations (e.g., the association number, the depth of terms in HPO) of diseases in the tested dataset.</p>
<p>Computing the similarity of two gene sets relies on the gene-gene similarity network. We extract the network from the HumanNet (Lee et al., <xref ref-type="bibr" rid="B13">2011</xref>). The HumanNet is a probabilistic functional gene network. Each interaction in the HumanNet is a log-likelihood score (<italic>LLS</italic>) which measures the probability of a true functional linkage between two genes. The functional similarity of two genes by normalizing the HumanNet (denoted as <italic>LLSN</italic>) are computed as follows (Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>):</p>
<disp-formula id="E2"><label>(2)</label><mml:math id="M2"><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>L</mml:mi><mml:mi>L</mml:mi><mml:mi>S</mml:mi><mml:mi>N</mml:mi></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>t</mml:mi><mml:mn>1</mml:mn></mml:mstyle><mml:mo>,</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>t</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>L</mml:mi><mml:mi>L</mml:mi><mml:mi>S</mml:mi></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>t</mml:mi><mml:mn>1</mml:mn></mml:mstyle><mml:mo>,</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>t</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x02212;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>L</mml:mi><mml:mi>L</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>S</mml:mi></mml:mstyle><mml:mrow><mml:mi>min</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>L</mml:mi><mml:mi>L</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>S</mml:mi></mml:mstyle><mml:mrow><mml:mi>max</mml:mi></mml:mrow></mml:msub><mml:mo>&#x02212;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>L</mml:mi><mml:mi>L</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>S</mml:mi></mml:mstyle><mml:mrow><mml:mi>min</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mrow></mml:math></disp-formula>
<disp-formula id="E3"><label>(3)</label><mml:math id="M3"><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>e</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>g</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mtext>&#x000A0;</mml:mtext><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo>=</mml:mo></mml:mstyle><mml:mtext>&#x000A0;</mml:mtext><mml:mrow><mml:mo>{</mml:mo><mml:mrow><mml:mtable columnalign='left'><mml:mtr columnalign='left'><mml:mtd columnalign='right'><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mn>1</mml:mn><mml:mo>,</mml:mo></mml:mstyle></mml:mrow></mml:mtd><mml:mtd columnalign='left'><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>1</mml:mn><mml:mo>=</mml:mo><mml:mi>g</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow></mml:mtd></mml:mtr><mml:mtr columnalign='left'><mml:mtd columnalign='right'><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>L</mml:mi><mml:mi>L</mml:mi><mml:mi>S</mml:mi><mml:mi>N</mml:mi></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>g</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo>,</mml:mo></mml:mstyle></mml:mrow></mml:mtd><mml:mtd columnalign='left'><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>1</mml:mn></mml:mstyle><mml:mo>&#x02260;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>2</mml:mn><mml:mi>a</mml:mi><mml:mi>n</mml:mi><mml:mi>d</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mi>e</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>g</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>g</mml:mi><mml:mn>2</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mstyle><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x02208;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>H</mml:mi><mml:mi>u</mml:mi><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>n</mml:mi><mml:mi>N</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:mtd></mml:mtr><mml:mtr columnalign='left'><mml:mtd columnalign='right'><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mn>0</mml:mn></mml:mstyle></mml:mtd><mml:mtd columnalign='left'><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>1</mml:mn></mml:mstyle><mml:mo>&#x02260;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mn>2</mml:mn><mml:mi>a</mml:mi><mml:mi>n</mml:mi><mml:mi>d</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mi>e</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>g</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>g</mml:mi><mml:mn>2</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mstyle><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x02208;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>H</mml:mi><mml:mi>u</mml:mi><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>n</mml:mi><mml:mi>N</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:mrow></mml:mrow></mml:math></disp-formula>
<p>Here, <italic>LLS</italic><sub><italic>min</italic></sub> and <italic>LLS</italic><sub><italic>max</italic></sub> represent the minimum and maximum in the HumanNet, respectively. <italic>sim</italic><sub><italic>gene</italic></sub> represents the similarity of two genes <italic>g1</italic> and <italic>g2</italic>. If there is no linkage of two genes in HumanNet, then their similarity is 0. Thus, the similarity measurement of two gene sets is defined as follows (Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>):</p>
<disp-formula id="E4"><label>(4)</label><mml:math id="M4"><mml:mrow><mml:mtable columnalign='left'><mml:mtr columnalign='left'><mml:mtd columnalign='left'><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mtext>&#x000A0;&#x000A0;</mml:mtext><mml:mi>G</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>e</mml:mi><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>G</mml:mi><mml:mn>1</mml:mn><mml:mo>,</mml:mo><mml:mi>G</mml:mi><mml:mn>2</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mstyle></mml:mrow></mml:mtd></mml:mtr><mml:mtr columnalign='left'><mml:mtd columnalign='left'><mml:mrow><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mstyle displaystyle='true'><mml:msub><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi><mml:mi>i</mml:mi></mml:mstyle><mml:mo>&#x02208;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>G</mml:mi><mml:mn>1</mml:mn></mml:mstyle></mml:mrow></mml:msub><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo stretchy='false'>(</mml:mo><mml:mi>g</mml:mi><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>G</mml:mi><mml:mn>2</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mstyle></mml:mrow></mml:mstyle><mml:mtext>&#x000A0;</mml:mtext><mml:mo>+</mml:mo><mml:msub><mml:mrow><mml:msup><mml:mstyle mathsize='140%' displaystyle='true'><mml:mo>&#x02211;</mml:mo></mml:mstyle><mml:mtext>&#x0200B;</mml:mtext></mml:msup></mml:mrow><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>g</mml:mi></mml:mstyle><mml:msup><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>i</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo>,</mml:mo></mml:mstyle></mml:msup></mml:mrow></mml:msub><mml:msub><mml:mrow></mml:mrow><mml:mrow><mml:mo>&#x02208;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>G</mml:mi><mml:mn>2</mml:mn></mml:mstyle></mml:mrow></mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo stretchy='false'>(</mml:mo><mml:mi>g</mml:mi></mml:mstyle><mml:msup><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>i</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo>,</mml:mo></mml:mstyle></mml:msup><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mo>,</mml:mo><mml:mi>G</mml:mi><mml:mn>1</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mstyle></mml:mrow><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>n</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mo>+</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mi>m</mml:mi></mml:mstyle></mml:mrow></mml:mfrac></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:mrow></mml:math></disp-formula>
<disp-formula id="E5"><label>(5)</label><mml:math id="M5"><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:msup><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>k</mml:mi></mml:mstyle><mml:mo>,</mml:mo></mml:msup><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>G</mml:mi></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>m</mml:mi><mml:mi>a</mml:mi><mml:mi>x</mml:mi></mml:mstyle><mml:mo>&#x0007B;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:mstyle><mml:mo>&#x02208;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>G</mml:mi></mml:mstyle><mml:mo>&#x02212;</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi></mml:mstyle><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>k</mml:mi></mml:mstyle><mml:mo>,</mml:mo><mml:mstyle mathvariant='bold-italic' mathsize='normal'><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x0007D;</mml:mo></mml:mrow></mml:math></disp-formula>
<p>Here <italic>gi</italic> represents a gene in the gene set <italic>G1</italic> and <italic>gi&#x00027;</italic> represents a gene in the gene set <italic>G2</italic>. <italic>k</italic> represents a gene in a gene set. <italic>G</italic> represents a gene set and <italic>ki</italic> represents any gene in <italic>G</italic>. We define the similarity between a gene <italic>k</italic> and a gene set <italic>G</italic> as the maximum of the similarity of <italic>k</italic> and <italic>ki</italic> in <italic>G</italic>. As shown in <xref ref-type="fig" rid="F2">Figure 2</xref> and formula (4), we compute the similarity of every gene <italic>gj</italic> (<italic>j</italic> &#x0003D; 1, 2,&#x02026;,m) in gene set <italic>G1</italic> and that of every gene g<italic>j&#x00027;</italic> (<italic>j</italic> &#x0003D; 1, 2,&#x02026;,n) and gene set <italic>G2</italic> respectively, and then calculate the average value of all similarities representing the similarities of two gene sets <italic>G1</italic> and <italic>G2</italic>.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Computing the similarity between two gene sets.</p></caption>
<graphic xlink:href="fgene-10-00466-g0002.tif"/>
</fig>
<p>Computing the similarity of two disease-related phenotype sets relies on the association of diseases and phenotypes. We could measure the similarity of two phenotype sets by their overlaps, the similarity between two phenotype sets could be defined as follows:</p>
<disp-formula id="E9"><label>(6)</label><mml:math id="M9"><mml:mtable class="eqnarray" columnalign="right center left"><mml:mtr><mml:mtd><mml:mstyle mathvariant="bold-italic"><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>H</mml:mi><mml:mi>P</mml:mi><mml:mi>O</mml:mi><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>P</mml:mi></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mn>1</mml:mn></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mo>,</mml:mo></mml:mstyle><mml:mstyle mathvariant="bold-italic"><mml:mi>P</mml:mi></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mn>2</mml:mn></mml:mstyle></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mtext>&#x000A0;</mml:mtext><mml:mstyle mathvariant="bold"><mml:mo>=</mml:mo></mml:mstyle><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mstyle mathvariant="bold"><mml:mn>2</mml:mn><mml:mo>&#x000D7;</mml:mo></mml:mstyle><mml:mo>|</mml:mo><mml:mstyle mathvariant="bold-italic"><mml:mi>P</mml:mi></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mn>1</mml:mn><mml:mo>&#x02229;</mml:mo><mml:mi>P</mml:mi></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mn>2</mml:mn></mml:mstyle><mml:mo>|</mml:mo></mml:mrow><mml:mrow><mml:mo>|</mml:mo><mml:mstyle mathvariant="bold-italic"><mml:mi>P</mml:mi></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mn>1</mml:mn></mml:mstyle><mml:mo>|</mml:mo><mml:mstyle mathvariant="bold"><mml:mo>&#x0002B;</mml:mo></mml:mstyle><mml:mo>|</mml:mo><mml:mstyle mathvariant="bold-italic"><mml:mi>P</mml:mi></mml:mstyle><mml:mstyle mathvariant="bold"><mml:mn>2</mml:mn></mml:mstyle><mml:mo>|</mml:mo></mml:mrow></mml:mfrac></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The total process of the disease similarity computation is shown in <xref ref-type="fig" rid="F3">Figure 3</xref>. For instant, to calculate the similarity of two disease terms, &#x0201C;Alzheimer&#x00027;s disease&#x0201D; (DOID:10652) and &#x0201C;schizophrenia&#x0201D; (DOID:5419). We firstly get the disease-related gene sets and disease-related phenotype sets of two diseases respectively, from the integrated DGP database in Disease-Genetic and Disease-Phenotypic Relationship Integrations. By using formula (4) and (5), the similarity of two gene sets is calculated as 0.4784. The similarity result of two phenotype sets by using formula (6) is 0.1111. Finally, we integrate the similarity of gene sets and phenotype sets by using formula (1), in this scenario the corresponding similarity value is 0.4417.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>The similarity calculation by using GPSim.</p></caption>
<graphic xlink:href="fgene-10-00466-g0003.tif"/>
</fig>
<p>Let <italic>N</italic> be the total number of diseases in DO, and <italic>K</italic> and <italic>L</italic> be the sizes of disease-related gene and disease-related phenotype sets, respectively. There are <italic>N</italic><sup>2</sup> pairs of diseases and it costs <italic>O</italic>(<italic>N</italic><sup>2</sup>) to compute all the similarities. For each disease pair, we need to compute both the similarities based on disease-related gene and disease-related phenotype sets. Calculating two diseases&#x00027; similarity based on disease-related gene sets costs <italic>O</italic>(<italic>K</italic><sup>2</sup>) to obtain the corresponding similarity. The intersection between two disease-related phenotype sets takes <italic>O</italic>(<italic>L</italic>). As a result, it takes <italic>O</italic>(<italic>N</italic><sup>2</sup> <sup>&#x0002A;</sup>(<italic>K</italic><sup>2</sup> &#x0002B;<italic>L</italic>)) to compute the similarity of all disease pairs.</p></sec></sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>In our experiments, we explore the phenotypic factors including the depth of HPO terms and the number of disease-phenotype associations when each disease has few disease-gene associations and compare GPSim with previous disease similarity measurement methods, including Resnik (Resnik, <xref ref-type="bibr" rid="B28">1995</xref>), Zhang (Zhang et al., <xref ref-type="bibr" rid="B37">2010</xref>), BOG (Mathur and Dinakarpandian, <xref ref-type="bibr" rid="B21">2012</xref>) and SemFunSim(Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>).</p>
<p>All the experiments are performed on 2.50 GHz Intel Core i7 CPU with 8.00 GB RAM running on Windows 10 64-bit system. We implemented all the approaches in Java with JDK 1.8.0 and Python 3.0.</p>
<p>To provide a fair comparison with previous approaches, we select the disease pairs with disease-gene and disease-phenotype associations from the SIDD benchmark and carry out the experiments by using the tested method used in previous approach (Cheng et al., <xref ref-type="bibr" rid="B2">2014</xref>). In particular, we take the disease pairs in the benchmark set as the positive examples, and randomly generate 500 disease pairs as the negative examples, combining the positive examples and the negative examples as a tested set. To reduce test error we generate 100 tested sets to compare the performance of different methods and get the average value of 100 test results. For each tested set, we calculate the similarity of each disease pair by using the Resnik&#x00027;s method, Zhang&#x00027;s, BOG, SemFunSim and GPSim, and the performance comparisons are performed by using a receiver operating characteristic curve (ROC). ROC curve is a curve drawn with true positive rate (TPR) as Y axis and false positive rate (FPR) as X axis according to a series of different dichotomies (boundary values or decision thresholds). Generally, the closer to the upper left corner the ROC is, the more accurate the corresponding method is. For showing the performance of different methods more directly, the area under curve (AUC) of the ROC was also given. The greater AUC is, the better the performance is.</p>
<p>In the first sets of experiments, for diseases having less genetic associations (e.g., &#x0003C;9) in DO, we firstly calculate the similarities by using GPSim with different values of the beta (see formula 1 in Computing the Similarity). From the results observed from <xref ref-type="fig" rid="F4">Figure 4A</xref>, we see that beta value of 0.9 is an optimum threshold in the tested dataset, which also reveals that jointly using disease-gene and disease-phenotype associations could improve the effect of disease similarity measurements. In this scenario, we also investigate the impact of the phenotypic factors such as the depth of HPO terms and the number of the disease-phenotype associations. To test the impact of similarity evaluation using different depth of HPO terms, we vary the HPO terms&#x00027; depth from 3, 5, 7, 9, and 11. As shown in the <xref ref-type="fig" rid="F4">Figure 4B</xref>, we see that, when the HPO terms&#x00027; depth is &#x0003E;5, after obtained the corresponding disease-phenotype associations (depth &#x02265;5), GPSim obtains the best the performance (the AUC is 81.51%), which illustrates that the performance of calculating disease similarity is declined by using the shallow HPO disease-phenotype associations. <xref ref-type="fig" rid="F4">Figure 4C</xref> shows the experimental results using different number of disease-phenotype associations in the deep layer of the HPO (e.g., depth &#x02265;5). From the figure, we see that, the more the number of disease-phenotype associations, the better the effect of GPSim.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>The ROC and AUC using different phenotypic factors. <bold>(A)</bold> ROC of different beta. <bold>(B)</bold> ROC of different HPO&#x00027;s depth. <bold>(C)</bold> ROC of different HPO&#x00027;s quantity.</p></caption>
<graphic xlink:href="fgene-10-00466-g0004.tif"/>
</fig>
<p>In the second sets of experiments, we firstly compare the performance of Resnik, Zhang, BOG, SemFunSim and GPSim in terms of ROC and the AUC, for the scenarios of diseases with few disease-gene associations (e.g., &#x0003C;9). As shown in <xref ref-type="fig" rid="F5">Figure 5</xref>, GPSim also presents the best performance. <xref ref-type="fig" rid="F6">Figure 6</xref> shows the performance for the scenarios of diseases with multiple disease-gene associations, and the consistent results are obtained and GPSim has the best performance. In particular, we see that the AUCs of GPSim, SemFunSim, BOG, Zhang and Resnik are 99.05, 97.69, 80.99, 67.80, and 59.05% respectively. Note that, since the negative samples are randomly generated, the average values of AUC of these methods may have a 2% float, and their corresponding floating directions are consistent. This is because (i) the similarity evaluation of Resnik&#x00027;s and Zhang&#x00027;s methods are centered on Disease Ontology only, and additional information such as associations among genes and diseases are not taken into account, (ii) BOG and SemFunSim improve the similarity measurement method by adding associations among genes and diseases to alleviate information insufficiency, (iii) GPSim further integrate gene, disease and phenotype associations extracted from multiple biomedical ontologies and databases, and it jointly utilizes these associations to effectively deduce the semantic similarity. Therefore, GPSim is more suitable for the similarity evaluation, which is what we have expected.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Performance comparisons based on the dataset with few genetic information.</p></caption>
<graphic xlink:href="fgene-10-00466-g0005.tif"/>
</fig>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>Performance comparisons based on all associations.</p></caption>
<graphic xlink:href="fgene-10-00466-g0006.tif"/>
</fig></sec>
<sec sec-type="conclusions" id="s4">
<title>Conclusion</title>
<p>The vast amount of biomedical data has brought huge benefits to disease diagnosis and life science research, but it has also brought challenges to the understanding and searching of biological information in different disease terms. Thus, a large number of biomedical ontologies with controlled vocabularies are created for the biomedical knowledge share. Currently, quantitative measures of the associations among diseases by using biomedical ontologies have become the research hotspot. In this paper, we focus on the joint computation of disease similarities by integrating gene and phenotype associations. In particular, we propose an effective method to measure the similarity of diseases in Disease Ontology with disease-related gene and phenotype associations extracted from HPO and other biomedical databases, which calculates the similarities by jointly utilizing their associations. The final experiments show that, our proposed method has the best performance in terms of ROC and AUC, compared with previous methods. In the future, we plan to apply GPSim to the disease annotation applications for providing researchers with a more powerful annotation tool based on biomedical ontologies. Additionally, we would like to involve more information, such as gene sequence, expression information, to improve our disease similarity model.</p></sec>
<sec id="s5">
<title>Data Availability</title>
<p>All datasets analyzed for this study are included in the manuscript and the supplementary files. The source code of GPSim is freely available at <ext-link ext-link-type="uri" xlink:href="https://github.com/lyotvincent/GPSim">https://github.com/lyotvincent/GPSim</ext-link>.</p></sec>
<sec id="s6">
<title>Author Contributions</title>
<p>JL conceived the project, conceptualized the method, designed the studies, and contributed to writing the manuscript. JL, SS, and LZ implemented the algorithms, performed the analysis and contributed to writing the manuscript. All authors read and approved the final version of the manuscript.</p>
<sec>
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p></sec></sec>
</body>
<back>
<ack><p>The authors thank the referees for their valuable comments and suggestions.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bandyopadhyay</surname> <given-names>S.</given-names></name> <name><surname>Mallick</surname> <given-names>K.</given-names></name></person-group> (<year>2014</year>). <article-title>A new path based hybrid measure for gene ontology similarity</article-title>. <source>IEEE/ACM Trans. Comput. Biol. Bioinform.</source> <volume>11</volume>, <fpage>116</fpage>&#x02013;<lpage>127</lpage>. <pub-id pub-id-type="doi">10.1109/TCBB.2013.149</pub-id><pub-id pub-id-type="pmid">26355512</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname> <given-names>L.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Ju</surname> <given-names>P.</given-names></name> <name><surname>Peng</surname> <given-names>J.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name></person-group> (<year>2014</year>). <article-title>SemFunSim: a new method for measuring disease similarity by integrating semantic and gene functional association</article-title>. <source>PLoS ONE</source> <volume>9</volume>:<fpage>e99415</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0099415</pub-id><pub-id pub-id-type="pmid">24932637</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Denny</surname> <given-names>P.</given-names></name> <name><surname>Feuermann</surname> <given-names>M.</given-names></name> <name><surname>Hill</surname> <given-names>D. P.</given-names></name> <name><surname>Lovering</surname> <given-names>R. C.</given-names></name> <name><surname>Plun-Favreau</surname> <given-names>H.</given-names></name> <name><surname>Roncaglia</surname> <given-names>P.</given-names></name></person-group> (<year>2018</year>). <article-title>Exploring autophagy with Gene Ontology</article-title>. <source>Autophagy</source> <volume>2018</volume>, <fpage>1</fpage>&#x02013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1080/15548627.2017.1415189</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Groza</surname> <given-names>T.</given-names></name> <name><surname>K&#x000F6;hler</surname> <given-names>S.</given-names></name> <name><surname>Moldenhauer</surname> <given-names>D.</given-names></name> <name><surname>Vasilevsky</surname> <given-names>N.</given-names></name> <name><surname>Baynam</surname> <given-names>G.</given-names></name> <name><surname>Zemojtel</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>The human phenotype ontology: semantic unification of common and rare disease</article-title>. <source>Am. J. Hum. Genet.</source> <volume>97</volume>, <fpage>111</fpage>&#x02013;<lpage>124</lpage>. <pub-id pub-id-type="doi">10.1016/j.ajhg.2015.05.020</pub-id><pub-id pub-id-type="pmid">26119816</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harrow</surname> <given-names>I.</given-names></name> <name><surname>Jim&#x000E9;nez-Ruiz</surname> <given-names>E.</given-names></name> <name><surname>Splendiani</surname> <given-names>A.</given-names></name> <name><surname>Romacker</surname> <given-names>M.</given-names></name> <name><surname>Woollard</surname> <given-names>P.</given-names></name> <name><surname>Markel</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Matching disease and phenotype ontologies in the ontology alignment evaluation initiative</article-title>. <source>J. Biomed. Sem.</source> <volume>8</volume>:<fpage>55</fpage>. <pub-id pub-id-type="doi">10.1186/s13326-017-0162-9</pub-id><pub-id pub-id-type="pmid">29197409</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jeong</surname> <given-names>J. C.</given-names></name> <name><surname>Chen</surname> <given-names>X.</given-names></name></person-group> (<year>2015</year>). <article-title>A new semantic functional similarity over gene ontology</article-title>. <source>IEEE/ACM Trans Comput Biol Bioinform</source>. <volume>12</volume>, <fpage>322</fpage>&#x02013;<lpage>334</lpage>. <pub-id pub-id-type="doi">10.1109/TCBB.2014.2343963</pub-id><pub-id pub-id-type="pmid">26357220</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kibbe</surname> <given-names>W. A.</given-names></name> <name><surname>Arze</surname> <given-names>C.</given-names></name> <name><surname>Felix</surname> <given-names>V.</given-names></name> <name><surname>Mitraka</surname> <given-names>E.</given-names></name> <name><surname>Bolton</surname> <given-names>E.</given-names></name> <name><surname>Fu</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Disease ontology 2015 update: an expanded and updated database of human diseases for linking biomedical knowledge through disease data</article-title>. <source>Nucleic Acids Res.</source> <volume>43</volume>:<fpage>D1071</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gku1011</pub-id><pub-id pub-id-type="pmid">25348409</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>M. H.</given-names></name> <name><surname>Lee</surname> <given-names>Y. J.</given-names></name> <name><surname>Lee</surname> <given-names>J. H.</given-names></name></person-group> (<year>1993</year>). <article-title>Information retrieval based on conceptual distance in is - a hierarchies</article-title>. <source>J. Docum.</source> <volume>49</volume>, <fpage>188</fpage>&#x02013;<lpage>207</lpage>. <pub-id pub-id-type="doi">10.1108/eb026913</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x000F6;hler</surname> <given-names>S.</given-names></name> <name><surname>Doelken</surname> <given-names>S. C.</given-names></name> <name><surname>Mungall</surname> <given-names>C. J.</given-names></name> <name><surname>Bauer</surname> <given-names>S.</given-names></name> <name><surname>Firth</surname> <given-names>H. V.</given-names></name> <name><surname>Bailleul-Forestier</surname> <given-names>I.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>The Human phenotype ontology project: linking molecular biology and disease through phenotype data</article-title>. <source>Nucleic Acids Res.</source> <volume>42</volume>, <fpage>966</fpage>&#x02013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkt1026</pub-id><pub-id pub-id-type="pmid">24217912</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>K&#x000F6;hler</surname> <given-names>S.</given-names></name> <name><surname>Schulz</surname> <given-names>M. H.</given-names></name> <name><surname>Krawitz</surname> <given-names>P.</given-names></name> <name><surname>Bauer</surname> <given-names>S.</given-names></name> <name><surname>D&#x000F6;lken</surname> <given-names>S.</given-names></name> <name><surname>Ott</surname> <given-names>C. E.</given-names></name> <etal/></person-group>. (<year>2009</year>). <article-title>Clinical diagnostics in human genetics with semantic similarity searches in ontologies</article-title>. <source>Am. J. Hum. Genet.</source> <volume>85</volume>, <fpage>457</fpage>&#x02013;<lpage>464</lpage>. <pub-id pub-id-type="doi">10.1016/j.ajhg.2009.09.003</pub-id><pub-id pub-id-type="pmid">19800049</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kozaki</surname> <given-names>K.</given-names></name> <name><surname>Yamagata</surname> <given-names>Y.</given-names></name> <name><surname>Mizoguchi</surname> <given-names>R.</given-names></name> <name><surname>Imai</surname> <given-names>T.</given-names></name> <name><surname>Ohe</surname> <given-names>K.</given-names></name></person-group> (<year>2017</year>). <article-title>Disease compass - a navigation system for disease knowledge based on ontology and linked data techniques</article-title>. <source>J. Biomed. Sem.</source> <volume>8</volume>:<fpage>22</fpage>. <pub-id pub-id-type="doi">10.1186/s13326-017-0132-2</pub-id><pub-id pub-id-type="pmid">28629436</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Landrum</surname> <given-names>M. J.</given-names></name> <name><surname>Lee</surname> <given-names>J. M.</given-names></name> <name><surname>Riley</surname> <given-names>G. R.</given-names></name> <name><surname>Jang</surname> <given-names>W.</given-names></name> <name><surname>Rubinstein</surname> <given-names>W. S.</given-names></name> <name><surname>Church</surname> <given-names>D. M.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>ClinVar: public archive of relationships among sequence variation and human phenotype</article-title>. <source>Nucleic Acids Res.</source> <volume>42</volume>:<fpage>D980</fpage>. <pub-id pub-id-type="doi">10.1093/nar/gkt1113</pub-id><pub-id pub-id-type="pmid">24234437</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>I.</given-names></name> <name><surname>Blom</surname> <given-names>U. M.</given-names></name> <name><surname>Wang</surname> <given-names>P. I.</given-names></name> <name><surname>Shim</surname> <given-names>J. E.</given-names></name> <name><surname>Marcotte</surname> <given-names>E. M.</given-names></name> <name><surname>Lee</surname> <given-names>I.</given-names></name> <name><surname>Blom</surname> <given-names>U. M.</given-names></name> <name><surname>Wang</surname> <given-names>P. I.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Prioritizing candidate disease genes by network-based boosting of genome-wide association data</article-title>. <source>Genome Res.</source> <volume>21</volume>:<fpage>1109</fpage>. <pub-id pub-id-type="doi">10.1101/gr.118992.110</pub-id><pub-id pub-id-type="pmid">21536720</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>I.</given-names></name> <name><surname>Lehner</surname> <given-names>B.</given-names></name> <name><surname>Crombie</surname> <given-names>C.</given-names></name> <name><surname>Wong</surname> <given-names>W.</given-names></name> <name><surname>Fraser</surname> <given-names>A. G.</given-names></name> <name><surname>Marcotte</surname> <given-names>E. M.</given-names></name></person-group> (<year>2008</year>). <article-title>A single gene network accurately predicts phenotypic effects of gene perturbation in <italic>Caenorhabditis elegans</italic></article-title>. <source>Nat. Genet.</source> <volume>40</volume>, <fpage>181</fpage>&#x02013;<lpage>188</lpage>. <pub-id pub-id-type="doi">10.1038/ng.2007.70</pub-id><pub-id pub-id-type="pmid">18223650</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>B.</given-names></name> <name><surname>Wang</surname> <given-names>J. Z.</given-names></name> <name><surname>Feltus</surname> <given-names>F. A.</given-names></name> <name><surname>Zhou</surname> <given-names>J.</given-names></name> <name><surname>Luo</surname> <given-names>F.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>Effectively integrating information content and structural relationship to improve the GO-based similarity measure between proteins</article-title>. <source>Comput. Eng. Finan. Sci. arXiv</source> <fpage>166</fpage>&#x02013;<lpage>172</lpage>.</citation></ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>D.</given-names></name></person-group> (<year>1998</year>). <article-title>&#x0201C;An information-theoretic definition of similarity,&#x0201D;</article-title> in <source>International Conference on Machine Learning</source> (<publisher-loc>San Francisco, CA</publisher-loc>), <fpage>296</fpage>&#x02013;<lpage>304</lpage>.</citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Yan</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>Answering approximate queries over XML data</article-title>. <source>IEEE Transac. Fuzzy Syst.</source> <volume>24</volume>, <fpage>288</fpage>&#x02013;<lpage>305</lpage>. <pub-id pub-id-type="doi">10.1109/TFUZZ.2015.2453168</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name></person-group> (<year>2017</year>). <article-title>Efficient keyword search in fuzzy XML</article-title>. <source>Fuzzy Sets Syst.</source> <volume>317</volume>, <fpage>68</fpage>&#x02013;<lpage>87</lpage> <pub-id pub-id-type="doi">10.1016/j.fss.2016.05.015</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>Tree pattern matching in heterogeneous fuzzy XML databases</article-title>. <source>Knowl. Based Syst.</source> <volume>122</volume>, <fpage>119</fpage>&#x02013;<lpage>130</lpage> <pub-id pub-id-type="doi">10.1016/j.knosys.2017.02.003</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lovering</surname> <given-names>R. C.</given-names></name> <name><surname>Roncaglia</surname> <given-names>P.</given-names></name> <name><surname>Howe</surname> <given-names>D. G.</given-names></name> <name><surname>Laulederkind</surname> <given-names>S. J. F.</given-names></name> <name><surname>Khodiyar</surname> <given-names>V. K.</given-names></name> <name><surname>Berardini</surname> <given-names>T. Z.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Improving interpretation of cardiac phenotypes and enhancing discovery with expanded knowledge in the gene ontology</article-title>. <source>Circ. Genom. Precis. Med.</source> <volume>11</volume>:<fpage>e001813</fpage>. <pub-id pub-id-type="doi">10.1161/CIRCGEN.117.001813</pub-id><pub-id pub-id-type="pmid">29440116</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mathur</surname> <given-names>S.</given-names></name> <name><surname>Dinakarpandian</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). <article-title>Finding disease similarity based on implicit semantic similarity</article-title>. <source>J. Biomed. Inform.</source> <volume>45</volume>, <fpage>363</fpage>&#x02013;<lpage>371</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbi.2011.11.017</pub-id><pub-id pub-id-type="pmid">22166490</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meehan</surname> <given-names>T. F.</given-names></name> <name><surname>Vasilevsky</surname> <given-names>N. A.</given-names></name> <name><surname>Mungall</surname> <given-names>C. J.</given-names></name> <name><surname>Dougall</surname> <given-names>D. S.</given-names></name> <name><surname>Haendel</surname> <given-names>M. A.</given-names></name> <name><surname>Blake</surname> <given-names>J. A.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Ontology based molecular signatures for immune cell types via gene expression analysis</article-title>. <source>BMC Bioinformatics</source> <volume>14</volume>:<fpage>263</fpage>. <pub-id pub-id-type="doi">10.1186/1471-2105-14-263</pub-id><pub-id pub-id-type="pmid">24004649</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ni</surname> <given-names>P.</given-names></name> <name><surname>Wang</surname> <given-names>J.</given-names></name> <name><surname>Zhong</surname> <given-names>P.</given-names></name> <name><surname>Li</surname> <given-names>Y.</given-names></name> <name><surname>Wu</surname> <given-names>F.</given-names></name> <name><surname>Pan</surname> <given-names>Y.</given-names></name></person-group> (<year>2018</year>). <article-title>Constructing disease similarity networks based on disease module theory</article-title>. <source>IEEE/ACM Transac. Comp. Biol. Bioinform.</source> <volume>99</volume>:<fpage>1</fpage>. <pub-id pub-id-type="doi">10.1109/TCBB.2018.2817624</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Osborne</surname> <given-names>J. D.</given-names></name> <name><surname>Flatow</surname> <given-names>J.</given-names></name> <name><surname>Holko</surname> <given-names>M.</given-names></name> <name><surname>Lin</surname> <given-names>S. M.</given-names></name> <name><surname>Kibbe</surname> <given-names>W. A.</given-names></name> <name><surname>Zhu</surname> <given-names>L. J.</given-names></name> <etal/></person-group>. (<year>2009</year>). <article-title>Annotating the human genome with disease ontology</article-title>. <source>BMC Genomics</source> <volume>10</volume>:<fpage>S6</fpage>. <pub-id pub-id-type="doi">10.1186/1471-2164-10-S1-S6</pub-id><pub-id pub-id-type="pmid">19594883</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Patel</surname> <given-names>S.</given-names></name> <name><surname>Roncaglia</surname> <given-names>P.</given-names></name> <name><surname>Lovering</surname> <given-names>R. C.</given-names></name></person-group> (<year>2015</year>). <article-title>Using Gene Ontology to describe the role of the neurexin-neuroligin-SHANK complex in human, mouse and rat and its relevance to autism</article-title>. <source>BMC Bioinformatics</source> <volume>16</volume>:<fpage>186</fpage>. <pub-id pub-id-type="doi">10.1186/s12859-015-0622-0</pub-id><pub-id pub-id-type="pmid">26047810</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peng</surname> <given-names>J.</given-names></name> <name><surname>Xue</surname> <given-names>H.</given-names></name> <name><surname>Hui</surname> <given-names>W.</given-names></name> <name><surname>Lu</surname> <given-names>J.</given-names></name> <name><surname>Chen</surname> <given-names>B.</given-names></name> <name><surname>Jiang</surname> <given-names>Q.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>An online tool for measuring and visualizing phenotype similarities using HPO</article-title>. <source>BMC Genom.</source> <volume>19</volume>(<supplement>Suppl. 6</supplement>), <fpage>185</fpage>&#x02013;<lpage>193</lpage>. <pub-id pub-id-type="doi">10.1186/s12864-018-4927-z</pub-id><pub-id pub-id-type="pmid">30367579</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peng</surname> <given-names>K.</given-names></name> <name><surname>Xu</surname> <given-names>W.</given-names></name> <name><surname>Zheng</surname> <given-names>J.</given-names></name> <name><surname>Huang</surname> <given-names>K.</given-names></name> <name><surname>Wang</surname> <given-names>H.</given-names></name> <name><surname>Tong</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>The Disease and Gene Annotations (DGA): an annotation resource for human disease</article-title>. <source>Nucleic Acids Res.</source> <volume>41</volume>, <fpage>D553</fpage>&#x02013;<lpage>D560</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gks1244</pub-id><pub-id pub-id-type="pmid">23197658</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Resnik</surname> <given-names>P.</given-names></name></person-group> (<year>1995</year>). <article-title>Using information content to evaluate semantic similarity in a taxonomy</article-title>. <source>arXiv</source> <fpage>448</fpage>&#x02013;<lpage>453</lpage>.</citation></ref>
<ref id="B29">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Santos</surname> <given-names>R. F. D.</given-names></name> <name><surname>Boedihardjo</surname> <given-names>A. P.</given-names></name> <name><surname>Lu</surname> <given-names>C. T.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x0201C;Towards ontological similarity for spatial hierarchies,&#x0201D;</article-title> in <source>ACM Sigspatial International Workshop on Querying and Mining Uncertain Spatio-Temporal Data</source> (<publisher-loc>California, CA</publisher-loc>).</citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schlicker</surname> <given-names>A.</given-names></name> <name><surname>Domingues</surname> <given-names>F. S.</given-names></name> <name><surname>Rahnenf&#x000FC;hrer</surname> <given-names>J.</given-names></name> <name><surname>Lengauer</surname> <given-names>T.</given-names></name></person-group> (<year>2006</year>). <article-title>A new measure for functional similarity of gene products based on Gene Ontology</article-title>. <source>BMC Bioinformatics</source> <volume>7</volume>:<fpage>302</fpage>. <pub-id pub-id-type="doi">10.1186/1471-2105-7-302</pub-id><pub-id pub-id-type="pmid">16776819</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schriml</surname> <given-names>L. M.</given-names></name> <name><surname>Arze</surname> <given-names>C.</given-names></name> <name><surname>Nadendla</surname> <given-names>S.</given-names></name> <name><surname>Chang</surname> <given-names>Y. W.</given-names></name> <name><surname>Mazaitis</surname> <given-names>M.</given-names></name> <name><surname>Felix</surname> <given-names>V.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Disease Ontology: a backbone for disease semantic integration</article-title>. <source>Nucleic Acids Res.</source> <volume>40</volume>:<fpage>940</fpage>&#x02013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkr972</pub-id><pub-id pub-id-type="pmid">22080554</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>J. Z.</given-names></name> <name><surname>Du</surname> <given-names>Z.</given-names></name> <name><surname>Payattakool</surname> <given-names>R.</given-names></name> <name><surname>Yu</surname> <given-names>P. S.</given-names></name> <name><surname>Chen</surname> <given-names>C. F.</given-names></name></person-group> (<year>2007</year>). <article-title>A new method to measure the semantic similarity of GO terms</article-title>. <source>Bioinformatics</source> <volume>23</volume>, <fpage>1274</fpage>&#x02013;<lpage>1281</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btm087</pub-id><pub-id pub-id-type="pmid">17344234</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Westbury</surname> <given-names>S. K.</given-names></name> <name><surname>Turro</surname> <given-names>E.</given-names></name> <name><surname>Greene</surname> <given-names>D.</given-names></name> <name><surname>Lentaigne</surname> <given-names>C.</given-names></name> <name><surname>Kelly</surname> <given-names>A. M.</given-names></name> <name><surname>Bariana</surname> <given-names>T. K.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Human Phenotype Ontology annotation and cluster analysis to unravel genetic defects in 707 cases with unexplained bleeding and platelet disorders</article-title>. <source>Genome Med.</source> <volume>7</volume>:<fpage>36</fpage>. <pub-id pub-id-type="doi">10.1186/s13073-015-0151-5</pub-id><pub-id pub-id-type="pmid">25949529</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>H.</given-names></name> <name><surname>Meng</surname> <given-names>Z.</given-names></name> <name><surname>Shi</surname> <given-names>H.</given-names></name> <name><surname>Ju</surname> <given-names>H.</given-names></name> <name><surname>Jiang</surname> <given-names>Q.</given-names></name> <name><surname>Cheng</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>Measuring disease similarity and predicting disease-related ncRNAs by a novel method</article-title>. <source>BMC Med. Genom.</source> <volume>10</volume>(<supplement>Suppl. 5</supplement>):<fpage>71</fpage>. <pub-id pub-id-type="doi">10.1186/s12920-017-0315-9</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zeng</surname> <given-names>X.</given-names></name> <name><surname>Ding</surname> <given-names>N.</given-names></name> <name><surname>Rodr&#x000ED;guez-Pat&#x000F3;n</surname> <given-names>A.</given-names></name> <name><surname>Zou</surname> <given-names>Q.</given-names></name></person-group> (<year>2017</year>). <article-title>Probability-based collaborative filtering model for predicting gene-disease associations</article-title>. <source>BMC Med. Genom.</source> <volume>10</volume>(<supplement>Suppl. 5</supplement>):<fpage>76</fpage>. <pub-id pub-id-type="doi">10.1186/s12920-017-0313-y</pub-id><pub-id pub-id-type="pmid">29297351</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>C.</given-names></name> <name><surname>Wang</surname> <given-names>Y. J.</given-names></name> <name><surname>Cui</surname> <given-names>B.</given-names></name> <name><surname>Cong</surname> <given-names>G.</given-names></name></person-group> (<year>2008</year>). <article-title>&#x0201C;Semantic similarity based on compact concept ontology,&#x0201D;</article-title> in <source>International Conference on World Wide Web, WWW 2008</source> (<publisher-loc>Beijing</publisher-loc>: <publisher-name>DBLP</publisher-name>), <fpage>1125</fpage>&#x02013;<lpage>1126</lpage>. <pub-id pub-id-type="doi">10.1145/1367497.1367688</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>S.</given-names></name> <name><surname>Shang</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>M.</given-names></name> <name><surname>Diao</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x0201C;A new measure based on gene ontology for semantic similarity of genes,&#x0201D;</article-title> in <source>Wase International Conference on Information Engineering</source> (<publisher-loc>Washington, DC</publisher-loc>: <publisher-name>IEEE Computer Society</publisher-name>). <pub-id pub-id-type="doi">10.1109/ICIE.2010.28</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>Y.</given-names></name> <name><surname>Halang</surname> <given-names>W.</given-names></name></person-group> (<year>2006</year>). <article-title>&#x0201C;Rough concept lattice based ontology similarity measure,&#x0201D;</article-title> in <source>International Conference on Scalable Information Systems, Infoscale 2006</source>, (<publisher-loc>Hong Kong</publisher-loc>: <publisher-name>DBLP</publisher-name>), <fpage>15</fpage>. <pub-id pub-id-type="doi">10.1145/1146847.1146862</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zou</surname> <given-names>Q.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Song</surname> <given-names>L.</given-names></name> <name><surname>Zeng</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>G.</given-names></name></person-group> (<year>2016</year>). <article-title>Similarity computation strategies in the microRNA-disease network: a survey</article-title>. <source>Brief. Funct. Genom.</source> <volume>15</volume>, <fpage>55</fpage>&#x02013;<lpage>64</lpage>. <pub-id pub-id-type="doi">10.1093/bfgp/elv024</pub-id><pub-id pub-id-type="pmid">26134276</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> The work was partially supported by the National Key R&#x00026;D Program of China (2017YFC1200200, 2017YFC1200205, 2018YFC1603800, and 2018YFC1603802), National Natural Science Foundation of China (61602130 and 61872115), China Postdoctoral Science Foundation funded project (2015M581449 and 2016T90294), Heilongjiang Postdoctoral Fund (LBH-Z14089), Natural Science Foundation of Heilongjiang Province of China (QC2015067), Fundamental Research Funds for the Central Universities (HIT.NSRIF.2017036), and Shanghai Municipal Science and Technology Major Project (Grant No. 2017SHZDZX01).</p>
</fn>
</fn-group>
</back>
</article>