<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Artif. Intell.</journal-id>
<journal-title>Frontiers in Artificial Intelligence</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Artif. Intell.</abbrev-journal-title>
<issn pub-type="epub">2624-8212</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/frai.2023.1256352</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Artificial Intelligence</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Graph embedding and geometric deep learning relevance to network biology and structural chemistry</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Lecca</surname> <given-names>Paola</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/201561/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/funding-acquisition/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Lecca</surname> <given-names>Michela</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/916310/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Faculty of Engineering, Free University of Bozen-Bolzano</institution>, <addr-line>Bolzano</addr-line>, <country>Italy</country></aff>
<aff id="aff2"><sup>2</sup><institution>Fondazione Bruno Kessler, Digital Industry Center, Technologies of Vision</institution>, <addr-line>Trento</addr-line>, <country>Italy</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Georgios Leontidis, University of Aberdeen, United Kingdom</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Shailesh Tripathi, University of Applied Sciences Upper Austria Steyr, Austria</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Paola Lecca <email>Paola.Lecca&#x00040;unibz.it</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>16</day>
<month>11</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>6</volume>
<elocation-id>1256352</elocation-id>
<history>
<date date-type="received">
<day>10</day>
<month>07</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>16</day>
<month>10</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Lecca and Lecca.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Lecca and Lecca</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Graphs are used as a model of complex relationships among data in biological science since the advent of systems biology in the early 2000. In particular, graph data analysis and graph data mining play an important role in biology interaction networks, where recent techniques of artificial intelligence, usually employed in other type of networks (e.g., social, citations, and trademark networks) aim to implement various data mining tasks including classification, clustering, recommendation, anomaly detection, and link prediction. The commitment and efforts of artificial intelligence research in network biology are motivated by the fact that machine learning techniques are often prohibitively computational demanding, low parallelizable, and ultimately inapplicable, since biological network of realistic size is a large system, which is characterised by a high density of interactions and often with a non-linear dynamics and a non-Euclidean latent geometry. Currently, graph embedding emerges as the new learning paradigm that shifts the tasks of building complex models for classification, clustering, and link prediction to learning an informative representation of the graph data in a vector space so that many graph mining and learning tasks can be more easily performed by employing efficient non-iterative traditional models (e.g., a linear support vector machine for the classification task). The great potential of graph embedding is the main reason of the flourishing of studies in this area and, in particular, the artificial intelligence learning techniques. In this mini review, we give a comprehensive summary of the main graph embedding algorithms in light of the recent burgeoning interest in geometric deep learning.</p></abstract>
<kwd-group>
<kwd>deep learning</kwd>
<kwd>metric spaces</kwd>
<kwd>curved manifolds</kwd>
<kwd>latent network geometry</kwd>
<kwd>graph embedding</kwd>
<kwd>graph mining</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="1"/>
<equation-count count="5"/>
<ref-count count="179"/>
<page-count count="16"/>
<word-count count="15241"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Machine Learning and Artificial Intelligence</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1 Introduction</title>
<p>Graph embedding is a mathematical procedure that transforms nodes, edges, and their features into vectors of a vector space (usually of a lower dimension) while trying to maximally preserve properties such as graph structure, vertex-to-vertex relationship, and other relevant information about graphs, subgraphs, and vertices. The uses of graph embedding are numerous, ranging from obtaining a representation of multidimensional data in a lower dimensional space for the purpose of more efficient manipulation and interpretation to the identification of the latent geometry of graphs. This second purpose is recently gaining ground in the analysis of biological networks, for which the geometry of the latent metric space explains organisational principles and dynamics (Krioukov et al., <xref ref-type="bibr" rid="B74">2010</xref>; Krioukov, <xref ref-type="bibr" rid="B73">2016</xref>; Bianconi and Rahmede, <xref ref-type="bibr" rid="B10">2017</xref>; Alanis-Lobato et al., <xref ref-type="bibr" rid="B2">2018</xref>; Papadopoulos and Flores, <xref ref-type="bibr" rid="B108">2019</xref>; Bogu&#x000F1;&#x000E1; et al., <xref ref-type="bibr" rid="B11">2021</xref>; Lecca and Re, <xref ref-type="bibr" rid="B78">2022</xref>).</p>
<p>Graph embedding can be implemented with artificial intelligence techniques, but it can also be used upstream of artificial intelligence techniques for learning and data analysis to enable easier and more efficient application of the techniques themselves. Graph embedding has a number of potential benefits. Embedding-based algorithms usually outperform their equivalents that employ the original networks in terms of speed. Additionally, downstream analysis frequently uses the learnt embeddings, either through a direct interpretation of the embedding space or through the use of machine learning methods specifically created for vectorial data (Nelson et al., <xref ref-type="bibr" rid="B99">2019</xref>).</p>
<p>There are three types of embedding, namely, vertex embedding, edge/path embedding, and graph embedding proper. Vertex embedding is a mapping of graph vertices to vectors of a vector space (usually &#x0211D;<sup><italic>n</italic></sup>), which approximately preserves properties such as distances between nodes. This type of embedding is commonly used to perform visualization or prediction on the vertex level or prediction of new connections based on vertex similarities. DeepWalk (Perozzi et al., <xref ref-type="bibr" rid="B110">2014</xref>), node2vec (Grover and Leskovec, <xref ref-type="bibr" rid="B47">2016</xref>), and SDNE (Wang et al., <xref ref-type="bibr" rid="B144">2016</xref>) are three very well-known approaches to this type of embedding. Edge/path embedding is the mapping of graph edges to vectors of a vector space (usually of low dimension). This embedding is used to describe traversals across the graph and similarly to vertex embedding, targets edge prediction, reconstruction, and graph clustering (Wang et al., <xref ref-type="bibr" rid="B143">2020</xref>). Finally, &#x0201C;graph embeddings&#x0201D; is a representation of the whole graph with a single vector (for example, Graph Readout operation in DGL-LifeSci, <xref ref-type="bibr" rid="B34">2020</xref>). This type of embedding is used to make predictions on the graph level structure and compare or visualize the whole graphs, e.g., in studies of molecular structures where it is often necessary to compare chemical structures. In this review, however, we will not use the phrase &#x0201C;graph embedding&#x0201D; in this sense.</p>
<p>Graph embedding is critical to graph mining tasks such as classification, clustering, recommendation, anomaly detection, and link prediction. In the majority of applications, when the embedding is performed with the purpose to project the data in a lower dimensional space, the main reason for this lies in the possibility that the embedding offers to carry on these operations in simpler (in terms of handling and processing data structures and the usual operations on graphs) and more efficient manner. Network relationships in a graph of <italic>V</italic> nodes and <italic>E</italic> edges can only use a subset of mathematics, statistics, and machine learning, whereas vector spaces have a more diverse set of approaches (Pan et al., <xref ref-type="bibr" rid="B105">2020</xref>). Graph embedding consists of calculating the coordinates of its nodes in a vector space so that the properties of the graph, such as, for example, the node content and the distances between nodes, are preserved within a certain error, which is desired to be small. The adjacency matrix is the most common numerical representation of a graph. It is a |<italic>V</italic>| &#x000D7; |<italic>V</italic>| matrix, where |<italic>V</italic>| is the number of graph nodes. In the matrix, each column and row represents a node, and non-zero values indicate that two nodes are connected. It is nearly impossible to use an adjacency matrix as a feature space for large graphs. Consider that a graph with 10<sup>6</sup> nodes is represented by a 10<sup>6</sup>&#x000D7;10<sup>6</sup> adjacency matrix. Since node properties are packed into a vector by embedding rather than the adjacency matrix, they are more useful. Additionally, compared with equivalent procedures on graphs, vector operations are easier and quicker. In this regard, on the basis of a certainty now shared by many scholars form different disciplines and in different contexts of application [e.g., Cao et al., <xref ref-type="bibr" rid="B21">2016b</xref>; Goyal and Ferrara, <xref ref-type="bibr" rid="B46">2018</xref>; Pan et al., <xref ref-type="bibr" rid="B105">2020</xref>; Yang et al., <xref ref-type="bibr" rid="B156">2020</xref>; Amara et al., <xref ref-type="bibr" rid="B3">2021</xref>; Etaiwi and Awajan, <xref ref-type="bibr" rid="B36">2023</xref>], Zhang et al. (<xref ref-type="bibr" rid="B165">2020</xref>) talk about a paradigm shift and explain that this new learning paradigm has shifted the tasks of seeking complex models for classification, clustering, and link prediction &#x0201C;to learning a compact and informative representation for the graph data&#x0201D; so that many graph mining tasks can be easily performed by employing simple traditional models (e.g., a linear Support Vector Machine for the classification task). Furthermore, because of how different they can be in terms of scale, specificity, and topic, graph embedding can be challenging. A social network could be depicted by a large, dense, dynamic graph as opposed to a small, sparse, and static representation of a molecule (Xiong et al., <xref ref-type="bibr" rid="B152">2019</xref>; David et al., <xref ref-type="bibr" rid="B33">2020</xref>). In the end, this makes it challenging to identify an optimal embedding technique of general validity and applicability. It is, therefore, necessary to focus on the analysis and review of specific application domains. In the following sections, we will describe and review the current graph embedding methods commoly used in systems biology.</p></sec>
<sec id="s2">
<title>2 Graph embedding algorithms</title>
<p>The three types of graph embedding algorithms are (i) probability models, (ii) algorithms based on matrix factorization, and (iii) algorithms based on deep learning. For a comparative review of preservation extent of current graph embedding methods, we refer the reader to the study by Goyal and Ferrara (<xref ref-type="bibr" rid="B46">2018</xref>), Mohan and Pramod (<xref ref-type="bibr" rid="B97">2019</xref>), Vaudaine et al. (<xref ref-type="bibr" rid="B138">2020</xref>), and Xu (<xref ref-type="bibr" rid="B153">2021</xref>). In addition to classification according to the mathematical and/or algorithmic methodology adopted, graph embedding approaches can also be classified according to the type of input they process.</p>
<p><bold>Probabilistic embedding:</bold> Probabilistic embedding methods predict the distribution of embeddings, as opposed to deterministic embedding methods, which map the input to a single embedding vector. Probabilistic embeddings have the following benefits over deterministic methods: (i) probabilistic losses can stabilise training on noisy data; (ii) predicted uncertainty can be used to assess the quality of the data and identify out-of-domain data (see Karpukhin et al., <xref ref-type="bibr" rid="B64">2022</xref> for a more detailed discussion); (iii) tasks involving rejection and categorization may benefit from confidence (Chang et al., <xref ref-type="bibr" rid="B23">2020</xref>; Mena et al., <xref ref-type="bibr" rid="B95">2020</xref>; Karpukhin et al., <xref ref-type="bibr" rid="B64">2022</xref>).</p>
<p>By extracting various patterns from the network, probabilistic models such as DeepWalk (Perozzi et al., <xref ref-type="bibr" rid="B110">2014</xref>), node2vec (Grover and Leskovec, <xref ref-type="bibr" rid="B47">2016</xref>), and LINE (Tang et al., <xref ref-type="bibr" rid="B132">2015c</xref>) try to learn graph embedding. DeepWalk learns the node embedding from a set of random walks. Node2vec creates random walk sequences for network encoding by combining breadth-first sampling (BFS) and depth-first sampling (DFS) techniques. LINE handles massive information networks while maintaining both first-order and second-order proximities. Other random walk variations include DDRW [Discriminative Deep Random Walk (Li et al., <xref ref-type="bibr" rid="B81">2016a</xref>)] and HARP (Hierarchical Representation Learning Approach, Zhao et al., <xref ref-type="bibr" rid="B175">2023</xref>). Global structural equivalence, neighbourhood connectivities at the local level, and other different order proximities are among the recorded patterns or walks. These graph embedding algorithms outperform traditional approaches such as Spectral Clustering (von Luxburg, <xref ref-type="bibr" rid="B140">2007</xref>) and are scalable to large networks (Pan et al., <xref ref-type="bibr" rid="B105">2020</xref>).</p>
<p><bold>Matrix factorization-based embedding:</bold> The adjacency matrix <italic>A</italic>&#x02208;&#x0211D;<sup><italic>m</italic>&#x000D7;<italic>n</italic></sup> is factorized by two matrices, namely, <italic>U</italic>&#x02208;&#x0211D;<sup><italic>m</italic>&#x000D7;<italic>d</italic></sup> and <italic>V</italic>&#x02208;&#x0211D;<sup><italic>n</italic>&#x000D7;<italic>d</italic></sup> (to be learnt), where <italic>d</italic> is the dimension of the embedding space. When compared with learning the entire matrix, matrix factorization usually produces a more concise representation. The embedding matrices <italic>U</italic> and <italic>V</italic> have <italic>O</italic>((<italic>m</italic>&#x0002B;<italic>n</italic>)<italic>d</italic>) entries, whereas the full matrix has <italic>O</italic>(<italic>mn</italic>) entries. The embedding dimension <italic>d</italic> in these matrices is usually much smaller than <italic>m</italic> and <italic>n</italic>. The embeddings are learned such that the <italic>UV</italic><sup><italic>T</italic></sup> well approximates the matrix <italic>A</italic>. The entry (<italic>i, j</italic>) of <italic>U</italic>, <italic>V</italic><sup><italic>T</italic></sup> is the inner product &#x02329;<italic>U</italic><sub><italic>i</italic></sub>, <italic>V</italic><sub><italic>j</italic></sub>&#x0232A;, which we want to be close to <italic>A</italic><sub><italic>ij</italic></sub>.</p>
<p>Examples of factorisation-based embedding algorithms are GraRep (Graph Representations with Global Structural Information, Cao et al., <xref ref-type="bibr" rid="B18">2015</xref>), HOPE (High-Order Proximity preserved Embedding, Ou et al., <xref ref-type="bibr" rid="B103">2016</xref>), and M-NMF (Modularized Nonnegative Matrix Factorization, Yan and Chang, <xref ref-type="bibr" rid="B154">2019</xref>), which then factorise the adjacency matrix to implement the embedding. GraRep, as well as NEU [Neural Network Embeddings (Yang et al., <xref ref-type="bibr" rid="B155">2017</xref>)], and AROPE (Arbitrary-Order Proximity Preserved Network Embedding, Zhang et al., <xref ref-type="bibr" rid="B172">2018</xref>) all capture the higher order approximation except the first-order and the second-order similarities. HOPE preserves asymmetric transitivity by approximating high-order proximity for improved performance in graph topological information capture and reconstruction from partially observed graphs. Among the graph embedding methods based on matrix factorisation, we also mention the recent study by Liu et al. (<xref ref-type="bibr" rid="B87">2020</xref>), who propose SMNMF, a Semisupervised Modularised Non-negative Matrix Embedding model. Liu et al. point out that the existing network representation learning algorithms are mostly unsupervised models, and that the pairwise constraint information, which represents community membership, is not effectively used to obtain node embedding results that are more consistent with previous knowledge. Their method, SMNMF, offers a network embedding procedure while preserving the community structure; the pairwise constraint (must-link and cannot-link) information is effectively fused with the network&#x00027;s adjacency matrix and node similarity matrix, making the node representations learned by the model more interpretable.</p>
<p><bold>Deep learning-based embedding:</bold> Neural network embeddings are learned low-dimensional vector representations of discrete variables. The network&#x00027;s parameters, or weights, are formed by the embeddings and are adjusted to reduce task loss. The resulting embedded vectors indicate categories where related categories are closer to one another in relation to the task.</p>
<p>Pan et al. (<xref ref-type="bibr" rid="B105">2020</xref>) report that many probabilistic algorithms, such as DeepWalk (Perozzi et al., <xref ref-type="bibr" rid="B110">2014</xref>), LINE (Large-scale Information Network Embedding) (Tang et al., <xref ref-type="bibr" rid="B132">2015c</xref>), and node2vec (Grover and Leskovec, <xref ref-type="bibr" rid="B47">2016</xref>), have lately been shown to be equivalent to matrix factorisation methods, and Qiu et al. (<xref ref-type="bibr" rid="B115">2018</xref>) have proposed a unified matrix factorisation method called NetMF (Network Embedding as Matrix Factorization) for graph embedding. The methods are unify DeepWalk, LINE, PTE [Predictive Text Embedding (Tang et al., <xref ref-type="bibr" rid="B130">2015a</xref>)], and node2vec.</p>
<p>Deep learning techniques based on autoencoders are also being researched (Zhu et al., <xref ref-type="bibr" rid="B179">2019</xref>; Hasibi and Michoel, <xref ref-type="bibr" rid="B50">2021</xref>; Xu, <xref ref-type="bibr" rid="B153">2021</xref>; Wang et al., <xref ref-type="bibr" rid="B141">2022</xref>). SDNE (Structural Deep Network Embedding) (Wang et al., <xref ref-type="bibr" rid="B144">2016</xref>) and DNGR (Deep Neural Networks for Graph Representations) (Cao et al., <xref ref-type="bibr" rid="B19">2016a</xref>) use deep autoencoders (Baldi, <xref ref-type="bibr" rid="B7">2012</xref>) to preserve the graph proximities and model the positive pointwise mutual information (PPMI). To learn representation for graph clustering, the MGAE (Marginalized Graph Autoencoder) algorithm relies on a marginalised single layer autoencoder (Wang et al., <xref ref-type="bibr" rid="B142">2017</xref>). For signed network embedding with a stacked auto-encoder framework, the DNE-SBP (Deep Network Embedding with Structural Balance Preservation) model is proposed (Shen and Chung, <xref ref-type="bibr" rid="B122">2020</xref>).</p>
<p><bold>Input-based classification of embedding algorithm:</bold> According to Pan et al. (<xref ref-type="bibr" rid="B105">2020</xref>), the embedding algorithms for graph mining can be further classified into <italic>topological network embedding</italic> approaches and <italic>content enhanced network embedding</italic> methods. The former take as an input only the information concerning the topological structure of the graph, and their learning objective is to preserve it maximally. The latter take as an input the node and process both topological information and content features.</p>
<p>DeepWalk, node2vec, LINE [Large-scale Information Network Embedding (Tang et al., <xref ref-type="bibr" rid="B131">2015b</xref>)], HARP (hierarchical representation learning approach, Chen et al., <xref ref-type="bibr" rid="B25">2018</xref>), DDRW (Discriminative Deep Random Walk, Li et al., <xref ref-type="bibr" rid="B82">2016b</xref>), and Walklets (Perozzi et al., <xref ref-type="bibr" rid="B111">2016</xref>) are <italic>topological network embedding</italic> approaches. DeepWalk can be interpreted as a factorisation method, and Yang et al. introduced TADW. They also suggested extending DeepWalk to investigate node features. Many other embedding algorithms process both topological and node content information, e.g., TriDNR [Tri-Party Deep Network Representation (Pan et al., <xref ref-type="bibr" rid="B106">2016</xref>)], UPPSINE [User Profile Preserving Social Network Embedding (Zhang et al., <xref ref-type="bibr" rid="B164">2017</xref>)], ASNE [Attributed Social Network Embedding (Liao et al., <xref ref-type="bibr" rid="B84">2018</xref>)], LANE [Label informed Attributed Network Embedding (Huang et al., <xref ref-type="bibr" rid="B58">2017</xref>)], DANE [Domain Adaptive Network Embedding (Song et al., <xref ref-type="bibr" rid="B128">2022</xref>)], and BANE [Binarized attributed network embedding (Yang et al., <xref ref-type="bibr" rid="B157">2018</xref>)].</p>
<p>TriDNR uses a tri-party neural network architecture to record information about structure, node content, and labels. UPPSNE uses an approximated kernel mapping scheme to take the advantage of user profile characteristics in order to maximise the learning that users are embedding into social networks. In essence, a kernel approximation mapping is learning an estimated subspace in the high-dimensional feature vector space that is induced and defined by the kernel function (Francis and Raimond, <xref ref-type="bibr" rid="B40">2020</xref>). For attributed social networks, ASNE trains a neural network model to incorporate both structural proximity and attribute proximity, and LANE integrates label information into the optimization process to learn a better embedding. This is, in general, a difficult task because of the possibility of noisy and incomplete label information. Additionally, labels, geometrical structure, and node properties are totally distinct from one another. Finally, recently, BANE was suggested to learn binarised embedding for an attributed graph, which could improve efficiency for later graph analytical tasks.</p>
<p>Most graph embedding methods have been developed principally for indirect graphs, since (i) information about the direction of the arcs leads to a non-symmetrical weighted adjacency matrix (the factorisation of which is more complex), and (ii) the metric space that can possibly describe the latent geometry of a directed graph must have characteristics such that it can store information about directionality. For this reason, we devote the next section to those embedding techniques specialised for directed graphs. For the sake of completeness, we will then discuss in the following sections the embedding methods for three other categories of graphs (bipartite, temporal, and multi-label), which, with their topological peculiarities, are useful in describing numerous real-world networks. We refer the reader to the study by Kami&#x00144;ski et al. (<xref ref-type="bibr" rid="B63">2019</xref>), Vaudaine et al. (<xref ref-type="bibr" rid="B138">2020</xref>), Zhang et al. (<xref ref-type="bibr" rid="B171">2021c</xref>) for a comparison of different embedding methods.</p>
<sec>
<title>2.1 Embedding of directed graphs</title>
<p>For undirected graphs, the weighted adjacency matrix (alias <italic>affinity matrix</italic>) is symmetrical, and thus, for each pair of nodes, the weight of the arcs joining them and/or the dissimilarity or distance between them are uniquely defined, since they have no dependence on the direction of the arc. The symmetry of the affinity matrix greatly simplifies the operations and computational procedures of the embedding methods. However, there is a significant amount of intrinsically asymmetric graph data, such as, for example, social networks, alignment scores between biological sequences, and citation data. As reported by Perrault-joncas and Meila (<xref ref-type="bibr" rid="B112">2011</xref>), a common strategy for this type of data is not to use as input for embedding procedures, the asymmetric affinity matrix <italic>W</italic>, but the matrices obtained from it as <italic>W</italic>&#x0002B;<italic>W</italic><sup><italic>T</italic></sup> or <italic>W</italic><sup><italic>T</italic></sup><italic>W</italic>. In fact, suppose that</p>
<disp-formula id="E1"><mml:math id="M1"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>W</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo stretchy="true">(</mml:mo><mml:mrow><mml:mtable style="text-align:axis;" equalrows="false" columnlines="none none none none none none none none none" equalcolumns="false" class="array"><mml:mtr><mml:mtd><mml:mi>a</mml:mi></mml:mtd><mml:mtd><mml:mi>b</mml:mi></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi>c</mml:mi></mml:mtd><mml:mtd><mml:mi>d</mml:mi></mml:mtd></mml:mtr></mml:mtable></mml:mrow><mml:mo stretchy="true">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>a</italic>&#x02260;<italic>d</italic> and <italic>b</italic>&#x02260;<italic>c</italic>. Then,</p>
<disp-formula id="E2"><mml:math id="M2"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>W</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mi>W</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mrow><mml:mo stretchy="true">(</mml:mo><mml:mrow><mml:mtable style="text-align:axis;" equalrows="false" columnlines="none none none none none none none none none" equalcolumns="false" class="array"><mml:mtr><mml:mtd><mml:mn>2</mml:mn><mml:mi>a</mml:mi></mml:mtd><mml:mtd><mml:mi>b</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mi>c</mml:mi></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi>b</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mi>c</mml:mi></mml:mtd><mml:mtd><mml:mn>2</mml:mn><mml:mi>d</mml:mi></mml:mtd></mml:mtr></mml:mtable></mml:mrow><mml:mo stretchy="true">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>and</p>
<disp-formula id="E3"><mml:math id="M3"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mi>W</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msup><mml:mi>W</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo stretchy="true">(</mml:mo><mml:mrow><mml:mtable style="text-align:axis;" equalrows="false" columnlines="none none none none none none none none none" equalcolumns="false" class="array"><mml:mtr><mml:mtd><mml:msup><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mi>b</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mtd><mml:mtd><mml:mi>a</mml:mi><mml:mi>b</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mi>c</mml:mi><mml:mi>d</mml:mi></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi>b</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mi>c</mml:mi></mml:mtd><mml:mtd><mml:msup><mml:mrow><mml:mi>b</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mrow><mml:mi>c</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mtd></mml:mtr></mml:mtable></mml:mrow><mml:mo stretchy="true">)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>are both symmetric matrices.</p>
<p>Already in the early 2000s, other approaches have been proposed to directly deal with the asymmetry of the affinity matrix (Zhou et al., <xref ref-type="bibr" rid="B177">2004</xref>, <xref ref-type="bibr" rid="B178">2005</xref>; Meil&#x00103; and Pentney, <xref ref-type="bibr" rid="B94">2007</xref>) or define directed Laplacian operators (Chung, <xref ref-type="bibr" rid="B30">2006</xref>).</p>
<p>Interest in and the need to develop efficient <italic>ad hoc</italic> methods for embedding directed graphs have re-emerged very recently, and the attention of the community has focused mainly on embedding in non-Euclidean spaces. Indeed, it is becoming more and more apparent that Euclidean geometry cannot easily encode complex interactions on big graphs and is not flexible to handle edge directionality. Of interest, as being more functional for geometric deep learning, we mention the study by Sim et al. (<xref ref-type="bibr" rid="B124">2021</xref>). The authors of this study demonstrate that directed graphs can be efficiently represented by an embedding model that combines three elements, namely, a non-trivial global topology (directed graphs, eventually containing cycles), a pseudo-Riemannian metric structure, and an original likelihood function that explicitly takes into account a preferred direction in embedding space.</p>
<p>Pseudo-Riemannian manifolds are Riemannian manifold generalisations that relax the requirement of the non-degenerate metric tensor&#x00027;s positive definiteness. As comprehensively described in the study by Law and Lucas (<xref ref-type="bibr" rid="B76">2023</xref>), there are two categories in the machine learning literature on pseudo-Riemannian manifolds. The first category does not consider whether the manifold is time-oriented or not; instead, it concentrates on how to optimise a given function whose domain is a pseudo-Riemannian manifold (Law and Stam, <xref ref-type="bibr" rid="B77">2020</xref>; Law, <xref ref-type="bibr" rid="B75">2021</xref>). The second category makes the use of how general relativity interprets a particular family of pseudo-Riemannian manifolds known as &#x0201C;spacetime&#x0201D; (Clough and Evans, <xref ref-type="bibr" rid="B31">2017</xref>; Sim et al., <xref ref-type="bibr" rid="B124">2021</xref>). Spacetimes are actually linked time-oriented Lorentz manifolds. They inherently have a causal structure that shows whether or not there is a causal chain connecting occurrences at different positions on the manifold. In directed graphs, each node is an event, and the existence of a directed arc between two nodes depends on the causal characteristics of the curves connecting them (Bombelli et al., <xref ref-type="bibr" rid="B12">1987</xref>). This causal structure has been used to depict these directed networks.</p>
<p>Sim et al. (<xref ref-type="bibr" rid="B124">2021</xref>), on the other hand, use three different spacetime types and suggest an <italic>ad hoc</italic> method introducing a time coordinate difference function, whose sign is then used to determine the orientation of edges. This has been an interesting and innovative approach that suggested further research and advancement as indicated by Law and Lucas (<xref ref-type="bibr" rid="B76">2023</xref>). In that study, Law et al. observe, regarding the study by Sim el al., that when the manifold is non-chronological and does not generalise to all spacetimes, the sign of such a function, for example, alternates periodically and is not always relevant. Additionally, when a geodesic cannot connect two points, their distance function remains constant.</p>
<p>In this brief subsection, we have emphasized embedding methods of directed graphs that adopt spacetime representations. Indeed, the wealth of information contained in spatiotemporal structures could inspire the design of a neural network that can learn most of it and can thus become as accurate a tool for geometric deep learning as possible. For the sake of completeness, however, we mention some other recent studies that propose other methods for embedding directed graphs, such as ShortWalk algorithm by Zhao et al. (<xref ref-type="bibr" rid="B174">2021</xref>), MagNet by Zhang et al. (<xref ref-type="bibr" rid="B168">2021a</xref>), and the study of Khosla et al. (<xref ref-type="bibr" rid="B66">2020</xref>). Less recent is the study of Chen et al. (<xref ref-type="bibr" rid="B28">2007</xref>) that proposed an approach taking into account the link structure of graphs to embed the vertices of a directed graph into a vector space.</p>
<p>The idea of ShortWalk is that long random walks may become stuck or stopped in a directed graph, producing embeddings of poor quality. To enhance the directed graph network embeddings, ShortWalk generates shorter traces by doing brief random walks that restart more frequently. MagNet uses a graph neural network for modelling directed graphs, exploiting a complex Hermitian matrix which encodes undirected geometric structure as the magnitude of the matrix entries and the direction of edges in their phase. Khosla et al. (<xref ref-type="bibr" rid="B66">2020</xref>) created role-specific vertex neighbourhoods and trained node embeddings in their associated source/target roles using <italic>alternating random walk technique</italic>, fully using the semantics of directed graphs. Alternating walk technique draws inspiration from SALSA (Lempel and Moran, <xref ref-type="bibr" rid="B79">2001</xref>), a stochastic variant of the HITS (Kleinberg, <xref ref-type="bibr" rid="B69">1999</xref>) algorithm that also recognises hubs and authorities as two different categories of significant nodes in a directed network. The pathways produced by alternating random walks between hubs (source nodes) and authorities (target nodes), sampling both nearby hubs and authorities in relation to an input node.</p>
<p>In the study by Chen et al. (<xref ref-type="bibr" rid="B28">2007</xref>), the main goal of the authors was to keep vertices on the locality property of a directed graph in the embedded space. To assess this locality quality, they combined the transition probability with the stationary distribution of Markov random walks. It turns out that they obtained an ideal vector space embedding that maintains the local affinity that is inherent in the directed graph by utilising random walks to explore the directed links of the graph.</p>
<p>Finally, it is worth mentioning that most of the directed graph embedding techniques mentioned in this section are also appropriate for embedding bipartite graphs. A comprehensive survey on bipartite graph embedding can be found in the study by Giamphy et al. (<xref ref-type="bibr" rid="B45">2023</xref>), and a short review is also presented in the next sub-section.</p></sec>
<sec>
<title>2.2 Embedding of bipartite graphs</title>
<p>Since bipartite graphs are frequently utilised in many different application domains [many of them in biology and medicine (Pavlopoulos et al., <xref ref-type="bibr" rid="B109">2018</xref>; Ma et al., <xref ref-type="bibr" rid="B90">2023</xref>) and drug discovery an repurposing (Zheng et al., <xref ref-type="bibr" rid="B176">2018</xref>; Manoochehri and Nourani, <xref ref-type="bibr" rid="B93">2020</xref>; Hostallero et al., <xref ref-type="bibr" rid="B57">2022</xref>; Yu et al., <xref ref-type="bibr" rid="B162">2022</xref>)], bipartite graph embedding has recently received a lot of interest. The majority of earlier techniques, which use random walk- or reconstruction-based objectives, are usually successful at learning local graph topologies. However, the general characteristics of the bipartite network, such as the long-range dependencies of heterogeneous nodes and the community structures of homogeneous nodes, are not effectively retained. To circumvent these constraints, Cao et al. (<xref ref-type="bibr" rid="B17">2021</xref>) developed BiGI, a bipartite graph embedding that captures such global features by introducing a novel local-global infomax objective. BiGI generates a global representation initially, which is made up of two prototype representations. The suggested subgraph-level attention method is then used by BiGI to encode sampled edges as local representations. BiGI makes nodes in a bipartite graph globally relevant by maximising mutual information between local and global representations.</p>
<p>Also the Yang et al. (<xref ref-type="bibr" rid="B159">2022b</xref>) proposal for efficient embedding of bipartite graphs of big size is of interest. Yang et al. pointed out that existing solutions are rarely scalable to vast bipartite graphs, and they frequently produce subpar results. The study by Yang et al. (<xref ref-type="bibr" rid="B159">2022b</xref>) introduced Generic Bipartite Network Embedding (GEBE), a general bipartite network embedding (BNE) framework, with four core algorithmic designs that achieves state-of-the-art performance on very large bipartite graphs. First, GEBE provides two generic measures that may be instantiated using three popular probability distributions, such as Poisson, Geometric, and Uniform distributions, to capture multi-hop similarity (MHS)/ multi-hop proximity (MHP) between homogeneous/heterogeneous nodes. Second, GEBE develops a unified BNE goal to preserve the two measurements of all feasible node pairs. Third, GEBE includes a number of efficiency strategies for obtaining high-quality embeddings on large graphs. Finally, according to the study by Yang et al. (<xref ref-type="bibr" rid="B159">2022b</xref>), GEBE performs best when MHS and MHP are instantiated using a Poisson distribution, therefore they continued to build GEBEp based on Poisson-instantiated MHS and MHP with challenging efficiency improvements.</p></sec>
<sec>
<title>2.3 Embedding of temporal graphs</title>
<p>A network whose links are not continuously active is referred to as a temporal network or a time-varying network (Holme and Saram&#x000E4;ki, <xref ref-type="bibr" rid="B53">2012</xref>). Each connection includes its active time as well as any further details that may apply, including its weight. Traditional network embedding methods are created for static structures, frequently taken into account nodes, and face significant difficulties when the network is changing over time. Various methods for embedding temporal networks have been proposed in the last years, e.g., Stwalk (Pandhre et al., <xref ref-type="bibr" rid="B107">2018</xref>), tNodeEmbed (Singer et al., <xref ref-type="bibr" rid="B125">2019</xref>), Online Node2Vec (B&#x000E9;res et al., <xref ref-type="bibr" rid="B8">2019</xref>), and the Dynamic Bayesian Knowledge Graphs Embedding model of Liao et al. (<xref ref-type="bibr" rid="B85">2021</xref>). In many methods of temporal network embedding, the traditional representation of the temporal network is often modified, whether it takes the form of a list of events, a tensor [as in the method by Gauvin et al. (<xref ref-type="bibr" rid="B43">2014</xref>)], or a supra-adjacency matrix [as in DyANE algorithm by Sato et al. (<xref ref-type="bibr" rid="B118">2021</xref>)]. Each of these approaches, such as DyANE, Online Node2Vec, STWalk, and tNodeEmbed, share the common goal of resolving the node embedding issue by locally sampling the temporal&#x02013;structural neighbourhood of nodes to produce contexts, which they then feed into a Skip-Gram learning architecture adapted from the text representation literature. They have been used in chemical and biological research studies, e.g. Kim et al. (<xref ref-type="bibr" rid="B68">2018</xref>), &#x000D6;zt&#x000FC;rk et al. (<xref ref-type="bibr" rid="B104">2020</xref>), Fang et al. (<xref ref-type="bibr" rid="B38">2021</xref>), and Gharavi et al. (<xref ref-type="bibr" rid="B44">2021</xref>) and in biomedical language processing (Zhang et al., <xref ref-type="bibr" rid="B170">2019b</xref>).</p>
<p>Regarding these studies, Torricelli et al. (<xref ref-type="bibr" rid="B135">2020</xref>) highlighted that as a workaround these methods construct a series of correlated/updated embeddings of network snapshots that take into account the network&#x00027;s recent past. Torricelli et al. stated that the main drawback of these approaches is that it might be challenging to control a large number of hyper-parameters for the sampling random walk process and the embedding itself. The embedding of nodes may, however, fail to capture the dynamic shifts in temporal interconnections. The performance of the prediction might be severely hindered by simply considering past and current interactions in the embedding, whereas bringing future occurrences into account can greatly enhance this task. Torricelli et al. (<xref ref-type="bibr" rid="B135">2020</xref>) developed weg2vec to overcome these limitations. Weg2vec learns a low-dimensional representation of a temporal network based on the temporal and structural similarity of occurrences. A higher order static representation of temporal networks, sampled locally by weg2vec, codes the intricate patterns that define the structure and dynamics of real-world networks. This method of unsupervised representation learning can concurrently take into account an event&#x00027;s past and future contexts. It samples without the use of dynamical processes, making it controllable by a few hyper-parameters. It finds similarities between various events or nodes that may be active at various periods but have an impact on a group of nodes that are similar in future.</p>
<p>Finally, the studies by Yang et al. (<xref ref-type="bibr" rid="B158">2022a</xref>) proposed a hyperbolic temporal graph network on the Poincar&#x000E9; ball model of hyperbolic space; the temporal network embedding using graph attention network by Mohan and Pramod (<xref ref-type="bibr" rid="B98">2021</xref>); the embedding based on a variational autoencoder able to capture the evolution of temporal networks by Jiao et al. (<xref ref-type="bibr" rid="B61">2022</xref>), ConMNCI by Liu et al. (<xref ref-type="bibr" rid="B88">2022</xref>) that inductively mines local and communal influences. The authors of ConMNCI suggested an aggregator function that combines local and global influences to produce node embeddings at any time and presented the concept of continuous learning to strengthen inductive learning; the continuous-time dynamic network embeddings by Nguyen et al. (<xref ref-type="bibr" rid="B100">2018</xref>), the causal anonymous walk representations for temporal network embedding by Makarov et al. (<xref ref-type="bibr" rid="B92">2022</xref>); and TempNodeEmb by Abbas et al. (<xref ref-type="bibr" rid="B1">2023</xref>). To extract node orientation using angle approach, the methodology by Abbas et al. considered a three-layer graph neural network at each time step, taking advantage of the networks&#x00027; ability to evolve.</p>
<p>Finally, we mention a study aimed at the possibility of using embedding methodologies in practice for networks of degree sizes, i.e., the proposal for parallelising temporal network embedding procedure by Xie et al. (<xref ref-type="bibr" rid="B151">2022</xref>).</p></sec>
<sec>
<title>2.4 Embedding of multi-label graphs</title>
<p>The graph convolution network (GCN) is a widely-used method to embed multi-label graphs (Ye and Wang, <xref ref-type="bibr" rid="B160">2022</xref>). However, Gao et al. (<xref ref-type="bibr" rid="B42">2019</xref>), pointed out that for multi-label learning problems, the supervision component of GCN just minimises the cross-entropy loss between the last layer outputs and the ground-truth label distribution, which often misses important information such as label correlations and prevents obtaining high performance. In this study, the authors proposed ML-GCN, a semi-supervised learning approach for Multi-Label classification based on GCN. ML-GCN first makes the use of a GCN before including the node attributes and graph topological data. Then, a label matrix is generated at random, with each row (or label vector) denoting a different type of label. Before the most recent convolution operation performed by GCN, the label vector&#x00027;s dimension was the same as the node vector&#x00027;s. In other words, every label and node is contained within a constant vector space. The label vectors and node vectors are finally concatenated during the ML-GCN model training to serve as the inputs of the relaxed Skip-Gram model to identify the node-label correlation and the label-label correlation.</p>
<p>Another study by Shi et al. (<xref ref-type="bibr" rid="B123">2020</xref>), to learn feature representation for networked multi-label instances, presented an interesting multi-label network embedding (MLNE) method. The key to MLNE learning is to combine node topological structures, node content, and multi-label correlations. To couple information for successful learning, the authors developed a two-layer network embedding approach. To capture higher order label correlations, the authors employed labels to construct a high-level label-label network on top of a low-level node-node network, with the label network interacting with the node network <italic>via</italic> multi-labelling interactions. Latent label-specific characteristics from a high-level label network with well-captured high-order correlations between labels are used to improve the low-level node-node network. In MLNE, both node and label representations are forced to be optimised in the same low-dimensional latent space to enable multi-label informed network embedding.</p>
<p>Recent successful applications of the embedding for multi-label classification in medical domain is the medical term semantic type classification (Yue et al., <xref ref-type="bibr" rid="B163">2019</xref>) and the knowledge graph embedding to profile transcription factors and their target genes interaction (Wu et al., <xref ref-type="bibr" rid="B149">2023</xref>).</p></sec>
<sec>
<title>2.5 On the complexity of graph embedding</title>
<p>To conclude this section on graph embedding, we would like to provide some information about the complexity of the embedding.</p>
<p>Due to the high dimensionality and heterogeneity of real-world size networks, classical adjacency matrix-based techniques suffer from high computational costs and prohibitive memory needs. The computational complexity of adjacency matrix approaches is at best <italic>O</italic>(<italic>n</italic><sup>2</sup>) (where <italic>n</italic> is the number of nods of the graph).</p>
<p>Random walk-based methods, on the other hand, proved as more efficient in terms of both space and time requirements than both matrix factorisation and BFS/DFS-based methods. For example in node2vec (Grover and Leskovec, <xref ref-type="bibr" rid="B47">2016</xref>), the space complexity for storing each node&#x00027;s closest neighbours is <italic>O</italic>(<italic>e</italic>) (where <italic>e</italic> is the number of edges). The links between each node&#x00027;s neighbours need to be stored for 2nd order random walks, incurring a space complexity of <italic>O</italic>(<italic>d</italic><sup>2</sup><italic>n</italic>) (here <italic>d</italic> is the average degree of the graph, and <italic>n</italic> the number of nodes). Random walks have a temporal complexity advantage over conventional search-based sampling techniques too. Random walks, in particular, offer a straightforward way to boost the effective sampling rate by reusing samples across several source nodes by imposing network connectedness in the sample production process.</p>
<p>The increasing of methods for graph embedding obviously prevents us from making generalisations or categorisations regarding the complexity of the various methods. Here, we wanted to report the information in this regard that is confirmed in the literature. At the moment of writing, and to the best of our knowledge, systematic studies on estimating the complexity of each proposed method are very limited, if any, part of the literature on the subject.</p>
<p>To conclude, we mention the studies of Archdeacon (<xref ref-type="bibr" rid="B4">1990</xref>) and Chen et al. (<xref ref-type="bibr" rid="B27">1993</xref>) on the complexity of graph embedding procedures. It is well-known that embedding a graph G into a surface of minimum genus &#x003B3;<sub>min</sub>(<italic>G</italic>) is NP-hard whereas embedding a graph G into a surface of maximum genus &#x003B3;<sub>max</sub>(<italic>G</italic>) can be done in polynomial time. Chen et al. demonstrated that the problem of embedding a graph <italic>G</italic> with <italic>n</italic> vertices into a surface with genus at most &#x003B3;<sub>min</sub>(<italic>G</italic>)&#x0002B;<italic>f</italic>(<italic>n</italic>) remains NP-hard, but there is a linear time algorithm that approximates the minimum genus embedding either within a constant ratio or within a difference <italic>O</italic>(<italic>n</italic>) for any function <italic>f</italic>(<italic>n</italic><sup>&#x003F5;</sup>) &#x0003D; <italic>O</italic>(<italic>n</italic>) where 0 &#x02264; &#x003F5; &#x02264; 1.</p></sec></sec>
<sec id="s3">
<title>3 Geometric deep learning</title>
<p>A technique that takes into account a large class of machine learning issues from the perspectives of symmetry and invariance is known as <italic>geometric deep learning</italic> (Bronstein et al., <xref ref-type="bibr" rid="B15">2017</xref>, <xref ref-type="bibr" rid="B14">2021</xref>).</p>
<p>An example provided by R. East in East (<xref ref-type="bibr" rid="B35">2023</xref>) intuitively and effectively explains the concepts of symmetry and invariance in machine learning. R. East imagines that we are given a learning task and the data we are using to learn from has an underlying symmetry and takes as an example of the game of Noughts and Crosses. East points out that if we win, we would have won if the board had been rotated or flipped along any of the lines of symmetry. Moreover, we have two options if we want to train an algorithm to predict the result of these games: we can either disregard this symmetry or include it in some way. The benefit of focusing on the symmetry is that it recognises various board configurations as &#x0201C;the same thing&#x0201D; as far as the symmetry is concerned. As a result says East, we can immediately lower the quantity of data, and our algorithm must sort through by reducing the size of our parameter space. Our results are also naturally encouraged to be more generalisable by the fact that the learning model must encode a symmetry that truly exists in the system we are seeking to portray.</p>
<p>If we ignore the possibility that the majority of tasks of interest are not generic and come with necessary predefined regularities arising from the latent geometry of the physical system under investigation, learning generic functions in a given number of dimensions is a cursed estimation problem. Through unified geometrical concepts that may be used in a wide range of applications, geometric deep learning aims to exploit these regularities. Indeed, a powerful and time-tested solution to the dimensionality curse, and the foundation of most physical theories, is to take advantage of the system&#x00027;s recognised symmetries. Deep learning systems are not different. For instance, researchers have modified neural networks to exploit the geometry, resulting from physical measurements, such as grids in images, sequences in time-series, or position and momentum in molecules, and their associated symmetries, such as translation or rotation. The knowledge about the geometry of the physical systems is often referred to as <italic>geometric</italic>. These priors include the concepts of symmetry and invariance, stability, and multiscale visualisations. In summary, we can define geometric deep learning as a machine learning technique in which the machine, instructed by geometric priors, learns from complicated data represented by graphs or multidimensional points, often in non-Euclidean domains. Tong in an online study (Tong, <xref ref-type="bibr" rid="B134">2019</xref>) uses a very effective example to explain the difference between deep learning and geometric deep learning. He says that &#x0201C;The difference between traditional deep learning and geometric deep learning can be illustrated by imagining the accuracy between scanning an image of a person versus scanning the surface of the person themselves&#x0201D;.</p>
<p>Cao et al. (<xref ref-type="bibr" rid="B20">2020</xref>) go even further in explaining the difference between deep learning and geometric deep learning as follows. In several machine learning applications, such as object identification, image classification, speech recognition, and machine translation, the deep learning technologies, for instance, the convolutional neural networks (CNN)s, have produced exceptional results. Convolutional neural networks, in particular, leverage the fundamental statistical properties of data, such as local stationarity and multi-scale component structure, to capture more detailed local features and information than classic neural networks. Although deep learning technology is particularly effective in processing conventional signals such as images, sound, video, or text, current deep learning research still primarily concentrates on the aforementioned data that are defined in the Euclidean domain, i.e., grid-like data. However, as higher data scales and more powerful GPU computing capabilities emerge, people are becoming more and more interested in processing data in non-Euclidean domains. Here, we point out that graphs are endowed with latent geometry. By virtue of this, nodes and edges have spatial features, such as coordinates of nodes and directions along edges, which are geometric relationships (including distance, direction, and angle) among the entities for a graph neural network to learn from (see <xref ref-type="fig" rid="F1">Figure 1</xref> which suggest first to embed the graph in the least distorting manifold and then to apply geometric deep learning). In the previous section, we saw that embedding procedures give an indication which manifold best describes the latent metric space of the graph and calculates the nodes&#x00027; coordinates and distances in that manifold. Knowledge of the manifold describing the graph is thus an additional information that enriches the input for a neural network. However, manifold learning poses difficult challenges to traditional deep learning. When describing geometric shapes, such as the surfaces of objects, the manifold data are typically utilised. Cao et al. (<xref ref-type="bibr" rid="B20">2020</xref>) point out that it is difficult to identify the underlying pattern in these geometric data because they may be randomly dispersed and unevenly structured. Non-Euclidean data typically have an exceptionally vast scale, which is another problem. A molecular network, for instance, may include hundreds of millions of nodes. It seems unlikely that typical deep learning technology can be used in this situation to perform analysis and prediction. Indeed, geometric deep learning is much more articulate than traditional deep learning and involves fundamental building elements, as presented in <xref ref-type="fig" rid="F2">Figure 2</xref>. The convolution technique, which merges data from nearby nodes in a graph, serves as their foundation of each of these elements.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Geometric deep learning involves encoding a geometric understanding of the graph, e.g., the knowledge of nodes&#x00027; coordinates, and their distances in the latent metric space of the graph, and creates neural networks that can learn from this geometry who, in the majority of the real networks, is not Euclidean. In spite of the recent flourishing of the application of graph neural networks to biological sciences, a plethora of successful case studies populate the current literature [see for example the review by Zhang et al. (<xref ref-type="bibr" rid="B169">2021b</xref>)].</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="frai-06-1256352-g0001.tif"/>
</fig>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Building blocks of geometric deep learning according to the study by Sivakumar (<xref ref-type="bibr" rid="B126">2023</xref>). <bold>Graph Convolutional Networks (GCNs)</bold> are a particular type of neural network that may be used to categorise and extract characteristics from data that are graph-structured. The convolution technique, which merges data from nearby nodes in a graph, serves as their foundation. <bold>Graph Attention Networks (GATs)</bold> are a subset of GCNs that employ attention mechanisms to assess the relative relevance of various nodes in a graph. This enables GATs to process the graph while concentrating on the most important nodes. <bold>Laplacian eigenmaps:</bold> By mapping graph-structured data to a lower-dimensional space, a method known as Laplacian eigenmaps is utilised to reduce the dimensionality of the data. This is accomplished by identifying the eigenvectors of the graph&#x00027;s Laplacian matrix. <bold>Differentiable Pooling:</bold> This technique enables for the handling of variable-size graph-structured data by dynamically adjusting the number of nodes in a graph during the training phase (references in Ying et al., <xref ref-type="bibr" rid="B161">2018</xref>; Li et al., <xref ref-type="bibr" rid="B80">2021a</xref>). <bold>Spectral Graph Convolution</bold> is a method for handling graph-structured data that are based on the eigenvectors of the graph Laplacian. It enables the convolving of a signal on the graph by the use of a Fourier space filter (some references in Zhang et al., <xref ref-type="bibr" rid="B167">2019a</xref>; Salim and Sumitra, <xref ref-type="bibr" rid="B117">2022</xref>). <bold>Graph capsules:</bold> It is a technique that makes use of a capsule network design to enhance the functionality of graph-based models (Misra, <xref ref-type="bibr" rid="B96">2019</xref>). A certain class of neural network called capsules may simulate relationships between things.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="frai-06-1256352-g0002.tif"/>
</fig>
<sec>
<title>3.1 Applications</title>
<p>In <xref ref-type="table" rid="T1">Table 1</xref>, we summarize the main categories of the geometric deep learning and the current main applications of it. Various applications of geometric deep learning to the study of biological systems, especially at the level of dynamic interactome, are beginning to emerge, and we will make special mention of these in this review.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Categories and applications of geometric deep learning.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:&#x00023;919498;color:&#x00023;ffffff">
<th valign="top" align="left" colspan="2"><bold>Geometric deep learning</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Categories</bold></td>
<td valign="top" align="left"><bold>Applications</bold></td>
</tr> <tr>
<td valign="top" align="left"><bold>Graph Neural Networks (GNNs)</bold>. Examples of GNNs include Graph Convolutional Networks (GCNs) (Zhang et al., <xref ref-type="bibr" rid="B167">2019a</xref>) and Graph Attention Networks (GATs) (Veli&#x0010D;kovi&#x00107; et al., <xref ref-type="bibr" rid="B139">2018</xref>; Hong et al., <xref ref-type="bibr" rid="B54">2020</xref>; Chen et al., <xref ref-type="bibr" rid="B26">2022</xref>).</td>
<td valign="top" align="left">Image classification, object detection and segmentation, natural language processing, structural chemistry, molecule solubility, network node classification, and recommendation systems.</td>
</tr> <tr>
<td valign="top" align="left"><bold>Manifold-valued Neural Networks (MVNs)</bold>. Examples of MVNs include Spherical CNNs (Li et al., <xref ref-type="bibr" rid="B83">2021b</xref>; Su and Grauman, <xref ref-type="bibr" rid="B129">2021</xref>; Scott et al., <xref ref-type="bibr" rid="B120">2022</xref>), PointNet (Charles et al., <xref ref-type="bibr" rid="B24">2017</xref>), and ManifoldNet (Chakraborty et al., <xref ref-type="bibr" rid="B22">2022</xref>).</td>
<td valign="top" align="left">Image classification, object detection and segmentation, natural language processing, and recommendation systems.</td>
</tr>
<tr>
<td valign="top" align="left"><bold>Topology and Shape Analysis</bold>. Case studies and surveys in the study by Hensel et al. (<xref ref-type="bibr" rid="B51">2021</xref>) and Magai and Ayzenberg (<xref ref-type="bibr" rid="B91">2022</xref>).</td>
<td valign="top" align="left">Analysis of properties of data, such as connectivity, homology, and curvature, is used in fields such as computer vision, medical imaging, and computational biology.</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>When it comes to operating on graph-structured and manifold-valued data, geometric deep learning can be roughly divided into Graph Neural Networks (GNNs) and Manifold-valued Neural Networks (MVNs). Topology and Shape Analysis, which examines topological and geometric data properties, is another field that can be regarded as a subset of geometric deep learning.</p>
</table-wrap-foot>
</table-wrap>
<p>Pineda et al. (<xref ref-type="bibr" rid="B113">2023</xref>) apply geometric deep learning to the analysis of dynamical process. For their mechanical interpretation and connection to biological functions, dynamical processes in living systems can be characterised in order to gain valuable information. It is now possible to capture the movements of cells, organelles, and individual molecules at several spatiotemporal scales in physiological settings to recent advancements in microscopy techniques. However, the capture of microscopic image sequences still lags behind the automated analysis of dynamics happening in crowded and complicated situations. The authors in the study mentioned in the reference (Pineda et al., <xref ref-type="bibr" rid="B113">2023</xref>) offer a methodology built on geometric deep learning that successfully estimates dynamical properties with accuracy in a variety of biologically relevant settings. This deep learning strategy makes the use of an attention-based graph neural network (see in <xref ref-type="table" rid="T1">Table 1</xref> for some literature reference on attention graphs). This network can do a variety of things, such as to convert coordinates into trajectories and infer local and global dynamic attributes, by processing object features with geometric <italic>priors</italic>.</p>
<p>Drug repositioning is another growing application domain of geometric deep learning on graphs. Currently, drug repositioning uses artificial intelligence tools to find new markers of authorised medications. The non-Euclidean nature of biological network data, however, is not well accounted for the majority of drug repositioning computational approaches. To solve this issue, Zhao et al. (<xref ref-type="bibr" rid="B173">2022</xref>) developed a deep learning system called DDAGDL. It uses geometric deep learning over heterogeneous information networks to predict drug-drug associations. By cleverly projecting drugs and diseases that include geometric prior knowledge of network topology in a non-Euclidean domain onto a latent feature space, DDAGDL can take advantage of complex biological information to learn the feature representations of pharmaceuticals and disorders. The authors in the study by Zhao et al. (<xref ref-type="bibr" rid="B173">2022</xref>) showed that according to experimental findings, DDAGDL may recognise high-quality candidates for breast neoplasms and Alzheimer&#x00027;s dementia that have already been described by published studies.</p>
<p>Another application of considerable interest in the medical and biological fields of geometric deep learning was proposed by Das et al. (<xref ref-type="bibr" rid="B32">2022</xref>). The authors start from the consideration that drug-virus interactions should be investigated in order to prepare for potential new forms of viruses and variants and rapidly generate medications or vaccinations against potential viruses. Despite expensive and time-consuming experimental procedures, geometric deep learning is a way that can be utilised to make this process faster and cheaper. Das et al. (<xref ref-type="bibr" rid="B32">2022</xref>) offered a new model based on geometric deep learning for predicting drug-virus interactions against COVID-19. First, in the SMILES molecular structure representation (Weininger, <xref ref-type="bibr" rid="B145">1988</xref>), Das et al. employ antiviral medication data to generate features and better define the structure of chemical species. Then, the data are turned into a molecular representation, which is subsequently translated into a graphical structure that the geometrical deep learning model can understand.</p>
<p>Exploiting the idea that a molecule can be represented as a graph whose vertices correspond to the atoms of the compound and edges correspond to chemical bonds, geometric deep learning has been also applied for the prediction of molecular structure in structural chemistry and drug design (Hop et al., <xref ref-type="bibr" rid="B56">2018</xref>; David et al., <xref ref-type="bibr" rid="B33">2020</xref>; Atz et al., <xref ref-type="bibr" rid="B5">2021</xref>). Geometric deep learning has been also applied to macromolecular structure (i.e., molecular graph) in structure-based drug design. Structure-based drug design identifies appropriate ligands by utilising the three-dimensional geometric information of macromolecules such as proteins or nucleic acids. An overview of recent geometric deep learning applications in bioorganic and medicinal chemistry, emphasising its promise for structure-based drug discovery and design, is presented by Isert et al. (<xref ref-type="bibr" rid="B60">2023</xref>). The focus of this overview is on predicting molecular properties, ligand binding site and posture prediction, and structure-based <italic>de novo</italic> molecular design. Similarly, geometric deep learning has been applied on molecular graph for molecular crystal structure prediction in mentioned in the study by Kilgour et al. (<xref ref-type="bibr" rid="B67">2023</xref>) and the RNA molecular structure prediction mentioned in the study by Townshend et al. (<xref ref-type="bibr" rid="B136">2021</xref>).</p>
<p>Although not directly relevant to the conception of the structure of a molecule as a graph, an interesting recent application of geometric deep learning to biomolecular data, which contributes to create knowledge about the interaction networks between proteins and other biomolecules, is the study by Gainza et al. (<xref ref-type="bibr" rid="B41">2019</xref>). The rationale of the authors in this study is that it is still difficult in biology to predict interactions between proteins and other biomolecules merely based on the structure. On the basis of their study, the experimental well-consolidated knowledge is that the molecular surface, a high-level illustration of protein structure, shows the patterns of chemical and geometric properties that uniquely identify a protein&#x00027;s modes of interaction with other biomolecules. Consequently, Gainza et al. hypothesized that independent of their evolutionary background, proteins involved in related interactions may have comparable signatures. Although fingerprints might be challenging to understand visually, they can be learned from big datasets. To identify fingerprints that are crucial for particular biomolecular interactions, the authors introduced MaSIF (molecular surface interaction fingerprinting), a conceptual framework based on a geometric deep learning algorithm. MaSIF can predict protein pockets with ligands, protein-protein interaction sites, and rapid scanning of protein surfaces for protein-protein complex prediction.</p>
<p>Townshend et al. (<xref ref-type="bibr" rid="B136">2021</xref>) pointed out that the intricate three-dimensional configurations that RNA molecules take on are challenging to measure experimentally or anticipate computationally. The analysis of the RNA structure is crucial to find medications to treat diseases that are currently incurable. A machine-learning technique proposed by Townshend et al. developed a geometric deep learning technique to enhance the prediction of RNA structures. Interestingly, the authors highlighted an important feature of geometric deep learning, namely, the flexibility of this approach to be suitably adapted to work with a smaller amount of training data than that required by traditional deep learning techniques.</p>
<p>Finally, we mention the use of geometric deep learning techniques in neuroimaging and the study of the brain connectome (Gurbuz and Rekik, <xref ref-type="bibr" rid="B49">2020</xref>; Huang et al., <xref ref-type="bibr" rid="B59">2021</xref>; Williams et al., <xref ref-type="bibr" rid="B146">2021</xref>), as well as the study on (i) the relationship of human brain structure to cognitive function (Wu et al., <xref ref-type="bibr" rid="B148">2022</xref>), (ii) the topographic heterogeneity of cortical organisation as a necessary step toward precision modelling of neuropsychiatric disorders (Williams et al., <xref ref-type="bibr" rid="B146">2021</xref>), (iii) brain aging (Besson et al., <xref ref-type="bibr" rid="B9">2022</xref>).</p></sec>
<sec>
<title>3.2 Latent geometry and graph comparison</title>
<p>To compare graphs, it is necessary to define a distance metric between graphs. This is a very complex undertaking that necessitates balancing interpretability, computational efficiency, and outcome effectiveness - all of which are frequently dependent on the particular application area. It should come as no surprise that there is a tonne of literature on this subject and that many various approaches have been suggested (Wills and Meyer, <xref ref-type="bibr" rid="B147">2020</xref>). Of these three categories of methods for comparing graphs, the most closely related to latent geometry is the category of methods based on spectral analysis of the weighted adjacency matrix or Laplacian matrix, since the latent geometry of the network is derived from this. The rationale behind the use of spectral methods for graph comparison is that by comparing spectra provide metrics for comparing networks since the spectrum of a network&#x00027;s representation matrix (an adjacency or Laplacian matrix) contains information about its structure. In particular, the authors of NetSLD made explicit the relationship between weighted graph adjacency or Laplacian matrix and latent geometry through metaphors introduced by G&#x000FC;nthard and Primas (<xref ref-type="bibr" rid="B48">1956</xref>) and Kac (<xref ref-type="bibr" rid="B62">1966</xref>). Spectral graph theory is effective in the comparison of 3D objects&#x02014;said Tsitsulin et al. (<xref ref-type="bibr" rid="B137">2018</xref>)&#x02014;but graphs lack a fixed form, yet 3D objects have an exact low-dimensional shape. However, a graph can be thought of as a geometric entity. G&#x000FC;nthard and Primas (<xref ref-type="bibr" rid="B48">1956</xref>) posed the initial inquiry, &#x0201C;Can one hear the shape of a drum?&#x0201D; Kac (<xref ref-type="bibr" rid="B62">1966</xref>) elegantly posed the same query &#x0201C;To what extent may a graph (or, in general, a manifold) be determined by its spectrum?&#x0201D;. Since then, research has revealed that certain graphs are dictated by their spectrum and that isospectral graphs typically are isometric. Consequently, spectral graph theory provides a foundation for graph comparison.</p>
<p>Learning the latent geometry of a network also proves to be very useful in graph comparison because it can help address some of the challenges that this task presents. We summarise the main ones here and then explain how learning latent geometry can prove useful. First, graph comparison must not care about the order in which nodes are displayed; this is known as <italic>permutation -invariance</italic>. Second, a good method of graph comparison would make it possible to compare graphs both locally (representing, for example, the variations in atomic bonds between chemical compounds) and globally or communally (recording, for example, the various topologies of social networks). This ability is referred to as <italic>scale-adaptivity</italic>. Third, it would identify structural similarities regardless of network size (e.g., determining the similarity of two criminal networks of various sizes). This ability is referred to as <italic>size-invariance</italic>.</p>
<p>The research in graph comparison is very active today [see the recent review by Tantardini et al. (<xref ref-type="bibr" rid="B133">2019</xref>)], because&#x02014;as Tsitsulin et al. (<xref ref-type="bibr" rid="B137">2018</xref>) highlights&#x02014;there is not a method for graph comparison that meets all three of these criteria. In addition to these standards of quality, a workable method of graph comparison should be effectively computable. After preprocessing, it is suitable to do graph analytics jobs that frequently need pairwise graph comparisons inside a large collection of graphs in constant time. Unfortunately, current techniques perform considerably worse in this regard. Graph edit distance (GED) is a widely used graph distance; machine learning has utilised graph edit distance to compare objects when the objects are represented as attributed graphs rather than vectors. The GED is typically used in these situations to determine the distance between attributed graphs. GED is defined as the smallest number of edit operations (such as the deletion, insertion, and replacement of nodes and edges) required to change one graph into another (Serratosa, <xref ref-type="bibr" rid="B121">2021</xref>). GED is NP-hard and APX-hard to compute (Lin, <xref ref-type="bibr" rid="B86">1994</xref>); significant research in GED-based graph comparison has not been able to ignore this fact [see a concise but comprehensive state of the art on this in the study by Tsitsulin et al. (<xref ref-type="bibr" rid="B137">2018</xref>)]. Similar to GED, graph kernel approaches (Borgwardt et al., <xref ref-type="bibr" rid="B13">2020</xref>; Kriege et al., <xref ref-type="bibr" rid="B72">2020</xref>) do not explicitly represent the graph and and they do not scale well (Tsitsulin et al., <xref ref-type="bibr" rid="B137">2018</xref>). Identifying the challenges in meeting the requirements of efficiency, scalability, size, and permutation invariance, Tsitsulin et al. moved the issue to the spectral realm and provides an evocative metaphor to clarify their process. Heating the nodes of the graph and tracking the heat spread over time is a metaphor. The idea of a system of masses for the graph&#x00027;s nodes and springs for its edges is another helpful metaphor. The authors (Tsitsulin et al., <xref ref-type="bibr" rid="B137">2018</xref>) claimed that in both scenarios, the entire procedure embodies more global information with time and defines the graph in an efficient permutation-invariant way. They developed the NetLSD that summarises the features of the (undirected, unweighted) graph by a vector derived from the solution of the &#x0201C;heat equation&#x0201D; &#x02202;<italic>u</italic><sub><italic>t</italic></sub>/&#x02202; &#x0003D; &#x02212;<italic>Lu</italic><sub><italic>t</italic></sub>, where <italic>u</italic><sub><italic>t</italic></sub> is an <italic>n</italic>-dimensional vector and &#x0003D; <italic>I</italic>&#x02212;<italic>D</italic><sup>&#x02212;1/2</sup><italic>AD</italic><sup>&#x02212;1/2</sup> is the normalised Laplacian matrix. Since <italic>L</italic> is symmetric, it can be written as <italic>L</italic> &#x0003D; &#x003A6;<italic>&#x0039B;&#x003A6;</italic><sup>&#x022A4;</sup>, where &#x0039B; is a diagonal matrix of sorted eigenvalues &#x003BB;<sub>1</sub> &#x02264; &#x003BB;<sub>2</sub> &#x02264; &#x022EF; &#x02264; &#x003BB;<sub><italic>n</italic></sub> of which &#x003D5;<sub>1</sub>, &#x003D5;<sub>2</sub>, &#x02026;, &#x003D5;<sub><italic>n</italic></sub> are the corresponding eigenvectors. Hence, the closed-form solution is given by the <italic>n</italic>&#x000D7;<italic>n</italic> &#x0201C;heat kernel&#x0201D; matrix</p>
<disp-formula id="E4"><mml:math id="M4"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mi>e</mml:mi></mml:mrow><mml:mrow><mml:mo>-</mml:mo><mml:mi>L</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msup><mml:mo>=</mml:mo><mml:mn>&#x003A6;</mml:mn><mml:msup><mml:mrow><mml:mi>e</mml:mi></mml:mrow><mml:mrow><mml:mo>-</mml:mo><mml:mn>&#x0039B;</mml:mn><mml:mi>t</mml:mi></mml:mrow></mml:msup><mml:msup><mml:mrow><mml:mn>&#x003A6;</mml:mn></mml:mrow><mml:mrow><mml:mtext>T</mml:mtext></mml:mrow></mml:msup></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>whose entry (<sub><italic>H</italic><sub><italic>t</italic></sub>)<italic>ij</italic></sub> is the heat transferred from node <italic>i</italic> to <italic>j</italic> at time <italic>t</italic>.</p>
<p>NetLSD summarises the graph representation in the heat trace signature as follows:</p>
<disp-formula id="E5"><mml:math id="M5"><mml:mtable columnalign="left"><mml:mtr><mml:mtd><mml:mi>h</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>G</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mrow><mml:mo>{</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>h</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo>}</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x0003E;</mml:mo><mml:mn>0</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo class="qopname">trace</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>H</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Finally, the continuous-time function <italic>h</italic><sub><italic>t</italic></sub> is converted into a finite-dimensional vector by sampling over a suitable time interval, and the distance between two networks <italic>G</italic><sub>1</sub>, <italic>G</italic><sub>2</sub> is taken as the <italic>L</italic><sub>2</sub>-norm of the vector difference between <italic>h</italic>(<italic>G</italic><sub>1</sub>) and <italic>h</italic>(<italic>G</italic><sub>2</sub>). The time complexity of NetLSD is <italic>O</italic>(<italic>n</italic><sup>3</sup>), if the full eigen-decomposition of the Laplacian is carried out. Specifically, the heat or wave kernel of the Laplacian spectrum is inherited by the compact signature that NetLSD derives, thus &#x0201C;it hears the shape of a graph&#x0201D;&#x02014;said Tsitsulin et al. (<xref ref-type="bibr" rid="B137">2018</xref>).</p>
<p>At the conclusion of this section, some general comments on the spectral methods are made. Despite their use of ease and rigorous theoretical foundation, these methods exhibit some limitations, such as cospectrality between graphs, reliance on matrix representation, and abnormal sensitivity, wherein slight alterations in the graph&#x00027;s structure can result in significant changes in the spectrum (Tantardini et al., <xref ref-type="bibr" rid="B133">2019</xref>) and <italic>vice versa</italic>. However, it is reasonable to think that strategies to manage the sensitivity to noise or perturbations will not be long in coming, given the numerous advantages that spectral methods offer compared with their limitations, first of all the possibility that these methods offer to efficiently satisfy the three main desiderate of graph comparison as NetLSD has demonstrated.</p></sec></sec>
<sec id="s4">
<title>4 Challenges and future developments</title>
<p>A comprehensive review by Cai et al. (<xref ref-type="bibr" rid="B16">2018</xref>) outlines the challenges of graph embedding. In that review, the authors emphasized how the challenges of embedding a graph rely on the issue formulation, which entails embedding input and embedding output. The input to graph embedding algorithms according to Cai et al. can be categorized into four groups: homogeneous, heterogeneous, with auxiliary information, and graph built from non-relational data. The task of graph embedding is complicated by the fact that different forms of embedding input require different information to be kept in the embedded space. For instance, when embedding a graph with only structure information, the goal is to preserve the connections between the nodes. The auxiliary information, however, gives graph properties from various perspectives and may therefore also be taken into account during the embedding for a graph that has node label or attribute information. In contrast to the given and fixed embedding input, the embedding output is task driven &#x02013; said Cai et al. (<xref ref-type="bibr" rid="B16">2018</xref>). For instance, node embedding depicts nearby nodes as comparable vectors. Node-related activities such as node classification, node clustering can benefit from node embedding. However, in some circumstances, the tasks may pertain to a finer level of a network, such as node pairs, subgraphs, or the entire graph. Finding an appropriate embedding output type for the application of interest is thus the first hurdle in terms of embedding output. Node embedding, edge embedding, hybrid embedding, and whole-graph embedding are the four output categories commonly used to classify graph embedding results. Cai et al. (<xref ref-type="bibr" rid="B16">2018</xref>) then continue by asserting that distinct output granularities are faced with various difficulties and have distinct requirements for an optimal embedding. A successful node embedding, for instance, maintains the resemblance to its surrounding nodes in the embedded space. A decent whole-graph embedding, on the other hand, depicts a full graph as a vector in order to maintain the graph&#x00027;s level of similarity.</p>
<p>Since the output of embedding is task-driven, we can rightly imagine that the quality of the output is also contextual to the task. Consequently, any procedure for evaluating and validating graph embedding must necessarily refer to particular tasks and contexts. Regarding applications in biology of graph embedding, we mention here a study by Yue et al. (<xref ref-type="bibr" rid="B163">2019</xref>) that compared the performance of embedding methods with the purpose of link prediction. Three significant biomedical link prediction tasks&#x02013;drug-disease association (DDA), drug-drug interaction (DDI), and protein-protein interaction (PPI) prediction&#x02013;as well as two node classification tasks&#x02013;classification of medical terms according to their semantic types and protein function prediction&#x02013;are the subjects of the systematic comparison of 11 representative graph embedding methods as shown in the study mentioned in the reference (Yue et al., <xref ref-type="bibr" rid="B163">2019</xref>). According to Yue et al., the results of the test show that current graph embedding techniques are effective and deserve additional consideration in biological graph analysis in future. Recent graph embedding methods achieve competitive performance without using any biological features, and the learned embeddings can be treated as complementary representations for the biological features when compared with three state-of-the-art methods, namely, DDAs, DDIs, and protein function predictions. The comparative review by Yue et al. finally offers broad recommendations for choosing graph embedding algorithms and configuring their hyper-parameters for various biomedical objectives.</p>
<p>Graph embedding is proved to be of particular importance for the prediction of links in a network and, more generally, in all declinations of network inference (see Saint-Antoine and Singh, <xref ref-type="bibr" rid="B116">2020</xref> for a review on network inference challenges), a pivotal task in systems biology and, more specifically, gene regulatory network inference and single cell biology. In this regard, Hetzel et al. (<xref ref-type="bibr" rid="B52">2021</xref>) present a viewpoint on learning graph representations that is specifically inspired by the uses and difficulties of (i) single-cell biology; (ii) network inference, and (iii) current developments in spatial molecular profiling. Hetzel et al. (<xref ref-type="bibr" rid="B52">2021</xref>) state that single-cell RNA sequencing provides previously unattainable levels of resolution and scale for measuring gene expression and enables the investigation of cellular characteristics. Graphs provide a natural representation of the system in this setting, both as gene- and cell-centric. Thus, we foresee the possibility of obtaining highly informative results from graph embedding of such accurate and good quality data.</p>
<p>Finally, an additional challenge that graph embedding methods and geometric deep learning face are the management of noise in the data. The quality of the input data, as determined by the value of the experimental uncertainties on edge weights and/or structural noise that plague them, and the sparsity of the data are two parameters that affect the quality and thus the reliability of embedding results and consequently their geometric deep learning. Some studies are already tried to address these challenges (Zhang et al., <xref ref-type="bibr" rid="B166">2012</xref>; Pujara et al., <xref ref-type="bibr" rid="B114">2017</xref>; Fox and Rajamanickam, <xref ref-type="bibr" rid="B39">2019</xref>; Okuno and Shimodaira, <xref ref-type="bibr" rid="B101">2019</xref>; Cheng et al., <xref ref-type="bibr" rid="B29">2020</xref>; Hong et al., <xref ref-type="bibr" rid="B55">2021</xref>; Xia et al., <xref ref-type="bibr" rid="B150">2023</xref>).</p></sec>
<sec sec-type="conclusions" id="s5">
<title>5 Conclusion</title>
<p>In this mini-review, we have reviewed and collected an abundance of literature on graph embedding techniques and geometric deep learning methods of great relevance for graph mining of biological networks and/or biophysical systems that can be represented as networks/graphs. Since non-Euclidean data cannot be effectively represented using conventional deep learning techniques, geometric deep learning offers a significant advancement in the field of machine learning. Deep learning models in applied artificial intelligence perform appropriately with Euclidean data, but they performed with non-Euclidean data. Because it is usual to find data of this type in biology, biochemistry, and biophysics, this is a significant problem which is the rationale of the research studies in geometric deep learning. Graph embedding and geometric deep learning are not two separate methods but can operate in sequence since graph embedding can provide geometric information about nodes and/or arcs, which can then be used by geometric deep learning for more complete, reliable, and accurate analysis and inference of new knowledge.</p></sec>
<sec sec-type="author-contributions" id="s6">
<title>Author contributions</title>
<p>PL: Conceptualization, Funding acquisition, Investigation, Writing&#x02014;original draft, Writing&#x02014;review &#x00026; editing. ML: Investigation, Writing&#x02014;original draft, Writing&#x02014;review &#x00026; editing.</p></sec>
</body>
<back>
<sec sec-type="funding-information" id="s7">
<title>Funding</title>
<p>The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Open Access Publishing Fund of the Free University of Bozen-Bolzano.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s8">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abbas</surname> <given-names>K.</given-names></name> <name><surname>Abbasi</surname> <given-names>A.</given-names></name> <name><surname>Dong</surname> <given-names>S.</given-names></name> <name><surname>Niu</surname> <given-names>L.</given-names></name> <name><surname>Chen</surname> <given-names>L.</given-names></name> <name><surname>Chen</surname> <given-names>B.</given-names></name></person-group> (<year>2023</year>). <article-title>A novel temporal network-embedding algorithm for link prediction in dynamic networks</article-title>. <source>Entropy</source> <volume>25</volume>, <fpage>257</fpage>. <pub-id pub-id-type="doi">10.3390/e25020257</pub-id><pub-id pub-id-type="pmid">36832623</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alanis-Lobato</surname> <given-names>G.</given-names></name> <name><surname>Mier</surname> <given-names>P.</given-names></name> <name><surname>Andrade-Navarro</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>The latent geometry of the human protein interaction network</article-title>. <source>Bioinformatics</source> <volume>34</volume>, <fpage>2826</fpage>&#x02013;<lpage>2834</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/bty206</pub-id><pub-id pub-id-type="pmid">29635317</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amara</surname> <given-names>A.</given-names></name> <name><surname>Hadj Taieb</surname> <given-names>M. A.</given-names></name> <name><surname>Ben Aouicha</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Network representation learning systematic review: Ancestors and current development state</article-title>. <source>Mach. Learn. Appl</source>. <volume>6</volume>, <fpage>100130</fpage>. <pub-id pub-id-type="doi">10.1016/j.mlwa.2021.100130</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Archdeacon</surname> <given-names>D.</given-names></name></person-group> (<year>1990</year>). <article-title>&#x0201C;The complexity of the graph embedding problem,&#x0201D;</article-title> in <source>Topics in Combinatorics and Graph Theory</source>, eds R. Bodendiek and R. Henn (Heidelberg: Physica-Verlag). <pub-id pub-id-type="doi">10.1007/978-3-642-46908-4_6</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Atz</surname> <given-names>K.</given-names></name> <name><surname>Grisoni</surname> <given-names>F.</given-names></name> <name><surname>Schneider</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). <article-title>Geometric deep learning on molecular representations</article-title>. <source>Nat. Mach. Intellig</source>. <volume>3</volume>, <fpage>1023</fpage>&#x02013;<lpage>1032</lpage>. <pub-id pub-id-type="doi">10.1038/s42256-021-00418-8</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bagrow</surname> <given-names>J. P.</given-names></name> <name><surname>Bollt</surname> <given-names>E. M.</given-names></name></person-group> (<year>2019</year>). <article-title>An information-theoretic, all-scales approach to comparing networks</article-title>. <source>Appl. Netw. Sci</source>. <volume>4</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1007/s41109-019-0156-x</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Baldi</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x0201C;Autoencoders, unsupervised learning, and deep architectures,&#x0201D;</article-title> in <source>Proceedings of ICML Workshop on Unsupervised and Transfer Learning, Vol. 27</source>, eds I. Guyon, G. Dror, V. Lemaire, G. Taylor, and D. Silver (Bellevue, WA: PMLR), <fpage>37</fpage>&#x02013;<lpage>49</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v27/baldi12a.html">https://proceedings.mlr.press/v27/baldi12a.html</ext-link></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000E9;res</surname> <given-names>F.</given-names></name> <name><surname>Kelen</surname> <given-names>D. M.</given-names></name> <name><surname>P&#x000E1;lovics</surname> <given-names>R.</given-names></name> <name><surname>Bencz&#x000FA;r</surname> <given-names>A. A.</given-names></name></person-group> (<year>2019</year>). <article-title>Node embeddings in dynamic graphs</article-title>. <source>Appl. Netw. Sci</source>. <volume>4</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1007/s41109-019-0169-5</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Besson</surname> <given-names>P.</given-names></name> <name><surname>Rogalski</surname> <given-names>E.</given-names></name> <name><surname>Gill</surname> <given-names>N. P.</given-names></name> <name><surname>Zhang</surname> <given-names>H.</given-names></name> <name><surname>Martersteck</surname> <given-names>A.</given-names></name> <name><surname>Bandt</surname> <given-names>S. K.</given-names></name></person-group> (<year>2022</year>). <article-title>Geometric deep learning reveals a structuro-temporal understanding of healthy and pathologic brain aging</article-title>. <source>Front. Aging Neurosci</source>. <volume>14</volume>, <fpage>895535</fpage>. <pub-id pub-id-type="doi">10.3389/fnagi.2022.895535</pub-id><pub-id pub-id-type="pmid">36081894</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bianconi</surname> <given-names>G.</given-names></name> <name><surname>Rahmede</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>Emergent hyperbolic network geometry</article-title>. <source>Sci. Rep</source>. <volume>7</volume>, <fpage>974</fpage>. <pub-id pub-id-type="doi">10.1038/srep41974</pub-id><pub-id pub-id-type="pmid">28167818</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bogu&#x000F1;&#x000E1;</surname> <given-names>M.</given-names></name> <name><surname>Bonamassa</surname> <given-names>I.</given-names></name> <name><surname>Domenico</surname> <given-names>M. D.</given-names></name> <name><surname>Havlin</surname> <given-names>S.</given-names></name> <name><surname>Krioukov</surname> <given-names>D.</given-names></name> <name><surname>Serrano</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Network geometry</article-title>. <source>Nat. Rev. Phys</source>. <volume>3</volume>, <fpage>114</fpage>&#x02013;<lpage>135</lpage>. <pub-id pub-id-type="doi">10.1038/s42254-020-00264-4</pub-id></citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bombelli</surname> <given-names>L.</given-names></name> <name><surname>Lee</surname> <given-names>J.</given-names></name> <name><surname>Meyer</surname> <given-names>D.</given-names></name> <name><surname>Sorkin</surname> <given-names>R. D.</given-names></name></person-group> (<year>1987</year>). <article-title>Space-time as a causal set</article-title>. <source>Phys. Rev. Lett</source>. <volume>59</volume>, <fpage>521</fpage>&#x02013;<lpage>524</lpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.59.521</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Borgwardt</surname> <given-names>K.</given-names></name> <name><surname>Ghisu</surname> <given-names>E.</given-names></name> <name><surname>Llinares-L&#x000F3;pez</surname> <given-names>F.</given-names></name> <name><surname>O&#x00027;Bray</surname> <given-names>L.</given-names></name> <name><surname>Rieck</surname> <given-names>B.</given-names></name></person-group> (<year>2020</year>). <article-title>Graph kernels: State-of-the-art and future challenges</article-title>. <source>Trends Mach. Learn</source>. 13 531&#x02013;712. <pub-id pub-id-type="doi">10.1561/2200000076</pub-id></citation>
</ref>
<ref id="B14">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Bronstein</surname> <given-names>M. M.</given-names></name> <name><surname>Bruna</surname> <given-names>J.</given-names></name> <name><surname>Cohen</surname> <given-names>T.</given-names></name> <name><surname>Veli&#x0010D;kovi&#x00107;</surname> <given-names>P.</given-names></name></person-group> (<year>2021</year>). <source>Geometric deep learning: grids, groups, graphs, geodesics, and gauges. ArXiv. abs/2104.13478</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://api.semanticscholar.org/CorpusID:233423603">https://api.semanticscholar.org/CorpusID:233423603</ext-link></citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bronstein</surname> <given-names>M. M.</given-names></name> <name><surname>Bruna</surname> <given-names>J.</given-names></name> <name><surname>LeCun</surname> <given-names>Y.</given-names></name> <name><surname>Szlam</surname> <given-names>A.</given-names></name> <name><surname>Vandergheynst</surname> <given-names>P.</given-names></name></person-group> (<year>2017</year>). <article-title>Geometric deep learning: going beyond euclidean data</article-title>. <source>IEEE Signal Process. Mag</source>. <volume>34</volume>, <fpage>18</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.1109/MSP.2017.2693418</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cai</surname> <given-names>H.</given-names></name> <name><surname>Zheng</surname> <given-names>V. W.</given-names></name> <name><surname>Chang</surname> <given-names>K. C.-C.</given-names></name></person-group> (<year>2018</year>). <article-title>A comprehensive survey of graph embedding: problems, techniques, and applications</article-title>. <source>IEEE Trans. Knowl. Data Eng</source>. <volume>30</volume>, <fpage>1616</fpage>&#x02013;<lpage>1637</lpage>. <pub-id pub-id-type="doi">10.1109/TKDE.2018.2807452</pub-id></citation>
</ref>
<ref id="B17">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>J.</given-names></name> <name><surname>Lin</surname> <given-names>X.</given-names></name> <name><surname>Guo</surname> <given-names>S.</given-names></name> <name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Liu</surname> <given-names>T.</given-names></name> <name><surname>Wang</surname> <given-names>B.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;Bipartite graph embedding via mutual information maximization,&#x0201D;</article-title> in <source>Proceedings of the 14th ACM International Conference on Web Search and Data Mining</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>), <fpage>635</fpage>&#x02013;<lpage>643</lpage>. <pub-id pub-id-type="doi">10.1145/3437963.3441783</pub-id></citation>
</ref>
<ref id="B18">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>S.</given-names></name> <name><surname>Lu</surname> <given-names>W.</given-names></name> <name><surname>Xu</surname> <given-names>Q.</given-names></name></person-group> (<year>2015</year>). <article-title>&#x0201C;Grarep: Learning graph representations with global structural information,&#x0201D;</article-title> in <source>Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, CIKM &#x00027;15</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>), <fpage>891</fpage>&#x02013;<lpage>900</lpage>.</citation>
</ref>
<ref id="B19">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>S.</given-names></name> <name><surname>Lu</surname> <given-names>W.</given-names></name> <name><surname>Xu</surname> <given-names>Q.</given-names></name></person-group> (<year>2016a</year>). <article-title>&#x0201C;Deep neural networks for learning graph representations,&#x0201D;</article-title> in <source>Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence</source> (<publisher-loc>Phoenix, AZ</publisher-loc>: <publisher-name>AAAI Press</publisher-name>), <fpage>1145</fpage>&#x02013;<lpage>1152</lpage>.</citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>W.</given-names></name> <name><surname>Yan</surname> <given-names>Z.</given-names></name> <name><surname>He</surname> <given-names>Z.</given-names></name> <name><surname>He</surname> <given-names>Z.</given-names></name></person-group> (<year>2020</year>). <article-title>A comprehensive survey on geometric deep learning</article-title>. <source>IEEE Access</source> <volume>8</volume>, <fpage>35929</fpage>&#x02013;<lpage>35949</lpage>. <pub-id pub-id-type="doi">10.1109/ACCESS.2020.2975067</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>X.</given-names></name> <name><surname>Zheng</surname> <given-names>Y.</given-names></name> <name><surname>Shi</surname> <given-names>C.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Wu</surname> <given-names>B.</given-names></name></person-group> (<year>2016b</year>). <article-title>&#x0201C;Link prediction in schema-rich heterogeneous information network,&#x0201D;</article-title> in <source>Pacific-Asia Conference on Knowledge Discovery and Data Mining</source>.</citation>
</ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chakraborty</surname> <given-names>R.</given-names></name> <name><surname>Bouza</surname> <given-names>J.</given-names></name> <name><surname>Manton</surname> <given-names>J. H.</given-names></name> <name><surname>Vemuri</surname> <given-names>B. C.</given-names></name></person-group> (<year>2022</year>). <article-title>ManifoldNet: A deep neural network for manifold-valued data with applications</article-title>. <source>IEEE Trans. Pattern Anal. Mach. Intell</source>. <volume>44</volume>, <fpage>799</fpage>&#x02013;<lpage>810</lpage>. <pub-id pub-id-type="doi">10.1109/TPAMI.2020.3003846</pub-id><pub-id pub-id-type="pmid">32750791</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Chang</surname> <given-names>J.</given-names></name> <name><surname>Lan</surname> <given-names>Z.</given-names></name> <name><surname>Cheng</surname> <given-names>C.</given-names></name> <name><surname>Wei</surname> <given-names>Y.</given-names></name></person-group> (<year>2020</year>). <article-title>&#x0201C;Data uncertainty learning in face recognition,&#x0201D;</article-title> in <source>2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA</source> (<publisher-loc>Manhattan, NY</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>5709</fpage>&#x02013;<lpage>5718</lpage>. <pub-id pub-id-type="doi">10.1109/CVPR42600.2020.00575</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Charles</surname> <given-names>R. Q.</given-names></name> <name><surname>Su</surname> <given-names>H.</given-names></name> <name><surname>Kaichun</surname> <given-names>M.</given-names></name> <name><surname>Guibas</surname> <given-names>L. J.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x0201C;PointNet: Deep learning on point sets for 3d classification and segmentation,&#x0201D;</article-title> in <source>2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)</source>. <publisher-loc>Manhattan, NY</publisher-loc>: <publisher-name>IEEE</publisher-name>.</citation>
</ref>
<ref id="B25">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>H.</given-names></name> <name><surname>Perozzi</surname> <given-names>B.</given-names></name> <name><surname>Hu</surname> <given-names>Y.</given-names></name> <name><surname>Skiena</surname> <given-names>S.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Harp: Hierarchical representation learning for networks,&#x0201D;</article-title> in <source>Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence, AAAI&#x00027;18/IAAI&#x00027;18/EAAI&#x00027;18</source>. <publisher-loc>Washington D.C.</publisher-loc>: <publisher-name>AAAI Press</publisher-name>.</citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>J.</given-names></name> <name><surname>Fang</surname> <given-names>C.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name></person-group> (<year>2022</year>). <article-title>Global attention-based graph neural networks for node classification</article-title>. <source>Neur. Proc. Lett</source>. <volume>55</volume>, <fpage>4127</fpage>&#x02013;<lpage>4150</lpage>. <pub-id pub-id-type="doi">10.1007/s11063-022-11032-z</pub-id></citation>
</ref>
<ref id="B27">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>J.</given-names></name> <name><surname>Kanchi</surname> <given-names>S. P.</given-names></name> <name><surname>Kanevsky</surname> <given-names>A.</given-names></name></person-group> (<year>1993</year>). <article-title>&#x0201C;On the complexity of graph embeddings,&#x0201D;</article-title> in <source>Lecture Notes in Computer Science</source>. <publisher-loc>Cham</publisher-loc>: <publisher-name>Springer Berlin Heidelberg</publisher-name>, <fpage>234</fpage>&#x02013;<lpage>245</lpage>.</citation>
</ref>
<ref id="B28">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>M.</given-names></name> <name><surname>Yang</surname> <given-names>Q.</given-names></name> <name><surname>Tang</surname> <given-names>X.</given-names></name></person-group> (<year>2007</year>). <article-title>&#x0201C;Directed graph embedding,&#x0201D;</article-title> in <source>Proceedings of the 20th International Joint Conference on Artifical Intelligence, IJCAI&#x00027;07</source>. <publisher-loc>San Francisco, CA, USA</publisher-loc>: <publisher-name>Morgan Kaufmann Publishers Inc</publisher-name>, <fpage>2707</fpage>&#x02013;<lpage>2712</lpage>.</citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname> <given-names>K.</given-names></name> <name><surname>Zhu</surname> <given-names>Y.</given-names></name> <name><surname>Zhang</surname> <given-names>M.</given-names></name> <name><surname>Sun</surname> <given-names>Y.</given-names></name></person-group> (<year>2020</year>). <source>Noi gan</source>&#x02002; <italic>NOISE aware knowledge graph embedding with gan</italic>?&#x000B0;</citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chung</surname> <given-names>F.</given-names></name></person-group> (<year>2006</year>). <article-title>The diameter and laplacian eigenvalues of directed graphs</article-title>. <source>Electr. J. Combinator</source>. <volume>13</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.37236/1142</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Clough</surname> <given-names>J. R.</given-names></name> <name><surname>Evans</surname> <given-names>T. S.</given-names></name></person-group> (<year>2017</year>). <article-title>Embedding graphs in lorentzian spacetime</article-title>. <source>PLoS ONE</source> <volume>12</volume>, <fpage>e0187301</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0187301</pub-id><pub-id pub-id-type="pmid">29107967</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Das</surname> <given-names>B.</given-names></name> <name><surname>Kutsal</surname> <given-names>M.</given-names></name> <name><surname>Das</surname> <given-names>R.</given-names></name></person-group> (<year>2022</year>). <article-title>A geometric deep learning model for display and prediction of potential drug-virus interactions against SARS-CoV-2</article-title>. <source>Chemometrics and Intellig. Lab. Syst</source>. <volume>229</volume>, <fpage>104640</fpage>. <pub-id pub-id-type="doi">10.1016/j.chemolab.2022.104640</pub-id><pub-id pub-id-type="pmid">36042844</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>David</surname> <given-names>L.</given-names></name> <name><surname>Thakkar</surname> <given-names>A.</given-names></name> <name><surname>Mercado</surname> <given-names>R.</given-names></name> <name><surname>Engkvist</surname> <given-names>O.</given-names></name></person-group> (<year>2020</year>). <article-title>Molecular representations in AI-driven drug discovery: a review and practical guide</article-title>. <source>J. Cheminform</source>. <volume>12</volume>, <fpage>5</fpage>. <pub-id pub-id-type="doi">10.1186/s,13321-020-00460-5</pub-id><pub-id pub-id-type="pmid">33431035</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="web"><person-group person-group-type="author"><collab>DGL LifeSci</collab></person-group> (<year>2020</year>). <source>Readout for Computing Graph Representations; DGL-LifeSci 0.3.1 documentation &#x02013; <italic>lifesci.dgl.ai</italic></source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://lifesci.dgl.ai/api/model.readout.html&#x00023;::text=After%20updating%20node%2Fedge%20representations,of%20updated%20node%2Fedge%20representations">https://lifesci.dgl.ai/api/model.readout.html&#x00023;::text=After%20updating%20node%2Fedge%20representations,of%20updated%20node%2Fedge%20representations</ext-link> (accessed July 9, 2023).</citation>
</ref>
<ref id="B35">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>East</surname> <given-names>R.</given-names></name></person-group> (<year>2023</year>). <source>Introduction to Geometric Quantum Machine Learning | <italic>PennyLane Demos</italic></source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://pennylane.ai/qml/demos/tutorial_geometric_qml">https://pennylane.ai/qml/demos/tutorial_geometric_qml</ext-link> (accessed September 18, 2023).</citation>
</ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Etaiwi</surname> <given-names>W.</given-names></name> <name><surname>Awajan</surname> <given-names>A.</given-names></name></person-group> (<year>2023</year>). <article-title>Semanticgraph2vec: Semantic graph embedding for text representation</article-title>. <source>Array</source> <volume>17</volume>, <fpage>100276</fpage>. <pub-id pub-id-type="doi">10.1016/j.array.2023.100276</pub-id></citation>
</ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Faisal</surname> <given-names>F. E.</given-names></name> <name><surname>Newaz</surname> <given-names>K.</given-names></name> <name><surname>Chaney</surname> <given-names>J. L.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Emrich</surname> <given-names>S. J.</given-names></name> <name><surname>Clark</surname> <given-names>P. L.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>GRAFENE: Graphlet-based alignment-free network approach integrates 3d structural and sequence (residue order) data to improve protein structural comparison</article-title>. <source>Sci. Rep</source>. <volume>7</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-017-14411-y</pub-id><pub-id pub-id-type="pmid">29097661</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fang</surname> <given-names>G.</given-names></name> <name><surname>Zeng</surname> <given-names>F.</given-names></name> <name><surname>Li</surname> <given-names>X.</given-names></name> <name><surname>Yao</surname> <given-names>L.</given-names></name></person-group> (<year>2021</year>). <article-title>Word2vec based deep learning network for DNA n4-methylcytosine sites identification</article-title>. <source>Procedia Comput. Sci</source>. <volume>187</volume>, <fpage>270</fpage>&#x02013;<lpage>277</lpage>. <pub-id pub-id-type="doi">10.1016/j.procs.2021.04.062</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fox</surname> <given-names>J.</given-names></name> <name><surname>Rajamanickam</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <source>How Robust are Graph Neural Networks to Structural Noise</source>?</citation>
</ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Francis</surname> <given-names>D. P.</given-names></name> <name><surname>Raimond</surname> <given-names>K.</given-names></name></person-group> (<year>2020</year>). <article-title>Major advancements in kernel function approximation</article-title>. <source>Artif. Intellig. Rev</source>. <volume>54</volume>, <fpage>843</fpage>&#x02013;<lpage>876</lpage>. <pub-id pub-id-type="doi">10.1007/s10462-020-09880-z</pub-id></citation>
</ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gainza</surname> <given-names>P.</given-names></name> <name><surname>Sverrisson</surname> <given-names>F.</given-names></name> <name><surname>Monti</surname> <given-names>F.</given-names></name> <name><surname>Rodol&#x000E0;</surname> <given-names>E.</given-names></name> <name><surname>Boscaini</surname> <given-names>D.</given-names></name> <name><surname>Bronstein</surname> <given-names>M. M.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Deciphering interaction fingerprints from protein molecular surfaces using geometric deep learning</article-title>. <source>Nat. Methods</source> <volume>17</volume>, <fpage>184</fpage>&#x02013;<lpage>192</lpage>. <pub-id pub-id-type="doi">10.1038/s41592-019-0666-6</pub-id><pub-id pub-id-type="pmid">31819266</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Gao</surname> <given-names>K.</given-names></name> <name><surname>Zhang</surname> <given-names>J.</given-names></name> <name><surname>Zhou</surname> <given-names>C.</given-names></name></person-group> (<year>2019</year>). <source>Semi-supervised graph embedding for multi-label graph node classification. <italic>ArXiv</italic>. abs/1907.05743</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://api.semanticscholar.org/CorpusID:196470841">https://api.semanticscholar.org/CorpusID:196470841</ext-link></citation>
</ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gauvin</surname> <given-names>L.</given-names></name> <name><surname>Panisson</surname> <given-names>A.</given-names></name> <name><surname>Cattuto</surname> <given-names>C.</given-names></name></person-group> (<year>2014</year>). <article-title>Detecting the community structure and activity patterns of temporal networks: A non-negative tensor factorization approach</article-title>. <source>PLoS ONE</source> <volume>9</volume>, <fpage>e86028</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0086028</pub-id><pub-id pub-id-type="pmid">24497935</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gharavi</surname> <given-names>E.</given-names></name> <name><surname>Gu</surname> <given-names>A.</given-names></name> <name><surname>Zheng</surname> <given-names>G.</given-names></name> <name><surname>Smith</surname> <given-names>J. P.</given-names></name> <name><surname>Cho</surname> <given-names>H. J.</given-names></name> <name><surname>Zhang</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Embeddings of genomic region sets capture rich biological associations in lower dimensions</article-title>. <source>Bioinformatics</source> <volume>37</volume>, <fpage>4299</fpage>&#x02013;<lpage>4306</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btab439</pub-id><pub-id pub-id-type="pmid">34156475</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Giamphy</surname> <given-names>E.</given-names></name> <name><surname>Guillaume</surname> <given-names>J.-L.</given-names></name> <name><surname>Doucet</surname> <given-names>A.</given-names></name> <name><surname>Sanchis</surname> <given-names>K.</given-names></name></person-group> (<year>2023</year>). <article-title>A survey on bipartite graphs embedding</article-title>. <source>Soc. Netw. Analy. Mini</source>. <volume>13</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1007/s13278-023-01058-z</pub-id></citation>
</ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goyal</surname> <given-names>P.</given-names></name> <name><surname>Ferrara</surname> <given-names>E.</given-names></name></person-group> (<year>2018</year>). <article-title>Graph embedding techniques, applications, and performance: a survey</article-title>. <source>Knowl.-Based Syst</source>. <volume>151</volume>, <fpage>78</fpage>&#x02013;<lpage>94</lpage>. <pub-id pub-id-type="doi">10.1016/j.knosys.2018.03.022</pub-id></citation>
</ref>
<ref id="B47">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Grover</surname> <given-names>A.</given-names></name> <name><surname>Leskovec</surname> <given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Node2vec: Scalable feature learning for networks,&#x0201D;</article-title> in <source>Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD &#x00027;16</source>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>, <fpage>855</fpage>&#x02013;<lpage>864</lpage>. <pub-id pub-id-type="doi">10.1145/2939672.2939754</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>G&#x000FC;nthard</surname> <given-names>H. H.</given-names></name> <name><surname>Primas</surname> <given-names>H.</given-names></name></person-group> (<year>1956</year>). <article-title>Zusammenhang von Graphentheorie und MO-Theorie von Molekeln mit Systemen konjugierter Bindungen</article-title>. <source>Helv. Chim. Acta</source> <volume>39</volume>, <fpage>1645</fpage>&#x02013;<lpage>1653</lpage>. <pub-id pub-id-type="doi">10.1002/hlca.19560390623</pub-id></citation>
</ref>
<ref id="B49">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gurbuz</surname> <given-names>M. B.</given-names></name> <name><surname>Rekik</surname> <given-names>I.</given-names></name></person-group> (<year>2020</year>). <article-title>&#x0201C;Deep graph normalizer: A geometric deep learning approach for estimating connectional brain templates,&#x0201D;</article-title> in <source>Medical Image Computing and Computer Assisted Intervention &#x02013;MICCAI 2020</source>. <publisher-loc>Cham</publisher-loc>: <publisher-name>Springer International Publishing</publisher-name>, <fpage>155</fpage>&#x02013;<lpage>165</lpage>.</citation>
</ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hasibi</surname> <given-names>R.</given-names></name> <name><surname>Michoel</surname> <given-names>T.</given-names></name></person-group> (<year>2021</year>). <article-title>A graph feature auto-encoder for the prediction of unobserved node features on biological networks</article-title>. <source>BMC Bioinformat</source>. <volume>22</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.1186/s12859-021-04447-3</pub-id><pub-id pub-id-type="pmid">34706640</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hensel</surname> <given-names>F.</given-names></name> <name><surname>Moor</surname> <given-names>M.</given-names></name> <name><surname>Rieck</surname> <given-names>B.</given-names></name></person-group> (<year>2021</year>). <article-title>A survey of topological machine learning methods</article-title>. <source>Front. Artif. Intellig</source>. <volume>4</volume>, <fpage>155</fpage>&#x02013;<lpage>165</lpage>. <pub-id pub-id-type="doi">10.3389/frai.2021.155-165</pub-id><pub-id pub-id-type="pmid">34124648</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hetzel</surname> <given-names>L.</given-names></name> <name><surname>Fischer</surname> <given-names>D. S.</given-names></name> <name><surname>G&#x000FC;nnemann</surname> <given-names>S.</given-names></name> <name><surname>Theis</surname> <given-names>F. J.</given-names></name></person-group> (<year>2021</year>). <article-title>Graph representation learning for single-cell biology</article-title>. <source>Curr. Opini. Syst. Biol</source>. <volume>28</volume>, <fpage>100347</fpage>. <pub-id pub-id-type="doi">10.1016/j.coisb.2021.05.008</pub-id></citation>
</ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holme</surname> <given-names>P.</given-names></name> <name><surname>Saram&#x000E4;ki</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Temporal networks</article-title>. <source>Phys. Rep</source>. <volume>519</volume>, <fpage>97</fpage>&#x02013;<lpage>125</lpage>. <pub-id pub-id-type="doi">10.1016/j.physrep.2012.03.001</pub-id></citation>
</ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hong</surname> <given-names>H.</given-names></name> <name><surname>Guo</surname> <given-names>H.</given-names></name> <name><surname>Lin</surname> <given-names>Y.</given-names></name> <name><surname>Yang</surname> <given-names>X.</given-names></name> <name><surname>Li</surname> <given-names>Z.</given-names></name> <name><surname>Ye</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>An attention-based graph neural network for heterogeneous structural learning</article-title>. <source>Proc. Innov. Appl. Artif. Intell. Conf</source>. <volume>34</volume>, <fpage>4132</fpage>&#x02013;<lpage>4139</lpage>. <pub-id pub-id-type="doi">10.1609/aaai.v34i04.5833</pub-id></citation>
</ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hong</surname> <given-names>Y.</given-names></name> <name><surname>Bu</surname> <given-names>C.</given-names></name> <name><surname>Wu</surname> <given-names>X.</given-names></name></person-group> (<year>2021</year>). High-quality noise detection for knowledge graph embedding with rule-based triple confidence,&#x0201D; in PRICAI <italic>2021: Trends in Artificial Intelligence</italic>. Cham: Springer International <volume>Publishing</volume>, <fpage>572</fpage>&#x02013;<lpage>585</lpage>.</citation>
</ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hop</surname> <given-names>P.</given-names></name> <name><surname>Allgood</surname> <given-names>B.</given-names></name> <name><surname>Yu</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>Geometric deep learning autonomously learns chemical features that outperform those engineered by domain experts</article-title>. <source>Mol. Pharm</source>. <volume>15</volume>, <fpage>4371</fpage>&#x02013;<lpage>4377</lpage>. <pub-id pub-id-type="doi">10.1021/acs.molpharmaceut.7b01144</pub-id><pub-id pub-id-type="pmid">29863875</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hostallero</surname> <given-names>D. E.</given-names></name> <name><surname>Li</surname> <given-names>Y.</given-names></name> <name><surname>Emad</surname> <given-names>A.</given-names></name></person-group> (<year>2022</year>). <article-title>Looking at the BiG picture: incorporating bipartite graphs in drug response prediction</article-title>. <source>Bioinformatics</source> <volume>38</volume>, <fpage>3609</fpage>&#x02013;<lpage>3620</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btac383</pub-id><pub-id pub-id-type="pmid">35674359</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>X.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Hu</surname> <given-names>X.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x0201C;Label informed attributed network embedding,&#x0201D;</article-title> in <source>Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM &#x00027;17</source>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>, <fpage>731</fpage>&#x02013;<lpage>739</lpage>.</citation>
</ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>Z.</given-names></name> <name><surname>Cai</surname> <given-names>H.</given-names></name> <name><surname>Dan</surname> <given-names>T.</given-names></name> <name><surname>Lin</surname> <given-names>Y.</given-names></name> <name><surname>Laurienti</surname> <given-names>P.</given-names></name> <name><surname>Wu</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). Detecting brain state changes by geometric deep learning of functional dynamics on riemannian manifold. In Medical Image Computing and Computer Assisted Intervention &#x02013;MICCAI 2021, pages 543-552. Springer International Publishing. <pub-id pub-id-type="doi">10.1007/978-3-030-87234-2_51</pub-id></citation>
</ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Isert</surname> <given-names>C.</given-names></name> <name><surname>Atz</surname> <given-names>K.</given-names></name> <name><surname>Schneider</surname> <given-names>G.</given-names></name></person-group> (<year>2023</year>). <article-title>Structure-based drug design with geometric deep learning</article-title>. <source>Curr. Opin. Struct. Biol</source>. <volume>79</volume>, <fpage>102548</fpage>. <pub-id pub-id-type="doi">10.1016/j.sbi.2023.102548</pub-id><pub-id pub-id-type="pmid">36842415</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jiao</surname> <given-names>P.</given-names></name> <name><surname>Guo</surname> <given-names>X.</given-names></name> <name><surname>Jing</surname> <given-names>X.</given-names></name> <name><surname>He</surname> <given-names>D.</given-names></name> <name><surname>Wu</surname> <given-names>H.</given-names></name> <name><surname>Pan</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Temporal network embedding for link prediction via VAE joint attention mechanism</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst</source>. <volume>33</volume>, <fpage>7400</fpage>&#x02013;<lpage>7413</lpage>. <pub-id pub-id-type="doi">10.1109/TNNLS.2021.3084957</pub-id><pub-id pub-id-type="pmid">34106869</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kac</surname> <given-names>M.</given-names></name></person-group> (<year>1966</year>). <article-title>Can one hear the shape of a drum?</article-title> <source>Am. Mathematical Monthly</source> <volume>73</volume>, <fpage>1</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1080/00029890.1966.11970915</pub-id><pub-id pub-id-type="pmid">17749416</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kami&#x00144;ski</surname> <given-names>B.</given-names></name> <name><surname>Pra</surname> <given-names>P.</given-names></name> <name><surname>Th&#x000E9;berge</surname> <given-names>F.</given-names></name></person-group> (<year>2019</year>). <article-title>An unsupervised framework for comparing graph embeddings</article-title>. <source>J. Complex Netw</source>. <volume>8</volume>, <fpage>5</fpage>. <pub-id pub-id-type="doi">10.1093/comnet/cnz043</pub-id></citation>
</ref>
<ref id="B64">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Karpukhin</surname> <given-names>I.</given-names></name> <name><surname>Dereka</surname> <given-names>S.</given-names></name> <name><surname>Kolesnikov</surname> <given-names>S.</given-names></name></person-group> (<year>2022</year>). <source>GitHub - tinkoff-ai/probabilistic-embeddings: &#x0201C;Probabilistic Embeddings Revisited&#x0201D; Paper Official Repository &#x02014;</source> <ext-link ext-link-type="uri" xlink:href="http://github.com">github.com</ext-link>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://github.com/tinkoff-ai/probabilistic-embeddings">https://github.com/tinkoff-ai/probabilistic-embeddings</ext-link> (accessed October 20, 2023).</citation>
</ref>
<ref id="B65">
<citation citation-type="thesis"><person-group person-group-type="author"><name><surname>Kehr</surname> <given-names>B.</given-names></name> <name><surname>Trappe</surname> <given-names>K.</given-names></name> <name><surname>Holtgrewe</surname> <given-names>M.</given-names></name> <name><surname>Reinert</surname> <given-names>K.</given-names></name></person-group> (<year>2014</year>). <article-title>Genome alignment with graph data structures: a comparison</article-title>. <source>BMC Bioinformat</source>. <volume>15</volume>, <fpage>99</fpage>. <pub-id pub-id-type="doi">10.1186/1471-2105-15-99</pub-id><pub-id pub-id-type="pmid">24712884</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Khosla</surname> <given-names>M.</given-names></name> <name><surname>Leonhardt</surname> <given-names>J.</given-names></name> <name><surname>Nejdl</surname> <given-names>W.</given-names></name> <name><surname>Anand</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>&#x0201C;Node representation learning for directed graphs,&#x0201D;</article-title> in <source>Machine Learning and Knowledge Discovery in Databases - European Conference, ECML PKDD 2019, Proceedings, Vol. 11906</source> (<publisher-loc>Lecture Notes in Computer Science</publisher-loc>), eds U. Brefeld, E. Fromont, A. Hotho, A. Knobbe, M. Maathuis, and C. Robardet (Springer International Publishing), <fpage>395</fpage>&#x02013;<lpage>411</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-46150-8_24</pub-id></citation>
</ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kilgour</surname> <given-names>M.</given-names></name> <name><surname>Rogal</surname> <given-names>J.</given-names></name> <name><surname>Tuckerman</surname> <given-names>M.</given-names></name></person-group> (<year>2023</year>). <article-title>Geometric deep learning for molecular crystal structure prediction</article-title>. <source>J. Chem. Theory Comput</source>. <volume>19</volume>, <fpage>4743</fpage>&#x02013;<lpage>4756</lpage>. <pub-id pub-id-type="doi">10.1021/acs.jctc.3c00031</pub-id><pub-id pub-id-type="pmid">37053511</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>M.</given-names></name> <name><surname>Baek</surname> <given-names>S. H.</given-names></name> <name><surname>Song</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Relation extraction for biological pathway construction using node2vec</article-title>. <source>BMC Bioinformat</source>. <volume>19</volume>, <fpage>8</fpage>. <pub-id pub-id-type="doi">10.1186/s12859-018-2200-8</pub-id><pub-id pub-id-type="pmid">29897325</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kleinberg</surname> <given-names>J. M.</given-names></name></person-group> (<year>1999</year>). <article-title>Authoritative sources in a hyperlinked environment</article-title>. <source>J. ACM</source>. <volume>46</volume>, <fpage>604</fpage>&#x02013;<lpage>632</lpage>. <pub-id pub-id-type="doi">10.1145/324133.324140</pub-id></citation>
</ref>
<ref id="B70">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kol&#x000E1;&#x00159;</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>&#x0201C;Graph alignment, protein interaction networks,&#x0201D;</article-title> in <source>Encyclopedia of Systems Biology</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Springer New York</publisher-name>, <fpage>861</fpage>&#x02013;<lpage>865</lpage>.</citation>
</ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koutra</surname> <given-names>D.</given-names></name> <name><surname>Shah</surname> <given-names>N.</given-names></name> <name><surname>Vogelstein</surname> <given-names>J. T.</given-names></name> <name><surname>Gallagher</surname> <given-names>B.</given-names></name> <name><surname>Faloutsos</surname> <given-names>C.</given-names></name></person-group> (<year>2016</year>). <article-title>Deltacon: Principled massive-graph similarity function with attribution</article-title>. <source>ACM Trans. Knowl. Discov. Data</source> <volume>10</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.1145/2824443</pub-id></citation>
</ref>
<ref id="B72">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kriege</surname> <given-names>N. M.</given-names></name> <name><surname>Johansson</surname> <given-names>F. D.</given-names></name> <name><surname>Morris</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>A survey on graph kernels</article-title>. <source>Appl. Netw. Sci</source>. <volume>5</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.1007/s41109-019-0195-3</pub-id></citation>
</ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krioukov</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>Clustering implies geometry in networks</article-title>. <source>Phys. Rev. Lett</source>. <volume>116</volume>, <fpage>2</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.116.208302</pub-id><pub-id pub-id-type="pmid">27258887</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krioukov</surname> <given-names>D.</given-names></name> <name><surname>Papadopoulos</surname> <given-names>F.</given-names></name> <name><surname>Kitsak</surname> <given-names>M.</given-names></name> <name><surname>Vahdat</surname> <given-names>A.</given-names></name> <name><surname>Bogu n&#x000E1;</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Hyperbolic geometry of complex networks</article-title>. <source>Physical Review E</source> <volume>82</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.82.036106</pub-id><pub-id pub-id-type="pmid">21230138</pub-id></citation></ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Law</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;Ultrahyperbolic neural networks,&#x0201D;</article-title> in <source>Advances in Neural Information Processing Systems</source>, eds. M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and Y. W. Vaughan. New York: Curran Associates, <volume>Inc</volume>, <fpage>22058</fpage>&#x02013;<lpage>22069</lpage>.</citation>
</ref>
<ref id="B76">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Law</surname> <given-names>M. T.</given-names></name> <name><surname>Lucas</surname> <given-names>J.</given-names></name></person-group> (<year>2023</year>). <article-title>&#x0201C;Spacetime representation learning,&#x0201D;</article-title> in <source>Proceedings of The Eleventh Inter International Conference on Learning Representations, ICLR</source> (Kigali). Available online at: <ext-link ext-link-type="uri" xlink:href="http://OpenReview.net">OpenReview.net</ext-link></citation>
</ref>
<ref id="B77">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Law</surname> <given-names>M. T.</given-names></name> <name><surname>Stam</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>&#x0201C;Ultrahyperbolic representation learning,&#x0201D;</article-title> in <source>Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS&#x00027;20</source>. <publisher-loc>Red Hook, NY, USA</publisher-loc>: <publisher-name>Curran Associates Inc</publisher-name>.</citation>
</ref>
<ref id="B78">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lecca</surname> <given-names>P.</given-names></name> <name><surname>Re</surname> <given-names>A.</given-names></name></person-group> (<year>2022</year>). <article-title>&#x0201C;Checking for non-euclidean latent geometry of biological networks,&#x0201D;</article-title> in <source>2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)</source>. <publisher-loc>Las Vegas, NV</publisher-loc>: <publisher-name>IEEE</publisher-name>.</citation>
</ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lempel</surname> <given-names>R.</given-names></name> <name><surname>Moran</surname> <given-names>S.</given-names></name></person-group> (<year>2001</year>). <article-title>SALSA</article-title>. <source>ACM Trans. Informat. Syst</source>. <volume>19</volume>, <fpage>131</fpage>&#x02013;<lpage>160</lpage>. <pub-id pub-id-type="doi">10.1145/382979.383041</pub-id></citation>
</ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>H.</given-names></name> <name><surname>Li</surname> <given-names>L.</given-names></name> <name><surname>Xv</surname> <given-names>G.</given-names></name> <name><surname>Lin</surname> <given-names>C.</given-names></name> <name><surname>Li</surname> <given-names>K.</given-names></name> <name><surname>Jiang</surname> <given-names>B.</given-names></name></person-group> (<year>2021a</year>). <article-title>SPEX: A generic framework for enhancing neural social recommendation</article-title>. <source>ACM Trans. Informat. Syst</source>. <volume>40</volume>, <fpage>1</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1145/3473338</pub-id></citation>
</ref>
<ref id="B81">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Zhu</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>B.</given-names></name></person-group> (<year>2016a</year>). <article-title>&#x0201C;Discriminative deep random walk for network classification,&#x0201D;</article-title> in <source>Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)</source>. <publisher-loc>Berlin, Germany</publisher-loc>: <publisher-name>Association for Computational Linguistics</publisher-name>, <fpage>1004</fpage>&#x02013;<lpage>1013</lpage>.</citation>
</ref>
<ref id="B82">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Zhu</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>B.</given-names></name></person-group> (<year>2016b</year>). <article-title>&#x0201C;Discriminative deep random walk for network classification,&#x0201D;</article-title> in <source>Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)</source>. <publisher-loc>Berlin, Germany</publisher-loc>: <publisher-name>Association for Computational Linguistics</publisher-name>, <fpage>1004</fpage>&#x02013;<lpage>1013</lpage>.</citation>
</ref>
<ref id="B83">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>X.</given-names></name> <name><surname>Liu</surname> <given-names>Y.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name></person-group> (<year>2021b</year>). <article-title>&#x0201C;Object detection in omnidirectional images based on spherical cnn,&#x0201D;</article-title> in <source>2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)</source>. Beijing: <volume>IEEE</volume>, <fpage>269</fpage>&#x02013;<lpage>273</lpage>.</citation>
</ref>
<ref id="B84">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liao</surname> <given-names>L.</given-names></name> <name><surname>He</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>H.</given-names></name> <name><surname>Chua</surname> <given-names>T.-S.</given-names></name></person-group> (<year>2018</year>). <article-title>Attributed social network embedding</article-title>. <source>IEEE Trans. Knowl. Data Eng</source>. <volume>30</volume>, <fpage>2257</fpage>&#x02013;<lpage>2270</lpage>. <pub-id pub-id-type="doi">10.1109/TKDE.2018.2819980</pub-id></citation>
</ref>
<ref id="B85">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Liao</surname> <given-names>S.</given-names></name> <name><surname>Liang</surname> <given-names>S.</given-names></name> <name><surname>Meng</surname> <given-names>Z.</given-names></name> <name><surname>Zhang</surname> <given-names>Q.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;Learning dynamic embeddings for temporal knowledge graphs,&#x0201D;</article-title> in <source>Proceedings of the 14th ACM International Conference on Web Search and Data Mining</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>.</citation>
</ref>
<ref id="B86">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>C.-L.</given-names></name></person-group> (<year>1994</year>). <article-title>&#x0201C;Hardness of approximating graph transformation problem,&#x0201D;</article-title> in <source>Algorithms and Computation</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer Berlin Heidelberg</publisher-name>, <fpage>74</fpage>&#x02013;<lpage>82</lpage>.</citation>
</ref>
<ref id="B87">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>D.</given-names></name> <name><surname>Ru</surname> <given-names>Y.</given-names></name> <name><surname>Li</surname> <given-names>Q.</given-names></name> <name><surname>Wang</surname> <given-names>S.</given-names></name> <name><surname>Niu</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>Semisupervised community preserving network embedding with pairwise constraints</article-title>. <source>Complexity</source> <volume>2020</volume>, <fpage>1</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1155/2020/7953758</pub-id></citation>
</ref>
<ref id="B88">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>M.</given-names></name> <name><surname>Quan</surname> <given-names>Z.-W.</given-names></name> <name><surname>Wu</surname> <given-names>J.-M.</given-names></name> <name><surname>Liu</surname> <given-names>Y.</given-names></name> <name><surname>Han</surname> <given-names>M.</given-names></name></person-group> (<year>2022</year>). <article-title>Embedding temporal networks inductively via mining neighborhood and community influences</article-title>. <source>Appl. Intellig</source>. <volume>52</volume>, <fpage>16069</fpage>&#x02013;<lpage>16088</lpage>. <pub-id pub-id-type="doi">10.1007/s10489-021-03102-x</pub-id></citation>
</ref>
<ref id="B89">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>Q.</given-names></name> <name><surname>Dong</surname> <given-names>Z.</given-names></name> <name><surname>Wang</surname> <given-names>E.</given-names></name></person-group> (<year>2018</year>). <article-title>Cut based method for comparing complex networks</article-title>. <source>Sci. Rep</source>. <volume>8</volume>, <fpage>5</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-018-21532-5</pub-id><pub-id pub-id-type="pmid">29572479</pub-id></citation></ref>
<ref id="B90">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ma</surname> <given-names>Y.</given-names></name> <name><surname>Zhang</surname> <given-names>H.</given-names></name> <name><surname>Jin</surname> <given-names>C.</given-names></name> <name><surname>Kang</surname> <given-names>C.</given-names></name></person-group> (<year>2023</year>). <article-title>Predicting lncRNA-protein interactions with bipartite graph embedding and deep graph neural networks</article-title>. <source>Front. Genet</source>. 14. <pub-id pub-id-type="doi">10.3389/fgene.2023.1136672</pub-id><pub-id pub-id-type="pmid">36845380</pub-id></citation></ref>
<ref id="B91">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Magai</surname> <given-names>G.</given-names></name> <name><surname>Ayzenberg</surname> <given-names>A.</given-names></name></person-group> (<year>2022</year>). <article-title>Topology and geometry of data manifold in deep learning</article-title>. <source>arXiv preprint arXiv:2204.08624</source>.</citation>
</ref>
<ref id="B92">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Makarov</surname> <given-names>I.</given-names></name> <name><surname>Savchenko</surname> <given-names>A.</given-names></name> <name><surname>Korovko</surname> <given-names>A.</given-names></name> <name><surname>Sherstyuk</surname> <given-names>L.</given-names></name> <name><surname>Severin</surname> <given-names>N.</given-names></name> <name><surname>Kiselev</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Temporal network embedding framework with causal anonymous walks representations</article-title>. <source>PeerJ. Comp. Sci</source>. 8, e858. <pub-id pub-id-type="doi">10.7717/peerj-cs.858</pub-id><pub-id pub-id-type="pmid">35174275</pub-id></citation></ref>
<ref id="B93">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manoochehri</surname> <given-names>H. E.</given-names></name> <name><surname>Nourani</surname> <given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>Drug-target interaction prediction using semi-bipartite graph model and deep learning</article-title>. <source>BMC Bioinformat</source>. <volume>21</volume>, <fpage>6</fpage>. <pub-id pub-id-type="doi">10.1186/s12859-020-3518-6</pub-id><pub-id pub-id-type="pmid">32631230</pub-id></citation></ref>
<ref id="B94">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Meil&#x00103;</surname> <given-names>M.</given-names></name> <name><surname>Pentney</surname> <given-names>W.</given-names></name></person-group> (<year>2007</year>). <article-title>&#x0201C;Clustering by weighted cuts in directed graphs,&#x0201D;</article-title> in <source>Proceedings of the 2007 SIAM International Conference on Data Mining</source>. <publisher-loc>Philadelphia, PA</publisher-loc>: <publisher-name>Society for Industrial and Applied Mathematics</publisher-name>.</citation>
</ref>
<ref id="B95">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mena</surname> <given-names>J.</given-names></name> <name><surname>Pujol</surname> <given-names>O.</given-names></name> <name><surname>Vitri?</surname> <given-names>J.</given-names></name></person-group> (<year>2020</year>). <article-title>Uncertainty-based rejection wrappers for black-box classifiers</article-title>. <source>IEEE Access</source> <volume>8</volume>, <fpage>101721</fpage>&#x02013;<lpage>101746</lpage>. <pub-id pub-id-type="doi">10.1109/ACCESS.2020.2996495</pub-id></citation>
</ref>
<ref id="B96">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Misra</surname> <given-names>A.</given-names></name></person-group> (<year>2019</year>). <source>Capsule Networks: The New Deep Learning Network</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://towardsdatascience.com/capsule-networks-the-new-deep-learning-network-bd917e6818e8">https://towardsdatascience.com/capsule-networks-the-new-deep-learning-network-bd917e6818e8</ext-link> (accessed July 8, 2023).</citation>
</ref>
<ref id="B97">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mohan</surname> <given-names>A.</given-names></name> <name><surname>Pramod</surname> <given-names>K. V.</given-names></name></person-group> (<year>2019</year>). <article-title>Network representation learning: models, methods and applications</article-title>. <source>SN Appl. Sci</source>. <volume>1</volume>, <fpage>9</fpage>. <pub-id pub-id-type="doi">10.1007/s42452-019-1044-9</pub-id></citation>
</ref>
<ref id="B98">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mohan</surname> <given-names>A.</given-names></name> <name><surname>Pramod</surname> <given-names>K. V.</given-names></name></person-group> (<year>2021</year>). <article-title>Temporal network embedding using graph attention network</article-title>. <source>Complex Intellig. Syst</source>. <volume>8</volume>, <fpage>13</fpage>&#x02013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1007/s40747-021-00332-x</pub-id></citation>
</ref>
<ref id="B99">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nelson</surname> <given-names>W.</given-names></name> <name><surname>Zitnik</surname> <given-names>M.</given-names></name> <name><surname>Wang</surname> <given-names>B.</given-names></name> <name><surname>Leskovec</surname> <given-names>J.</given-names></name> <name><surname>Goldenberg</surname> <given-names>A.</given-names></name> <name><surname>Sharan</surname> <given-names>R.</given-names></name></person-group> (<year>2019</year>). <article-title>To embed or not: network embedding as a paradigm in computational biology</article-title>. <source>Front. Genet</source>. <volume>10</volume>, <fpage>381</fpage>. <pub-id pub-id-type="doi">10.3389/fgene.2019.00381</pub-id><pub-id pub-id-type="pmid">31118945</pub-id></citation></ref>
<ref id="B100">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nguyen</surname> <given-names>G. H.</given-names></name> <name><surname>Lee</surname> <given-names>J. B.</given-names></name> <name><surname>Rossi</surname> <given-names>R. A.</given-names></name> <name><surname>Ahmed</surname> <given-names>N. K.</given-names></name> <name><surname>Koh</surname> <given-names>E.</given-names></name> <name><surname>Kim</surname> <given-names>S.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Continuous-time dynamic network embeddings,&#x0201D;</article-title> in <source>Companion of the The Web Conference 2018 on The Web Conference 2018</source> - <italic>WWW &#x00027;18</italic>. New York City: ACM Press.</citation>
</ref>
<ref id="B101">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Okuno</surname> <given-names>A.</given-names></name> <name><surname>Shimodaira</surname> <given-names>H.</given-names></name></person-group> (<year>2019</year>). <article-title>&#x0201C;Robust graph embedding with noisy link weights,&#x0201D;</article-title> in <source>Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics, Vol. 89</source>, eds. K. Chaudhuri, and M. Sugiyama (PMLR), <fpage>664</fpage>&#x02013;<lpage>673</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v89/okuno19b.html">https://proceedings.mlr.press/v89/okuno19b.html</ext-link></citation>
</ref>
<ref id="B102">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x000D6;mer Nebil Yavero&#x0011F;lu Milenkovi&#x00107;</surname> <given-names>T.</given-names></name> <name><surname>Pr&#x0017E;ulj</surname> <given-names>N.</given-names></name></person-group> (<year>2015</year>). <article-title>Proper evaluation of alignment-free network comparison methods</article-title>. <source>Bioinformatics</source> <volume>31</volume>, <fpage>2697</fpage>&#x02013;<lpage>2704</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btv170</pub-id><pub-id pub-id-type="pmid">25810431</pub-id></citation></ref>
<ref id="B103">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ou</surname> <given-names>M.</given-names></name> <name><surname>Cui</surname> <given-names>P.</given-names></name> <name><surname>Pei</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>Z.</given-names></name> <name><surname>Zhu</surname> <given-names>W.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Asymmetric transitivity preserving graph embedding,&#x0201D;</article-title> in <source>Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD &#x00027;16</source>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>, <fpage>1105</fpage>&#x02013;<lpage>1114</lpage>.</citation>
</ref>
<ref id="B104">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x000D6;zt&#x000FC;rk</surname> <given-names>H.</given-names></name> <name><surname>&#x000D6;zg&#x000FC;r</surname> <given-names>A.</given-names></name> <name><surname>Schwaller</surname> <given-names>P.</given-names></name> <name><surname>Laino</surname> <given-names>T.</given-names></name> <name><surname>Ozkirimli</surname> <given-names>E.</given-names></name></person-group> (<year>2020</year>). <article-title>Exploring chemical space using natural language processing methodologies for drug discovery</article-title>. <source>Drug Discov. Today</source> <volume>25</volume>:<fpage>689</fpage>&#x02013;<lpage>705</lpage>. <pub-id pub-id-type="doi">10.1016/j.drudis.2020.01.020</pub-id><pub-id pub-id-type="pmid">32027969</pub-id></citation></ref>
<ref id="B105">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pan</surname> <given-names>S.</given-names></name> <name><surname>Hu</surname> <given-names>R.</given-names></name> <name><surname>Fung</surname> <given-names>S.-F.</given-names></name> <name><surname>Long</surname> <given-names>G.</given-names></name> <name><surname>Jiang</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>Learning graph embedding with adversarial training methods</article-title>. <source>IEEE Trans. Cybern</source>. <volume>50</volume>, <fpage>2475</fpage>&#x02013;<lpage>2487</lpage>. <pub-id pub-id-type="doi">10.1109/TCYB.2019.2932096</pub-id><pub-id pub-id-type="pmid">31484146</pub-id></citation></ref>
<ref id="B106">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pan</surname> <given-names>S.</given-names></name> <name><surname>Wu</surname> <given-names>J.</given-names></name> <name><surname>Zhu</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>C.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Tri-party deep network representation,&#x0201D;</article-title> in <source>Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI&#x00027;16</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>AAAI Press</publisher-name>, <fpage>1895</fpage>&#x02013;<lpage>1901</lpage>.</citation>
</ref>
<ref id="B107">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pandhre</surname> <given-names>S.</given-names></name> <name><surname>Mittal</surname> <given-names>H.</given-names></name> <name><surname>Gupta</surname> <given-names>M.</given-names></name> <name><surname>Balasubramanian</surname> <given-names>V. N.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;STwalk,&#x0201D;</article-title> in <source>Proceedings of the ACM India Joint International Conference on Data Science and Management of Data</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>.</citation>
</ref>
<ref id="B108">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Papadopoulos</surname> <given-names>F.</given-names></name> <name><surname>Flores</surname> <given-names>M. A. R.</given-names></name></person-group> (<year>2019</year>). <article-title>Latent geometry and dynamics of proximity networks</article-title>. <source>Physical Rev. E</source> <volume>100</volume>, <fpage>5</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.100.052313</pub-id><pub-id pub-id-type="pmid">31870016</pub-id></citation></ref>
<ref id="B109">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pavlopoulos</surname> <given-names>G. A.</given-names></name> <name><surname>Kontou</surname> <given-names>P. I.</given-names></name> <name><surname>Pavlopoulou</surname> <given-names>A.</given-names></name> <name><surname>Bouyioukos</surname> <given-names>C.</given-names></name> <name><surname>Markou</surname> <given-names>E.</given-names></name> <name><surname>Bagos</surname> <given-names>P. G.</given-names></name></person-group> (<year>2018</year>). <article-title>Bipartite graphs in systems biology and medicine: a survey of methods and applications</article-title>. <source>Gigascience</source> <volume>7</volume>, <fpage>4</fpage>. <pub-id pub-id-type="doi">10.1093/gigascience/giy014</pub-id></citation>
</ref>
<ref id="B110">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Perozzi</surname> <given-names>B.</given-names></name> <name><surname>Al-Rfou</surname> <given-names>R.</given-names></name> <name><surname>Skiena</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>&#x0201C;DeepWalk,&#x0201D;</article-title> in <source>Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>.</citation>
</ref>
<ref id="B111">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Perozzi</surname> <given-names>B.</given-names></name> <name><surname>Kulkarni</surname> <given-names>V.</given-names></name> <name><surname>Skiena</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Walklets: Multiscale graph embeddings for interpretable network classification</article-title>. <source>ArXiv</source>. abs/1605.02115.</citation>
</ref>
<ref id="B112">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Perrault-joncas</surname> <given-names>D.</given-names></name> <name><surname>Meila</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>&#x0201C;Directed graph embedding: an algorithm based on continuous limits of laplacian-type operators,&#x0201D;</article-title> in <source>Advances in Neural Information Processing Systems</source>, J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger. New York: Curran Associates, Inc.</citation>
</ref>
<ref id="B113">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pineda</surname> <given-names>J.</given-names></name> <name><surname>Midtvedt</surname> <given-names>B.</given-names></name> <name><surname>Bachimanchi</surname> <given-names>H.</given-names></name> <name><surname>No&#x000E9;</surname> <given-names>S.</given-names></name> <name><surname>Midtvedt</surname> <given-names>D.</given-names></name> <name><surname>Volpe</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2023</year>). <article-title>Geometric deep learning reveals the spatiotemporal features of microscopic motion</article-title>. <source>Nat. Mach. Intellig</source>. <volume>5</volume>, <fpage>71</fpage>&#x02013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1038/s42256-022-00595-0</pub-id></citation>
</ref>
<ref id="B114">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pujara</surname> <given-names>J.</given-names></name> <name><surname>Augustine</surname> <given-names>E.</given-names></name> <name><surname>Getoor</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x0201C;Sparsity and noise: Where knowledge graph embeddings fall short,&#x0201D;</article-title> in <source>Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Association for Computational Linguistics</publisher-name>.</citation>
</ref>
<ref id="B115">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Qiu</surname> <given-names>J.</given-names></name> <name><surname>Dong</surname> <given-names>Y.</given-names></name> <name><surname>Ma</surname> <given-names>H.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Wang</surname> <given-names>K.</given-names></name> <name><surname>Tang</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Network embedding as matrix factorization: Unifying deepwalk, line, pte, and node2vec,&#x0201D;</article-title> in <source>Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, WSDM &#x00027;18</source>. <publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>, <fpage>459</fpage>&#x02013;<lpage>467</lpage>.</citation>
</ref>
<ref id="B116">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saint-Antoine</surname> <given-names>M. M.</given-names></name> <name><surname>Singh</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Network inference in systems biology: recent developments, challenges, and applications</article-title>. <source>Curr. Opin. Biotechnol</source>. <volume>63</volume>, <fpage>89</fpage>&#x02013;<lpage>98</lpage>. <pub-id pub-id-type="doi">10.1016/j.copbio.2019.12.002</pub-id><pub-id pub-id-type="pmid">31927423</pub-id></citation></ref>
<ref id="B117">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salim</surname> <given-names>A.</given-names></name> <name><surname>Sumitra</surname> <given-names>S.</given-names></name></person-group> (<year>2022</year>). <article-title>Spectral graph convolutional neural networks in the context of regularization theory</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst</source>. <volume>2022</volume>, <fpage>1</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1109/TNNLS.2022.3177742</pub-id><pub-id pub-id-type="pmid">35696484</pub-id></citation></ref>
<ref id="B118">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sato</surname> <given-names>K.</given-names></name> <name><surname>Oka</surname> <given-names>M.</given-names></name> <name><surname>Barrat</surname> <given-names>A.</given-names></name> <name><surname>Cattuto</surname> <given-names>C.</given-names></name></person-group> (<year>2021</year>). <article-title>Predicting partially observed processes on temporal networks by Dynamics-Aware Node Embeddings (DyANE)</article-title>. <source>EPJ Data Sci</source>. <volume>10</volume>, <fpage>22</fpage>. <pub-id pub-id-type="doi">10.1140/epjds/s13688-021-00277-8</pub-id></citation>
</ref>
<ref id="B119">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Saxena</surname> <given-names>T.</given-names></name> <name><surname>Xu</surname> <given-names>D.</given-names></name></person-group> (<year>2021</year>). <source>Graph Alignment-Based Protein Comparison</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://math.mit.edu/research/highschool/primes/materials/2020/Saxena-Xu.pdf">https://math.mit.edu/research/highschool/primes/materials/2020/Saxena-Xu.pdf</ext-link> (accessed October 17, 2023).</citation>
</ref>
<ref id="B120">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scott</surname> <given-names>O. B.</given-names></name> <name><surname>Gu</surname> <given-names>J.</given-names></name> <name><surname>Chan</surname> <given-names>A. E.</given-names></name></person-group> (<year>2022</year>). <article-title>Classification of protein-binding sites using a spherical convolutional neural network</article-title>. <source>J. Chem. Inf. Model</source>. <volume>62</volume>, <fpage>5383</fpage>&#x02013;<lpage>5396</lpage>. <pub-id pub-id-type="doi">10.1021/acs.jcim.2c00832</pub-id><pub-id pub-id-type="pmid">36341715</pub-id></citation></ref>
<ref id="B121">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Serratosa</surname> <given-names>F.</given-names></name></person-group> (<year>2021</year>). <article-title>Redefining the graph edit distance</article-title>. <source>SN Comp. Sci</source>. <volume>2</volume>, <fpage>6</fpage>. <pub-id pub-id-type="doi">10.1007/s42979-021-00792-5</pub-id></citation>
</ref>
<ref id="B122">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shen</surname> <given-names>X.</given-names></name> <name><surname>Chung</surname> <given-names>F.-L.</given-names></name></person-group> (<year>2020</year>). <article-title>Deep network embedding for graph representation learning in signed networks</article-title>. <source>IEEE Trans. Cybern</source>. <volume>50</volume>, <fpage>1556</fpage>&#x02013;<lpage>1568</lpage>. <pub-id pub-id-type="doi">10.1109/TCYB.2018.2871503</pub-id><pub-id pub-id-type="pmid">30307885</pub-id></citation></ref>
<ref id="B123">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shi</surname> <given-names>M.</given-names></name> <name><surname>Tang</surname> <given-names>Y.</given-names></name> <name><surname>Zhu</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Mlne: Multi-label network embedding</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst</source> <volume>31</volume>, <fpage>3682</fpage>&#x02013;<lpage>3695</lpage>. <pub-id pub-id-type="doi">10.1109/TNNLS.2019.2945869</pub-id><pub-id pub-id-type="pmid">31722493</pub-id></citation></ref>
<ref id="B124">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Sim</surname> <given-names>A.</given-names></name> <name><surname>Wiatrak</surname> <given-names>M.</given-names></name> <name><surname>Brayne</surname> <given-names>A.</given-names></name> <name><surname>Creed</surname> <given-names>P.</given-names></name> <name><surname>Paliwal</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;Directed graph embeddings in pseudo-riemannian manifolds,&#x0201D;</article-title> in <source>International Conference on Machine Learning</source>. <publisher-loc>Honolulu</publisher-loc>: <publisher-name>Hawaii Convention Center</publisher-name>.</citation>
</ref>
<ref id="B125">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Singer</surname> <given-names>U.</given-names></name> <name><surname>Guy</surname> <given-names>I.</given-names></name> <name><surname>Radinsky</surname> <given-names>K.</given-names></name></person-group> (<year>2019</year>). <article-title>&#x0201C;Node embedding over temporal graphs,&#x0201D;</article-title> in <source>Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence</source>. <publisher-loc>Cape Town</publisher-loc>: <publisher-name>International Joint Conferences on Artificial Intelligence Organization</publisher-name>.</citation>
</ref>
<ref id="B126">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Sivakumar</surname> <given-names>D.</given-names></name></person-group> (<year>2023</year>). <source>Introduction to Geometric Deep Learning - <italic>Scaler Topic</italic></source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.scaler.com/topics/geometric-deep-learning/">https://www.scaler.com/topics/geometric-deep-learning/</ext-link> (accessed July 6, 2023).</citation>
</ref>
<ref id="B127">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Soltanshahi</surname> <given-names>M. A.</given-names></name> <name><surname>Teimourpour</surname> <given-names>B.</given-names></name> <name><surname>Khatibi</surname> <given-names>T.</given-names></name> <name><surname>Zare</surname> <given-names>H.</given-names></name></person-group> (<year>2022</year>). <article-title>Grar: a novel framework for graph alignment based on relativity concept</article-title>. <source>Expert Syst. Appl</source>. <volume>187</volume>, <fpage>115908</fpage>. <pub-id pub-id-type="doi">10.1016/j.eswa.2021.115908</pub-id></citation>
</ref>
<ref id="B128">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Song</surname> <given-names>G.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Xu</surname> <given-names>L.</given-names></name> <name><surname>Lu</surname> <given-names>H.</given-names></name></person-group> (<year>2022</year>). <article-title>Domain adaptive network embedding</article-title>. <source>IEEE Trans. Big Data</source> <volume>8</volume>, <fpage>1220</fpage>&#x02013;<lpage>1232</lpage>. <pub-id pub-id-type="doi">10.1109/TBDATA.2020.3034201</pub-id></citation>
</ref>
<ref id="B129">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Su</surname> <given-names>Y.-C.</given-names></name> <name><surname>Grauman</surname> <given-names>K.</given-names></name></person-group> (<year>2021</year>). <article-title>Learning spherical convolution for 360 recognition</article-title>. <source>IEEE Trans. Pattern Analy. Mach. Intellig</source>. <volume>44</volume>, <fpage>8371</fpage>&#x02013;<lpage>8386</lpage>. <pub-id pub-id-type="doi">10.1109/TPAMI.2021.3113612</pub-id><pub-id pub-id-type="pmid">34543192</pub-id></citation></ref>
<ref id="B130">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>J.</given-names></name> <name><surname>Qu</surname> <given-names>M.</given-names></name> <name><surname>Mei</surname> <given-names>Q.</given-names></name></person-group> (<year>2015a</year>). <article-title>&#x0201C;PTE,&#x0201D;</article-title> in <source>Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>.</citation>
</ref>
<ref id="B131">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>J.</given-names></name> <name><surname>Qu</surname> <given-names>M.</given-names></name> <name><surname>Wang</surname> <given-names>M.</given-names></name> <name><surname>Zhang</surname> <given-names>M.</given-names></name> <name><surname>Yan</surname> <given-names>J.</given-names></name> <name><surname>Mei</surname> <given-names>Q.</given-names></name></person-group> (<year>2015b</year>). <article-title>&#x0201C;Line: Large-scale information network embedding,&#x0201D;</article-title> in <source>Proceedings of the 24th International Conference on World Wide Web</source>. <publisher-loc>Geneva</publisher-loc>: <publisher-name>International World Wide Web Conferences Steering Committee</publisher-name>.</citation>
</ref>
<ref id="B132">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>J.</given-names></name> <name><surname>Qu</surname> <given-names>M.</given-names></name> <name><surname>Wang</surname> <given-names>M.</given-names></name> <name><surname>Zhang</surname> <given-names>M.</given-names></name> <name><surname>Yan</surname> <given-names>J.</given-names></name> <name><surname>Mei</surname> <given-names>Q.</given-names></name></person-group> (<year>2015c</year>). Line: Large-scale information network embedding,&#x0201D; in <italic>Proceedings of the 24th International Conference on World Wide Web</italic>. Geneva: International World Wide Web Conferences Steering Committee.</citation>
</ref>
<ref id="B133">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tantardini</surname> <given-names>M.</given-names></name> <name><surname>Ieva</surname> <given-names>F.</given-names></name> <name><surname>Tajoli</surname> <given-names>L.</given-names></name> <name><surname>Piccardi</surname> <given-names>C.</given-names></name></person-group> (<year>2019</year>). <article-title>Comparing methods for comparing networks</article-title>. <source>Sci. Rep</source>. <volume>9</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-019-53708-y</pub-id></citation>
</ref>
<ref id="B134">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Tong</surname> <given-names>F.</given-names></name></person-group> (<year>2019</year>). What is Geometric Deep Learning? Available online at: <ext-link ext-link-type="uri" xlink:href="https://flawnsontong.medium.com/what-is-geometric-deep-learning-b2adb662d91d&#x00023;::text=In%20traditional%20Deep%20Learning%2C%20dimensionality,number%20of%20features%20it%20has">https://flawnsontong.medium.com/what-is-geometric-deep-learning-b2adb662d91d&#x00023;::text=In%20traditional%20Deep%20Learning%2C%20dimensionality,number%20of%20features%20it%20has</ext-link> (accessed June 29, 2023).</citation>
</ref>
<ref id="B135">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Torricelli</surname> <given-names>M.</given-names></name> <name><surname>Karsai</surname> <given-names>M.</given-names></name> <name><surname>Gauvin</surname> <given-names>L.</given-names></name></person-group> (<year>2020</year>). <article-title>weg2vec: Event embedding for temporal networks</article-title>. <source>Sci. Rep</source>. <volume>10</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-020-63221-2</pub-id><pub-id pub-id-type="pmid">32346033</pub-id></citation></ref>
<ref id="B136">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Townshend</surname> <given-names>R. J. L.</given-names></name> <name><surname>Eismann</surname> <given-names>S.</given-names></name> <name><surname>Watkins</surname> <given-names>A. M.</given-names></name> <name><surname>Rangan</surname> <given-names>R.</given-names></name> <name><surname>Karelina</surname> <given-names>M.</given-names></name> <name><surname>Das</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Geometric deep learning of RNA structure</article-title>. <source>Science</source> <volume>373</volume>, <fpage>1047</fpage>&#x02013;<lpage>1051</lpage>. <pub-id pub-id-type="doi">10.1126/science.abe5650</pub-id><pub-id pub-id-type="pmid">34446608</pub-id></citation></ref>
<ref id="B137">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tsitsulin</surname> <given-names>A.</given-names></name> <name><surname>Mottin</surname> <given-names>D.</given-names></name> <name><surname>Karras</surname> <given-names>P.</given-names></name> <name><surname>Bronstein</surname> <given-names>A.</given-names></name> <name><surname>M&#x000FC;ller</surname> <given-names>E.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;NetLSD,&#x0201D;</article-title> in <source>Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery</source> &#x00026; <italic>Data Mining</italic>. New York: ACM.</citation>
</ref>
<ref id="B138">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vaudaine</surname> <given-names>R.</given-names></name> <name><surname>Cazabet</surname> <given-names>R.</given-names></name> <name><surname>Largeron</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>&#x0201C;Comparing the preservation of network properties by graph embeddings,&#x0201D;</article-title> in <source>Lecture Notes in Computer Science</source>, M. R. Berthold, A. Feelders, and G. Krempl. Cham: Springer International <volume>Publishing</volume>, <fpage>522</fpage>&#x02013;<lpage>534</lpage>.</citation>
</ref>
<ref id="B139">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Veli&#x0010D;kovi&#x00107;</surname> <given-names>P.</given-names></name> <name><surname>Cucurull</surname> <given-names>G.</given-names></name> <name><surname>Casanova</surname> <given-names>A.</given-names></name> <name><surname>Romero</surname> <given-names>A.</given-names></name> <name><surname>Li&#x000F2;</surname> <given-names>P.</given-names></name> <name><surname>Bengio</surname> <given-names>Y.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Graph attention networks,&#x0201D;</article-title> in <source>International Conference on Learning Representations</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://OpenReview.net">OpenReview.net</ext-link></citation>
</ref>
<ref id="B140">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>von Luxburg</surname> <given-names>U.</given-names></name></person-group> (<year>2007</year>). <article-title>A tutorial on spectral clustering</article-title>. <source>Stat. Comput</source>. <volume>17</volume>, <fpage>395</fpage>&#x02013;<lpage>416</lpage>. <pub-id pub-id-type="doi">10.1007/s11222-007-9033-z</pub-id></citation>
</ref>
<ref id="B141">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>B.</given-names></name> <name><surname>Chen</surname> <given-names>Y.</given-names></name> <name><surname>Sheng</surname> <given-names>J.</given-names></name> <name><surname>He</surname> <given-names>Z.</given-names></name></person-group> (<year>2022</year>). <article-title>Attributed graph embedding based on attention with cluster</article-title>. <source>Mathematics</source> <volume>10</volume>, <fpage>4563</fpage>. <pub-id pub-id-type="doi">10.3390/math10234563</pub-id></citation>
</ref>
<ref id="B142">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Pan</surname> <given-names>S.</given-names></name> <name><surname>Long</surname> <given-names>G.</given-names></name> <name><surname>Zhu</surname> <given-names>X.</given-names></name> <name><surname>Jiang</surname> <given-names>J.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x0201C;MGAE,&#x0201D;</article-title> in <source>Proceedings of the 2017 ACM on Conference on Information and Knowledge Management</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>.</citation>
</ref>
<ref id="B143">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Wang</surname> <given-names>C.</given-names></name> <name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Ye</surname> <given-names>X.</given-names></name> <name><surname>Yu</surname> <given-names>P. S.</given-names></name></person-group> (<year>2020</year>). <article-title>Edge2vec</article-title>. <source>ACM Trans. Knowl. Discov. Data</source> <volume>14</volume>, <fpage>1</fpage>&#x02013;<lpage>24</lpage>. <pub-id pub-id-type="doi">10.1145/3391298</pub-id></citation>
</ref>
<ref id="B144">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>D.</given-names></name> <name><surname>Cui</surname> <given-names>P.</given-names></name> <name><surname>Zhu</surname> <given-names>W.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Structural deep network embedding,&#x0201D;</article-title> in <source>Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>.</citation>
</ref>
<ref id="B145">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weininger</surname> <given-names>D.</given-names></name></person-group> (<year>1988</year>). <article-title>SMILES, a chemical language and information system. 1. introduction to methodology and encoding rules</article-title>. <source>J. Chem. Inform. Comp. Sci</source>. <volume>28</volume>, <fpage>31</fpage>&#x02013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.1021/ci00057a005</pub-id></citation>
</ref>
<ref id="B146">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname> <given-names>L. Z. J.</given-names></name> <name><surname>Fawaz</surname> <given-names>A.</given-names></name> <name><surname>Glasser</surname> <given-names>M. F.</given-names></name> <name><surname>Edwards</surname> <given-names>A. D.</given-names></name> <name><surname>Robinson</surname> <given-names>E. C.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;Geometric deep learning of the human connectome project multimodal cortical parcellation,&#x0201D;</article-title> in <source>Machine Learning in Clinical Neuroimaging</source>, A. Abdulkadir, S. M. Kia, M. Habes, V. Kumar, J. M. Rondina, C. Tax, et al. Cham: Springer International <volume>Publishing</volume>, <fpage>103</fpage>&#x02013;<lpage>112</lpage>.</citation>
</ref>
<ref id="B147">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wills</surname> <given-names>P.</given-names></name> <name><surname>Meyer</surname> <given-names>F. G.</given-names></name></person-group> (<year>2020</year>). <article-title>Metrics for graph comparison: a practitioner&#x00027;s guide</article-title>. <source>PLoS ONE</source> <volume>15</volume>, <fpage>e0228728</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0228728</pub-id><pub-id pub-id-type="pmid">32050004</pub-id></citation></ref>
<ref id="B148">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>Y.</given-names></name> <name><surname>Besson</surname> <given-names>P.</given-names></name> <name><surname>Azcona</surname> <given-names>E. A.</given-names></name> <name><surname>Bandt</surname> <given-names>S. K.</given-names></name> <name><surname>Parrish</surname> <given-names>T. B.</given-names></name> <name><surname>Breiter</surname> <given-names>H. C.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>A multicohort geometric deep learning study of age dependent cortical and subcortical morphologic interactions for fluid intelligence prediction</article-title>. <source>Sci. Rep</source>. <volume>12</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-022-22313-x</pub-id><pub-id pub-id-type="pmid">36273036</pub-id></citation></ref>
<ref id="B149">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wu</surname> <given-names>Y.-H.</given-names></name> <name><surname>Huang</surname> <given-names>Y.-A.</given-names></name> <name><surname>Li</surname> <given-names>J.-Q.</given-names></name> <name><surname>You</surname> <given-names>Z.-H.</given-names></name> <name><surname>Hu</surname> <given-names>P.-W.</given-names></name> <name><surname>Hu</surname> <given-names>L.</given-names></name> <etal/></person-group>. (<year>2023</year>). <article-title>Knowledge graph embedding for profiling the interaction between transcription factors and their target genes</article-title>. <source>PLoS Comput. Biol</source>. 19, e1011207. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1011207</pub-id><pub-id pub-id-type="pmid">37339154</pub-id></citation></ref>
<ref id="B150">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xia</surname> <given-names>J.</given-names></name> <name><surname>Lin</surname> <given-names>H.</given-names></name> <name><surname>Xu</surname> <given-names>Y.</given-names></name> <name><surname>Tan</surname> <given-names>C.</given-names></name> <name><surname>Wu</surname> <given-names>L.</given-names></name> <name><surname>Li</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2023</year>). <article-title>Gnn cleaner: Label cleaner for graph structured data</article-title>. <source>IEEE Trans. Know. Data Eng</source>. <volume>2023</volume>, <fpage>1</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1109/TKDE.2023.3288002</pub-id></citation>
</ref>
<ref id="B151">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xie</surname> <given-names>L.</given-names></name> <name><surname>Shen</surname> <given-names>H.</given-names></name> <name><surname>Feng</surname> <given-names>D.</given-names></name></person-group> (<year>2022</year>). <article-title>Structural&#x02013;temporal embedding of large-scale dynamic networks with parallel implementation</article-title>. <source>Comp. Electrical Eng</source>. <volume>100</volume>, <fpage>107835</fpage>. <pub-id pub-id-type="doi">10.1016/j.compeleceng.2022.107835</pub-id></citation>
</ref>
<ref id="B152">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xiong</surname> <given-names>Z.</given-names></name> <name><surname>Wang</surname> <given-names>D.</given-names></name> <name><surname>Liu</surname> <given-names>X.</given-names></name> <name><surname>Zhong</surname> <given-names>F.</given-names></name> <name><surname>Wan</surname> <given-names>X.</given-names></name> <name><surname>Li</surname> <given-names>X.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Pushing the boundaries of molecular representation for drug discovery with the graph attention mechanism</article-title>. <source>J. Med. Chem</source>. <volume>63</volume>, <fpage>8749</fpage>&#x02013;<lpage>8760</lpage>. <pub-id pub-id-type="doi">10.1021/acs.jmedchem.9b00959</pub-id><pub-id pub-id-type="pmid">31408336</pub-id></citation></ref>
<ref id="B153">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xu</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Understanding graph embedding methods and their applications</article-title>. <source>SIAM Review</source> <volume>63</volume>, <fpage>825</fpage>&#x02013;<lpage>853</lpage>. <pub-id pub-id-type="doi">10.1137/20M1386062</pub-id></citation>
</ref>
<ref id="B154">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yan</surname> <given-names>C.</given-names></name> <name><surname>Chang</surname> <given-names>Z.</given-names></name></person-group> (<year>2019</year>). <article-title>Modularized tri-factor nonnegative matrix factorization for community detection enhancement</article-title>. <source>Physica A</source>. <volume>533</volume>, <fpage>122050</fpage>. <pub-id pub-id-type="doi">10.1016/j.physa.2019.122050</pub-id></citation>
</ref>
<ref id="B155">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>C.</given-names></name> <name><surname>Sun</surname> <given-names>M.</given-names></name> <name><surname>Liu</surname> <given-names>Z.</given-names></name> <name><surname>Tu</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x0201C;Fast network embedding enhancement via high order proximity approximation,&#x0201D;</article-title> in <source>Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence</source>. <publisher-loc>Cape Town</publisher-loc>: <publisher-name>International Joint Conferences on Artificial Intelligence Organization</publisher-name>.</citation>
</ref>
<ref id="B156">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>F.</given-names></name> <name><surname>Fan</surname> <given-names>K.</given-names></name> <name><surname>Song</surname> <given-names>D.</given-names></name> <name><surname>Lin</surname> <given-names>H.</given-names></name></person-group> (<year>2020</year>). <article-title>Graph-based prediction of protein-protein interactions with attributed signed graph embedding</article-title>. <source>BMC Bioinformat</source>. <volume>21</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1186/s12859-020-03646-8</pub-id><pub-id pub-id-type="pmid">32693790</pub-id></citation></ref>
<ref id="B157">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>H.</given-names></name> <name><surname>Pan</surname> <given-names>S.</given-names></name> <name><surname>Zhang</surname> <given-names>P.</given-names></name> <name><surname>Chen</surname> <given-names>L.</given-names></name> <name><surname>Lian</surname> <given-names>D.</given-names></name> <name><surname>Zhang</surname> <given-names>C.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Binarized attributed network embedding,&#x0201D;</article-title> in <source>2018 IEEE International Conference on Data Mining (ICDM)</source>. Singapore: <volume>IEEE</volume>, <fpage>1476</fpage>&#x02013;<lpage>1481</lpage>.</citation>
</ref>
<ref id="B158">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>M.</given-names></name> <name><surname>Zhou</surname> <given-names>M.</given-names></name> <name><surname>Xiong</surname> <given-names>H.</given-names></name> <name><surname>King</surname> <given-names>I.</given-names></name></person-group> (<year>2022a</year>). <article-title>Hyperbolic temporal network embedding</article-title>. <source>IEEE Trans. Knowl. Data Eng</source>. <volume>35</volume>, <fpage>11489</fpage>&#x02013;<lpage>11502</lpage>. <pub-id pub-id-type="doi">10.1109/TKDE.2022.3232398</pub-id></citation>
</ref>
<ref id="B159">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>R.</given-names></name> <name><surname>Shi</surname> <given-names>J.</given-names></name> <name><surname>Huang</surname> <given-names>K.</given-names></name> <name><surname>Xiao</surname> <given-names>X.</given-names></name></person-group> (<year>2022b</year>). <article-title>&#x0201C;Scalable and effective bipartite network embedding,&#x0201D;</article-title> in <source>Proceedings of the 2022 International Conference on Management of Data</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>ACM</publisher-name>.</citation>
</ref>
<ref id="B160">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ye</surname> <given-names>W.-C.</given-names></name> <name><surname>Wang</surname> <given-names>J.-C.</given-names></name></person-group> (<year>2022</year>). <article-title>&#x0201C;Multilabel classification based on graph neural networks,&#x0201D;</article-title> in <source>Artificial Intelligence</source>. <publisher-loc>London, UK</publisher-loc>: <publisher-name>IntechOpen</publisher-name>.</citation>
</ref>
<ref id="B161">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ying</surname> <given-names>R.</given-names></name> <name><surname>You</surname> <given-names>J.</given-names></name> <name><surname>Morris</surname> <given-names>C.</given-names></name> <name><surname>Ren</surname> <given-names>X.</given-names></name> <name><surname>Hamilton</surname> <given-names>W. L.</given-names></name> <name><surname>Leskovec</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Hierarchical graph representation learning with differentiable pooling,&#x0201D;</article-title> in <source>Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS&#x00027;18</source>. <publisher-loc>Red Hook, NY, USA</publisher-loc>: <publisher-name>Curran Associates Inc</publisher-name>, <fpage>4805</fpage>&#x02013;<lpage>4815</lpage>.</citation>
</ref>
<ref id="B162">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yu</surname> <given-names>L.</given-names></name> <name><surname>Cheng</surname> <given-names>M.</given-names></name> <name><surname>Qiu</surname> <given-names>W.</given-names></name> <name><surname>Xiao</surname> <given-names>X.</given-names></name> <name><surname>Lin</surname> <given-names>W.</given-names></name></person-group> (<year>2022</year>). <article-title>idse-HE: Hybrid embedding graph neural network for drug side effects prediction</article-title>. <source>J. Biomed. Inform</source>. <volume>131</volume>, <fpage>104098</fpage>. <pub-id pub-id-type="doi">10.1016/j.jbi.2022.104098</pub-id><pub-id pub-id-type="pmid">35636720</pub-id></citation></ref>
<ref id="B163">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yue</surname> <given-names>X.</given-names></name> <name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Huang</surname> <given-names>J.</given-names></name> <name><surname>Parthasarathy</surname> <given-names>S.</given-names></name> <name><surname>Moosavinasab</surname> <given-names>S.</given-names></name> <name><surname>Huang</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Graph embedding on biomedical networks: methods, applications and evaluations</article-title>. <source>Bioinformatics</source> <volume>36</volume>, <fpage>1241</fpage>&#x02013;<lpage>1251</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btz718</pub-id><pub-id pub-id-type="pmid">31584634</pub-id></citation></ref>
<ref id="B164">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>D.</given-names></name> <name><surname>Yin</surname> <given-names>J.</given-names></name> <name><surname>Zhu</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>&#x0201C;User profile preserving social network embedding,&#x0201D;</article-title> in <source>Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence</source>. <publisher-loc>Cape Town</publisher-loc>: <publisher-name>International Joint Conferences on Artificial Intelligence Organization</publisher-name>.</citation>
</ref>
<ref id="B165">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>D.</given-names></name> <name><surname>Yin</surname> <given-names>J.</given-names></name> <name><surname>Zhu</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>Network representation learning: A survey</article-title>. <source>IEEE Trans. Big Data</source> <volume>6</volume>, <fpage>3</fpage>&#x02013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1109/TBDATA.2018.2850013</pub-id></citation>
</ref>
<ref id="B166">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>H.</given-names></name> <name><surname>Zha</surname> <given-names>Z.-J.</given-names></name> <name><surname>Yan</surname> <given-names>S.</given-names></name> <name><surname>Wang</surname> <given-names>M.</given-names></name> <name><surname>Chua</surname> <given-names>T.-S.</given-names></name></person-group> (<year>2012</year>). <article-title>&#x0201C;Robust non-negative graph embedding: Towards noisy data, unreliable graphs, and noisy labels,&#x0201D;</article-title> in <source>2012 IEEE Conference on Computer Vision and Pattern Recognition</source>. Providence, RI: <volume>IEEE</volume>, <fpage>2464</fpage>&#x02013;<lpage>2471</lpage>.</citation>
</ref>
<ref id="B167">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>S.</given-names></name> <name><surname>Tong</surname> <given-names>H.</given-names></name> <name><surname>Xu</surname> <given-names>J.</given-names></name> <name><surname>Maciejewski</surname> <given-names>R.</given-names></name></person-group> (<year>2019a</year>). <article-title>Graph convolutional networks: a comprehensive review</article-title>. <source>Computat. Soc. Netw</source>. <volume>6</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1186/s40649-019-0069-y</pub-id></citation>
</ref>
<ref id="B168">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>X.</given-names></name> <name><surname>He</surname> <given-names>Y.</given-names></name> <name><surname>Brugnone</surname> <given-names>N.</given-names></name> <name><surname>Perlmutter</surname> <given-names>M.</given-names></name> <name><surname>Hirn</surname> <given-names>M.</given-names></name></person-group> (<year>2021a</year>). <article-title>Magnet: A neural network for directed graphs</article-title>. <source>Adv. Neural Inf. Process. Syst</source>. <volume>34</volume>, <fpage>27003</fpage>&#x02013;<lpage>27015</lpage>.<pub-id pub-id-type="pmid">36046111</pub-id></citation></ref>
<ref id="B169">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>X.-M.</given-names></name> <name><surname>Liang</surname> <given-names>L.</given-names></name> <name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Tang</surname> <given-names>M.-J.</given-names></name></person-group> (<year>2021b</year>). <article-title>Graph neural networks and their current applications in bioinformatics</article-title>. <source>Front. Genet</source>. <volume>12</volume>, <fpage>690049</fpage>. <pub-id pub-id-type="doi">10.3389/fgene.2021.690049</pub-id><pub-id pub-id-type="pmid">34394185</pub-id></citation></ref>
<ref id="B170">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Chen</surname> <given-names>Q.</given-names></name> <name><surname>Yang</surname> <given-names>Z.</given-names></name> <name><surname>Lin</surname> <given-names>H.</given-names></name> <name><surname>Lu</surname> <given-names>Z.</given-names></name></person-group> (<year>2019b</year>). <article-title>BioWordVec, improving biomedical word embeddings with subword information and MeSH</article-title>. <source>Scient. Data</source> <volume>6</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1038/s41597-019-0055-0</pub-id><pub-id pub-id-type="pmid">31076572</pub-id></citation></ref>
<ref id="B171">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Y.-J.</given-names></name> <name><surname>Yang</surname> <given-names>K.-C.</given-names></name> <name><surname>Radicchi</surname> <given-names>F.</given-names></name></person-group> (<year>2021c</year>). <article-title>Systematic comparison of graph embedding methods in practical tasks</article-title>. <source>Phys. Rev. E</source> <volume>104</volume>, <fpage>044315</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.104.044315</pub-id><pub-id pub-id-type="pmid">34781460</pub-id></citation></ref>
<ref id="B172">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>Z.</given-names></name> <name><surname>Cui</surname> <given-names>P.</given-names></name> <name><surname>Wang</surname> <given-names>X.</given-names></name> <name><surname>Pei</surname> <given-names>J.</given-names></name> <name><surname>Yao</surname> <given-names>X.</given-names></name> <name><surname>Zhu</surname> <given-names>W.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;Arbitrary-order proximity preserved network embedding,&#x0201D;</article-title> in <source>Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery</source> &#x00026; <italic>Data Mining, KDD &#x00027;18</italic>. New York, NY, USA: Association for Computing <volume>Machinery</volume>, <fpage>2778</fpage>&#x02013;<lpage>2786</lpage>.</citation>
</ref>
<ref id="B173">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>B.-W.</given-names></name> <name><surname>Su</surname> <given-names>X.-R.</given-names></name> <name><surname>Hu</surname> <given-names>P.-W.</given-names></name> <name><surname>Ma</surname> <given-names>Y.-P.</given-names></name> <name><surname>Zhou</surname> <given-names>X.</given-names></name> <name><surname>Hu</surname> <given-names>L.</given-names></name></person-group> (<year>2022</year>). <article-title>A geometric deep learning framework for drug repositioning over heterogeneous information networks</article-title>. <source>Brief. Bioinformatics</source> <volume>23</volume>, <fpage>6</fpage>. <pub-id pub-id-type="doi">10.1093/bib/bbac384</pub-id><pub-id pub-id-type="pmid">36125202</pub-id></citation></ref>
<ref id="B174">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>F.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Lu</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>ShortWalk: an approach to network embedding on directed graphs</article-title>. <source>Soc. Netw. Analy. Mining</source> <volume>11</volume>, <fpage>1</fpage>. <pub-id pub-id-type="doi">10.1007/s13278-020-00714-y</pub-id></citation>
</ref>
<ref id="B175">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>S.</given-names></name> <name><surname>Du</surname> <given-names>Z.</given-names></name> <name><surname>Chen</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.</given-names></name> <name><surname>Tang</surname> <given-names>J.</given-names></name> <name><surname>Yu</surname> <given-names>P. S.</given-names></name></person-group> (<year>2023</year>). <article-title>Hierarchical representation learning for attributed networks</article-title>. <source>IEEE Trans. Knowl. Data Eng</source>. <volume>35</volume>, <fpage>2641</fpage>&#x02013;<lpage>2656</lpage>.</citation>
</ref>
<ref id="B176">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zheng</surname> <given-names>S.</given-names></name> <name><surname>Ma</surname> <given-names>H.</given-names></name> <name><surname>Wang</surname> <given-names>J.</given-names></name> <name><surname>Li</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>&#x0201C;A computational bipartite graph-based drug repurposing method,&#x0201D;</article-title> in <source>Methods in Molecular Biology</source>. <publisher-loc>Cham</publisher-loc>: <publisher-name>Springer New York</publisher-name>, <fpage>115</fpage>&#x02013;<lpage>127</lpage>.<pub-id pub-id-type="pmid">30547439</pub-id></citation></ref>
<ref id="B177">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>D.</given-names></name> <name><surname>Hofmann</surname> <given-names>T.</given-names></name> <name><surname>Sch&#x000F6;lkopf</surname> <given-names>B.</given-names></name></person-group> (<year>2004</year>). <article-title>&#x0201C;Semi-supervised learning on directed graphs,&#x0201D;</article-title> in <source>Advances in Neural Information Processing Systems</source>, eds. L. Saul, Y. Weiss, and L. Bottou. New York: MIT Press.</citation>
</ref>
<ref id="B178">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>D.</given-names></name> <name><surname>Huang</surname> <given-names>J.</given-names></name> <name><surname>Sch&#x000F6;lkopf</surname> <given-names>B.</given-names></name></person-group> (<year>2005</year>). <article-title>&#x0201C;Learning from labeled and unlabeled data on a directed graph,&#x0201D;</article-title> in <source>Proceedings of the 22nd international conference on Machine learning</source> - <italic>ICML</italic>. New York: ACM Press.</citation>
</ref>
<ref id="B179">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhu</surname> <given-names>Q.</given-names></name> <name><surname>Jiang</surname> <given-names>X.</given-names></name> <name><surname>Zhu</surname> <given-names>Q.</given-names></name> <name><surname>Pan</surname> <given-names>M.</given-names></name> <name><surname>He</surname> <given-names>T.</given-names></name></person-group> (<year>2019</year>). <article-title>Graph embedding deep learning guides microbial biomarkers&#x00027; identification</article-title>. <source>Front. Genet</source>. <volume>10</volume>, <fpage>1182</fpage>. <pub-id pub-id-type="doi">10.3389/fgene.2019.01182</pub-id><pub-id pub-id-type="pmid">31824573</pub-id></citation></ref>
</ref-list>
</back>
</article>