<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Cell Dev. Biol.</journal-id>
<journal-title>Frontiers in Cell and Developmental Biology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Cell Dev. Biol.</abbrev-journal-title>
<issn pub-type="epub">2296-634X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">1233808</article-id>
<article-id pub-id-type="doi">10.3389/fcell.2023.1233808</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Cell and Developmental Biology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The linear framework II: using graph theory to analyse the transient regime of Markov processes</article-title>
<alt-title alt-title-type="left-running-head">Nam and Gunawardena</alt-title>
<alt-title alt-title-type="right-running-head">
<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3389/fcell.2023.1233808">10.3389/fcell.2023.1233808</ext-link>
</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Nam</surname>
<given-names>Kee-Myoung</given-names>
</name>
<xref ref-type="fn" rid="fn1">
<sup>&#x2020;</sup>
</xref>
<uri xlink:href="https://loop.frontiersin.org/people/2334143/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Gunawardena</surname>
<given-names>Jeremy</given-names>
</name>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/2333017/overview"/>
</contrib>
</contrib-group>
<aff>
<institution>Department of Systems Biology</institution>, <institution>Harvard Medical School</institution>, <addr-line>Boston</addr-line>, <addr-line>MA</addr-line>, <country>United States</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/2036835/overview">Michael Blinov</ext-link>, UConn Health, United States</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/456332/overview">Silas Boye Nissen</ext-link>, Stanford University, United States</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/265528/overview">Lee Bardwell</ext-link>, University of California, Irvine, United States</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Jeremy Gunawardena, <email>jeremy@hms.harvard.edu</email>
</corresp>
<fn fn-type="present-address" id="fn1">
<label>
<sup>&#x2020;</sup>
</label>
<p>
<bold>Present Address:</bold> Kee-Myoung Nam, Department of Molecular, Cellular and Developmental Biology, Yale University, New Haven, CT, United States</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>03</day>
<month>11</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>11</volume>
<elocation-id>1233808</elocation-id>
<history>
<date date-type="received">
<day>02</day>
<month>06</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>10</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2023 Nam and Gunawardena.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Nam and Gunawardena</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>The linear framework uses finite, directed graphs with labelled edges to model biomolecular systems. Graph vertices represent chemical species or molecular states, edges represent reactions or transitions and edge labels represent rates that also describe how the system is interacting with its environment. The present paper is a sequel to a recent review of the framework that focussed on how graph-theoretic methods give insight into steady states as rational algebraic functions of the edge labels. Here, we focus on the transient regime for systems that correspond to continuous-time Markov processes. In this case, the graph specifies the infinitesimal generator of the process. We show how the moments of the first-passage time distribution, and related quantities, such as splitting probabilities and conditional first-passage times, can also be expressed as rational algebraic functions of the labels. This capability is timely, as new experimental methods are finally giving access to the transient dynamic regime and revealing the computations and information processing that occur before a steady state is reached. We illustrate the concepts, methods and formulas through examples and show how the results may be used to illuminate previous findings in the literature.</p>
</abstract>
<kwd-group>
<kwd>linear framework</kwd>
<kwd>graph theory</kwd>
<kwd>Matrix-Tree theorems</kwd>
<kwd>rational functions</kwd>
<kwd>Markov processes</kwd>
<kwd>first-passage times</kwd>
</kwd-group>
<contract-sponsor id="cn001">National Institutes of Health<named-content content-type="fundref-id">10.13039/100000002</named-content>
</contract-sponsor>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Signaling</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>The linear framework is a graph-theoretic approach to analysing biomolecular systems (<xref ref-type="bibr" rid="B23">Gunawardena, 2012</xref>; <xref ref-type="bibr" rid="B42">Mirzaev and Gunawardena, 2013</xref>; <xref ref-type="bibr" rid="B24">Gunawardena, 2014</xref>). A recent review (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>) described how the framework has been used to study systems at steady state, in contexts such as post-translational modification and gene regulation. The present paper is a sequel to this review, which describes how the graph-theoretic approach can be extended to the transient regime, prior to the steady state being reached, for systems that are Markov processes. These new results were introduced in the first author&#x2019;s Ph.D. thesis (<xref ref-type="bibr" rid="B48">Nam, 2021</xref>) and full details with complete proofs are being published separately (<xref ref-type="bibr" rid="B45">Nam and Gunawardena, 2023</xref>). The purpose of the present paper is to provide an elementary introduction to this circle of ideas for a wider readership in cell and developmental biology. We hope this will be of interest to anyone who wants to explore the transient regime for biological systems that can be modelled by Markov processes.</p>
<p>Linear framework graphs (hereafter, &#x201c;graphs&#x201d;) are finite, simple, directed graphs with labelled edges. (A simple graph is one in which there is at most one edge between any two distinct vertices and there are no self-loops.) Graph vertices, usually denoted 1, 2, 3, <italic>&#x2026;</italic>, represent chemical species or molecular states; edges, denoted <italic>i</italic> &#x2192; <italic>j</italic>, represent reactions or transitions; and edge labels, denoted <italic>&#x2113;</italic>(<italic>i</italic> &#x2192; <italic>j</italic>), represent rates which are positive and have dimensions of (time)<sup>&#x2212;1</sup>. Importantly, the labels may include expressions that describe how the underlying system is interacting with its environment. For example, the graph in <xref ref-type="fig" rid="F1">Figure 1A</xref> shows how ligand binding gives rise to concentration terms in the edge labels.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Linear framework graph and Laplacian matrix. <bold>(A)</bold> An example graph, <italic>G</italic>, representing the binding of two ligands, each to one site, on a biomolecule, with vertices indexed 1, <italic>&#x2026;</italic>, 4 as shown. The labels on the edges 1 &#x2192; 2 and 3 &#x2192; 4 include the concentration, <italic>x</italic>, of the blue ligand that binds to the first site and the labels on the edges 1 &#x2192; 3 and 2 &#x2192; 4 include the concentration, <italic>y</italic>, of the purple ligand that binds to the second site. The parameters <italic>k</italic>
<sub>1</sub>, <italic>k</italic>
<sub>3</sub>, <italic>k</italic>
<sub>5</sub> and <italic>k</italic>
<sub>7</sub> are on-rates for binding, with dimensions of (concentration &#xd7; time)<sup>&#x2212;1</sup>; the other parameters are simple rates with dimensions of (time)<sup>&#x2212;1</sup>. Graphics were generated using BioRender.com. <bold>(B)</bold> The Laplacian matrix, <inline-formula id="inf57">
<mml:math id="m82">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, for the graph in panel <bold>A</bold>.</p>
</caption>
<graphic xlink:href="fcell-11-1233808-g001.tif"/>
</fig>
<p>A graph yields a linear dynamics, from which the linear framework gets its name. The dynamics is most simply described by imagining that the edges are chemical reactions with the edge labels as the rate constants for mass-action kinetics. Since each reaction has only a single substrate, the resulting dynamics is necessarily linear and can be expressed in matrix form as<disp-formula id="e1">
<mml:math id="m1">
<mml:mfrac>
<mml:mrow>
<mml:mi>d</mml:mi>
<mml:mi>u</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>d</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x22c5;</mml:mo>
<mml:mi>u</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>.</mml:mo>
</mml:math>
<label>(1)</label>
</disp-formula>Here, <inline-formula id="inf1">
<mml:math id="m2">
<mml:mi>u</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mi>T</mml:mi>
</mml:mrow>
</mml:msup>
</mml:math>
</inline-formula> is the column vector of concentrations at each of the <italic>N</italic> vertices, and <inline-formula id="inf2">
<mml:math id="m3">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is the Laplacian matrix of the graph (<xref ref-type="fig" rid="F1">Figure 1B</xref>). Graph Laplacians are defined with varying conventions and scalings and they may be interpreted as discrete versions of the classical Laplacian differential operator (<xref ref-type="bibr" rid="B12">Chung, 1997</xref>). From this viewpoint, Eq. <xref ref-type="disp-formula" rid="e1">1</xref> is a discretised diffusion equation. Since matter is neither created nor destroyed during the dynamics, there is a conservation law,<disp-formula id="e2">
<mml:math id="m4">
<mml:msub>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2b;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mtext>tot</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>.</mml:mo>
</mml:math>
<label>(2)</label>
</disp-formula>Eq. <xref ref-type="disp-formula" rid="e2">2</xref> manifests itself in the column sums of the Laplacian being zero, <inline-formula id="inf3">
<mml:math id="m5">
<mml:mn>1</mml:mn>
<mml:mo>&#x22c5;</mml:mo>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>0</mml:mn>
</mml:math>
</inline-formula> (<xref ref-type="fig" rid="F1">Figure 1B</xref>), where 1 denotes the all-ones row vector of the appropriate dimension.</p>
<p>The framework is typically used in two contexts: for bulk biochemistry of reacting chemical species, where <italic>u</italic>(<italic>t</italic>) in Eq. <xref ref-type="disp-formula" rid="e1">1</xref> describes the deterministic time evolution of species concentrations; and for individual molecular systems that exhibit stochastic transitions, where <italic>u</italic>(<italic>t</italic>) describes the deterministic time evolution of the probabilities of the molecular states. In the latter case, since probabilities sum to 1, <italic>u</italic>
<sub>tot</sub> &#x3d; 1. It is interesting that the same mathematics describes both contexts. Here, we will be working in the context of individual molecules and stochastic transitions. From now on, <italic>u</italic>(<italic>t</italic>) will be the vector of probabilities and we will assume that <italic>u</italic>
<sub>tot</sub> &#x3d; 1.</p>
<p>The graph formulation allows nonlinear biochemistry, which often arises from ligand binding, to be disentangled into a linear part carried by the linear dynamics in Eq. <xref ref-type="disp-formula" rid="e1">1</xref> and a nonlinear part that comes through the edge labels (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>). The terms appearing in the labels, such as ligand concentrations (<xref ref-type="fig" rid="F1">Figure 1A</xref>), have to be dealt with separately. They may be specified by separate conservation laws or by other graphs (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>). For the present paper, we will assume that any ligands that are interacting with a graph are present in &#x201c;reservoirs&#x201d; (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>, &#xa7;4), similar to thermodynamic reservoirs, so that their free concentrations do not change upon binding. Accordingly, edge labels are treated as constants over the timescale of the dynamics in Eq. <xref ref-type="disp-formula" rid="e1">1</xref>. In this case, for the stochastic context described above, the graph specifies the infinitesimal generator for a finite-state, continuous-time, time-homogeneous Markov process, <italic>X</italic>(<italic>t</italic>), (hereafter, a &#x201c;Markov process&#x201d;), so that the edge labels are given by,<disp-formula id="equ1">
<mml:math id="m6">
<mml:mi>&#x2113;</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x2192;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:munder>
<mml:mrow>
<mml:mi>lim</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>h</mml:mi>
<mml:mo>&#x2192;</mml:mo>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:munder>
<mml:mfrac>
<mml:mrow>
<mml:mi>Pr</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>X</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>h</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>j</mml:mi>
<mml:mo stretchy="false">&#x2223;</mml:mo>
<mml:mi>X</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>h</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>,</mml:mo>
</mml:math>
</disp-formula>whenever the right-hand side is nonzero and therefore positive. (A zero infinitesimal rate does not yield an edge.) Conversely, any such Markov process with an infinitesimal generator is specified by a graph (<xref ref-type="bibr" rid="B42">Mirzaev and Gunawardena, 2013</xref>, Theorem 4). The Laplacian dynamics in Eq. <xref ref-type="disp-formula" rid="e1">1</xref>, with <italic>u</italic>
<sub>tot</sub> &#x3d; 1, becomes the master equation for the forward evolution of the vertex probabilities, <italic>u</italic>(<italic>t</italic>). The linearity of the linear framework is perhaps less surprising now, as master equations are, indeed, linear (<xref ref-type="bibr" rid="B55">van Kampen, 1992</xref>). We see that, within reservoir assumptions, the linear framework provides a graph-theoretic way to define and study the Markov processes that have been widely used to model biological systems.</p>
<p>Surprisingly, the graph rarely makes an appearance in the Markov process literature. This may be because the graph theory has so far primarily been used to study steady states of the Laplacian dynamics (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>), which may not have been of much mathematical interest outside of applications in biology. Since Eq. <xref ref-type="disp-formula" rid="e1">1</xref> is linear, it can readily be solved in terms of the eigenvalues and eigenvectors of <inline-formula id="inf4">
<mml:math id="m7">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. Recall that if <inline-formula id="inf5">
<mml:math id="m8">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x22c5;</mml:mo>
<mml:mi>v</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>&#x3bb;</mml:mi>
<mml:mi>v</mml:mi>
</mml:math>
</inline-formula>, for some vector <italic>v</italic> and some scalar <italic>&#x3bb;</italic>, then <italic>v</italic> is an eigenvector for the eigenvalue <italic>&#x3bb;</italic> (<xref ref-type="bibr" rid="B53">Strang, 2022</xref>). By definition, the steady state of Eq. <xref ref-type="disp-formula" rid="e1">1</xref>, which we will denote by <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>), satisfies <italic>du</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>)/<italic>dt</italic> &#x3d; 0, so it follows from Eq. <xref ref-type="disp-formula" rid="e1">1</xref> that <inline-formula id="inf6">
<mml:math id="m9">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x22c5;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>0</mml:mn>
</mml:math>
</inline-formula>. In other words, <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>) is an eigenvector for the zero eigenvalue.</p>
<p>When <italic>G</italic> is <italic>strongly connected</italic> (see below), the steady state, <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>) is unique. This particular eigenvector can be calculated from <inline-formula id="inf7">
<mml:math id="m10">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> using the determinants of principal sub-matrices, or the <italic>first minors</italic> of <inline-formula id="inf8">
<mml:math id="m11">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, which thereby have terms of alternating sign (<xref ref-type="bibr" rid="B53">Strang, 2022</xref>). It is a remarkable property of Laplacian matrices that extensive cancellations take place so that their minors can be written as <italic>manifestly positive polynomials</italic> in the edge labels (Eq. <xref ref-type="disp-formula" rid="e5">5</xref>). A polynomial is a sum of <italic>monomials</italic>, where a monomial is an algebraic expression consisting solely of a product of variables and a numerical coefficient, like 5<italic>a</italic>
<sup>3</sup>
<italic>bc</italic>
<sup>2</sup> (<xref ref-type="bibr" rid="B3">Barbeau, 1989</xref>). A polynomial is manifestly positive if the numerical coefficient of each monomial is positive. (A polynomial like <italic>a</italic>
<sup>2</sup> &#x2212; 2<italic>ab</italic> &#x2b; <italic>b</italic>
<sup>2</sup> &#x3d; (<italic>a</italic> &#x2212; <italic>b</italic>)<sup>2</sup> is positive for any distinct positive values of <italic>a</italic> and <italic>b</italic>, but it is not manifestly positive.) A <italic>rational function</italic> or <italic>rational expression</italic> is the ratio of two polynomials and is itself manifestly positive if both its numerator and denominator polynomials are manifestly positive.</p>
<p>The algebra that gives rise to manifestly positive polynomials is controlled by appropriate subgraphs of <italic>G</italic>, described in the classical Matrix-Tree theorem (MTT), which goes back to 19th century work on electrical circuits (<xref ref-type="bibr" rid="B30">Kirchhoff, 1847</xref>; <xref ref-type="bibr" rid="B42">Mirzaev and Gunawardena, 2013</xref>); the manifest positivity is exactly what is required for parametric dependence in biology. Steady-state probabilities thereby emerge as manifestly positive rational functions of the edge labels (Eq. <xref ref-type="disp-formula" rid="e4">4</xref>). This representation has proved very useful in giving mathematical access to steady states (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>).</p>
<p>An important feature of this rational expression for steady-state probabilities is that it holds for systems that do not necessarily reach a steady state of thermodynamic equilibrium. Briefly, graphs that can reach thermodynamic equilibrium must be <italic>reversible</italic>, so that, given any edge <italic>i</italic> &#x2192; <italic>j</italic>, there is an edge <italic>j</italic> &#x2192; <italic>i</italic> that represents the reverse process, and must satisfy the <italic>cycle condition</italic>: the product of the label ratios along any cycle of reversible edges is always 1 (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>, &#xa7;4). The cycle condition is equivalent to <italic>detailed balance</italic> or <italic>microscopic reversibility</italic>. In this case, a considerable simplification can be made in describing steady-state probabilities and the resulting expressions turn out to be equivalent to those of equilibrium statistical mechanics (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>, &#xa7;4). One great advantage of the linear framework is that it provides a restricted context in which non-equilibrium statistical mechanics can be exactly solved in rational algebraic terms. The functional significance of energy expenditure is a very interesting problem in cellular information processing (<xref ref-type="bibr" rid="B18">Estrada et al., 2016</xref>) but lies outside the scope of the present paper. We will mention some of the questions that arise in the Discussion.</p>
<p>A distinguishing feature of the linear framework is that the graph is treated, not just as a description or as a vehicle for doing Matrix-Tree calculations, but as a mathematical entity in its own right, in terms of which general theorems can be formulated. The graph provides a rigorous language in which salient biological features can be precisely expressed while others can be left largely unspecified, thereby allowing some general principles to emerge from behind the overwhelming molecular complexity that is ever present. Among the areas for which this approach has yielded insights are input-output responses (<xref ref-type="bibr" rid="B59">Wong et al., 2018</xref>; <xref ref-type="bibr" rid="B60">Yordanov and Stelling, 2018</xref>), post-translational modifications (<xref ref-type="bibr" rid="B15">Dasgupta et al., 2014</xref>; <xref ref-type="bibr" rid="B46">Nam et al., 2020</xref>), allostery (<xref ref-type="bibr" rid="B6">Biddle et al., 2021</xref>) and gene regulation (<xref ref-type="bibr" rid="B18">Estrada et al., 2016</xref>; <xref ref-type="bibr" rid="B5">Biddle et al., 2019</xref>).</p>
<p>Since the initial development of the linear framework, we had long thought that only steady states could be expressed as rational functions of the edge labels. However, as we will show here, important properties of the transient regime, such as first-passage times, can also be calculated as rational functions of the edge labels. The capability to analyse transient behaviour using graph-theoretic methods is particularly welcome because real-time and single-molecule experimental methods are finally giving access to the transient regime within living cells (<xref ref-type="bibr" rid="B31">Kleine Borgmann et al., 2013</xref>; <xref ref-type="bibr" rid="B35">Liao et al., 2015</xref>; <xref ref-type="bibr" rid="B28">Jones et al., 2017</xref>; <xref ref-type="bibr" rid="B37">Loffreda et al., 2017</xref>; <xref ref-type="bibr" rid="B11">Chen et al., 2018</xref>; <xref ref-type="bibr" rid="B17">Dufourt et al., 2018</xref>; <xref ref-type="bibr" rid="B41">Mir et al., 2018</xref>; <xref ref-type="bibr" rid="B56">Volkov et al., 2018</xref>; <xref ref-type="bibr" rid="B49">Nandan et al., 2022</xref>). Much of our understanding of biochemical behaviour has relied on steady-state assumptions, which are not always explicitly stated. The rich complexity of transient behaviours which are beginning to emerge suggests that the time is ripe to develop a more fundamental understanding of the kinds of biochemical computations and information processing that can be achieved transiently. For this, the mathematical methods described here may be of some value.</p>
</sec>
<sec sec-type="results" id="s2">
<title>2 Results</title>
<sec id="s2-1">
<title>2.1 Steady states and spanning trees</title>
<p>As preparation for discussing first-passage times, we briefly explain how steady-state probabilities are calculated in terms of the graph; see (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>, &#xa7;2) for more details. If we have a graph <italic>G</italic>, we noted in the Introduction that the steady state, <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>), satisfies <inline-formula id="inf9">
<mml:math id="m12">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x22c5;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>0</mml:mn>
</mml:math>
</inline-formula>, so that, in linear algebra terms, <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>) lies by definition in the <italic>kernel</italic> of the Laplacian matrix: <inline-formula id="inf10">
<mml:math id="m13">
<mml:msup>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x2208;</mml:mo>
<mml:mi>ker</mml:mi>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. If <italic>G</italic> is <italic>strongly connected</italic>&#x2014;i.e., if, for any pair of distinct vertices <italic>i</italic> and <italic>j</italic>, there is a directed path of edges from <italic>i</italic> to <italic>j</italic>&#x2014;then this kernel is one-dimensional (<xref ref-type="bibr" rid="B23">Gunawardena, 2012</xref>),<disp-formula id="e3">
<mml:math id="m14">
<mml:mi>dim</mml:mi>
<mml:mo>&#x2009;</mml:mo>
<mml:mi>ker</mml:mi>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>.</mml:mo>
</mml:math>
<label>(3)</label>
</disp-formula>(The structure of <inline-formula id="inf11">
<mml:math id="m15">
<mml:mi>ker</mml:mi>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is well understood for non-strongly connected graphs (<xref ref-type="bibr" rid="B42">Mirzaev and Gunawardena, 2013</xref>). We will not need this for steady states but we will encounter non-strong connectivity when discussing first-passage times in the next section.) Eq. <xref ref-type="disp-formula" rid="e3">3</xref> means that if <inline-formula id="inf12">
<mml:math id="m16">
<mml:mi>z</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi>ker</mml:mi>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> is any nonzero vector, then any other vector in the kernel, such as <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>), is a scalar multiple of <italic>z</italic>: <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>) &#x3d; <italic>&#x3bb;z</italic>, for some number <italic>&#x3bb;</italic>.</p>
<p>The classical Matrix-Tree theorem (MTT) yields a formula for a canonical basis vector, <inline-formula id="inf13">
<mml:math id="m17">
<mml:mi>&#x3c1;</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x2208;</mml:mo>
<mml:mi>ker</mml:mi>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. We will describe this formula shortly but note first that, as just mentioned, <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>) must be a scalar multiple of <italic>&#x3c1;</italic>(<italic>G</italic>), so that <inline-formula id="inf14">
<mml:math id="m18">
<mml:msubsup>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>&#x3bb;</mml:mi>
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> for <italic>i</italic> &#x3d; 1, &#x2026;, <italic>N</italic>. Using the conservation law in Eq. <xref ref-type="disp-formula" rid="e2">2</xref> and recalling that <italic>u</italic>
<sub>tot</sub> &#x3d; 1 for probabilities, <italic>&#x3bb;</italic> may be removed by normalising, so that,<disp-formula id="e4">
<mml:math id="m19">
<mml:msubsup>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2b;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(4)</label>
</disp-formula>
</p>
<p>We need some terminology to explain how <italic>&#x3c1;</italic>(<italic>G</italic>) is determined from <italic>G</italic>. A <italic>spanning forest</italic>, <italic>F</italic>, of <italic>G</italic> is a subgraph that contains all vertices in <italic>G</italic> (&#x201c;spanning&#x201d;), lacks cycles when edge directions are ignored (&#x201c;forest&#x201d;), and has at most one outgoing edge from each vertex. The vertices with no outgoing edges are called the <italic>roots</italic> of <italic>F</italic>. If <italic>F</italic> has only one root, it is called a <italic>spanning tree</italic>. A forest consists of separate trees, although the forest is upside down, with each tree ascending to its root. Given any non-empty subset of vertices, <italic>&#x2205;</italic> &#x2260; <italic>U</italic> &#x2286;{1, <italic>&#x2026;</italic>, <italic>N</italic>}, let &#x3a6;<sub>
<italic>U</italic>
</sub>(<italic>G</italic>) denote the set of spanning forests of <italic>G</italic> that are rooted at <italic>U</italic>. Finally, given any subgraph <italic>H</italic> of <italic>G</italic>, let <italic>w</italic>(<italic>H</italic>) denote the product of all the edge labels in <italic>H</italic>: <italic>w</italic>(<italic>H</italic>) &#x3d; <italic>&#x220f;</italic>
<sub>
<italic>i</italic>&#x2192;<italic>j</italic>&#x2208;<italic>H</italic>
</sub>
<italic>&#x2113;</italic>(<italic>i</italic> &#x2192; <italic>j</italic>). As a matter of convention, if <italic>H</italic> has no edges, then <italic>w</italic>(<italic>H</italic>) &#x3d; 1. Then, <italic>&#x3c1;</italic>
<sub>
<italic>i</italic>
</sub>(<italic>G</italic>) is obtained by summing <italic>w</italic>(<italic>F</italic>) over all spanning trees <italic>F</italic> of <italic>G</italic> that are rooted at <italic>i</italic>,<disp-formula id="e5">
<mml:math id="m20">
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c1;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:munder>
</mml:mstyle>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>.</mml:mo>
</mml:math>
<label>(5)</label>
</disp-formula>
<italic>&#x3c1;</italic>
<sub>
<italic>i</italic>
</sub>(<italic>G</italic>) is a manifestly positive polynomial in the edge labels, with each <italic>w</italic>(<italic>F</italic>) being a monomial with coefficient &#x2b;1. The steady-state probabilities, <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>), can be recovered from <italic>&#x3c1;</italic>
<sub>
<italic>i</italic>
</sub>(<italic>G</italic>) by using Eq. <xref ref-type="disp-formula" rid="e4">4</xref>. <xref ref-type="fig" rid="F2">Figure 2</xref> illustrates this calculation for an example graph with five vertices and <italic>i</italic> &#x3d; 5. Spanning trees are sufficient to calculate steady-state probabilities in Eq. <xref ref-type="disp-formula" rid="e5">5</xref> but spanning forests are also needed for the transient quantities considered below (Eqs. <xref ref-type="disp-formula" rid="e6">6</xref>, <xref ref-type="disp-formula" rid="e7">7</xref>).</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>Spanning trees and steady-state probabilities. <bold>(A)</bold> An example graph, <italic>G</italic>, on five vertices, <inline-formula id="inf15">
<mml:math id="m21">
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mn>5</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>, with 11 edges, labeled <italic>k</italic>
<sub>1</sub>,<italic>&#x2026;</italic>, <italic>k</italic>
<sub>11</sub>. <italic>G</italic> is strongly connected. <bold>(B)</bold> The 20 spanning trees of <italic>G</italic> rooted at vertex 5 (red), each with its corresponding monomial product of edge labels. The sum of these 20 edge label products gives <italic>&#x3c1;</italic>
<sub>5</sub>(<italic>G</italic>) in Eq. <xref ref-type="disp-formula" rid="e5">5</xref>.</p>
</caption>
<graphic xlink:href="fcell-11-1233808-g002.tif"/>
</fig>
<p>Eq. <xref ref-type="disp-formula" rid="e5">5</xref> is a consequence of the classical MTT. The MTT is one of a family of theorems that describe the relationship between the minors of <inline-formula id="inf16">
<mml:math id="m22">
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> and spanning forests of <italic>G</italic>. The details of how Eq. <xref ref-type="disp-formula" rid="e5">5</xref> arises from the MTT, along with a statement and proof of the MTT itself, are given in <xref ref-type="bibr" rid="B42">Mirzaev and Gunawardena (2013)</xref>.</p>
<p>Since a strongly connected graph contains at least one directed path from each vertex to every other vertex, there is always at least one spanning tree rooted at each vertex. Therefore, the right-hand side of Eq. <xref ref-type="disp-formula" rid="e5">5</xref> is never empty and has at least one term for any choice of <italic>i</italic>. However, the number of rooted spanning trees may depend on the vertex: in <xref ref-type="fig" rid="F2">Figure 2</xref>, there are 20 spanning trees rooted at vertex 5 but the reader can check that there is only one spanning tree rooted at vertex 3. The size of <italic>&#x3c1;</italic>
<sub>
<italic>i</italic>
</sub>(<italic>G</italic>) can vary markedly with <italic>i</italic>, depending on the structure of <italic>G</italic>.</p>
<p>It follows from Eq. <xref ref-type="disp-formula" rid="e4">4</xref> that <italic>u</italic>
<sup>
<italic>&#x221e;</italic>
</sup>(<italic>G</italic>) is a manifestly positive rational function of the labels and is also always nonzero, irrespective of the values of the labels. It is well known in probability theory that the steady-state probabilities of a Markov process are always positive when the corresponding graph is strongly connected, and here we not only see why this is so but also how to calculate these probabilities in terms of the transition rates.</p>
<p>Manifest positivity is what we would want for a formula that yields a steady-state probability. It is a striking fact that many well-known mathematical formulas of molecular biology, such as those of Michaelis&#x2013;Menten and King&#x2013;Altman in enzyme kinetics, Monod&#x2013;Wyman&#x2013;Changeux and Koshland&#x2013;N&#xe9;methy&#x2013;Filmer in protein allostery and Ackers&#x2013;Johnson&#x2013;Shea in gene regulation, all have the structure of manifestly positive rational functions. However, they are typically derived in entirely different ways. In fact, all these rational functions can be shown to arise from Eqs. <xref ref-type="disp-formula" rid="e4">4</xref>, <xref ref-type="disp-formula" rid="e5">5</xref> applied to appropriate linear framework graphs (<xref ref-type="bibr" rid="B23">Gunawardena, 2012</xref>; <xref ref-type="bibr" rid="B59">Wong et al., 2018</xref>; <xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>), thereby revealing a surprising mathematical unity underlying the complexity of molecular biology.</p>
</sec>
<sec id="s2-2">
<title>2.2 First-passage times and spanning forests</title>
<p>We turn now from the steady state to the transient regime and specifically to <italic>first-passage times</italic> (FPTs) (<xref ref-type="bibr" rid="B27">Iyer-Biswas and Zilman, 2016</xref>). Given a graph <italic>G</italic>, the FPT from one vertex, <italic>i</italic>, to a distinct target vertex, <italic>j</italic> &#x2260; <italic>i</italic>, is the random variable for the time it takes the underlying Markov process, <italic>X</italic>(<italic>t</italic>), to reach <italic>j</italic> for the first time when starting from <italic>i</italic>. Formally,<disp-formula id="equ2">
<mml:math id="m23">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x398;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>inf</mml:mi>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x3e;</mml:mo>
<mml:mn>0</mml:mn>
<mml:mspace width="0.17em"/>
<mml:mo>:</mml:mo>
<mml:mspace width="0.17em"/>
<mml:mi>X</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>j</mml:mi>
<mml:mo stretchy="false">&#x2223;</mml:mo>
<mml:mi>X</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>.</mml:mo>
</mml:math>
</disp-formula>Of interest are the mean and higher moments of the FPT distribution. <italic>Recurrence times</italic> for the process returning to <italic>i</italic> after leaving <italic>i</italic> can be treated similarly, as can FPTs for reaching a subset of target states from a distinct subset of initial states, but we will leave these refinements aside so as not to complicate the discussion.</p>
<p>For the kinds of stochastic molecular systems considered here, FPTs have been used to quantify several properties: the completion time of an enzymatic turnover (<xref ref-type="bibr" rid="B19">Fisher and Kolomeisky, 1999</xref>; <xref ref-type="bibr" rid="B33">Kou et al., 2005</xref>; <xref ref-type="bibr" rid="B52">Shaevitz et al., 2005</xref>; <xref ref-type="bibr" rid="B32">Kolomeisky and Fisher, 2007</xref>; <xref ref-type="bibr" rid="B10">Chemla et al., 2008</xref>; <xref ref-type="bibr" rid="B21">Garai et al., 2009</xref>; <xref ref-type="bibr" rid="B4">Bel et al., 2010</xref>; <xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>; <xref ref-type="bibr" rid="B7">Cao, 2011</xref>; <xref ref-type="bibr" rid="B43">Moffitt and Bustamante, 2014</xref>); the speed with which an enzyme can discriminate between correct and incorrect substrates (<xref ref-type="bibr" rid="B2">Banerjee et al., 2017</xref>; <xref ref-type="bibr" rid="B14">Cui and Mehta, 2018</xref>; <xref ref-type="bibr" rid="B38">Mallory et al., 2019</xref>); the statistical structure of transcriptional bursting (<xref ref-type="bibr" rid="B34">Lammers et al., 2020</xref>); and the time by which a regulated molecule crosses an abundance threshold (<xref ref-type="bibr" rid="B13">Co et al., 2017</xref>; <xref ref-type="bibr" rid="B22">Ghusinga et al., 2017</xref>; <xref ref-type="bibr" rid="B25">Gupta et al., 2018</xref>). We briefly discuss two examples by way of motivation before proceeding to the technical details.</p>
<p>The development of single-molecule techniques for visualising transcription in live cells (<xref ref-type="bibr" rid="B20">Fukaya et al., 2016</xref>; <xref ref-type="bibr" rid="B17">Dufourt et al., 2018</xref>) has revealed that transcription is often characterised by transient &#x201c;bursts&#x201d; of mRNA expression interspersed by periods of inactivity. Efforts to explain how such bursting arises have focussed on stochastic transitions between transcriptionally active and inactive states in a Markovian setting (<xref ref-type="bibr" rid="B50">Peccoud and Ycart, 1995</xref>; <xref ref-type="bibr" rid="B34">Lammers et al., 2020</xref>). In active states, successive mRNAs are produced in a burst, which is terminated when the system makes a transition to an inactive state. The FPT to reach an active state from an inactive one provides an estimate of the time between bursts, which can be measured experimentally. As noted by <xref ref-type="bibr" rid="B34">Lammers et al. (2020)</xref>, comparing the distributions of such FPTs offers a sensitive means to discriminate between different gene regulatory models.</p>
<p>FPTs have also been used to quantify the time at which a regulated molecule reaches a specific abundance threshold (<xref ref-type="bibr" rid="B13">Co et al., 2017</xref>; <xref ref-type="bibr" rid="B22">Ghusinga et al., 2017</xref>; <xref ref-type="bibr" rid="B25">Gupta et al., 2018</xref>). An example of this type of system is bacterial lysis by phage <italic>&#x3bb;</italic>. Upon infecting <italic>Escherichia coli</italic>, phage <italic>&#x3bb;</italic> expresses a protein, holin S105, that accumulates in the inner cell membrane until a threshold concentration is reached, at which point the holin molecules abruptly initiate lysis by puncturing the membrane with large irregular holes (<xref ref-type="bibr" rid="B57">White et al., 2010</xref>). Various other cellular processes, such as bacterial sporulation (<xref ref-type="bibr" rid="B51">Piggot and Hilbert, 2004</xref>), cell cycle progression (<xref ref-type="bibr" rid="B36">Liu et al., 2015</xref>) and cell migration during development (<xref ref-type="bibr" rid="B25">Gupta et al., 2018</xref>), rely on similar thresholding mechanisms. The FPT analysis undertaken by <xref ref-type="bibr" rid="B22">Ghusinga et al. (2017)</xref> shows the impact of different regulatory strategies on the variance in the FPT to reach the threshold and gives insight into the regulatory mechanism of bacterial lysis.</p>
<p>Despite their broad usefulness in biology, FPTs have often been calculated by numerical simulations (<xref ref-type="bibr" rid="B34">Lammers et al., 2020</xref>) or by analytical methods that rely on the special structure of the model (<xref ref-type="bibr" rid="B22">Ghusinga et al., 2017</xref>). We describe here a systematic graph-theoretic scheme, similar to that in Eq. <xref ref-type="disp-formula" rid="e5">5</xref>, by which the moments of the FPT distribution can be expressed as rational functions of the edge labels.</p>
<p>Since &#x398;<sub>
<italic>i</italic>,<italic>j</italic>
</sub>(<italic>G</italic>) measures the time taken by <italic>X</italic>(<italic>t</italic>) to reach <italic>j</italic> from <italic>i</italic> for the first time, the distribution of &#x398;<sub>
<italic>i</italic>,<italic>j</italic>
</sub>(<italic>G</italic>) does not depend on the outgoing edges from <italic>j</italic> or their labels. Therefore, one can remove from <italic>G</italic> the edges leaving <italic>j</italic> without affecting the distribution of &#x398;<sub>
<italic>i</italic>,<italic>j</italic>
</sub>(<italic>G</italic>). For example, the distribution of &#x398;<sub>
<italic>i</italic>,5</sub>(<italic>G</italic>) is the same for the strongly connected graph in <xref ref-type="fig" rid="F2">Figure 2A</xref> and for the graph in <xref ref-type="fig" rid="F3">Figure 3A</xref>, which is formed by removing the edges leaving 5 from the graph in <xref ref-type="fig" rid="F2">Figure 2A</xref>. In consequence, it is convenient when working with FPTs to deal with graphs that may not be strongly connected, for which some additional terminology is helpful.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Spanning forests and FPTs. <bold>(A)</bold> An example graph, <italic>G</italic>, obtained by taking the graph in <xref ref-type="fig" rid="F2">Figure 2A</xref> and removing the outgoing edge from vertex 5. <italic>G</italic> has a single terminal SCC containing the single vertex 5. <bold>(B)</bold> The 24 doubly-rooted spanning forests of <italic>G</italic> in which 5 is a root (red font) and there is a path from 1 to the other root (also in red font), each with its corresponding product of edge labels. The sum of these 24 edge label products is equal to the numerator of <inline-formula id="inf17">
<mml:math id="m24">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1,5</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> in Eq. <xref ref-type="disp-formula" rid="e6">6</xref>.</p>
</caption>
<graphic xlink:href="fcell-11-1233808-g003.tif"/>
</fig>
<p>A graph <italic>G</italic> always has a unique decomposition into <italic>strongly connected components</italic> (SCCs), which can be thought of as the maximal strongly connected subgraphs; see <xref ref-type="bibr" rid="B42">Mirzaev and Gunawardena (2013)</xref> for the full details. The directed edges which leave these SCCs give rise to a <italic>partial order</italic> on the set of SCCs. Those SCCs which are maximal in the partial order are called <italic>terminal</italic>. For example, the graph in <xref ref-type="fig" rid="F2">Figure 2A</xref> is strongly connected and therefore has only a single SCC, but if the edge 5 &#x2192; 1 is removed, to yield the graph in <xref ref-type="fig" rid="F3">Figure 3A</xref>, this graph has 3 SCCs in the partial order {1, 2, 3}&#x2aaf;{4}&#x2aaf;{5}. Let us consider the special case where <italic>G</italic> has a unique terminal SCC that contains just one vertex, say, <italic>q</italic> &#x2208; {1, <italic>&#x2026;</italic>, <italic>N</italic>}, like the graph in <xref ref-type="fig" rid="F3">Figure 3A</xref>. This is what happens upon removal of the edges leaving a vertex, <italic>q</italic>, in a strongly connected graph, as in <xref ref-type="fig" rid="F2">Figure 2A</xref>: <italic>q</italic> forms a unique terminal SCC, {<italic>q</italic>}, with only one vertex. If the underlying Markov process <italic>X</italic>(<italic>t</italic>) starts from any other vertex, say <italic>i</italic>, then the probability that <italic>X</italic>(<italic>t</italic>) eventually reaches <italic>q</italic> is 1. There may, of course, be trajectories of the process along which <italic>q</italic> is never reached but these form a set of probability zero.</p>
<p>We need just a bit more notation. The quantities we want to calculate are the <italic>k</italic>th moments of the probability distribution of the FPT from <italic>i</italic> to <italic>q</italic>,<disp-formula id="equ3">
<mml:math id="m25">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">&#x27e8;</mml:mo>
<mml:mrow>
<mml:mspace width="0.17em"/>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x398;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mspace width="0.17em"/>
</mml:mrow>
<mml:mo stretchy="false">&#x27e9;</mml:mo>
</mml:mrow>
<mml:mo>,</mml:mo>
</mml:math>
</disp-formula>where &#x27e8; &#x2212; &#x27e9; denotes the average over the underlying sample space of trajectories. Let <inline-formula id="inf18">
<mml:math id="m26">
<mml:mi mathvariant="script">I</mml:mi>
</mml:math>
</inline-formula> denote the subset of non-terminal vertices, <inline-formula id="inf19">
<mml:math id="m27">
<mml:mi mathvariant="script">I</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
<mml:mo>&#x5c;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. Given any non-empty subset of vertices, <italic>&#x2205;</italic> &#x2260; <italic>U</italic> &#x2282; {1, <italic>&#x2026;</italic>, <italic>N</italic>}, and vertices <italic>j</italic> &#x2208; {1, <italic>&#x2026;</italic>, <italic>N</italic>} and <italic>r</italic> &#x2208; <italic>U</italic>, let &#x3a6;<sub>
<italic>U</italic>:<italic>j</italic>&#x21dd;<italic>r</italic>
</sub>(<italic>G</italic>) denote the set of spanning forests of <italic>G</italic> that are rooted at <italic>U</italic> and contain a directed path of edges from <italic>j</italic> to the root <italic>r</italic>, specified by <italic>j</italic> &#x21dd; <italic>r</italic>. By convention, there is always a (trivial) directed path from any vertex to itself, so that <italic>r</italic> &#x21dd; <italic>r</italic>. Then, for the mean FPT, we have (<xref ref-type="bibr" rid="B45">Nam and Gunawardena, 2023</xref>),<disp-formula id="e6">
<mml:math id="m28">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">I</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>:</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(6)</label>
</disp-formula>The numerator in Eq. <xref ref-type="disp-formula" rid="e6">6</xref> runs over all doubly-rooted spanning forests of <italic>G</italic> in which <italic>q</italic> is one root and there is a directed path of edges from <italic>i</italic> to the other root. <xref ref-type="fig" rid="F3">Figure 3B</xref> demonstrates this calculation for the graph in <xref ref-type="fig" rid="F3">Figure 3A</xref>. The denominator in Eq. <xref ref-type="disp-formula" rid="e6">6</xref> runs over all spanning trees of <italic>G</italic> rooted at <italic>q</italic> and is similar in that respect to the right-hand side of Eq. <xref ref-type="disp-formula" rid="e5">5</xref>.</p>
<p>The combinatorics become more complicated for the higher moments of &#x398;<sub>
<italic>i</italic>,<italic>q</italic>
</sub>(<italic>G</italic>). Choose <italic>k</italic>-tuples of non-terminal vertices,<disp-formula id="equ4">
<mml:math id="m29">
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2208;</mml:mo>
<mml:munder>
<mml:mrow>
<mml:munder accentunder="false">
<mml:mrow>
<mml:mi mathvariant="script">I</mml:mi>
<mml:mo>&#xd7;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#xd7;</mml:mo>
<mml:mi mathvariant="script">I</mml:mi>
</mml:mrow>
<mml:mo>&#x23DF;</mml:mo>
</mml:munder>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mtext>&#x2009;times</mml:mtext>
</mml:mrow>
</mml:munder>
<mml:mo>,</mml:mo>
</mml:math>
</disp-formula>and set <italic>j</italic>
<sub>0</sub> &#x3d; <italic>i</italic>. Then, for the <italic>k</italic>th moment, we have (<xref ref-type="bibr" rid="B45">Nam and Gunawardena, 2023</xref>),<disp-formula id="e7">
<mml:math id="m30">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>!</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mrow>
<mml:mo>&#x220f;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:munderover>
</mml:mstyle>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>:</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x21dd;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(7)</label>
</disp-formula>The product in the numerator of Eq. <xref ref-type="disp-formula" rid="e7">7</xref> again involves doubly-rooted spanning forests, in which <italic>q</italic> is one of the roots and the other root shifts along the <italic>k</italic>-tuple from <italic>j</italic>
<sub>1</sub> to <italic>j</italic>
<sub>
<italic>k</italic>
</sub>, with <italic>j</italic>
<sub>
<italic>u</italic>&#x2212;1</sub> having a directed path to <italic>j</italic>
<sub>
<italic>u</italic>
</sub> as <italic>u</italic> runs from 1 to <italic>k</italic>. Eq. <xref ref-type="disp-formula" rid="e7">7</xref> reduces to Eq. <xref ref-type="disp-formula" rid="e6">6</xref> when <italic>k</italic> &#x3d; 1.</p>
<p>Note that a spanning forest, or the special case of a spanning tree, that has <italic>q</italic> as a root cannot include any outgoing edge from <italic>q</italic>. Hence, the spanning forests or trees with <italic>q</italic> &#x3d; 5 as a root are the same for the strongly connected graph in <xref ref-type="fig" rid="F2">Figure 2A</xref> as for the graph in <xref ref-type="fig" rid="F3">Figure 3A</xref>, in which {<italic>q</italic>} has become the unique terminal SCC by removing the edges that leave <italic>q</italic>. Accordingly, both the numerator and denominator in Eqs. <xref ref-type="disp-formula" rid="e6">6</xref>, <xref ref-type="disp-formula" rid="e7">7</xref> give the same result for <italic>q</italic> &#x3d; 5 in either graph. This is the graph-theoretic consequence of the fact, mentioned above, that the probability distribution of &#x398;<sub>
<italic>i</italic>,5</sub>(<italic>G</italic>) is the same for the graphs in <xref ref-type="fig" rid="F2">Figure 2A</xref> and <xref ref-type="fig" rid="F3">Figure 3A</xref>.</p>
<p>Eq. <xref ref-type="disp-formula" rid="e7">7</xref> and, by specialisation, Eq. <xref ref-type="disp-formula" rid="e6">6</xref> can be derived, after some manipulations, from the All-Minors Matrix-Tree theorem, a more recent generalisation of the classical MTT (<xref ref-type="bibr" rid="B45">Nam and Gunawardena, 2023</xref>).</p>
<p>As a sanity check on Eq. <xref ref-type="disp-formula" rid="e7">7</xref>, we note that if <italic>G</italic> has <italic>N</italic> vertices, then any spanning forest with <italic>r</italic> roots has <italic>N</italic> &#x2212; <italic>r</italic> edges, as can be checked for the examples in <xref ref-type="fig" rid="F2">Figure 2B</xref> and <xref ref-type="fig" rid="F3">Figure 3B</xref>. It follows from Eq. <xref ref-type="disp-formula" rid="e7">7</xref> that <inline-formula id="inf20">
<mml:math id="m31">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> has dimensions of (time)<sup>
<italic>k</italic>
</sup>, as expected for the <italic>k</italic>th moment of an FPT.</p>
<p>Let us see what Eq. <xref ref-type="disp-formula" rid="e7">7</xref> tells us for the graph <italic>G</italic> consisting of just two vertices, 1 and 2, with <italic>&#x2113;</italic>(1 &#x2192; 2) &#x3d; <italic>a</italic> and <italic>&#x2113;</italic>(2 &#x2192; 1) &#x3d; <italic>b</italic>. If we consider <inline-formula id="inf21">
<mml:math id="m32">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1,2</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, then, for the denominator of Eq. <xref ref-type="disp-formula" rid="e7">7</xref>, we need the spanning trees rooted at 2, given by &#x3a6;<sub>{2}</sub>(<italic>G</italic>). There is only one such tree <italic>F</italic>, for which <italic>w</italic>(<italic>F</italic>) &#x3d; <italic>a</italic>. As for the numerator, we need the spanning forests rooted at <italic>j</italic>
<sub>
<italic>u</italic>
</sub> and 2, given by <inline-formula id="inf22">
<mml:math id="m33">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>2</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
<mml:mo>:</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x21dd;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. Since the roots have to be distinct, the only possibility is that <italic>j</italic>
<sub>
<italic>u</italic>
</sub> &#x3d; 1. But then the only forest, <italic>F</italic>, with these roots has just these vertices and no edges. Recalling the convention for what happens when there are no edges, we find that <italic>w</italic>(<italic>F</italic>) &#x3d; 1. It follows that Eq. <xref ref-type="disp-formula" rid="e7">7</xref> collapses to the simple conclusion that<disp-formula id="equ5">
<mml:math id="m34">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1,2</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>!</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mi>a</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
</disp-formula>In particular, the mean FPT is 1/<italic>a</italic> and the variance, which is <inline-formula id="inf23">
<mml:math id="m35">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1,2</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1,2</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
</mml:math>
</inline-formula>, is 1/<italic>a</italic>
<sup>2</sup>. Only the rate <italic>a</italic> is relevant, as we would expect, since the rate <italic>b</italic> is the label on an edge that leaves the target vertex. Because this example is so simple, the moments of the FPT distribution can be readily calculated without the paraphernalia of Eq. <xref ref-type="disp-formula" rid="e7">7</xref>. The case of a longer pipeline of vertices is more demanding, as we will see below (<xref ref-type="fig" rid="F5">Figure 5</xref>).</p>
<p>Eq. <xref ref-type="disp-formula" rid="e7">7</xref> gives a general and systematic method to calculate FPTs from the linear framework graph associated with a Markov process. It can be used to calculate exact formulas in simple graphs and to avoid estimating FPT moments by cumbersome numerical simulations of the Markov process. The combinatorics rapidly become formidable as the graph becomes larger or less symmetric, as is perhaps already evident in <xref ref-type="fig" rid="F2">Figure 2B</xref> and <xref ref-type="fig" rid="F3">Figure 3B</xref>. The broader value of Eq. <xref ref-type="disp-formula" rid="e7">7</xref> is that it reveals the mathematical structure of the FPT moments as manifestly positive rational functions of the edge labels. This can often be informative in its own right, as we will see in discussing enzyme kinetics below. We will say more about ways of dealing with the combinatorial complexity in the Discussion.</p>
</sec>
<sec id="s2-3">
<title>2.3 Splitting probabilities and conditional FPTs</title>
<p>In the previous section, we considered the FPT distribution from a given vertex <italic>i</italic> to a single target vertex. It is, however, often the case that there are several target vertices and one wants to know the probability of reaching a particular target vertex or the FPT to that vertex conditioned on the Markov process actually reaching it. (If target vertices lie in different SCCs that are not related in the partial order, then a trajectory that reaches one target can never reach any other target, so that the mean FPT to each target becomes infinite. Conditioning on reaching the target is therefore essential.) Let us suppose, therefore, that <italic>G</italic> is a graph with one or more terminal SCCs, each of which consists of a single vertex. Let <inline-formula id="inf24">
<mml:math id="m36">
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>&#x2282;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> be the subset consisting of these terminal vertices. Given <italic>i</italic> &#x2208; {1, <italic>&#x2026;</italic>, <italic>N</italic>} and <inline-formula id="inf25">
<mml:math id="m37">
<mml:mi>q</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula>, define the <italic>splitting probability from</italic> <italic>i</italic> <italic>to</italic> <italic>q</italic>, denoted <italic>&#x3c0;</italic>
<sub>
<italic>i</italic>,<italic>q</italic>
</sub>(<italic>G</italic>), to be the probability that the underlying Markov process, when started from <italic>i</italic>, eventually reaches <italic>q</italic>, as opposed to any other terminal vertex. Then we have (<xref ref-type="bibr" rid="B45">Nam and Gunawardena, 2023</xref>),<disp-formula id="e8">
<mml:math id="m38">
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c0;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>:</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(8)</label>
</disp-formula>The denominator in Eq. <xref ref-type="disp-formula" rid="e8">8</xref> runs over all spanning forests of <italic>G</italic> rooted at <inline-formula id="inf26">
<mml:math id="m39">
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula>, and the numerator runs over the subset of those spanning forests in which there is a directed path of edges from <italic>i</italic> to the root <italic>q</italic>. Accordingly, the right-hand side of Eq. <xref ref-type="disp-formula" rid="e8">8</xref> must lie between 0 and 1, as expected for a probability. If <inline-formula id="inf27">
<mml:math id="m40">
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula> and <italic>i</italic> &#x2260; <italic>q</italic>, then there is no directed path from <italic>i</italic> to <italic>q</italic> and so Eq. <xref ref-type="disp-formula" rid="e8">8</xref> gives 0, while if <italic>i</italic> &#x3d; <italic>q</italic>, then every spanning forest has a (trivial) path of directed edges from <italic>i</italic> to <italic>q</italic> and so Eq. <xref ref-type="disp-formula" rid="e8">8</xref> gives 1. If <italic>G</italic> contains only one terminal vertex, then every spanning forest of <italic>G</italic> rooted at <inline-formula id="inf28">
<mml:math id="m41">
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> has a path of directed edges from <italic>i</italic> to <italic>q</italic>, and so Eq. <xref ref-type="disp-formula" rid="e8">8</xref> again gives 1. <xref ref-type="fig" rid="F4">Figure 4</xref> illustrates the calculation of the splitting probability from <italic>i</italic> &#x3d; 1 to <italic>q</italic> &#x3d; 5 on a six-vertex graph with two terminal vertices, 5 and 6.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Splitting probabilities. <bold>(A)</bold> An example graph, <italic>G</italic>, on six vertices, <inline-formula id="inf29">
<mml:math id="m42">
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mn>6</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:math>
</inline-formula>, with three SCCs. The partial order is given by {1, 2, 3, 4}&#x2aaf;{5} and {1, 2, 3, 4}&#x2aaf;{6}, with {5} and {6} being the two terminal SCCs. <bold>(B)</bold> The 18 spanning forests of <italic>G</italic> rooted at vertices 5 and 6 (red font), with those containing a path from 1 to 5 in the green box and those containing a path from 1 to 6 in the purple box. Each spanning forest is shown with its corresponding product of edge labels. The sum of all 18 edge label products is equal to the denominator of <italic>&#x3c0;</italic>
<sub>1,5</sub>(<italic>G</italic>) in Eq. <xref ref-type="disp-formula" rid="e8">8</xref>; the sum of the six edge label products in the green box is equal to the numerator of <italic>&#x3c0;</italic>
<sub>1,5</sub>(<italic>G</italic>) in Eq. <xref ref-type="disp-formula" rid="e8">8</xref>.</p>
</caption>
<graphic xlink:href="fcell-11-1233808-g004.tif"/>
</fig>
<p>Let us turn now to the conditional FPT for reaching a particular target vertex, <inline-formula id="inf30">
<mml:math id="m43">
<mml:mi>q</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula>, from the vertex <inline-formula id="inf31">
<mml:math id="m44">
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">I</mml:mi>
</mml:math>
</inline-formula>, where, as before, <inline-formula id="inf32">
<mml:math id="m45">
<mml:mi mathvariant="script">I</mml:mi>
</mml:math>
</inline-formula> is the subset of non-terminal vertices, <inline-formula id="inf33">
<mml:math id="m46">
<mml:mi mathvariant="script">I</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x2026;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
<mml:mo>&#x5c;</mml:mo>
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula>. For the mean conditional FPT from <inline-formula id="inf34">
<mml:math id="m47">
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">I</mml:mi>
</mml:math>
</inline-formula> to <inline-formula id="inf35">
<mml:math id="m48">
<mml:mi>q</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula>, denoted by <inline-formula id="inf36">
<mml:math id="m49">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c7;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, we find that (<xref ref-type="bibr" rid="B45">Nam and Gunawardena, 2023</xref>),<disp-formula id="e9">
<mml:math id="m50">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c7;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">I</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>&#x222a;</mml:mo>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>:</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>:</mml:mo>
<mml:mi>j</mml:mi>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>:</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(9)</label>
</disp-formula>If there is only one terminal vertex, so that <inline-formula id="inf37">
<mml:math id="m51">
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, then the mean conditional FPT, <inline-formula id="inf38">
<mml:math id="m52">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c7;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, as given by Eq. <xref ref-type="disp-formula" rid="e9">9</xref>, is equal to the mean FPT, <inline-formula id="inf39">
<mml:math id="m53">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, as given by Eq. <xref ref-type="disp-formula" rid="e6">6</xref>. Formulas for the higher moments of the conditional FPT can be obtained in a similar way.</p>
<p>Evidently, the unconditional mean FPT to reach any terminal vertex in <inline-formula id="inf40">
<mml:math id="m54">
<mml:mi mathvariant="script">T</mml:mi>
</mml:math>
</inline-formula> from <italic>i</italic>, denoted <inline-formula id="inf41">
<mml:math id="m55">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c8;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, is now given by,<disp-formula id="equ6">
<mml:math id="m56">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c8;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>p</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">T</mml:mi>
</mml:mrow>
</mml:munder>
</mml:mstyle>
<mml:msub>
<mml:mrow>
<mml:mi>&#x3c0;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>p</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mspace width="0.17em"/>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c7;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>.</mml:mo>
</mml:math>
</disp-formula>Combining Eqs. <xref ref-type="disp-formula" rid="e8">8</xref>, <xref ref-type="disp-formula" rid="e9">9</xref>, we can show that this mean FPT can also be expressed in terms of the spanning forests of <italic>G</italic>, as<disp-formula id="e10">
<mml:math id="m57">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c8;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="script">I</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
<mml:mo>&#x222a;</mml:mo>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>:</mml:mo>
<mml:mi>i</mml:mi>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi mathvariant="script">T</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>,</mml:mo>
</mml:math>
<label>(10)</label>
</disp-formula>which specialises to Eq. <xref ref-type="disp-formula" rid="e6">6</xref> when there is only a single terminal vertex.</p>
<p>Splitting probabilities and conditional FPTs have not been as widely used as have the unconditional FPTs described in the previous section. This reflects the relatively simple models that have been formulated so far in the literature. However, as we have shown here, there is no greater difficulty in dealing with these more complex quantities, at least within the graph-theoretic approach that we have outlined here. All the quantities we have considered are manifestly positive rational functions of the edge labels. This mathematical accessibility should allow deeper analysis of transient stochastic properties.</p>
</sec>
<sec id="s2-4">
<title>2.4 Single-molecule enzyme kinetics</title>
<p>Single-molecule experimental methods have given unprecedented access to the stochastic kinetics of individual enzymes and have stimulated the development of theoretical models to account for the resulting data. This literature offers a convenient setting to illustrate the ideas introduced above.</p>
<p>A frequently used model in enzyme kinetics corresponds to a <italic>pipeline</italic> graph (<xref ref-type="fig" rid="F5">Figure 5</xref>) (<xref ref-type="bibr" rid="B19">Fisher and Kolomeisky, 1999</xref>; <xref ref-type="bibr" rid="B33">Kou et al., 2005</xref>; <xref ref-type="bibr" rid="B32">Kolomeisky and Fisher, 2007</xref>; <xref ref-type="bibr" rid="B10">Chemla et al., 2008</xref>; <xref ref-type="bibr" rid="B21">Garai et al., 2009</xref>; <xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>; <xref ref-type="bibr" rid="B43">Moffitt and Bustamante, 2014</xref>). Such a graph consists of vertices 1, <italic>&#x2026;</italic>, <italic>N</italic>, representing different conformations of the enzyme, with nearest-neighbour transitions, <italic>i</italic> &#x2192; <italic>i</italic> &#x2b; 1 or <italic>i</italic> &#x2192; <italic>i</italic> &#x2212; 1. Substrate may bind at any forward transition, <italic>i</italic> &#x2192; <italic>i</italic> &#x2b; 1, so that <italic>&#x2113;</italic>(<italic>i</italic> &#x2192; <italic>i</italic> &#x2b; 1) incurs a concentration term that we will denote by <italic>x</italic>, and binding is assumed to be reversible, so that <italic>i</italic> &#x2b; 1 &#x2192; <italic>i</italic>. The final transition, <italic>N</italic> &#x2212; 1 &#x2192; <italic>N</italic>, is usually treated as an irreversible catalytic step, with the enzyme returning to its initial conformation, so that vertex <italic>N</italic> corresponds to vertex 1 in the next enzymatic cycle. A pipeline may be thought of as partitioned into reversible &#x201c;blocks&#x201d; that are separated by sequences of irreversible transitions. <xref ref-type="fig" rid="F5">Figures 5A, C</xref> show pipeline graphs with 1 and 3 reversible blocks, respectively.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Pipeline graphs. <bold>(A)</bold> A pipeline graph on 8 vertices that consists of a single reversible block, with substrate binding with concentration <italic>x</italic> at the edges 2 &#x2192; 3 and 4 &#x2192; 5, followed by a single irreversible transition, 7 &#x2192; 8. <bold>(B)</bold> The spanning forest <italic>F</italic>(2, 6, 8), in the notation described in the text, for the graph in panel <bold>A</bold>. The two roots, 2 and 8, are in red font. <bold>(C)</bold> A pipeline graph with three reversible blocks, in each of which the substrate binds once. As explained in the text, the mean FPT, <inline-formula id="inf42">
<mml:math id="m58">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1,8</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, has a reciprocal Michaelis&#x2013;Menten dependence on the substrate concentration, <italic>x</italic>, as in Eq. <xref ref-type="disp-formula" rid="e15">15</xref>.</p>
</caption>
<graphic xlink:href="fcell-11-1233808-g005.tif"/>
</fig>
<p>The mean FPT for reaching vertex <italic>N</italic> from vertex 1 is a measure of the enzyme&#x2019;s completion time. Bustamante and colleagues have emphasised how the substrate dependence of <inline-formula id="inf43">
<mml:math id="m59">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf44">
<mml:math id="m60">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> contains information about the enzyme mechanism, and they have built on previous studies (<xref ref-type="bibr" rid="B16">Derrida, 1983</xref>) to analyse this theoretically (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>). This amounts to studying <inline-formula id="inf45">
<mml:math id="m61">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf46">
<mml:math id="m62">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> as functions of <italic>x</italic>, which falls directly into the scope of the results described above. We will show how the graph-theoretic methods introduced here provide a straightforward way to recover some of these previous findings. We do not intend to be exhaustive and there is much more of interest in the cited references. We hope, rather, to show the advantages of the graph-theoretic approach over the variety of approaches used previously, such as recursive solution of the master equation (<xref ref-type="bibr" rid="B16">Derrida, 1983</xref>) or Fourier transformation and determinants (<xref ref-type="bibr" rid="B10">Chemla et al., 2008</xref>).</p>
<p>Consider first a pipeline graph, <italic>G</italic>, with a single reversible block consisting of the vertices 1, <italic>&#x2026;</italic>, <italic>N</italic> &#x2212; 1 and recall Eq. <xref ref-type="disp-formula" rid="e6">6</xref> for the mean FPT, where the terminal vertex is <italic>q</italic> &#x3d; <italic>N</italic>. An example is shown in <xref ref-type="fig" rid="F5">Figure 5A</xref> with the notation that we will use for the edge labels, <italic>&#x2113;</italic>(<italic>i</italic> &#x2192; <italic>i</italic> &#x2b; 1) &#x3d; <italic>p</italic>
<sub>
<italic>i</italic>
</sub> and <italic>&#x2113;</italic>(<italic>i</italic> &#x2b; 1 &#x2192; <italic>i</italic>) &#x3d; <italic>q</italic>
<sub>
<italic>i</italic>
</sub>. It is evident that there is only a single spanning tree, <italic>T</italic> &#x2208; &#x3a6;<sub>{<italic>N</italic>}</sub>(<italic>G</italic>), consisting of all the forward edges, so that <italic>w</italic>(<italic>T</italic>) &#x3d; <italic>p</italic>
<sub>1</sub>&#x22ef;<italic>p</italic>
<sub>
<italic>N</italic>&#x2212;1</sub>. This gives the denominator of <inline-formula id="inf47">
<mml:math id="m63">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. As for the doubly-rooted spanning forests of &#x3a6;<sub>{<italic>j</italic>,<italic>N</italic>}</sub>(<italic>G</italic>) in the numerator, they can be indexed as <italic>F</italic>(<italic>j</italic>, <italic>k</italic>, <italic>N</italic>), where <italic>j</italic> &#x3c; <italic>k</italic> &#x2264; <italic>N</italic> and <italic>k</italic> is the vertex with the smallest index that has a directed path to the root <italic>N</italic> (<xref ref-type="fig" rid="F5">Figure 5B</xref>). Furthermore, each such forest has a directed path from 1 to the root <italic>j</italic>, so that &#x3a6;<sub>{<italic>j</italic>,<italic>N</italic>}:1&#x21dd;<italic>j</italic>
</sub>(<italic>G</italic>) &#x3d; &#x3a6;<sub>{<italic>j</italic>,<italic>N</italic>}</sub>(<italic>G</italic>). We see from the labels in <xref ref-type="fig" rid="F5">Figure 5B</xref> that<disp-formula id="e11">
<mml:math id="m64">
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x22ef;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x22ef;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x22ef;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
</mml:math>
<label>(11)</label>
</disp-formula>where the &#x201c;missing&#x201d; label, between vertices <italic>k</italic> &#x2212; 1 and <italic>k</italic>, corresponds to the gap between the tree rooted at <italic>j</italic> and the tree rooted at <italic>N</italic> in the forest. If we divide by the denominator, we see that each spanning forest <italic>F</italic>(<italic>j</italic>, <italic>k</italic>, <italic>N</italic>) contributes a rational function of the labels that we may write in the form,<disp-formula id="equ7">
<mml:math id="m65">
<mml:mfrac>
<mml:mrow>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>T</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mrow>
<mml:mo>&#x220f;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:munderover>
</mml:mstyle>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
</disp-formula>The spanning forests in &#x3a6;<sub>{<italic>j</italic>,<italic>N</italic>}</sub>(<italic>G</italic>) therefore contribute the sum,<disp-formula id="equ8">
<mml:math id="m66">
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mo movablelimits="false" form="prefix">&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="{" close="}">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>:</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x21dd;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msub>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>F</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mi>w</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>T</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>,</mml:mo>
</mml:math>
</disp-formula>where,<disp-formula id="e12">
<mml:math id="m67">
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>j</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:munderover>
</mml:mstyle>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mrow>
<mml:mo>&#x220f;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:munderover>
</mml:mstyle>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:mfenced>
<mml:mo>.</mml:mo>
</mml:math>
<label>(12)</label>
</disp-formula>Note that, in Eq. <xref ref-type="disp-formula" rid="e12">12</xref>, the empty product for <italic>k</italic> &#x3d; <italic>j</italic> &#x2b; 1 is by convention taken to be 1. It follows from Eq. <xref ref-type="disp-formula" rid="e6">6</xref> that the enzyme completion time is given by,<disp-formula id="e13">
<mml:math id="m68">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mrow>
<mml:mo>&#x2211;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:munderover>
</mml:mstyle>
<mml:mfrac>
<mml:mrow>
<mml:mi mathvariant="normal">&#x394;</mml:mi>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>p</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(13)</label>
</disp-formula>With some notational translation, Eq. <xref ref-type="disp-formula" rid="e13">13</xref> can be seen to be the same as (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>, Eq. S2). The quantity &#x394;(<italic>j</italic>, <italic>N</italic>) in Eq. <xref ref-type="disp-formula" rid="e12">12</xref> first appears in Derrida&#x2019;s derivation of the velocity and diffusion constant of a Markov particle on a periodic pipeline (<xref ref-type="bibr" rid="B16">Derrida, 1983</xref>, Eq. 24); &#x394;(<italic>j</italic>, <italic>N</italic>) &#x3d; &#x393;(<italic>j</italic> &#x2b; 1, <italic>N</italic> &#x2212; 1), where &#x393; is the quantity defined in Eq. S3 of <xref ref-type="bibr" rid="B44">Moffitt et al. (2010)</xref>. The calculation above, using the general formula for the mean FPT in Eq. <xref ref-type="disp-formula" rid="e6">6</xref>, is hopefully more transparent.</p>
<p>Suppose now that substrate binds at <italic>s</italic> forward transitions in the pipeline graph, with concentration <italic>x</italic>. We will refer to terms other than <italic>x</italic> in the edge labels as &#x201c;kinetic parameters,&#x201d; which thereby include both simple rates and on-rates. Since we can exclude the final catalytic transition from substrate binding, it follows that 1 &#x2264; <italic>s</italic> &#x2264; <italic>N</italic> &#x2212; 2. Eq. <xref ref-type="disp-formula" rid="e11">11</xref> then shows that the enzyme completion time has the following structure as a rational algebraic function of <italic>x</italic>,<disp-formula id="e14">
<mml:math id="m69">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>a</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>a</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mi>x</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>a</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msup>
<mml:mrow>
<mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:msup>
</mml:mrow>
<mml:mrow>
<mml:mi>b</mml:mi>
<mml:msup>
<mml:mrow>
<mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(14)</label>
</disp-formula>Here, the coefficients <italic>a</italic>
<sub>0</sub>, <italic>&#x2026;</italic>, <italic>a</italic>
<sub>
<italic>s</italic>
</sub> and <italic>b</italic> are all manifestly positive polynomials in the kinetic parameters. In particular, the forest <italic>F</italic>(<italic>N</italic> &#x2212; 1, <italic>N</italic>, <italic>N</italic>) includes all the substrate-binding transitions, which confirms that <italic>a</italic>
<sub>
<italic>s</italic>
</sub> &#x3e; 0. If the substrate-binding transitions are specified, these polynomials may be explicitly calculated using Eq. <xref ref-type="disp-formula" rid="e11">11</xref>. Eq. <xref ref-type="disp-formula" rid="e14">14</xref> already provides some insight. In the limit of low substrate, the completion time diverges at an order, 1/<italic>x</italic>
<sup>
<italic>s</italic>
</sup>, that depends on the number of substrate-binding transitions. In contrast, in the limit of high substrate, the completion time asymptotes to the positive value <italic>a</italic>
<sub>
<italic>s</italic>
</sub>/<italic>b</italic>. If substrate binds at only one transition in the pipeline, so that <italic>s</italic> &#x3d; 1, then the completion time exhibits a reciprocal Michaelis&#x2013;Menten form (<xref ref-type="bibr" rid="B33">Kou et al., 2005</xref>; <xref ref-type="bibr" rid="B21">Garai et al., 2009</xref>; <xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>; <xref ref-type="bibr" rid="B43">Moffitt and Bustamante, 2014</xref>) (Discussion),<disp-formula id="e15">
<mml:math id="m70">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>a</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>0</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>a</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mi>x</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>b</mml:mi>
<mml:mi>x</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>.</mml:mo>
</mml:math>
<label>(15)</label>
</disp-formula>
</p>
<p>The higher moments of the FPT, as specified by Eq. <xref ref-type="disp-formula" rid="e7">7</xref>, are more complicated to calculate but the doubly-rooted spanning forests that are needed for the numerator, which are contained in <inline-formula id="inf48">
<mml:math id="m71">
<mml:msub>
<mml:mrow>
<mml:mi mathvariant="normal">&#x3a6;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">{</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">}</mml:mo>
</mml:mrow>
<mml:mo>:</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x21dd;</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>j</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>u</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, have already been enumerated by the forests <italic>F</italic>(<italic>j</italic>, <italic>k</italic>, <italic>N</italic>) introduced above (<xref ref-type="fig" rid="F5">Figure 5B</xref>). It seems reasonable to conclude from Eq. <xref ref-type="disp-formula" rid="e7">7</xref> that <inline-formula id="inf49">
<mml:math id="m72">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> has a similar rational algebraic structure as shown in Eq. <xref ref-type="disp-formula" rid="e14">14</xref> but with a degree of <italic>ks</italic> for both the numerator and the denominator. In particular, if substrate binds at only one transition, so that <italic>s</italic> &#x3d; 1, the second moment of the FPT is a quadratic rational function (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>).</p>
<p>In their study of the packaging motor for the <italic>&#x3c6;</italic>29 bacteriophage, Bustamante and colleagues consider a more general pipeline graph, <italic>G</italic>, that consists of multiple reversible blocks separated by single irreversible transitions (<xref ref-type="fig" rid="F5">Figure 5C</xref>) (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>). The packaging motor is a pentameric ring of identical ATPase units that compacts the <italic>&#x3c6;</italic>29 double-stranded DNA into the assembling viral capsid. It has been found to do this in a burst of four ATP-consuming steps per cycle. ATP hydrolysis during the catalytic step is typically irreversible under physiological conditions and a pipeline with 4 reversible blocks serves as a model for the motor (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>, <xref ref-type="fig" rid="F4">Figure 4A</xref>).</p>
<p>If the Markov process takes an irreversible transition in <italic>G</italic>, it cannot subsequently visit the preceding reversible blocks. Also, every irreversible transition must be taken to reach <italic>N</italic>. Hence, any trajectory that begins at 1 and reaches <italic>N</italic> must take each irreversible transition exactly once. It follows from this that the FPT from 1 to <italic>N</italic> is just the sum of the FPTs for each reversible block considered separately and these FPTs are all independent of each other. Suppose there are <italic>m</italic> reversible blocks which start at the vertices <italic>e</italic>
<sub>0</sub>, <italic>e</italic>
<sub>1</sub>, &#x2026;, <italic>e</italic>
<sub>
<italic>m</italic>&#x2212;1</sub>, where 1 &#x3d; <italic>e</italic>
<sub>0</sub> &#x3c; <italic>e</italic>
<sub>1</sub> &#x3c; <italic>e</italic>
<sub>2</sub> &#x3c; &#x22ef; &#x3c; <italic>e</italic>
<sub>
<italic>m</italic>&#x2212;1</sub> &#x3c; <italic>N</italic>. Let <italic>G</italic>
<sub>
<italic>i</italic>
</sub> be the subgraph consisting of the vertices from <italic>e</italic>
<sub>
<italic>i</italic>&#x2212;1</sub> to <italic>e</italic>
<sub>
<italic>i</italic>
</sub>, which includes the <italic>i</italic>th reversible block and the immediately following irreversible transition. It follows that,<disp-formula id="e16">
<mml:math id="m73">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x3d;</mml:mo>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2b;</mml:mo>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2b;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#x2b;</mml:mo>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>m</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>m</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfenced>
<mml:mo>.</mml:mo>
</mml:math>
<label>(16)</label>
</disp-formula>
</p>
<p>If substrate binds at the same number of transitions in each reversible block, then Eq. <xref ref-type="disp-formula" rid="e7">7</xref> shows that the <inline-formula id="inf50">
<mml:math id="m74">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mrow>
<mml:mi>e</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> all have the same rational algebraic structure with the same degrees in both the numerator and the denominator. It follows from Eq. <xref ref-type="disp-formula" rid="e16">16</xref> that <inline-formula id="inf51">
<mml:math id="m75">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> must also have this same rational algebraic structure. For the case of the <italic>&#x3c6;</italic>29 packaging motor, ATP binds at only one transition in each reversible block, so the completion time has the reciprocal Michaelis&#x2013;Menten form of Eq. <xref ref-type="disp-formula" rid="e15">15</xref> and the resulting curve may be fitted to the experimental data (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>, <xref ref-type="fig" rid="F3">Figure 3A</xref>). Bustamante and colleagues make use of the reciprocal of the coefficient of variation,<disp-formula id="equ9">
<mml:math id="m76">
<mml:msub>
<mml:mrow>
<mml:mi>n</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mtext>min</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
</mml:mrow>
<mml:mrow>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
<mml:mo>&#x2212;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:msubsup>
<mml:mfenced open="(" close=")">
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
</mml:mfenced>
</mml:mrow>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:mo>,</mml:mo>
</mml:math>
</disp-formula>which is readily seen from the discussion above to be a quadratic rational function of <italic>x</italic>, and they also fit this curve to the experimental data (<xref ref-type="bibr" rid="B44">Moffitt et al., 2010</xref>, <xref ref-type="fig" rid="F3">Figure 3B</xref>). A theorem due to <xref ref-type="bibr" rid="B1">Aldous and Shepp (1987)</xref>, which is of independent interest, tells us that, for an arbitrary graph with <italic>N</italic> vertices, <italic>n</italic>
<sub>min</sub> &#x3c; <italic>N</italic>.</p>
<p>An interesting question arises as to whether <italic>n</italic>
<sub>min</sub> itself is also manifestly positive, as might be expected of a coefficient of variation, given that this is true for both <inline-formula id="inf52">
<mml:math id="m77">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf53">
<mml:math id="m78">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>2</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>. A further point made by <xref ref-type="bibr" rid="B44">Moffitt et al. (2010)</xref> is that the quadratic structure of <italic>n</italic>
<sub>min</sub> may not be limited to pipeline graphs but may be true also for some graphs with branches and parallel pathways. If so, the graph-theoretic methods described here offer a way to generalise their findings.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s3">
<title>3 Discussion</title>
<p>We have reviewed here how the graph-theoretic linear framework, as applied to continuous-time Markov processes, can be used to show that the moments of the FPT distribution (Eqs. <xref ref-type="disp-formula" rid="e6">6</xref>, <xref ref-type="disp-formula" rid="e7">7</xref>), splitting probabilities (Eq. <xref ref-type="disp-formula" rid="e8">8</xref>) and conditional mean FPTs (Eq. <xref ref-type="disp-formula" rid="e9">9</xref>) can be exactly expressed as manifestly positive rational algebraic functions of the edge labels or transition rates. This reveals that not only steady-state probabilities but also transient properties of Markov processes have this same algebraic structure, thereby substantially expanding the mathematical scope of the linear framework.</p>
<p>The formulas given here can be used to obtain closed-form solutions for simple graphs, as we showed for the pipeline graphs used in enzyme kinetics (Eq. <xref ref-type="disp-formula" rid="e13">13</xref>). However, this is a little misleading because enumeration of spanning forests becomes rapidly intractable as the graph becomes larger or less symmetric. Moreover, as is evident by examining the algebraic terms in <xref ref-type="fig" rid="F2">Figure 2B</xref> and <xref ref-type="fig" rid="F3">Figure 3B</xref>, every label in the graph can appear in the formulas. There is both a combinatorial explosion and a global parametric dependence. These challenges have long been recognised when dealing with steady-state probabilities (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>), before the transient regime became mathematically accessible, and several strategies have emerged for dealing with them.</p>
<p>First, when properties of interest are treated as functions of substrate concentration, a great deal can be said about the resulting rational algebraic structure, even when it is hard to calculate the coefficients explicitly in terms of the edge labels (<xref ref-type="bibr" rid="B54">Thomson and Gunawardena, 2009</xref>; <xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>). As we saw with Eq. <xref ref-type="disp-formula" rid="e14">14</xref>, the algebraic structure for the mean FPT, <inline-formula id="inf54">
<mml:math id="m79">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, is highly informative, especially with respect to the limits of low or high concentration, which may also be experimentally accessible. The Michaelis&#x2013;Menten structure, or its reciprocal in Eq. <xref ref-type="disp-formula" rid="e15">15</xref>, arises in a remarkably wide range of biological contexts that are far removed from the 3-vertex pipeline graph considered, in effect, by Michaelis and Menten (<xref ref-type="bibr" rid="B40">Michaelis and Menten, 1913</xref>). The linear framework allows general theorems to be proved, which characterise many of the contexts in which the Michaelis&#x2013;Menten structure does appear (<xref ref-type="bibr" rid="B59">Wong et al., 2018</xref>). In this respect, the context discussed above, of a pipeline graph with multiple reversible blocks, in which substrate binds once in each block, falls outside the scope of the theorems in <xref ref-type="bibr" rid="B59">Wong et al. (2018)</xref>. As suggested by <xref ref-type="bibr" rid="B44">Moffitt et al. (2010)</xref>, it seems plausible that the Michaelis&#x2013;Menten structure may also arise for more complicated graphs and an interesting problem arises in characterising this new context.</p>
<p>Second, the question of when the Michaelis&#x2013;Menten structure arises is closely related to whether or not the graph satisfies the cycle condition and can thereby reach a steady state of thermodynamic equilibrium. If it can, there is a necessary and sufficient condition for the emergence of the Michaelis&#x2013;Menten structure; if it cannot, and the graph reaches a non-equilibrium steady state, then only partial sufficient conditions are known (<xref ref-type="bibr" rid="B59">Wong et al., 2018</xref>). Of course, the pipeline example just mentioned cannot reach thermodynamic equilibrium, as it contains irreversible transitions (<xref ref-type="fig" rid="F5">Figure 5A</xref>). If the cycle condition is satisfied, the complexity problem is substantially reduced, insofar as calculating steady-state probabilities is concerned. It is possible to find an alternative basis element to <italic>&#x3c1;</italic>(<italic>G</italic>) in <inline-formula id="inf55">
<mml:math id="m80">
<mml:mi>ker</mml:mi>
<mml:mi mathvariant="script">L</mml:mi>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula> (Eq. <xref ref-type="disp-formula" rid="e5">5</xref>), which is based on paths rather than spanning trees, for which the combinatorial explosion disappears and the parametric dependence becomes local, not global (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>). It is a very interesting question as to whether transient quantities like FPTs show any similar reduction in complexity for graphs that satisfy the cycle condition.</p>
<p>Aside from the calculational complexity, the thermodynamic issues also have a deep impact on biological function. The role of energy expenditure in force generation or pattern formation has been widely studied (<xref ref-type="bibr" rid="B32">Kolomeisky and Fisher, 2007</xref>; <xref ref-type="bibr" rid="B29">Karsenti, 2008</xref>) but its significance for cellular information processing has been more elusive (<xref ref-type="bibr" rid="B58">Wong and Gunawardena, 2020</xref>). In the latter domain, unlike the two former ones, information processing can take place at thermodynamic equilibrium, for instance, through binding and unbinding. However, there is a limit to how well this can be done, as first pointed out by <xref ref-type="bibr" rid="B26">Hopfield (1974)</xref>. We have introduced the concept of the <italic>Hopfield barrier</italic>, as the limit to how well a given information processing task can be undertaken by a mechanism that operates at thermodynamic equilibrium (<xref ref-type="bibr" rid="B18">Estrada et al., 2016</xref>). For example, the Hill function with Hill coefficient <italic>n</italic> is the universal Hopfield barrier for the sharpness of input-output responses with <italic>n</italic> binding sites for the input (<xref ref-type="bibr" rid="B47">Nam et al., 2022</xref>; <xref ref-type="bibr" rid="B39">Martinez-Corral et al., 2023</xref>). Another interesting question arises as to whether there are also Hopfield barriers in the transient regime. That is, if a graph satisfies the cycle condition and can reach a steady state of thermodynamic equilibrium, are there limits on the moments of the FPT distribution, <inline-formula id="inf56">
<mml:math id="m81">
<mml:msubsup>
<mml:mrow>
<mml:mi>&#x3c4;</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>q</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:msubsup>
<mml:mrow>
<mml:mo stretchy="false">(</mml:mo>
<mml:mrow>
<mml:mi>G</mml:mi>
</mml:mrow>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>, which can only be exceeded if energy is expended to break the cycle condition, allowing the system to reach a non-equilibrium steady state?</p>
<p>Third, the algebraic complexity of non-equilibrium steady states can be reorganised to make the complexity more tractable (<xref ref-type="bibr" rid="B8">&#xc7;etiner and Gunawardena, 2022</xref>). This breakthrough has enabled steady-state calculations to be undertaken that were previously out of reach. It is conceivable that similar kinds of reorganisation may also throw light on the calculation of transient quantities. Finally, a fourth potential approach to overcoming the complexity is to exploit the recursive technique for enumerating spanning forests that was developed by <xref ref-type="bibr" rid="B9">Chebotarev and Agaev (2002)</xref>. While this technique looks promising, it has yet to be properly exploited.</p>
<p>The methods outlined here bring the FPTs of Markov processes into focus as manifestly positive rational algebraic functions of the transition rates. This gives mathematical access to them in a way that has been lacking in previous treatments, which have not exploited graph theory and the Matrix-Tree theorems. We hope this review will encourage more use of the linear framework in cell and developmental biology. We anticipate that, as we have found for steady states, this exploration will lead to further general principles and mathematical theorems that rise above the molecular complexity that confronts us in biology.</p>
</sec>
</body>
<back>
<sec sec-type="data-availability" id="s4">
<title>Data availability statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s5">
<title>Author contributions</title>
<p>K-MN undertook most of the work described here in his Ph.D. thesis, which was supervised by JG. K-MN and JG wrote the paper together. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="s6">
<title>Funding</title>
<p>K-MN and JG were supported in part by NIH grant R01GM122928.</p>
</sec>
<ack>
<p>We thank Michael Blinov for the invitation to submit a paper to this research topic and for his encouragement and patience; two reviewers for their constructive suggestions; and members of the Gunawardena lab for their comments.</p>
</ack>
<sec sec-type="COI-statement" id="s7">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s8">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Aldous</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Shepp</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>1987</year>). <article-title>The least variable phase-type distribution is Erlang</article-title>. <source>Commun. Stat. Stoch. Models</source> <volume>3</volume>, <fpage>467</fpage>&#x2013;<lpage>473</lpage>. <pub-id pub-id-type="doi">10.1080/15326348708807067</pub-id>
</citation>
</ref>
<ref id="B2">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Banerjee</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Kolomeisky</surname>
<given-names>A. B.</given-names>
</name>
<name>
<surname>Igoshin</surname>
<given-names>O. A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Elucidating interplay of speed and accuracy in biological error correction</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>114</volume>, <fpage>5183</fpage>&#x2013;<lpage>5188</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1614838114</pub-id>
</citation>
</ref>
<ref id="B3">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Barbeau</surname>
<given-names>E. J.</given-names>
</name>
</person-group> (<year>1989</year>). <source>Polynomials</source>. <publisher-name>Springer-Verlag</publisher-name>.</citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Bel</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Munsky</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Nemenman</surname>
<given-names>I.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>The simplicity of completion time distributions for common complex biochemical processes</article-title>. <source>Phys. Biol.</source> <volume>7</volume>, <fpage>016003</fpage>. <pub-id pub-id-type="doi">10.1088/1478-3975/7/1/016003</pub-id>
</citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Biddle</surname>
<given-names>J. W.</given-names>
</name>
<name>
<surname>Nguyen</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Negative reciprocity, not ordered assembly, underlies the interaction of Sox2 and Oct4 on DNA</article-title>. <source>eLife</source> <volume>8</volume>, <fpage>e41017</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.41017</pub-id>
</citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Biddle</surname>
<given-names>J. W.</given-names>
</name>
<name>
<surname>Martinez-Corral</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Wong</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Allosteric conformational ensembles have unlimited capacity for integrating information</article-title>. <source>eLife</source> <volume>10</volume>, <fpage>e65498</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.65498</pub-id>
</citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cao</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2011</year>). <article-title>Michaelis&#x2013;Menten equation and detailed balance in enzymatic networks</article-title>. <source>J. Phys. Chem. B</source> <volume>115</volume>, <fpage>5493</fpage>&#x2013;<lpage>5498</lpage>. <pub-id pub-id-type="doi">10.1021/jp110924w</pub-id>
</citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>&#xc7;etiner</surname>
<given-names>U.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Reformulating non-equilibrium steady states and generalized hopfield discrimination</article-title>. <source>Phys. Rev. E</source> <volume>106</volume>, <fpage>064128</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.106.064128</pub-id>
</citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chebotarev</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Agaev</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2002</year>). <article-title>Forest matrices around the Laplacian matrix</article-title>. <source>Lin. Alg. Appl.</source> <volume>356</volume>, <fpage>253</fpage>&#x2013;<lpage>274</lpage>. <pub-id pub-id-type="doi">10.1016/s0024-3795(02)00388-9</pub-id>
</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chemla</surname>
<given-names>Y. R.</given-names>
</name>
<name>
<surname>Moffitt</surname>
<given-names>J. R.</given-names>
</name>
<name>
<surname>Bustamante</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Exact solutions for kinetic models of macromolecular dynamics</article-title>. <source>J. Chem. Phys. B</source> <volume>112</volume>, <fpage>6025</fpage>&#x2013;<lpage>6044</lpage>. <pub-id pub-id-type="doi">10.1021/jp076153r</pub-id>
</citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Levo</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Barinov</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Fujioka</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Jaynes</surname>
<given-names>J. B.</given-names>
</name>
<name>
<surname>Gregor</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Dynamic interplay between enhancer&#x2013;promoter topology and gene activity</article-title>. <source>Nat. Genet.</source> <volume>50</volume>, <fpage>1296</fpage>&#x2013;<lpage>1303</lpage>. <pub-id pub-id-type="doi">10.1038/s41588-018-0175-z</pub-id>
</citation>
</ref>
<ref id="B12">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Chung</surname>
<given-names>F. R. K.</given-names>
</name>
</person-group> (<year>1997</year>). <source>
<italic>Spectral graph theory</italic>. No. 92 in regional conference series in mathematics</source>. <publisher-loc>Providence, RI, USA</publisher-loc>: <publisher-name>American Mathematical Society</publisher-name>.</citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Co</surname>
<given-names>A. D.</given-names>
</name>
<name>
<surname>Lagomarsino</surname>
<given-names>M. C.</given-names>
</name>
<name>
<surname>Caselle</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Osella</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Stochastic timing in gene expression for simple regulatory strategies</article-title>. <source>Nucleic Acids Res.</source> <volume>45</volume>, <fpage>1069</fpage>&#x2013;<lpage>1078</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkw1235</pub-id>
</citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cui</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Mehta</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Identifying feasible operating regimes for early T-cell recognition: the speed, energy, accuracy trade-off in kinetic proofreading and adaptive sorting</article-title>. <source>PLOS ONE</source> <volume>13</volume>, <fpage>e0202331</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0202331</pub-id>
</citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dasgupta</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Croll</surname>
<given-names>D. H.</given-names>
</name>
<name>
<surname>Owen</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Vander Heiden</surname>
<given-names>M. G.</given-names>
</name>
<name>
<surname>Locasale</surname>
<given-names>J. W.</given-names>
</name>
<name>
<surname>Alon</surname>
<given-names>U.</given-names>
</name>
<etal/>
</person-group> (<year>2014</year>). <article-title>A fundamental trade-off in covalent switching and its circumvention by enzyme bifunctionality in glucose homeostasis</article-title>. <source>J. Biol. Chem.</source> <volume>289</volume>, <fpage>13010</fpage>&#x2013;<lpage>13025</lpage>. <pub-id pub-id-type="doi">10.1074/jbc.M113.546515</pub-id>
</citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Derrida</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>1983</year>). <article-title>Velocity and diffusion constant of a periodic one-dimensional hopping model</article-title>. <source>J. Stat. Phys.</source> <volume>31</volume>, <fpage>433</fpage>&#x2013;<lpage>450</lpage>. <pub-id pub-id-type="doi">10.1007/bf01019492</pub-id>
</citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Dufourt</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Trullo</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Hunter</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Fernandez</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Lazaro</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Dejean</surname>
<given-names>M.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Temporal control of gene expression by the pioneer factor Zelda through transient interactions in hubs</article-title>. <source>Nat. Commun.</source> <volume>9</volume>, <fpage>5194</fpage>. <pub-id pub-id-type="doi">10.1038/s41467-018-07613-z</pub-id>
</citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Estrada</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Wong</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>DePace</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Information integration and energy expenditure in gene regulation</article-title>. <source>Cell.</source> <volume>166</volume>, <fpage>234</fpage>&#x2013;<lpage>244</lpage>. <pub-id pub-id-type="doi">10.1016/j.cell.2016.06.012</pub-id>
</citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fisher</surname>
<given-names>M. E.</given-names>
</name>
<name>
<surname>Kolomeisky</surname>
<given-names>A. B.</given-names>
</name>
</person-group> (<year>1999</year>). <article-title>The force exerted by a molecular motor</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>96</volume>, <fpage>6597</fpage>&#x2013;<lpage>6602</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.96.12.6597</pub-id>
</citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Fukaya</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Lim</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Levine</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Enhancer control of transcriptional bursting</article-title>. <source>Cell.</source> <volume>166</volume>, <fpage>358</fpage>&#x2013;<lpage>368</lpage>. <pub-id pub-id-type="doi">10.1016/j.cell.2016.05.025</pub-id>
</citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Garai</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Chowdhury</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Chowdhury</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Ramakrishnan</surname>
<given-names>T. V.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Stochastic kinetics of ribosomes: single motor properties and collective behavior</article-title>. <source>Phys. Rev. E</source> <volume>80</volume>, <fpage>011908</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.80.011908</pub-id>
</citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ghusinga</surname>
<given-names>K. R.</given-names>
</name>
<name>
<surname>Dennehy</surname>
<given-names>J. J.</given-names>
</name>
<name>
<surname>Singh</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>First-passage time approach to controlling noise in the timing of intracellular events</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>114</volume>, <fpage>693</fpage>&#x2013;<lpage>698</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1609012114</pub-id>
</citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>A linear framework for time-scale separation in nonlinear biochemical systems</article-title>. <source>PLOS ONE</source> <volume>7</volume>, <fpage>e36321</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0036321</pub-id>
</citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Time-scale separation: Michaelis and Menten&#x2019;s old idea, still bearing fruit</article-title>. <source>FEBS J.</source> <volume>281</volume>, <fpage>473</fpage>&#x2013;<lpage>488</lpage>. <pub-id pub-id-type="doi">10.1111/febs.12532</pub-id>
</citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gupta</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Varennes</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Korswagen</surname>
<given-names>H. C.</given-names>
</name>
<name>
<surname>Mugler</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Temporal precision of regulated gene expression</article-title>. <source>PLOS Comput. Biol.</source> <volume>14</volume>, <fpage>e1006201</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1006201</pub-id>
</citation>
</ref>
<ref id="B53">
<citation citation-type="book">
<person-group person-group-type="editor">
<name>
<surname>Strang</surname>
<given-names>G.</given-names>
</name>
</person-group> (Editor) (<year>2022</year>). <source>Introduction to linear algebra</source>. <edition>6 edn</edition> (<publisher-loc>Wellesley, MA, USA</publisher-loc>: <publisher-name>Wellesley-Cambridge Press</publisher-name>).</citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hopfield</surname>
<given-names>J. J.</given-names>
</name>
</person-group> (<year>1974</year>). <article-title>Kinetic proofreading: a new mechanism for reducing errors in biosynthetic processes requiring high specificity</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>71</volume>, <fpage>4135</fpage>&#x2013;<lpage>4139</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.71.10.4135</pub-id>
</citation>
</ref>
<ref id="B27">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Iyer-Biswas</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Zilman</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>First-passage processes in cellular biology</article-title>,&#x201d; in <source>Advances in chemical physics</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Rice</surname>
<given-names>S. A.</given-names>
</name>
<name>
<surname>Dinner</surname>
<given-names>A. R.</given-names>
</name>
</person-group> (<publisher-name>John Wiley &#x26; Sons Inc.</publisher-name>), <fpage>261</fpage>&#x2013;<lpage>306</lpage>.</citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Jones</surname>
<given-names>D. L.</given-names>
</name>
<name>
<surname>Leroy</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Unoson</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Fange</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>&#x106;uri&#x107;</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Lawson</surname>
<given-names>M. J.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>Kinetics of dCas9 target search in <italic>Escherichia coli</italic>
</article-title>. <source>Science</source> <volume>357</volume>, <fpage>1420</fpage>&#x2013;<lpage>1424</lpage>. <pub-id pub-id-type="doi">10.1126/science.aah7084</pub-id>
</citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Karsenti</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Self-organization in cell biology: a brief history</article-title>. <source>Nat. Rev. Mol. Cell. Biol.</source> <volume>9</volume>, <fpage>255</fpage>&#x2013;<lpage>262</lpage>. <pub-id pub-id-type="doi">10.1038/nrm2357</pub-id>
</citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kirchhoff</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>1847</year>). <article-title>Ueber die Aufl&#xf6;sung der Gleichungen, auf welche man bei der Untersuchung der linearen Vertheilung galvanischer Str&#xf6;me gef&#xfc;hrt wind</article-title>. <source>Ann. Phys. Chem.</source> <volume>148</volume>, <fpage>497</fpage>&#x2013;<lpage>508</lpage>. <pub-id pub-id-type="doi">10.1002/andp.18471481202</pub-id>
</citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kleine Borgmann</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Ries</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Ewers</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Ulbrich</surname>
<given-names>M. H.</given-names>
</name>
<name>
<surname>Graumann</surname>
<given-names>P. L.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>The bacterial SMC complex displays two distinct modes of interaction with the chromosome</article-title>. <source>Cell. Rep.</source> <volume>3</volume>, <fpage>1483</fpage>&#x2013;<lpage>1492</lpage>. <pub-id pub-id-type="doi">10.1016/j.celrep.2013.04.005</pub-id>
</citation>
</ref>
<ref id="B32">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kolomeisky</surname>
<given-names>A. B.</given-names>
</name>
<name>
<surname>Fisher</surname>
<given-names>M. E.</given-names>
</name>
</person-group> (<year>2007</year>). <article-title>Molecular motors: a theorist&#x2019;s perspective</article-title>. <source>Annu. Rev. Phys. Chem.</source> <volume>58</volume>, <fpage>675</fpage>&#x2013;<lpage>695</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.physchem.58.032806.104532</pub-id>
</citation>
</ref>
<ref id="B33">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kou</surname>
<given-names>S. C.</given-names>
</name>
<name>
<surname>Cherayil</surname>
<given-names>B. J.</given-names>
</name>
<name>
<surname>Min</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>English</surname>
<given-names>B. P.</given-names>
</name>
<name>
<surname>Xie</surname>
<given-names>X. S.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Single-molecule Michaelis&#x2013;Menten equations</article-title>. <source>J. Phys. Chem. B</source> <volume>109</volume>, <fpage>19068</fpage>&#x2013;<lpage>19081</lpage>. <pub-id pub-id-type="doi">10.1021/jp051490q</pub-id>
</citation>
</ref>
<ref id="B34">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lammers</surname>
<given-names>N. C.</given-names>
</name>
<name>
<surname>Kim</surname>
<given-names>Y. J.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Garcia</surname>
<given-names>H. G.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>A matter of time: using dynamics and theory to uncover mechanisms of transcriptional bursting</article-title>. <source>Curr. Opin. Cell. Biol.</source> <volume>67</volume>, <fpage>147</fpage>&#x2013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1016/j.ceb.2020.08.001</pub-id>
</citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liao</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Schroeder</surname>
<given-names>J. W.</given-names>
</name>
<name>
<surname>Gao</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Simmons</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Biteen</surname>
<given-names>J. S.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Single-molecule motions and interactions in live cells reveal target search dynamics in mismatch repair</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>112</volume>, <fpage>E6898</fpage>&#x2013;<lpage>E6906</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1507386112</pub-id>
</citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Liu</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Jiang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Qu</surname>
<given-names>Y.</given-names>
</name>
<etal/>
</person-group> (<year>2015</year>). <article-title>Reliable cell cycle commitment in budding yeast is ensured by signal integration</article-title>. <source>eLife</source> <volume>4</volume>, <fpage>e03977</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.03977</pub-id>
</citation>
</ref>
<ref id="B37">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Loffreda</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Jacchetti</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Antunes</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Rainone</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Daniele</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Morisaki</surname>
<given-names>T.</given-names>
</name>
<etal/>
</person-group> (<year>2017</year>). <article-title>Live-cell p53 single-molecule binding is modulated by C-terminal acetylation and correlates with transcriptional activity</article-title>. <source>Nat. Commun.</source> <volume>8</volume>, <fpage>313</fpage>. <pub-id pub-id-type="doi">10.1038/s41467-017-00398-7</pub-id>
</citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mallory</surname>
<given-names>J. D.</given-names>
</name>
<name>
<surname>Kolomeisky</surname>
<given-names>A. B.</given-names>
</name>
<name>
<surname>Igoshin</surname>
<given-names>O. A.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Trade-offs between error, speed, noise, and energy dissipation in biological processes with proofreading</article-title>. <source>J. Phys. Chem. B</source> <volume>123</volume>, <fpage>4718</fpage>&#x2013;<lpage>4725</lpage>. <pub-id pub-id-type="doi">10.1021/acs.jpcb.9b03757</pub-id>
</citation>
</ref>
<ref id="B39">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Martinez-Corral</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Nam</surname>
<given-names>K.-M.</given-names>
</name>
<name>
<surname>DePace</surname>
<given-names>A. H.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2023</year>). <source>The Hill function is the universal Hopfield barrier for sharpness of input-output responses</source>. <comment>In preparation</comment>
</citation>
</ref>
<ref id="B40">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Michaelis</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Menten</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>1913</year>). <article-title>Die kinetik der Invertinwirkung</article-title>. <source>Biochem. Z</source> <volume>49</volume>, <fpage>333</fpage>&#x2013;<lpage>369</lpage>.</citation>
</ref>
<ref id="B41">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mir</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Stadler</surname>
<given-names>M. R.</given-names>
</name>
<name>
<surname>Ortiz</surname>
<given-names>S. A.</given-names>
</name>
<name>
<surname>Hannon</surname>
<given-names>C. E.</given-names>
</name>
<name>
<surname>Harrison</surname>
<given-names>M. M.</given-names>
</name>
<name>
<surname>Darzacq</surname>
<given-names>X.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Dynamic multifactor hubs interact transiently with sites of active transcription in <italic>Drosophila</italic> embryos</article-title>. <source>eLife</source> <volume>7</volume>, <fpage>e40497</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.40497</pub-id>
</citation>
</ref>
<ref id="B42">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mirzaev</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Laplacian dynamics on general graphs</article-title>. <source>Bull. Math. Biol.</source> <volume>75</volume>, <fpage>2118</fpage>&#x2013;<lpage>2149</lpage>. <pub-id pub-id-type="doi">10.1007/s11538-013-9884-8</pub-id>
</citation>
</ref>
<ref id="B43">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Moffitt</surname>
<given-names>J. R.</given-names>
</name>
<name>
<surname>Bustamante</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Extracting signal from noise: kinetic mechanisms from a Michaelis&#x2013;Menten-like expression for enzymatic fluctuations</article-title>. <source>FEBS J.</source> <volume>281</volume>, <fpage>498</fpage>&#x2013;<lpage>517</lpage>. <pub-id pub-id-type="doi">10.1111/febs.12545</pub-id>
</citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Moffitt</surname>
<given-names>J. R.</given-names>
</name>
<name>
<surname>Chemla</surname>
<given-names>Y. R.</given-names>
</name>
<name>
<surname>Bustamante</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Mechanistic constraints from the substrate concentration dependence of enzymatic fluctuations</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>107</volume>, <fpage>15739</fpage>&#x2013;<lpage>15744</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1006997107</pub-id>
</citation>
</ref>
<ref id="B45">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Nam</surname>
<given-names>K.-M.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2023</year>). <source>Algebraic formulas for first-passage times of Markov processes in the linear framework</source>. <comment>In preparation</comment>.</citation>
</ref>
<ref id="B46">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nam</surname>
<given-names>K.-M.</given-names>
</name>
<name>
<surname>Gyori</surname>
<given-names>B. M.</given-names>
</name>
<name>
<surname>Amethyst</surname>
<given-names>S. V.</given-names>
</name>
<name>
<surname>Bates</surname>
<given-names>D. J.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Robustness and parameter geography in post-translational modification systems</article-title>. <source>PLOS Comput. Biol.</source> <volume>16</volume>, <fpage>e1007573</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1007573</pub-id>
</citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nam</surname>
<given-names>K.-M.</given-names>
</name>
<name>
<surname>Martinez-Corral</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>The linear framework: using graph theory to reveal the algebra and thermodynamics of biomolecular systems</article-title>. <source>Interface Focus</source> <volume>12</volume>, <fpage>20220013</fpage>. <pub-id pub-id-type="doi">10.1098/rsfs.2022.0013</pub-id>
</citation>
</ref>
<ref id="B48">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Nam</surname>
<given-names>K.-M.</given-names>
</name>
</person-group> (<year>2021</year>). <source>Algebraic approaches to molecular information processing</source>. <comment>Ph.D. thesis</comment>. <publisher-name>Harvard University</publisher-name>.</citation>
</ref>
<ref id="B49">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nandan</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Das</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Lott</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Koseska</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2022</year>). <article-title>Cells use molecular working memory to navigate in changing chemoattractant fields</article-title>. <source>eLife</source> <volume>11</volume>, <fpage>e76825</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.76825</pub-id>
</citation>
</ref>
<ref id="B50">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Peccoud</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Ycart</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>1995</year>). <article-title>Markovian modeling of gene-product synthesis</article-title>. <source>Theor. Popul. Biol.</source> <volume>48</volume>, <fpage>222</fpage>&#x2013;<lpage>234</lpage>. <pub-id pub-id-type="doi">10.1006/tpbi.1995.1027</pub-id>
</citation>
</ref>
<ref id="B51">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Piggot</surname>
<given-names>P. J.</given-names>
</name>
<name>
<surname>Hilbert</surname>
<given-names>D. W.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Sporulation of Bacillus subtilis</article-title>. <source>Curr. Opin. Microbiol.</source> <volume>7</volume>, <fpage>579</fpage>&#x2013;<lpage>586</lpage>. <pub-id pub-id-type="doi">10.1016/j.mib.2004.10.001</pub-id>
</citation>
</ref>
<ref id="B52">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shaevitz</surname>
<given-names>J. W.</given-names>
</name>
<name>
<surname>Block</surname>
<given-names>S. M.</given-names>
</name>
<name>
<surname>Schnitzer</surname>
<given-names>M. J.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Statistical kinetics of macromolecular dynamics</article-title>. <source>Biophys. J.</source> <volume>89</volume>, <fpage>P2277</fpage>&#x2013;<lpage>P2285</lpage>. <pub-id pub-id-type="doi">10.1529/biophysj.105.064295</pub-id>
</citation>
</ref>
<ref id="B54">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Thomson</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>The rational parameterization theorem for multisite post-translational modification systems</article-title>. <source>J. Theor. Biol.</source> <volume>261</volume>, <fpage>626</fpage>&#x2013;<lpage>636</lpage>. <pub-id pub-id-type="doi">10.1016/j.jtbi.2009.09.003</pub-id>
</citation>
</ref>
<ref id="B55">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>van Kampen</surname>
<given-names>N. G.</given-names>
</name>
</person-group> (<year>1992</year>). <source>Stochastic processes in physics and chemistry</source>. <publisher-loc>Amsterdam, The Netherlands</publisher-loc>: <publisher-name>Elsevier</publisher-name>.</citation>
</ref>
<ref id="B56">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Volkov</surname>
<given-names>I. L.</given-names>
</name>
<name>
<surname>Lind&#xe9;n</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Rivera</surname>
<given-names>J. A.</given-names>
</name>
<name>
<surname>Ieong</surname>
<given-names>K.-W.</given-names>
</name>
<name>
<surname>Metelev</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Elf</surname>
<given-names>J.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>tRNA tracking for direct measurements of protein synthesis kinetics in live cells</article-title>. <source>Nat. Chem. Biol.</source> <volume>14</volume>, <fpage>618</fpage>&#x2013;<lpage>626</lpage>. <pub-id pub-id-type="doi">10.1038/s41589-018-0063-y</pub-id>
</citation>
</ref>
<ref id="B57">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>White</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Chiba</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Pang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Dewey</surname>
<given-names>J. S.</given-names>
</name>
<name>
<surname>Savva</surname>
<given-names>C. G.</given-names>
</name>
<name>
<surname>Holzenburg</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2010</year>). <article-title>Holin triggering in real time</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>108</volume>, <fpage>798</fpage>&#x2013;<lpage>803</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1011921108</pub-id>
</citation>
</ref>
<ref id="B58">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wong</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Gene regulation in and out of equilibrium</article-title>. <source>Annu. Rev. Biophys.</source> <volume>49</volume>, <fpage>199</fpage>&#x2013;<lpage>226</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-biophys-121219-081542</pub-id>
</citation>
</ref>
<ref id="B59">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wong</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Dutta</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Chowdhury</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Gunawardena</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Structural conditions on complex networks for the Michaelis-Menten input-output response</article-title>. <source>Proc. Natl. Acad. Sci. U. S. A.</source> <volume>115</volume>, <fpage>9738</fpage>&#x2013;<lpage>9743</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1808053115</pub-id>
</citation>
</ref>
<ref id="B60">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Yordanov</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Stelling</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Steady-state differential dose response in biological systems</article-title>. <source>Biophys. J.</source> <volume>114</volume>, <fpage>723</fpage>&#x2013;<lpage>736</lpage>. <pub-id pub-id-type="doi">10.1016/j.bpj.2017.11.3780</pub-id>
</citation>
</ref>
</ref-list>
</back>
</article>