<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Bioeng. Biotechnol.</journal-id>
<journal-title>Frontiers in Bioengineering and Biotechnology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Bioeng. Biotechnol.</abbrev-journal-title>
<issn pub-type="epub">2296-4185</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fbioe.2014.00091</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Bioengineering and Biotechnology</subject>
<subj-group>
<subject>Methods Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Integrative Analysis of Metabolic Models &#x02013; from Structure to Dynamics</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Hartmann</surname> <given-names>Anja</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor1">&#x0002A;</xref>
<uri xlink:href="http://frontiersin.org/people/u/174092"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Schreiber</surname> <given-names>Falk</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://frontiersin.org/people/u/189056"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Leibniz Institute of Plant Genetics and Crop Plant Research (IPK)</institution>, <addr-line>Gatersleben</addr-line>, <country>Germany</country></aff>
<aff id="aff2"><sup>2</sup><institution>Monash University</institution>, <addr-line>Melbourne, VIC</addr-line>, <country>Australia</country></aff>
<aff id="aff3"><sup>3</sup><institution>Martin-Luther-University Halle-Wittenberg</institution>, <addr-line>Halle</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Daniel Machado, University of Minho, Portugal</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Rafael Costa, Instituto de Engenharia de Sistemas e Computadores, Investiga&#x000E7;&#x000E3;o e Desenvolvimento em Lisboa (INESC-ID/IST), Portugal; Ina Koch, Goethe University Frankfurt am Main, Germany</p></fn>
<corresp content-type="corresp" id="cor1">&#x0002A;Correspondence: Anja Hartmann, Leibniz Institute of Plant Genetics and Crop Plant Research (IPK), Corrensstr. 3, OT Gatersleben, Stadt Seeland 06466, Germany e-mail: <email>hartmann&#x00040;ipk-gatersleben.de</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Systems Biology, a section of the journal Frontiers in Bioengineering and Biotechnology.</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>26</day>
<month>01</month>
<year>2015</year>
</pub-date>
<pub-date pub-type="collection">
<year>2014</year>
</pub-date>
<volume>2</volume>
<elocation-id>91</elocation-id>
<history>
<date date-type="received">
<day>12</day>
<month>09</month>
<year>2014</year>
</date>
<date date-type="accepted">
<day>30</day>
<month>12</month>
<year>2014</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2015 Hartmann and Schreiber.</copyright-statement>
<copyright-year>2015</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>The characterization of biological systems with respect to their behavior and functionality based on versatile biochemical interactions is a major challenge. To understand these complex mechanisms at systems level modeling approaches are investigated. Different modeling formalisms allow metabolic models to be analyzed depending on the question to be solved, the biochemical knowledge and the availability of experimental data. Here, we describe a method for an integrative analysis of the structure and dynamics represented by qualitative and quantitative metabolic models. Using various formalisms, the metabolic model is analyzed from different perspectives. Determined structural and dynamic properties are visualized in the context of the metabolic model. Interaction techniques allow the exploration and visual analysis thereby leading to a broader understanding of the behavior and functionality of the underlying biological system. The System Biology Metabolic Model Framework (<italic>SBM</italic><sup>2</sup> &#x02013; Framework) implements the developed method and, as an example, is applied for the integrative analysis of the crop plant potato.</p>
</abstract>
<kwd-group>
<kwd>metabolic modeling</kwd>
<kwd>integrative analysis</kwd>
<kwd>kinetic analysis</kwd>
<kwd>flux balance analysis</kwd>
<kwd>petri net analysis</kwd>
<kwd>topological analysis</kwd>
</kwd-group>
<counts>
<fig-count count="4"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="32"/>
<page-count count="10"/>
<word-count count="6676"/>
</counts>
</article-meta>
</front>
<body>
<sec id="S1" sec-type="introduction">
<label>1</label> <title>Introduction</title>
<p>Metabolic models have been reconstructed for an increasing number of organisms to understand complex biochemical processes. At least 54 bacterial, 6 archaeal, and 16 eukaryotic reconstructions are available to-date while many others are under development (Xu et al., <xref ref-type="bibr" rid="B32">2013</xref>). In addition, resources such as Path2Models (B&#x000FC;chel et al., <xref ref-type="bibr" rid="B3">2013</xref>) provide draft models for a large number of organisms. Such metabolic models are composed of biochemical reactions and associated experimental parameters of the biological system under investigation. Different metabolic models can be reconstructed depending upon the completeness of knowledge about the detailed interaction mechanisms in a biological system. The metabolism is thereby roughly represented in large and mostly qualitative models and smaller, but more quantitative models (Steuer and Junker, <xref ref-type="bibr" rid="B29">2008</xref>). Different model sizes and knowledge details allow the structural and dynamic properties to be analyzed using different modeling formalisms. For further details on modeling formalisms in Systems Biology the reader is referred to (Machado et al., <xref ref-type="bibr" rid="B19">2011</xref>). Several modeling formalisms entail different analysis techniques facilitating the investigation of a metabolic model from different perspectives and thus, revealing complementary insights.</p>
<p>A couple of review papers evaluated modeling formalisms (Wiechert, <xref ref-type="bibr" rid="B31">2002</xref>; Steuer and Junker, <xref ref-type="bibr" rid="B29">2008</xref>; H&#x000FC;bner et al., <xref ref-type="bibr" rid="B11">2011</xref>; Koch et al., <xref ref-type="bibr" rid="B15">2011</xref>; Machado et al., <xref ref-type="bibr" rid="B19">2011</xref>; Pfau et al., <xref ref-type="bibr" rid="B25">2011</xref>; Dandekar et al., <xref ref-type="bibr" rid="B6">2012</xref>) and revealed among others kinetic, Petri net, stoichiometric, and topological modeling methods as well-established. The strengths and weaknesses of each formalism are summarized in Figure <xref ref-type="fig" rid="F1">1</xref>.</p>
<fig position="float" id="F1">
<label>Figure 1</label>
<caption>
<p><bold>Metabolism is represented in large and mostly qualitative models and smaller, but more quantitative models</bold>. Different modeling formalisms that depend on the completeness of knowledge about the detailed interaction mechanisms are utilized to gain knowledge on the underlying biological system. Each modeling formalism is applied to different models as indicated by the corresponding colors and possesses strengths (&#x0002B;) and weaknesses (&#x02212;). The integration of the independent modeling formalisms mitigates the weaknesses (&#x02212;) and leads to the potential of the integrated analysis indicated in parentheses (major &#x0002B; or minor &#x000B1; improvement, explanations are given in the Results and Discussion section). Adapted from Steuer and Junker (<xref ref-type="bibr" rid="B29">2008</xref>).</p></caption>
<graphic xlink:href="fbioe-02-00091-g001.tif"/>
</fig>
<p>Kinetic modeling using ordinary differential equations (ODEs) includes detailed quantitative descriptions on the biochemical processes and therefore requires often difficult to obtain kinetic rate equations and parameters. Due to this, kinetic modeling is generally limited to smaller models, but leads to quantitative predictions and reveals dynamic behavior of the underlying biological system (Resat et al., <xref ref-type="bibr" rid="B27">2009</xref>). Petri net modeling is powerful due to several Petri net extensions for qualitative and quantitative analysis. The stochastic effects involved in quantitative predictions and system dynamics can be accounted for by using, for example, the stochastic Petri net (SPN) simulation. However, these extensions complicate the qualitative analysis (Baldan et al., <xref ref-type="bibr" rid="B1">2010</xref>). Stoichiometric modeling using optimization-based analysis such as flux balance analysis (FBA) (Orth et al., <xref ref-type="bibr" rid="B24">2010</xref>) allows for quantitative predictions due to the steady-state assumption. A static description of the biochemical processes is therefore sufficient when including stoichiometric, thermodynamic, and enzyme capacity constraints. Thus, stoichiometric modeling is applicable for large models, but is limited in revealing the dynamic behavior of the underlying biological system (Lewis et al., <xref ref-type="bibr" rid="B18">2012</xref>). Topological modeling considers only the topological information of models (not limited in model size) and can identify structures and robustness against disturbances. Using, for example, centrality analysis (Kosch&#x000FC;tzki and Schreiber, <xref ref-type="bibr" rid="B16">2008</xref>) different importance concepts provide insights into key elements based on metabolite or reaction graphs (Steuer and Junker, <xref ref-type="bibr" rid="B29">2008</xref>).</p>
<p>Some of the introduced metabolic modeling formalisms are already investigated in different approaches to analyze metabolic models at the system level and to overcome problems due to the lack of experimental data. Described methods either extent qualitative models with obtained analysis results to investigate a follow-up quantitative analysis, or models are reduced to assign less data for quantitative analysis. In most cases, such as Birch et al. (<xref ref-type="bibr" rid="B2">2014</xref>) and Chowdhury et al. (<xref ref-type="bibr" rid="B5">2014</xref>), the stoichiometric formalism FBA is used to obtain flux distributions, which are utilized to derive ODEs for kinetic analysis (Resat et al., <xref ref-type="bibr" rid="B27">2009</xref>). Methods using the Petri net formalism for model reduction to integrate less data for kinetic analysis are described by Chen et al. (<xref ref-type="bibr" rid="B4">2011</xref>), Gilbert and Heiner (<xref ref-type="bibr" rid="B8">2006</xref>), and Koch and Heiner (<xref ref-type="bibr" rid="B13">2008</xref>). An advanced method is presented by Machado et al. (<xref ref-type="bibr" rid="B20">2010</xref>) whereby Petri net formalism is applied to integrate both of the aforementioned methods for model reduction and a follow-up kinetic analysis. Grafahrend-Belau et al. (<xref ref-type="bibr" rid="B9">2013</xref>) combined overview kinetic models (household models) with FBA toward a quasi-dynamic FBA. Heiner et al. (<xref ref-type="bibr" rid="B10">2012</xref>) and Nagasaki et al. (<xref ref-type="bibr" rid="B23">2010</xref>) propose a unifying Petri net framework comprised of a family of related Petri net types. In this approach qualitative, stochastic and continuous Petri net analyses are conducted by converting different Petri net types into each other.</p>
<p>Here, we introduce an integrated approach, which complements the presented approaches through a formalization leading to a standardized, transformable, and extensible abstraction of metabolism. This method allows the investigated metabolic models to be integrated, utilizing different well-established modeling formalisms and at the same time maintaining a standardized visualization. Moreover, the integration of analysis results with corresponding elements of the metabolic model leads to a combination of model structure and model dynamics. Several interaction techniques support the exploration and interpretation of the gained analysis results to provide a comprehensive understanding of the underlying biological system.</p>
</sec>
<sec id="S2" sec-type="materials|methods">
<label>2</label> <title>Materials and Methods</title>
<p>In general, metabolic models are networks consisting of different elements such as metabolites and reactions with relations between these elements and additional attributes. Thus, a suitable data structure for metabolic models is a graph. Dependent upon the modeling formalism, graphs with different structure and attributes are able to represent kinetic, Petri net, stoichiometric, or topological models. Each of these graphs contains nodes (metabolites and/or reactions), which are related to each other through edges.</p>
<p>Following the concept of generalization, different <italic>specific graphs</italic> representing qualitative and quantitative metabolic models (Figure <xref ref-type="fig" rid="F2">2</xref>C) are generalized into a <italic>unified graph</italic> (Figure <xref ref-type="fig" rid="F2">2</xref>A). This concept allows a standard graphical representation to be maintained (Figure <xref ref-type="fig" rid="F2">2</xref>B) and additionally, to transform the <italic>unified graph</italic> into <italic>specific graphs</italic> to apply different modeling formalisms. Some formalisms utilize a reduced structure and attribute set of the <italic>unified graph</italic> to perform analyses (this will be described in detail in the Transformation Section). Using our method, the analysis results from different formalisms are visualized in the context of the metabolic model through data assignment functions (Figure <xref ref-type="fig" rid="F2">2</xref>D). Thus, the underlying biological system is characterized from different perspectives providing complementary insights. Using interaction techniques, the subsequent visual analysis is conducted. Furthermore, analysis results can be integrated in other formalisms to constrain this analysis and thereby make them either feasible or more precise.</p>
<fig position="float" id="F2">
<label>Figure 2</label>
<caption>
<p><bold>Concept for an integrative analysis of metabolic models including</bold>: <bold>(A)</bold> formalization (<italic>G</italic><sub>Unified</sub> with <italic>M</italic> metabolite and <italic>R</italic> reaction nodes, different edge types: <italic>ci</italic> consumption irreversible, <italic>cr</italic> consumption reversible, <italic>pi</italic> production irreversible, <italic>pr</italic> production reversible, and <italic>i</italic> inhibition), <bold>(B)</bold> visualization in <italic>SBGN-PD</italic>, <bold>(C)</bold> transformation in different <italic>specific graphs</italic>: <italic>G</italic><sub>Kinetic</sub> dark green, <italic>G</italic><sub>Petri net</sub> light green, <italic>G</italic><sub>Stoichiometric</sub> light blue, and two topological graphs <italic>G</italic><sub>Metabolite</sub> and <italic>G</italic><sub>Reaction</sub> dark blue, and <bold>(D)</bold> integration of different analysis results (colors represent results from different analysis performed using <italic>specific graphs</italic>).</p></caption>
<graphic xlink:href="fbioe-02-00091-g002.tif"/>
</fig>
<p>The following sections introduce the concept depicted in Figure <xref ref-type="fig" rid="F2">2</xref> in detail.</p>
<sec id="S2-1">
<label>2.1</label> <title>Formalization</title>
<p>With the aim to formally represent qualitative and quantitative metabolic models a directed, attributed, bipartite graph (called the <italic>unified graph</italic>) is defined as follows.</p>
<p><bold>Definition 2.1</bold> (unified graph). The <italic>unified graph G</italic><sub>Unified</sub>&#x02009;&#x0003D;&#x02009;(<italic>M</italic>, <italic>R</italic>, <italic>E</italic>, <italic>A</italic>) is a directed, attributed, bipartite graph consisting of two finite, non-empty sets <italic>M</italic> of metabolites and <italic>R</italic> of reactions, whereby both sets are disjoint <italic>M</italic>&#x02009;&#x02229;&#x02009;<italic>R</italic>&#x02009;&#x0003D;&#x02009;&#x02205;. Other finite sets are directed edges <italic>E</italic>&#x02009;&#x02286;&#x02009;(<italic>M&#x02009;&#x000D7;&#x02009;R</italic>)&#x02009;&#x0222A;&#x02009;(<italic>R&#x02009;&#x000D7;&#x02009;M</italic>) and attributes <italic>A</italic>&#x02009;&#x0003D;&#x02009;{<italic>type</italic>, <italic>stoichiometry</italic>, <italic>localization</italic>, <italic>label</italic>, <italic>concentration</italic>, <italic>capacity</italic>, <italic>rate</italic>, <italic>boundaries</italic>, <italic>objective function</italic>}, which are assigned to nodes and edges using the following functions:
<list list-type="bullet">
<list-item><p><italic>type: E</italic>&#x02009;&#x02192;&#x02009;{<italic>ci</italic>, <italic>pi</italic>, <italic>cr</italic>, <italic>pr</italic>, <italic>i</italic>} is a function, which assigns a type to each edge (<italic>ci</italic> consumption irreversible, <italic>pi</italic> production irreversible, <italic>cr</italic> consumption reversible, <italic>pr</italic> production reversible, or <italic>i</italic> inhibition). A directed edge from a metabolite to a reaction is of type <italic>ci</italic>, <italic>cr</italic>, or <italic>i</italic> [i.e., &#x02200;<italic>e</italic>&#x02009;&#x02208;&#x02009;(<italic>M&#x02009;&#x000D7;&#x02009;R</italic>): <italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>ci</italic>&#x02009;&#x02228;&#x02009;<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>cr</italic>&#x02009;&#x02228;&#x02009;<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>i</italic>] and a directed edge from a reaction to a metabolite is of type <italic>pi</italic> or <italic>pr</italic> [i.e., &#x02200;<italic>e</italic>&#x02009;&#x02208;&#x02009;(<italic>R&#x02009;&#x000D7;&#x02009;M</italic>): <italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>pi</italic>&#x02009;&#x02228;&#x02009;<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>pr</italic>]. To easily distinguish between reversible and irreversible edges, reversible edges are illustrated using a double-headed arrow, with the black arrow-head denoting the main direction from substrate (consumed metabolite) to product (produced metabolite) of a reaction.</p></list-item>
<list-item><p><italic>stoichiometry</italic>: <italic>E</italic>&#x02032;&#x02009;&#x02192;&#x02009;&#x0211D;<sub>&#x0003E;0</sub> is a function, which assigns a positive real number greater than 0 to each edge of type <italic>ci</italic>, <italic>cr</italic>, <italic>pi</italic>, or <italic>pr</italic> out of the set <italic>E</italic>&#x02032;&#x02009;&#x0003D;&#x02009;{<italic>e</italic>&#x02009;&#x02208;&#x02009;<italic>E</italic>&#x0007C;&#x02009;&#x000AC;&#x02009;(<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>i</italic>)}.</p></list-item>
<list-item><p><italic>label</italic>: <italic>M</italic>&#x02009;&#x0222A;&#x02009;<italic>R</italic>&#x02009;&#x02192;&#x02009;&#x003A3;&#x0002A; is a function, which assigns a word over the alphabet to each metabolite and each reaction.</p></list-item>
<list-item><p><italic>localization</italic>: <italic>M</italic>&#x02009;&#x02192;&#x02009;&#x003A3;&#x0002A; is a function, which assigns a word over the alphabet to each metabolite.</p></list-item>
<list-item><p><italic>capacity</italic>: <italic>M</italic>&#x02009;&#x02192;&#x02009;&#x0211D;<sub>&#x02265;0</sub>&#x02009;&#x0222A;&#x02009;{&#x0221E;} is a function, which assigns a positive real number or infinity {&#x0221E;} to each metabolite.</p></list-item>
<list-item><p><italic>concentration</italic>: <italic>M</italic>&#x02009;&#x02192;&#x02009;&#x0211D;<sub>&#x02265;0</sub> is a function, which assigns a positive real number to each metabolite. Additionally, the concentration of a metabolite has to be less than or equal to the capacity of the metabolite, &#x02200;<italic>m</italic>&#x02009;&#x02208;&#x02009;<italic>M: concentration(m)</italic>&#x02009;&#x02264;&#x02009;<italic>capacity</italic>(<italic>m</italic>).</p></list-item>
<list-item><p><italic>rate</italic>: <italic>R</italic> &#x02192;{{<italic>h</italic>, <italic>j</italic>}, <italic>h</italic>, <italic>j</italic>, {}} is a function, which assigns a kinetic rate equation <italic>j</italic>&#x02009;&#x02208;&#x02009;<italic>J</italic>, whereby <italic>J</italic> is a set of all kinetic rate equations or a positive real number (stochastic rate) <italic>h</italic>&#x02009;&#x02208;&#x02009;&#x0211D;<sub>&#x02265;0</sub> or the empty set to each reaction.</p></list-item>
<list-item><p><italic>boundaries</italic>: <italic>R</italic>&#x02009;&#x02192;&#x02009;(<italic>lower</italic>, <italic>upper</italic>), with <italic>lower</italic>, <italic>upper</italic>&#x02009;&#x02208;&#x02009;&#x0211D;<sub>&#x02265;0</sub>, and <italic>lower</italic>&#x02009;&#x02264;&#x02009;<italic>upper</italic> is a function, which assigns an ordered pair of positive real numbers to each reaction, whereby the lower bound has to be smaller than or equal to the upper bound.</p></list-item>
<list-item><p><italic>objective function</italic>: <italic>R</italic>&#x02009;&#x02192;&#x02009;{0, 1}, with &#x02200;<italic>r</italic>, <italic>r</italic>&#x02032;&#x02009;&#x02208;&#x02009;<italic>R</italic>: <italic>objective function</italic> (<italic>r</italic>)&#x02009;&#x0003D;&#x02009;1&#x02009;&#x02227;&#x02009;<italic>objective function</italic> (<italic>r</italic>&#x02032;)&#x02009;&#x0003D;&#x02009;1&#x02009;&#x021D2;&#x02009;r &#x0003D; r&#x02032;, is a function, which assigns 0 or 1 to each reaction, whereby only one reaction receives the value 1 (for optimization).</p></list-item>
</list></p>
<p>Furthermore, the following requirements must be fulfilled:</p>
<p>For all reactions <italic>r</italic>&#x02009;&#x02208;&#x02009;<italic>R</italic> applies: (1) there exists at least one incoming and one outgoing edge (whereby the incoming edge is not of type <italic>i</italic>) and (2) if one incoming or outgoing edge is reversible (irreversible) than all incoming and outgoing edges are reversible (irreversible). With this rule a reaction is either connected to reversible edges or irreversible edges but not a combination of them.</p>
<p>Between a metabolite <italic>m</italic>&#x02009;&#x02208;&#x02009;<italic>M</italic> and a reaction <italic>r</italic>&#x02009;&#x02208;&#x02009;<italic>R</italic> there are at most two edges <italic>e</italic>, <italic>e</italic>&#x02032;&#x02009;&#x02208;&#x02009;<italic>E</italic> of different types. If two edges <italic>e</italic> and <italic>e</italic>&#x02032; connect <italic>m</italic> with <italic>r</italic> the type of <italic>e</italic> is <italic>ci</italic> and the type of <italic>e</italic>&#x02032; is <italic>i</italic>. This case describes a substrate inhibition at high substrate concentrations, whereby a metabolite is substrate and inhibitor at the same time.</p>
<p>If one edge <italic>e</italic> connects <italic>r</italic> with <italic>m</italic> and another edge <italic>e</italic>&#x02032; connects <italic>m</italic> with <italic>r</italic> the type of <italic>e</italic> is <italic>pi</italic> and the type of <italic>e</italic>&#x02032; is <italic>i</italic>. In this case, a product inhibition is modeled with a metabolite as product and at the same time inhibitor of a reaction.</p>
<p>An explicit formulation of both cases for reversible reactions is not needed because the reaction mechanisms already provide implicit substrate- and product inhibition.</p>
<p>Moreover, the following sets are defined to simplify the transformation of the <italic>unified graph</italic> into <italic>specific graphs</italic> for analysis. The edge set <italic>E</italic> is composed of three subsets, <italic>E</italic>&#x02009;&#x0003D;&#x02009;<italic>E<sub>i</sub></italic>&#x02009;&#x0222A;&#x02009;<italic>E<sub>ir</sub></italic>&#x02009;&#x0222A;&#x02009;<italic>E<sub>r</sub></italic>. The subset of inhibitory edges is <italic>E<sub>i</sub></italic>&#x02009;&#x0003D;&#x02009;{<italic>e</italic>&#x02009;&#x02208; <italic>E</italic>&#x0007C;<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>i</italic>}, the subset of irreversible edges is <italic>E<sub>ir</sub></italic>&#x02009;&#x0003D;&#x02009;{<italic>e</italic>&#x02009;&#x02208;&#x02009;<italic>E&#x0007C;type</italic>(<italic>e</italic>) &#x0003D;&#x02009;<italic>ci</italic>&#x02009;&#x02228;&#x02009;<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>pi</italic>} and the subset of reversible edges is <italic>E<sub>r</sub></italic>&#x02009;&#x0003D;&#x02009;{<italic>e</italic>&#x02009;&#x02208;&#x02009;<italic>E&#x0007C;type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>cr</italic>&#x02009;&#x02228;&#x02009;<italic>type</italic>(<italic>e</italic>)&#x02009;&#x0003D;&#x02009;<italic>pr</italic>}. The set of metabolites <italic>M</italic> consists of a subset of metabolites <italic>M<sub>cp</sub></italic>, which are either consumed or produced in reactions <italic>M<sub>cp</sub></italic>&#x02009;&#x0003D;&#x02009;{<italic>m</italic>&#x02009;&#x02208;&#x02009;<italic>M</italic>&#x0007C;&#x02203;<italic>r</italic>&#x02009;&#x02208;&#x02009;<italic>R</italic>: (<italic>m</italic>, <italic>r</italic>)&#x02009;&#x02208;&#x02009;<italic>E<sub>r</sub></italic>&#x02009;&#x02228;&#x02009;(<italic>m</italic>, <italic>r</italic>)&#x02009;&#x02208;&#x02009;<italic>E<sub>ir</sub></italic>}&#x02009;&#x0222A;&#x02009;{<italic>m</italic>&#x02032;&#x02009;&#x02208;&#x02009;<italic>M</italic>&#x0007C;&#x02203;<italic>r</italic>&#x02009;&#x02208;&#x02009;<italic>R</italic>:(<italic>r</italic>, <italic>m</italic>&#x02032;)&#x02009;&#x02208;&#x02009;E<sub>r</sub> &#x02228;(r,&#x02009;m&#x02032;) &#x02208; E<sub>ir</sub>}.</p>
<p>To assign analysis results to nodes and edges of the <italic>unified graph</italic>, data assignment functions that integrate calculated structural and dynamic data are used (this will be described in detail in the Transformation section).</p>
<p>Due to the definition of the <italic>unified graph</italic> with a rich attribute set qualitative and quantitative metabolic models can be represented and additionally visualized using standards. Figure <xref ref-type="fig" rid="F3">3</xref> illustrates the basic elements of the <italic>unified graph</italic> and the corresponding visualization in <italic>SBGN-PD</italic>.</p>
<fig position="float" id="F3">
<label>Figure 3</label>
<caption>
<p><bold>Basic elements of the <italic>unified graph</italic> (left) and the corresponding <italic>SBGN-PD</italic> visualization (right)</bold>: <bold>(A)</bold> irreversible reactions, <bold>(B)</bold> inhibition of irreversible reactions, <bold>(C)</bold> localization (compartment) of metabolites (samecolor), <bold>(D)</bold> reversible reactions, <bold>(E)</bold> inhibition of reversible reactions, <bold>(F)</bold> export reactions (top irreversible and bottom reversible), and <bold>(G)</bold> import reactions (top irreversible, bottom reversible).</p></caption>
<graphic xlink:href="fbioe-02-00091-g003.tif"/>
</fig>
</sec>
<sec id="S2-2">
<label>2.2</label> <title>Visualization</title>
<p>In order to derive a standardized graphical representation of the <italic>unified graph</italic> the Systems Biology Graphical Notation (Le Nov&#x000E8;re et al., <xref ref-type="bibr" rid="B17">2009</xref>) (<italic>SBGN</italic>) is utilized. <italic>SBGN</italic> has been developed to interpret biological models easily without the need for extensive descriptions using three sub-languages. <italic>SBGN-PD</italic> (Moodie et al., <xref ref-type="bibr" rid="B21">2011</xref>) is the <italic>Process Description</italic> sub-language visualizing the temporal dependencies of biological interactions in detail and is thus suited for the metabolic models encoded in the <italic>unified graph</italic>.</p>
<p>The translation of the <italic>unified graph</italic> in a <italic>SBGN-PD</italic> visualization is based on the following schema. All elements of the metabolite set <italic>m</italic>&#x02009;&#x02208;&#x02009;<italic>M</italic> (reaction set <italic>r</italic>&#x02009;&#x02208;&#x02009;<italic>R</italic>) are visualized using <italic>simple chemicals</italic>&#x02009;&#x02208;&#x02009;<italic>entity pool nodes</italic> (<italic>process</italic>&#x02009;&#x02208;&#x02009;<italic>process nodes</italic>). All elements of the edge set <italic>e</italic>&#x02009;&#x02208;&#x02009;<italic>E</italic> are visualized using arcs of the set <italic>connecting arcs</italic> based on the assigned type. Edges of type <italic>ci</italic> are visualized using <italic>consumption arc</italic>, <italic>pi</italic> using <italic>production arc</italic>, <italic>cr</italic> using <italic>production arc</italic> in the opposite direction, <italic>pr</italic> using <italic>production arc</italic> and <italic>i</italic> using <italic>inhibition arc</italic>, respectively.</p>
<p>The edge attribute <italic>stoichiometry</italic> is visualized using <italic>cardinality</italic> and the metabolite attribute <italic>localization</italic> is visualized using <italic>compartment</italic>, which is a container for metabolites defined for this location. The localization of reactions is independent of a <italic>compartment</italic>, hence, a reaction could be located within, outside or on top of the border of a <italic>compartment</italic>. Import or export reactions in <italic>SBGN-PD</italic> are defined using the additional symbol <italic>source and sink</italic>&#x02009;&#x02208;&#x02009;<italic>entity pool nodes</italic>, see Figure <xref ref-type="fig" rid="F3">3</xref>.</p>
<p>Furthermore, interaction techniques allow the exploration and subsequent visual analysis leading to a broader understanding of the behavior and functionality of the underlying biological system (which will be described in detail in the Results and Discussion section).</p>
</sec>
<sec id="S2-3">
<label>2.3</label> <title>Transformation</title>
<p>Overall, five transformations from the <italic>unified graph</italic> (<italic>G</italic><sub>Unified</sub>) into the <italic>specific graphs</italic> (<italic>G</italic><sub>Kinetic</sub>, <italic>G</italic><sub>Petri net</sub>, <italic>G</italic><sub>Stoichiometric</sub>, <italic>G</italic><sub>Metabolite</sub>, <italic>G</italic><sub>Reaction</sub>) have to be performed as a prerequisite to analyze a metabolic model using different modeling formalisms. The different models, modeling formalisms and the transformation from <italic>G</italic><sub>Unified</sub> into <italic>G</italic><sub>Stoichiometric</sub> are described in the following. The transformations from <italic>G</italic><sub>Unified</sub> into <italic>G</italic><sub>Kinetic</sub>, <italic>G</italic><sub>Petri net</sub>, and into both of the topological graphs <italic>G</italic><sub>Metabolite</sub>, <italic>G</italic><sub>Reaction</sub> are defined in the Supplementary Material.</p>
<sec id="S2-3-1">
<label>2.3.1</label> <title>Kinetic model</title>
<p>A kinetic metabolic model (ODE model) consists of a structural description of relations between metabolites and reactions and is extended with detailed kinetic data including rate equations, metabolite concentrations, and additional kinetic parameters. The kinetic model is represented by the <italic>kinetic graph</italic> (<italic>G</italic><sub>Kinetic</sub>), which is transformed from the <italic>unified graph (G</italic><sub>Unified</sub><italic>)</italic>, see Figure <xref ref-type="fig" rid="F2">2</xref>C and for details Definition 1.1 in Supplementary Material. This transformation results in no structural differences, but in a reduced attribute set.</p>
<p>To analyze the kinetic metabolic model its <italic>kinetic graph</italic> is converted in ODEs, which are numerically solved (Resat et al., <xref ref-type="bibr" rid="B27">2009</xref>). Changes in metabolite concentrations and reaction rates over a period of time are obtained as the results of the analysis.</p>
</sec>
<sec id="S2-3-2">
<label>2.3.2</label> <title>Petri net model</title>
<p>A Petri net metabolic model can be defined using different Petri net types. Here, we refer to extended qualitative place/transition Petri nets (<italic>eP/T nets</italic>) and extended quantitative stochastic Petri nets (<italic>eSPNs</italic>). The extension includes continuous tokens (to model metabolite concentrations), continuous arc weights (to model non-integer stoichiometry), continuous place capacities (to model limited resources), and inhibitor arcs (to model inhibition). An inhibition is modeled using an inhibitor arc from a place to a transition meaning that the transition can only fire if no token is on that place. The transition may only fire when the place is empty.</p>
<p>Both Petri net types share the same structure, but <italic>eSPNs</italic> are specialized by weights for the exponentially distributed random variable (firing time) assigned to transitions. For further details on Petri nets for modeling metabolic models the reader is referred to Baldan et al. (<xref ref-type="bibr" rid="B1">2010</xref>). The Petri net model is represented by the <italic>Petri net graph</italic> (<italic>G</italic><sub>Petri net</sub>), which is transformed from the <italic>unified graph</italic> (<italic>G</italic><sub>Unified</sub>), see Figure <xref ref-type="fig" rid="F2">2</xref>C and for details Definition 1.2 and Figure S1 in Supplementary Material. This transformation results in structural differences (reversible reactions are represented using a pair of irreversible reactions for both directions) and a reduced attribute set.</p>
<p>A Petri net metabolic model can be analyzed qualitatively or quantitatively. For the qualitative analysis, the <italic>Petri net graph</italic> is converted into a linear equation system, which can be solved to derive invariants describing main pathways (T-invariants) or metabolite conservation (P-invariants) of a metabolic model [more details in Murata (<xref ref-type="bibr" rid="B22">1989</xref>), Baldan et al. (<xref ref-type="bibr" rid="B1">2010</xref>), and Reisig (<xref ref-type="bibr" rid="B26">2013</xref>)]. Furthermore, all possible states are calculated using the reachability analysis and if the reachability graph cannot be constructed then the coverability graph is calculated instead (infinite state-space). The main purpose of the quantitative analysis (simulation) of a Petri net metabolic model is to include stochastic effects. The reactions can additionally be weighted with reaction rates to conduct a more constraint stochastic simulation revealing changes in metabolite concentrations over a number of simulation steps.</p>
</sec>
<sec id="S2-3-3">
<label>2.3.3</label> <title>Stoichiometric model</title>
<p>Compared to both of the aforementioned models a stoichiometric model consists of stoichiometric reactions without quantities, such as metabolite concentrations, or reaction rates. Due to the steady-state assumption, the regulatory effects resulting from enzymes or inhibitors are neglected; see Orth et al. (<xref ref-type="bibr" rid="B24">2010</xref>) for more details.</p>
<p><bold>Definition 2.2 (stoichiometric graph)</bold>. The <italic>unified graph G</italic><sub>Unified</sub> is transformed in a directed, attributed, bipartite <italic>stoichiometric graph G</italic><sub>Stoichiometric</sub>&#x02009;&#x0003D;&#x02009;(<italic>M<sub>S</sub></italic>, <italic>R<sub>S</sub></italic>, <italic>E<sub>S</sub></italic>, <italic>A<sub>S</sub></italic>) with a metabolite set <italic>M<sub>S</sub></italic>&#x02009;&#x0003D;&#x02009;<italic>M<sub>cp</sub></italic>, which is a subset of the set <italic>M</italic> in <italic>G</italic><sub>Unified</sub>. Metabolites with only inhibitory interactions to reactions are not considered. The reaction set in <italic>G</italic><sub>Stoichiometric</sub> <italic>R<sub>S</sub></italic>&#x02009;&#x0003D;&#x02009;<italic>R</italic> equals the reaction set <italic>R</italic> set in <italic>G<sub>Unified</sub></italic> and the edge set in <italic>G</italic><sub>Stoichiometric</sub> <italic>E<sub>S</sub></italic>&#x02009;&#x0003D;&#x02009;<italic>E<sub>ir</sub></italic>&#x02009;&#x0222A;&#x02009;<italic>E<sub>r</sub></italic> is a subset of the set <italic>E</italic> in <italic>G<sub>Unified</sub></italic>. Edges of type <italic>i</italic> are excluded. The attribute set in <italic>G</italic><sub>Stoichiometric</sub> <italic>A<sub>S</sub></italic>&#x02009;&#x02286;&#x02009;<italic>A</italic> is a subset of the set <italic>A</italic> in <italic>G</italic><sub>Unified</sub> with <italic>A<sub>S</sub></italic>&#x02009;&#x0003D;&#x02009;{<italic>type</italic>, <italic>stoichiometry</italic>, <italic>localization</italic>, <italic>label</italic>, <italic>boundaries</italic>, <italic>objective function</italic>}.</p>
<p>Figure <xref ref-type="fig" rid="F2">2</xref>C and for details Figure S4 in Supplementary Material depict the transformation of inhibited reactions from <italic>G</italic><sub>Unified</sub> into <italic>G</italic><sub>Stoichiometric</sub> and thereby detailing the difference between both graphs. This transformation results in structural differences (no inhibitions) and a reduced attribute set. Thereby, all regulatory information and quantitative data are lost.</p>
<p>Using the <italic>stoichiometric graph</italic>, a metabolic model can be validated utilizing the <italic>Dead-End</italic> analysis or <italic>Gap-Finding</italic> analysis revealing blocked reactions or dead-end metabolites. To examine the flow of metabolites through a metabolic model the <italic>stoichiometric graph</italic> is converted into a system of mass balance equations at steady-state, which are solved by minimizing or maximizing an objective function. This optimization can be conducted using a linear optimization instead of a non-linear optimization to handle the problem of alternate optimal solutions. Applicable optimization-based methods are <italic>FBA</italic>, flux variability analysis (<italic>FVA</italic>), robustness analysis (<italic>RA</italic>), and knockout-analyses (<italic>KA</italic>) resulting in a flux distribution, minimal and maximal fluxes, sensitivity curves, and sensitivity values, respectively. For a detailed description of optimization-based methods the reader is referred to (Lewis et al., <xref ref-type="bibr" rid="B18">2012</xref>).</p>
</sec>
<sec id="S2-3-4">
<label>2.3.4</label> <title>Topological models</title>
<p>Metabolic models are analyzed according to topological properties in order to understand the importance of key elements, structure, and robustness against disturbances. Since the <italic>metabolite graph</italic> (nodes represent metabolites, edges reactions) and <italic>reaction graph</italic> (nodes represent reactions, edges metabolites) are predominantly used for topological analysis (Steuer and Junker, <xref ref-type="bibr" rid="B29">2008</xref>) the <italic>unified graph G</italic><sub>Unified</sub> is transformed into both, see Figure <xref ref-type="fig" rid="F2">2</xref>C (For details see Definition 1.3 and Figure S2 in Supplementary Material for <italic>metabolite graph</italic> and Definition 1.4 and Figure S3 in Supplementary Material for <italic>reaction graph</italic>). This transformation results in structural differences (unipartite graphs) and a reduced attribute set. Thereby, all regulatory information and quantitative data are lost.</p>
<p>Topological analysis of the metabolic model based on its <italic>metabolite graph</italic> or <italic>reaction graph</italic> is conducted using the corresponding adjacency matrix. A shortest path analysis results in paths (subgraphs which could be the graph itself). Furthermore, centrality analysis with different centrality measures leads to a ranking of graph elements according to different importance concepts. For further details on different centrality measures the reader is referred to Kosch&#x000FC;tzki and Schreiber (<xref ref-type="bibr" rid="B16">2008</xref>).</p>
</sec>
</sec>
<sec id="S2-4">
<label>2.4</label> <title>Integration</title>
<p>To integrate structural and dynamic analysis results in the <italic>unified graph</italic>, which have been computed using <italic>specific graphs</italic>, data assignment functions are applied. To focus on several analysis methods, we chose typical examples from a number of analysis methods comprised in the different modeling formalisms. Using these analysis methods, two sets of data types are generated: vectors of numeric values and graph elements, which are assigned to different graph elements of the <italic>unified graph</italic>, see Table <xref ref-type="table" rid="T1">1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption>
<p><bold>Summary of typical examples of analysis methods and corresponding results produced with different modeling formalisms grouped in data types, which will be assigned to different graph elements [metabolite nodes (<italic>M</italic>), reaction nodes (<italic>R</italic>), and edges (<italic>E</italic>)] of the <italic>unified graph</italic></bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" rowspan="2" valign="top">Modeling formalisms</th>
<th align="left" colspan="2" rowspan="2" valign="top">Typical examples of analysis methods</th>
<th align="left" rowspan="2" valign="top">Analysis results</th>
<th align="left" rowspan="2" valign="top">Data types</th>
<th align="center" colspan="3"><italic>G</italic><sub>Unified</sub><hr/></th>
</tr>
<tr>
<th align="center"><italic>M</italic></th>
<th align="center"><italic>R</italic></th>
<th align="center"><italic>E</italic></th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Kinetic modeling</td>
<td align="left" colspan="2">Kinetic analysis</td>
<td align="left">Metabolite concentrations, reaction rates over time</td>
<td align="left">Vector of time dependent numeric values</td>
<td align="left">x</td>
<td align="left">x</td>
<td align="left"/>
</tr>
<tr>
<td align="left" rowspan="3" valign="middle">Petri net modeling</td>
<td align="left" colspan="2">Invariant analysis</td>
<td align="left">P- and T-invariants</td>
<td align="left">Vector of numeric values</td>
<td align="left">x<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td align="left">x<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td align="left"/>
</tr>
<tr>
<td align="left" colspan="2">Reachability analysis</td>
<td align="left">Reachability graph/coverability graph</td>
<td align="left">Graph</td>
<td align="left">x<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td align="left">x<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td align="left"/>
</tr>
<tr>
<td align="left" colspan="2">Stochastic analysis</td>
<td align="left">Metabolite concentrations, reaction rates over steps</td>
<td align="left">Vector of step dependent numeric values</td>
<td align="left">x<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td align="left">x<xref ref-type="table-fn" rid="tfn1"><sup>a</sup></xref></td>
<td align="left"/>
</tr>
<tr>
<td align="left" rowspan="6" valign="middle">Stoichiometric modeling</td>
<td align="left" colspan="2">Stoichiometric analysis</td>
<td align="left">Dead-ends</td>
<td align="left">Nodes</td>
<td align="left">x</td>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left" rowspan="5" valign="middle">Optimization-based analysis</td>
<td align="left">Gap-finding</td>
<td align="left">Gaps</td>
<td align="left">Nodes</td>
<td align="left">x</td>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left">FBA</td>
<td align="left">Flux distribution</td>
<td align="left">Vector of numeric values</td>
<td align="left"/>
<td align="left"/>
<td align="left">x</td>
</tr>
<tr>
<td align="left">RA</td>
<td align="left">Sensitivity curve</td>
<td align="left">Vector of flux dependent numeric values</td>
<td align="left"/>
<td align="left">x</td>
<td align="left"/>
</tr>
<tr>
<td align="left">KA</td>
<td align="left">Sensitivity value</td>
<td align="left">Vector of numeric values</td>
<td align="left"/>
<td align="left">x</td>
<td align="left"/>
</tr>
<tr>
<td align="left">FVA</td>
<td align="left">Min/max flux values of reactions</td>
<td align="left">Vector of numeric value pairs</td>
<td align="left"/>
<td align="left">x</td>
<td align="left"/>
</tr>
<tr>
<td align="left" rowspan="2" valign="middle">Topological modeling</td>
<td align="left" colspan="2">Centrality analysis</td>
<td align="left">Centrality values</td>
<td align="left">Vector of numeric values</td>
<td align="left">x</td>
<td align="left">x</td>
<td align="left"/>
</tr>
<tr>
<td align="left" colspan="2">Shortest path</td>
<td align="left">Shortest path</td>
<td align="left">Graph</td>
<td align="left">x<xref ref-type="table-fn" rid="tfn2"><sup>b</sup></xref></td>
<td align="left">x<xref ref-type="table-fn" rid="tfn2"><sup>b</sup></xref></td>
<td align="left">x<xref ref-type="table-fn" rid="tfn2"><sup>b</sup></xref></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tfn1"><p><italic><sup>a</sup>Analysis results from forward and backward reactions of the Petri net are integrated into the corresponding reversible reactions in the unified graph</italic>.</p></fn>
<fn id="tfn2"><p><italic><sup>b</sup>Analysis results from edges of the metabolite graph or reaction graph correspond to several edges and nodes in the unified graph</italic>.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Numeric values of the vector (<italic>nv</italic>&#x02009;&#x02208;&#x02009;<italic>NV</italic>) are assigned to elements of the <italic>unified graph</italic> (<italic>M</italic> metabolite, <italic>R</italic> reaction, and <italic>E</italic> edge) using the assignment function <italic>zn</italic>: <italic>M</italic>, <italic>R</italic>, <italic>E</italic>&#x02009;&#x02192;&#x02009;<italic>NV</italic>, whereby the vector could comprise numeric values (e.g., sensitivity values), pairs of numeric values (e.g., min and max fluxes), and a set of time, step, and flux value dependent numeric values (e.g., metabolite concentrations over time, steps and sensitivity curves, respectively).</p>
<p>Another type of analysis results data are the elements of graphs, which are assigned to the <italic>unified graph</italic> using the assignment function <italic>zg</italic>: <italic>M</italic>, <italic>R</italic>, <italic>E</italic>&#x02009;&#x02192;&#x02009;<italic>M<sub>x</sub></italic>, <italic>R<sub>x</sub></italic>, <italic>E<sub>x</sub></italic>, whereby <italic>x</italic> can be replaced with <italic>P</italic> Petri net, <italic>S</italic> stoichiometric, <italic>K</italic> kinetic, <italic>M</italic> metabolite, or <italic>R</italic> reaction to define the <italic>specific graphs</italic>. As an example, <italic>Gap-Finding</italic> analysis results in a set of metabolites of the <italic>stoichiometric graph</italic>, which must be assigned to metabolites in the <italic>unified graph</italic> using <italic>zg</italic>: <italic>M</italic>&#x02009;&#x02192;&#x02009;<italic>M<sub>S</sub></italic>.</p>
<p>These assignment functions provide the basis for the visualization of the analysis results in the context of the metabolic model. Furthermore, interaction techniques such as <italic>brushing</italic> &#x00026; <italic>linking</italic> and <italic>animation</italic> support the exploration, for example, of different Petri net invariants in the context of the metabolic model [for more details concerning interaction techniques see Von Landesberger et al. (<xref ref-type="bibr" rid="B30">2011</xref>)]. An integrated visualization by means of an application using the developed method is represented in the Results and Discussion section.</p>
</sec>
</sec>
<sec id="S3" sec-type="discussion">
<label>3</label> <title>Results and Discussion</title>
<p>In conclusion, the developed method allows previously separated well-established modeling formalisms to be combined into one application using one workflow, supported by interaction techniques and integrated visualizations in the context of the metabolic model. The method mitigates the weaknesses (&#x02212;) of independent modeling formalisms as explained in the Introduction section and leads to major (&#x0002B;) or minor (&#x000B1;) improvements of an integrated analysis as already depicted in Figure <xref ref-type="fig" rid="F1">1</xref>.</p>
<p>In detail, using the integrated approach it is not required to define detailed kinetics to derive quantitative predictions and reveal dynamic behavior of the underlying biological system. Instead, using some parameters the Petri net simulation or stoichiometric modeling method FBA could be performed to approximate kinetic simulations. Thus, larger models are applicable in the integrated approach leading to analysis results, which could be again integrated to analyze the model further. Additionally, qualitative analysis can be conducted for extended Petri nets using another integrated formalism such as Dead-End analysis or centrality analysis. Quantitative predictions can be revealed for a qualitative model with a static description using stoichiometric analysis.</p>
<p>Hence, different modeling formalisms complement each other even through, overlaps between the introduced metabolic modeling formalisms exist. For example, the stoichiometric matrix used in the stoichiometric modeling formalism to derive mass balance equations corresponds to the incidence matrix of the Petri net formalism used to derive an equation system solved for, e.g., invariant analysis. In the case of structural analysis, both the stoichiometric and the Petri net formalism could be utilized to reveal, for example, <italic>Dead-End</italic> metabolites. Additionally, Petri net T-invariants correspond to flux modes, which could be directly calculated using the stoichiometric analysis method elementary flux modes (not presented here).</p>
<p>The described method is implemented as an Add-on for the <italic>VANTED</italic> system (Rohn et al., <xref ref-type="bibr" rid="B28">2012</xref>), called the System Biology Metabolic Model Framework (<italic>SBM</italic><sup>2</sup> &#x02013; Framework). It utilizes and extends <italic>VANTED</italic>s functionality for the interpretation of experimental data and for analyzing metabolic models with different modeling formalisms.</p>
<p>In order to characterize the metabolic functionality and behavior of the crop plant potato (<italic>Solanum tuberosum</italic>) an integrative analysis is performed using the described method. Due to its main component, starch in the potato tuber, potato is of great importance as food and in industry, for example, for the production of fuel. Therefore, a major aim of plant breeding is to improve the distribution of biomass within the plant in favor of harvestable plant parts. Based on the homogeneous tissue of the potato tuber the main flux of metabolites is from sucrose to starch (Geigenberger et al., <xref ref-type="bibr" rid="B7">2004</xref>). The investigation of sucrose degradation can be conducted. Almost all genes of this pathway are already known and thus provide the basis for the reconstruction of a metabolic model of the potato tuber.</p>
<p>Using a kinetic model representing the sucrose breakdown in the developing potato tuber (Junker, <xref ref-type="bibr" rid="B12">2004</xref>) the integrative analysis is performed and analysis results are shown in Figure <xref ref-type="fig" rid="F4">4</xref>A. The model comprises of 15 reactions and 17 metabolites located in the cytosol. Sucrose (<italic>Suc</italic>) is converted into hexose phosphates (e.g., glucose-6 phosphate, <italic>G</italic>6<italic>P</italic>) utilized in glycolysis (<italic>Glyc</italic>) and as precursors for starch synthase (<italic>StaSy</italic>). The pathways <italic>Glyc</italic>, starch biosynthesis, and energy consumption (<italic>ATP</italic><sub>cons</sub>) are modeled as summarized reactions. This is a necessary simplification to avoid unknown transport processes into additional compartments. To describe the environment the model is extended through sucrose import (<italic>Imp</italic>) and starch export reactions (<italic>Exp</italic>).</p>
<fig position="float" id="F4">
<label>Figure 4</label>
<caption>
<p><bold>Integrative analysis of the sucrose breakdown in the potato tuber</bold>. <bold>(A)</bold> The kinetic analysis results in time-course diagrams of metabolites and reactions (left wild type, right overexpression of <italic>Inv</italic>), <bold>(B)</bold> enlarged view of both diagrams for metabolite starch. Petri net invariant analysis results in T-invariants, one is represented using numbers (firing counter, left lower corner in pink) assigned to reactions. The steady-state flux distribution resulting from FBA optimized for maximization of starch biosynthesis is depicted as edge thickness (gray edge indicates 0 flux). <bold>(C)</bold> The topological analysis (shortest path betweenness centrality analysis) of the <italic>metabolite graph</italic> results in a <bold>(D)</bold> ranked table. Two metabolites are selected in the table (blue), which correspond to the highlighted (red) nodes in <bold>(A,C)</bold>.</p></caption>
<graphic xlink:href="fbioe-02-00091-g004.tif"/>
</fig>
<p>The kinetic analysis results in time-course diagrams converging toward a steady-state producing starch, which can be increased by an overexpression of the enzyme invertase (<italic>Inv</italic>) as described in Junker (<xref ref-type="bibr" rid="B12">2004</xref>). The consequence of the overexpression can be compared and visually analyzed to investigate both situations side by side in the model, see Figures <xref ref-type="fig" rid="F4">4</xref>A,B.</p>
<p>To perform a stochastic simulation the steady-state reaction rates generated by the kinetic analysis are used to weight the reactions of the eSPN. The stochastic simulation results in increasing and decreasing metabolite concentrations, which oscillate with different amplitudes (data not shown). The results indicate the production of starch and the utilization of reactions with different probabilities.</p>
<p>Additionally, the invariant analysis reveals beside 3 P-invariants (reflecting substance conservation) 19 T-invariants, which can be grouped in trivial and non-trivial T-invariants. Each of the seven trivial T-invariants corresponds to a reversible reaction. The non-trivial T-invariants can be differentiated in a group of nine representing the cleavage of sucrose by invertase and another group of three where the sucrose is cleaved by sucrose synthase. These T-invariants reflect the main processes that are pathways taking place in the metabolic model in reality (Koch et al., <xref ref-type="bibr" rid="B14">2005</xref>). One of the T-invariants is illustrated in Figure <xref ref-type="fig" rid="F4">4</xref>A by adding numbers (firing counter) to the corresponding reactions. Sucrose is initially cleaved by invertase, leading to the production of hexose phosphates, which are metabolized in <italic>Glyc</italic> and starch biosynthesis.</p>
<p>The stoichiometric analysis (irrespective regulatory processes), using only three steady-state reaction rates (<italic>Inv</italic>&#x02009;&#x0003D;&#x02009;0.16&#x02009;&#x003BC;M/FW/s, <italic>SuSy</italic>&#x02009;&#x0003D;&#x02009;4.89&#x02009;&#x003BC;M/FW/s, <italic>ATPcons</italic>&#x02009;&#x0003D;&#x02009;100&#x02009;&#x003BC;M/FW/s) to constrain the fluxes for these reactions, results in a flux distribution, which is comparable to the kinetic analysis results. In Figure <xref ref-type="fig" rid="F4">4</xref>A, the edge thickness corresponds to flux values. The flux through the starch biosynthesis reaction with 6.42&#x02009;&#x003BC;M/FW/s is equal to the one of the kinetic analysis. Additionally, the reaction <italic>AdK</italic> is not utilized as can be seen in results of the kinetic and Petri net analysis.</p>
<p>Using the <italic>metabolite graph</italic>, see Figure <xref ref-type="fig" rid="F4">4</xref>C, the structure of the potato model is investigated. To identify important metabolites that occur on the shortest paths between two nodes in a ranked way the <italic>shortest path betweenness (SPB)</italic> centrality analysis is conducted. As a result, the table in Figure <xref ref-type="fig" rid="F4">4</xref>D illustrates <italic>Suc</italic> and <italic>G</italic>6<italic>P</italic>, which are selected to be highlighted in Figures <xref ref-type="fig" rid="F4">4</xref>A,C. Both metabolites are very important in the model, indicating that without these metabolites the reactions of starch biosynthesis and <italic>Glyc</italic> could not be processed.</p>
<p>In summary, using the integrative analysis allows different modeling formalisms to be investigated in one workflow. An integrated and interactive visualization of the analysis results leads to an advantage over the use of each modeling formalism independently. This helps to compare analysis results from different formalisms within one metabolic model and allows for the investigation of analysis results from one formalism in another, as mentioned in the use case.</p>
</sec>
<sec id="S4">
<label>4</label> <title>Conclusion</title>
<p>We described a method, which is able to bring together different metabolic modeling formalisms. The integration is realized by a <italic>unified graph</italic>, enabling graph transformations, and a visualization in a standardized and formalized way. The <italic>unified graph</italic> supports user interaction and thereby allows different analysis results to be explored in the context of the metabolic model. The application reveals structural and dynamic properties of the crop plant potato utilizing the integrative analysis. The method has been implemented as an extension of the <italic>VANTED</italic> system and could also be applied to other model types, but we have focused here on metabolic models as an application area.</p>
<p>Combining different modeling formalisms opens many possibilities for future research. Additional analysis algorithms can be added to study metabolic models in more detail. We plan to extend the method for different types of models such as gene regulatory models to investigate further cellular processes. This extension requires the adaptation of the <italic>unified graph</italic>, adding of appropriate modeling formalisms, and corresponding transformations. Furthermore, the visualization has to be adapted to represent different types of models in <italic>SBGN</italic> using, for example, the sub-language <italic>SBGN-AF</italic> for gene regulatory models.</p>
</sec>
<sec id="S5">
<title>Author Contributions</title>
<p>Anja Hartmann developed the theoretical framework, the use case, and implemented the <italic>SBM</italic><sup>2</sup> &#x02013; Framework software. Falk Schreiber supervised the project and gave conceptual advice. Both authors wrote the manuscript.</p>
</sec>
<sec id="S6">
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="S7">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at <uri xlink:href="http://www.frontiersin.org/Journal/10.3389/fbioe.2014.00091/abstract">http://www.frontiersin.org/Journal/10.3389/fbioe.2014.00091/abstract</uri></p>
<supplementary-material xlink:href="Presentation_1.PDF" id="SM1" mimetype="applicationn/PDF" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baldan</surname> <given-names>P.</given-names></name> <name><surname>Cocco</surname> <given-names>N.</given-names></name> <name><surname>Marin</surname> <given-names>A.</given-names></name> <name><surname>Simeoni</surname> <given-names>M.</given-names></name></person-group> (<year>2010</year>). <article-title>Petri nets for modelling metabolic pathways: a survey</article-title>. <source>Nat. Comput.</source> <volume>9</volume>, <fpage>955</fpage>&#x02013;<lpage>989</lpage>.<pub-id pub-id-type="doi">10.1007/s11047-010-9180-6</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Birch</surname> <given-names>E. W.</given-names></name> <name><surname>Udell</surname> <given-names>M.</given-names></name> <name><surname>Covert</surname> <given-names>M. W.</given-names></name></person-group> (<year>2014</year>). <article-title>Incorporation of flexible objectives and time-linked simulation with flux balance analysis</article-title>. <source>J. Theor. Biol.</source> <volume>345</volume>, <fpage>12</fpage>&#x02013;<lpage>21</lpage>.<pub-id pub-id-type="doi">10.1016/j.jtbi.2013.12.009</pub-id><pub-id pub-id-type="pmid">24361328</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000FC;chel</surname> <given-names>F.</given-names></name> <name><surname>Rodriguez</surname> <given-names>N.</given-names></name> <name><surname>Swainston</surname> <given-names>N.</given-names></name> <name><surname>Wrzodek</surname> <given-names>C.</given-names></name> <name><surname>Czauderna</surname> <given-names>T.</given-names></name> <name><surname>Keller</surname> <given-names>R.</given-names></name> <etal/></person-group> (<year>2013</year>). <article-title>Path2models: large-scale generation of computational models from biochemical pathway maps</article-title>. <source>BMC Syst. Biol.</source> <volume>7</volume>:<fpage>116</fpage>.<pub-id pub-id-type="doi">10.1186/1752-0509-7-116</pub-id><pub-id pub-id-type="pmid">24180668</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>M.</given-names></name> <name><surname>Hariharaputran</surname> <given-names>S.</given-names></name> <name><surname>Hofest&#x000E4;dt</surname> <given-names>R.</given-names></name> <name><surname>Kormeier</surname> <given-names>B.</given-names></name> <name><surname>Spangardt</surname> <given-names>S.</given-names></name></person-group> (<year>2011</year>). <article-title>Petri net models for the semi-automatic construction of large scale biological networks</article-title>. <source>Nat. Comput.</source> <volume>10</volume>, <fpage>1077</fpage>&#x02013;<lpage>1097</lpage>.<pub-id pub-id-type="doi">10.1007/s11047-009-9151-y</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chowdhury</surname> <given-names>A.</given-names></name> <name><surname>Zomorrodi</surname> <given-names>A. R.</given-names></name> <name><surname>Maranas</surname> <given-names>C. D.</given-names></name></person-group> (<year>2014</year>). <article-title>k-OptForce: integrating kinetics with flux balance analysis for strain design</article-title>. <source>PLoS Comput. Biol.</source> <volume>10</volume>:<fpage>e1003487</fpage>.<pub-id pub-id-type="doi">10.1371/journal.pcbi.1003487</pub-id><pub-id pub-id-type="pmid">24586136</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dandekar</surname> <given-names>T.</given-names></name> <name><surname>Fieselmann</surname> <given-names>A.</given-names></name> <name><surname>Majeed</surname> <given-names>S.</given-names></name> <name><surname>Ahmed</surname> <given-names>Z.</given-names></name></person-group> (<year>2012</year>). <article-title>Software applications toward quantitative metabolic flux analysis and modeling</article-title>. <source>Brief. Bioinformatics</source> <volume>15</volume>, <fpage>91</fpage>&#x02013;<lpage>107</lpage>.<pub-id pub-id-type="doi">10.1093/bib/bbs065</pub-id><pub-id pub-id-type="pmid">23142828</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Geigenberger</surname> <given-names>P.</given-names></name> <name><surname>Stitt</surname> <given-names>M.</given-names></name> <name><surname>Fernie</surname> <given-names>A. R.</given-names></name></person-group> (<year>2004</year>). <article-title>Metabolic control analysis and regulation of the conversion of sucrose to starch in growing potato tubers</article-title>. <source>Plant Cell Environ.</source> <volume>27</volume>, <fpage>655</fpage>&#x02013;<lpage>673</lpage>.<pub-id pub-id-type="doi">10.1111/j.1365-3040.2004.01183.x</pub-id></citation></ref>
<ref id="B8"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Gilbert</surname> <given-names>D.</given-names></name> <name><surname>Heiner</surname> <given-names>M.</given-names></name></person-group> (<year>2006</year>). &#x0201C;<article-title>From Petri nets to differential equations &#x02013; an integrative approach for biochemical network analysis</article-title>,&#x0201D; in <source>ICATPN, Volume 4024 of Lecture Notes in Computer Science</source>, eds <person-group person-group-type="editor"><name><surname>Donatelli</surname> <given-names>S.</given-names></name> <name><surname>Thiagarajan</surname> <given-names>P. S.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>181</fpage>&#x02013;<lpage>200</lpage>.</citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grafahrend-Belau</surname> <given-names>E.</given-names></name> <name><surname>Junker</surname> <given-names>A.</given-names></name> <name><surname>Eschenr&#x000F6;der</surname> <given-names>A.</given-names></name> <name><surname>M&#x000FC;ller</surname> <given-names>J.</given-names></name> <name><surname>Schreiber</surname> <given-names>F.</given-names></name> <name><surname>Junker</surname> <given-names>B. H.</given-names></name></person-group> (<year>2013</year>). <article-title>Multiscale metabolic modeling: dynamic flux balance analysis on a whole-plant scale</article-title>. <source>Plant Physiol.</source> <volume>163</volume>, <fpage>637</fpage>&#x02013;<lpage>647</lpage>.<pub-id pub-id-type="doi">10.1104/pp.113.224006</pub-id><pub-id pub-id-type="pmid">23926077</pub-id></citation></ref>
<ref id="B10"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Heiner</surname> <given-names>M.</given-names></name> <name><surname>Herajy</surname> <given-names>M.</given-names></name> <name><surname>Liu</surname> <given-names>F.</given-names></name> <name><surname>Rohr</surname> <given-names>C.</given-names></name> <name><surname>Schwarick</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). &#x0201C;<article-title>Snoopy &#x02013; a unifying Petri net tool</article-title>,&#x0201D; in <source>Application and Theory of Petri Nets, Volume 7347 of Lecture Notes in Computer Science</source>, eds <person-group person-group-type="editor"><name><surname>Haddad</surname> <given-names>S.</given-names></name> <name><surname>Pomello</surname> <given-names>L.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>398</fpage>&#x02013;<lpage>407</lpage>.</citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>H&#x000FC;bner</surname> <given-names>K.</given-names></name> <name><surname>Sahle</surname> <given-names>S.</given-names></name> <name><surname>Kummer</surname> <given-names>U.</given-names></name></person-group> (<year>2011</year>). <article-title>Applications and trends in systems biology in biochemistry</article-title>. <source>FEBS J.</source> <volume>278</volume>, <fpage>2767</fpage>&#x02013;<lpage>2857</lpage>.<pub-id pub-id-type="doi">10.1111/j.1742-4658.2011.08217.x</pub-id><pub-id pub-id-type="pmid">21707921</pub-id></citation></ref>
<ref id="B12"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Junker</surname> <given-names>B. H.</given-names></name></person-group> (<year>2004</year>). <source>Sucrose Breakdown in the Potato Tuber</source>. Dissertation, Faculty of Science, <publisher-loc>Potsdam</publisher-loc>: <publisher-name>University of Potsdam</publisher-name>.</citation></ref>
<ref id="B13"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Koch</surname> <given-names>I.</given-names></name> <name><surname>Heiner</surname> <given-names>M.</given-names></name></person-group> (<year>2008</year>). &#x0201C;<article-title>Petri nets</article-title>,&#x0201D; in <source>Analysis of Biological Networks</source>, eds <person-group person-group-type="editor"><name><surname>Junker</surname> <given-names>B. H.</given-names></name> <name><surname>Schreiber</surname> <given-names>F.</given-names></name></person-group> (<publisher-name>Wiley</publisher-name>), <fpage>139</fpage>&#x02013;<lpage>180</lpage>.</citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koch</surname> <given-names>I.</given-names></name> <name><surname>Junker</surname> <given-names>B. H.</given-names></name> <name><surname>Heiner</surname> <given-names>M.</given-names></name></person-group> (<year>2005</year>). <article-title>Application of Petri net theory for modelling and validation of the sucrose breakdown pathway in the potato tuber</article-title>. <source>Bioinformatics</source> <volume>21</volume>, <fpage>1219</fpage>&#x02013;<lpage>1226</lpage>.<pub-id pub-id-type="doi">10.1093/bioinformatics/bti145</pub-id><pub-id pub-id-type="pmid">15546934</pub-id></citation></ref>
<ref id="B15"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Koch</surname> <given-names>I.</given-names></name> <name><surname>Reisig</surname> <given-names>W.</given-names></name> <name><surname>Schreiber</surname> <given-names>F.</given-names></name></person-group> (<year>2011</year>). <source>Modeling in Systems Biology: The Petri net Approach</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer</publisher-name>, <fpage>16</fpage>.</citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kosch&#x000FC;tzki</surname> <given-names>D.</given-names></name> <name><surname>Schreiber</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <article-title>Centrality analysis methods for biological networks and their application to gene regulatory networks</article-title>. <source>Gene Regul. Syst. Bio.</source> <volume>2</volume>, <fpage>193</fpage>&#x02013;<lpage>201</lpage>.<pub-id pub-id-type="pmid">19787083</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Le Nov&#x000E8;re</surname> <given-names>N.</given-names></name> <name><surname>Hucka</surname> <given-names>M.</given-names></name> <name><surname>Mi</surname> <given-names>H.</given-names></name> <name><surname>Moodie</surname> <given-names>S.</given-names></name> <name><surname>Schreiber</surname> <given-names>F.</given-names></name> <name><surname>Sorokin</surname> <given-names>A.</given-names></name> <etal/></person-group> (<year>2009</year>). <article-title>The systems biology graphical notation</article-title>. <source>Nat. Biotechnol.</source> <volume>27</volume>, <fpage>735</fpage>&#x02013;<lpage>741</lpage>.<pub-id pub-id-type="doi">10.1038/nbt0909-864d</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lewis</surname> <given-names>N. E.</given-names></name> <name><surname>Nagarajan</surname> <given-names>H.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2012</year>). <article-title>Constraining the metabolic genotype-phenotype relationship using a phylogeny of in silico methods</article-title>. <source>Nat. Rev. Microbiol.</source> <volume>77</volume>, <fpage>541</fpage>&#x02013;<lpage>580</lpage>.<pub-id pub-id-type="doi">10.1038/nrmicro2737</pub-id><pub-id pub-id-type="pmid">22367118</pub-id></citation></ref>
<ref id="B19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Machado</surname> <given-names>D.</given-names></name> <name><surname>Costa</surname> <given-names>R.</given-names></name> <name><surname>Rocha</surname> <given-names>M.</given-names></name> <name><surname>Ferreira</surname> <given-names>E. C.</given-names></name> <name><surname>Tidor</surname> <given-names>B.</given-names></name> <name><surname>Rocha</surname> <given-names>I.</given-names></name></person-group> (<year>2011</year>). <article-title>Modeling formalisms in systems biology</article-title>. <source>AMB Express</source> <volume>1</volume>, <fpage>45</fpage>&#x02013;<lpage>58</lpage>.<pub-id pub-id-type="doi">10.1186/2191-0855-1-45</pub-id></citation></ref>
<ref id="B20"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Machado</surname> <given-names>D.</given-names></name> <name><surname>Costa</surname> <given-names>R. S.</given-names></name> <name><surname>Rocha</surname> <given-names>M.</given-names></name> <name><surname>Rocha</surname> <given-names>I.</given-names></name> <name><surname>Tidor</surname> <given-names>B.</given-names></name> <name><surname>Ferreira</surname> <given-names>E. C.</given-names></name></person-group> (<year>2010</year>). &#x0201C;<article-title>Model transformation of metabolic networks using a Petri net based framework</article-title>,&#x0201D; in <conf-name>ACSD/Petri Nets Workshops, Volume 827 of CEUR Workshop Proceedings</conf-name>, eds <person-group person-group-type="editor"><name><surname>Donatelli</surname> <given-names>S.</given-names></name> <name><surname>Kleijn</surname> <given-names>J.</given-names></name> <name><surname>Machado</surname> <given-names>R. J.</given-names></name> <name><surname>Fernandes</surname> <given-names>J. M.</given-names></name></person-group> (<conf-loc>Braga</conf-loc>: <conf-sponsor>CEUR-WS.org</conf-sponsor>), <fpage>103</fpage>&#x02013;<lpage>117</lpage>.</citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moodie</surname> <given-names>S.</given-names></name> <name><surname>Nov&#x000E8;re</surname> <given-names>N. L.</given-names></name> <name><surname>Demir</surname> <given-names>E.</given-names></name> <name><surname>Mi</surname> <given-names>H.</given-names></name> <name><surname>Schreiber</surname> <given-names>F.</given-names></name></person-group> (<year>2011</year>). <article-title>Systems biology graphical notation: process description language level 1</article-title>. <source>Nat. Proc</source>.<pub-id pub-id-type="doi">10.1038/npre.2011.3721.4</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murata</surname> <given-names>T.</given-names></name></person-group> (<year>1989</year>). <article-title>Petri nets: properties, analysis and applications</article-title>. <source>Proc. IEEE</source> <volume>10</volume>, <fpage>291</fpage>&#x02013;<lpage>291</lpage>.</citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nagasaki</surname> <given-names>M.</given-names></name> <name><surname>Saito</surname> <given-names>A.</given-names></name> <name><surname>Jeong</surname> <given-names>E.</given-names></name> <name><surname>Li</surname> <given-names>C.</given-names></name> <name><surname>Kojima</surname> <given-names>K.</given-names></name> <name><surname>Ikeda</surname> <given-names>E.</given-names></name> <etal/></person-group> (<year>2010</year>). <article-title>Cell illustrator 4.0: a computational platform for systems biology</article-title>. <source>In silico Biol.</source> <volume>10</volume>, <fpage>5</fpage>&#x02013;<lpage>26</lpage>.</citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Orth</surname> <given-names>J. D.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2010</year>). <article-title>What is flux balance analysis?</article-title> <source>Nat. Biotechnol.</source> <volume>28</volume>, <fpage>245</fpage>&#x02013;<lpage>248</lpage>.<pub-id pub-id-type="doi">10.1038/nbt.1614</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pfau</surname> <given-names>T.</given-names></name> <name><surname>Christian</surname> <given-names>N.</given-names></name> <name><surname>Ebenh&#x000F6;h</surname> <given-names>O.</given-names></name></person-group> (<year>2011</year>). <article-title>Systems approaches to modelling pathways and networks</article-title>. <source>Brief. Funct. Genomics</source> <volume>10</volume>, <fpage>266</fpage>&#x02013;<lpage>279</lpage>.<pub-id pub-id-type="doi">10.1093/bfgp/elr022</pub-id><pub-id pub-id-type="pmid">21903724</pub-id></citation></ref>
<ref id="B26"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Reisig</surname> <given-names>W.</given-names></name></person-group> (<year>2013</year>). <source>Understanding Petri Nets &#x02013; Modeling Techniques, Analysis Methods, Case Studies</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>.</citation></ref>
<ref id="B27"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Resat</surname> <given-names>H.</given-names></name> <name><surname>Petzold</surname> <given-names>L.</given-names></name> <name><surname>Pettigrew</surname> <given-names>M. F.</given-names></name></person-group> (<year>2009</year>). &#x0201C;<article-title>Kinetic modeling of biological systems</article-title>,&#x0201D; in <source>Computational Systems Biology., Volume 541 of Methods in Molecular Biology</source>, eds <person-group person-group-type="editor"><name><surname>Ireton</surname> <given-names>R.</given-names></name> <name><surname>Montgomery</surname> <given-names>K.</given-names></name> <name><surname>Bumgarner</surname> <given-names>R.</given-names></name> <name><surname>Samudrala</surname> <given-names>R.</given-names></name> <name><surname>McDermott</surname> <given-names>J.</given-names></name></person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>Humana Press</publisher-name>), <fpage>311</fpage>&#x02013;<lpage>335</lpage>.</citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rohn</surname> <given-names>H.</given-names></name> <name><surname>Junker</surname> <given-names>A.</given-names></name> <name><surname>Hartmann</surname> <given-names>A.</given-names></name> <name><surname>Grafahrend-Belau</surname> <given-names>E.</given-names></name> <name><surname>Treutler</surname> <given-names>H.</given-names></name> <name><surname>Klapperst&#x000FC;ck</surname> <given-names>M.</given-names></name> <etal/></person-group> (<year>2012</year>). <article-title>Vanted v2: a framework for systems biology applications</article-title>. <source>BMC Syst. Biol.</source> <volume>6</volume>:<fpage>139</fpage>.<pub-id pub-id-type="doi">10.1186/1752-0509-6-139</pub-id><pub-id pub-id-type="pmid">23140568</pub-id></citation></ref>
<ref id="B29"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Steuer</surname> <given-names>R.</given-names></name> <name><surname>Junker</surname> <given-names>B. H.</given-names></name></person-group> (<year>2008</year>). &#x0201C;<article-title>Computational models of metabolism: stability and regulation in metabolic networks</article-title>,&#x0201D; in <source>Advances in Chemical Physics</source>, Vol. <volume>142</volume>, ed. <person-group person-group-type="editor"><name><surname>Rice</surname> <given-names>S. A.</given-names></name></person-group> (<publisher-loc>Hoboken</publisher-loc>: <publisher-name>John Wiley and Sons, Inc</publisher-name>), <fpage>105</fpage>&#x02013;<lpage>251</lpage>.<pub-id pub-id-type="doi">10.1002/9780470475935.ch3</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Von Landesberger</surname> <given-names>T.</given-names></name> <name><surname>Kuijper</surname> <given-names>A.</given-names></name> <name><surname>Schreck</surname> <given-names>T.</given-names></name> <name><surname>Kohlhammer</surname> <given-names>J.</given-names></name> <name><surname>van Wijk</surname> <given-names>J.</given-names></name> <name><surname>Fekete</surname> <given-names>J.-D.</given-names></name> <etal/></person-group> (<year>2011</year>). <article-title>Visual analysis of large graphs: state-of-the-art and future research challenges</article-title>. <source>Comput. Graph. Forum</source> <volume>30</volume>, <fpage>1719</fpage>&#x02013;<lpage>1749</lpage>.<pub-id pub-id-type="doi">10.1111/j.1467-8659.2011.01898.x</pub-id></citation></ref>
<ref id="B31"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wiechert</surname> <given-names>W.</given-names></name></person-group> (<year>2002</year>). <article-title>Modeling and simulation: tools for metabolic engineering</article-title>. <source>J. Biotechnol.</source> <volume>94</volume>, <fpage>37</fpage>&#x02013;<lpage>63</lpage>.<pub-id pub-id-type="doi">10.1016/S0168-1656(01)00418-7</pub-id></citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xu</surname> <given-names>C.</given-names></name> <name><surname>Liu</surname> <given-names>L.</given-names></name> <name><surname>Zhang</surname> <given-names>Z.</given-names></name> <name><surname>Jin</surname> <given-names>D.</given-names></name> <name><surname>Qiu</surname> <given-names>J.</given-names></name> <name><surname>Chen</surname> <given-names>M.</given-names></name></person-group> (<year>2013</year>). <article-title>Genome-scale metabolic model in guiding metabolic engineering of microbial improvement</article-title>. <source>Appl. Microbiol. Biotechnol.</source> <volume>97</volume>, <fpage>519</fpage>&#x02013;<lpage>539</lpage>.<pub-id pub-id-type="doi">10.1007/s00253-012-4543-9</pub-id><pub-id pub-id-type="pmid">23188456</pub-id></citation></ref>
</ref-list>
</back>
</article>