<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="methods-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Physiol.</journal-id>
<journal-title>Frontiers in Physiology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Physiol.</abbrev-journal-title>
<issn pub-type="epub">1664-042X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fphys.2016.00327</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Physiology</subject>
<subj-group>
<subject>Protocols</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>MetaboTools: A Comprehensive Toolbox for Analysis of Genome-Scale Metabolic Models</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Aurich</surname> <given-names>Maike K.</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/139819/overview"/></contrib>
<contrib contrib-type="author">
<name><surname>Fleming</surname> <given-names>Ronan M. T.</given-names></name></contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Thiele</surname> <given-names>Ines</given-names></name>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/93677/overview"/></contrib>
</contrib-group>
<aff><institution>Luxembourg Centre for Systems Biomedicine, University of Luxembourg</institution> <country>Esch-sur-Alzette, Luxembourg</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Natalia Polouliakh, Sony Computer Science Laboratories, Japan</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Alberto Marin-Sanguino, Technische Universit&#x000E4;t M&#x000FC;nchen, Germany; Adil Mardinoglu, Chalmers University of Technology, Sweden</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Ines Thiele <email>ines.thiele&#x00040;uni.lu</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Systems Biology, a section of the journal Frontiers in Physiology</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>03</day>
<month>08</month>
<year>2016</year>
</pub-date>
<pub-date pub-type="collection">
<year>2016</year>
</pub-date>
<volume>7</volume>
<elocation-id>327</elocation-id>
<history>
<date date-type="received">
<day>26</day>
<month>05</month>
<year>2016</year>
</date>
<date date-type="accepted">
<day>18</day>
<month>07</month>
<year>2016</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2016 Aurich, Fleming and Thiele.</copyright-statement>
<copyright-year>2016</copyright-year>
<copyright-holder>Aurich, Fleming and Thiele</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Metabolomic data sets provide a direct read-out of cellular phenotypes and are increasingly generated to study biological questions. Previous work, by us and others, revealed the potential of analyzing extracellular metabolomic data in the context of the metabolic model using constraint-based modeling. With the MetaboTools, we make our methods available to the broader scientific community. The MetaboTools consist of a protocol, a toolbox, and tutorials of two use cases. The protocol describes, in a step-wise manner, the workflow of data integration, and computational analysis. The MetaboTools comprise the Matlab code required to complete the workflow described in the protocol. Tutorials explain the computational steps for integration of two different data sets and demonstrate a comprehensive set of methods for the computational analysis of metabolic models and stratification thereof into different phenotypes. The presented workflow supports integrative analysis of multiple omics data sets. Importantly, all analysis tools can be applied to metabolic models without performing the entire workflow. Taken together, the MetaboTools constitute a comprehensive guide to the intra-model analysis of extracellular metabolomic data from microbial, plant, or human cells. This computational modeling resource offers a broad set of computational analysis tools for a wide biomedical and non-biomedical research community.</p>
</abstract>
<kwd-group>
<kwd>constraint-based reconstruction and analysis (COBRA)</kwd>
<kwd>metabolomics</kwd>
<kwd>metabolism</kwd>
<kwd>metabolic modeling</kwd>
<kwd>metabolic phenotypes</kwd>
<kwd>protocol</kwd>
<kwd>model analysis</kwd>
</kwd-group>
<counts>
<fig-count count="8"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="57"/>
<page-count count="24"/>
<word-count count="15147"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>Omics data are used to determine comprehensively qualitatively or quantitatively cellular components and how they change across different conditions (Mo et al., <xref ref-type="bibr" rid="B37">2009</xref>; Bordbar et al., <xref ref-type="bibr" rid="B11">2010</xref>, <xref ref-type="bibr" rid="B12">2012</xref>; Cuperlovic-Culf et al., <xref ref-type="bibr" rid="B14">2010</xref>). Of those, metabolomic data are the closest to an observed phenotype (Allen et al., <xref ref-type="bibr" rid="B4">2004</xref>; Krug et al., <xref ref-type="bibr" rid="B29">2012</xref>; Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>). Consequently, metabolomics is becoming an indispensable analytical method for many biological disciplines, including microbiology, plant sciences, biotechnology, and biomedicine (Kell, <xref ref-type="bibr" rid="B28">2004</xref>; Saito and Matsuda, <xref ref-type="bibr" rid="B44">2010</xref>; Petersen et al., <xref ref-type="bibr" rid="B41">2013</xref>).</p>
<p>However, the analysis and interpretation of metabolomic data is still in its infancy, limiting the interpretation to few metabolic pathways rather than providing a comprehensive understanding of the underlying mechanistic basis (Cuperlovic-Culf et al., <xref ref-type="bibr" rid="B14">2010</xref>). At the same time, computational modeling methods, such as constraint-based metabolic modeling (Orth et al., <xref ref-type="bibr" rid="B39">2010</xref>), are becoming increasingly popular for the interpretation of omics data (Joyce and Palsson, <xref ref-type="bibr" rid="B27">2006</xref>) and for the generation of experimentally testable hypotheses (Frezza et al., <xref ref-type="bibr" rid="B18">2011</xref>; Bordbar and Palsson, <xref ref-type="bibr" rid="B10">2012</xref>; Ghaffari et al., <xref ref-type="bibr" rid="B20">2015</xref>).</p>
<p>Metabolomic data can be obtained from quenched cells (intracellular metabolome) or from the spent medium of cells in culture (extracellular metabolomic data). Extracellular metabolomic data sets are generated from cultivations of cell lines in order to metabolically characterize them under different experimental conditions (e.g., drug treatment and hypoxia) (Paglia et al., <xref ref-type="bibr" rid="B40">2012</xref>; Fu et al., <xref ref-type="bibr" rid="B19">2014</xref>; Kucharzewska et al., <xref ref-type="bibr" rid="B30">2015</xref>). The extracellular metabolome captures metabolite consumption and byproduct release, e.g., lactate secretion by cancer cells, which can be interpreted as readout of the intracellular pathway use, such as aerobic glycolysis in cancer cells (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>). Whereas the connection between lactate and glycolytic flux is quite straightforward, the integration of entire uptake and secretion profiles can lead to novel insights of complex interactions between multiple pathways, which may be difficult to unveil manually. Previously, the intra-model analysis of extracellular metabolomic data of two T-cell lines let to the prediction of phenotypic properties of the cell lines, namely differences in flux through the TCA cycle and the electron transport chain, which were subsequently experimentally supported (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>). Computational analysis enables the prediction of the intracellular pathway activity that explain the measured metabolite uptake and secretion pattern and differences thereof between, e.g., cell lines or environmental conditions, and can lead to experimentally testable hypothesis.</p>
<p>The advantage of using extracellular metabolomic data lies in the accessibility of the medium, which saves time in sample preparation and allows for repeated measurements from the same cells. Moreover, concentration changes in the spent medium resulting from uptake and secretion by the cells can be converted into fluxes and used as constraints on the exchange reactions.</p>
<p>Extracellular metabolomic data have been extensively used in metabolic modeling to define cell and tissue specific exchange pattern (Mo et al., <xref ref-type="bibr" rid="B37">2009</xref>; Cottret et al., <xref ref-type="bibr" rid="B13">2010</xref>; Ahn et al., <xref ref-type="bibr" rid="B3">2011</xref>; Jamshidi et al., <xref ref-type="bibr" rid="B25">2011</xref>; Fan et al., <xref ref-type="bibr" rid="B16">2013</xref>; Mardinoglu et al., <xref ref-type="bibr" rid="B33">2013</xref>); however, the process has never been addressed by a protocol explicitly. In comparison to the integration of transcriptomic data with metabolic models (Blazier and Papin, <xref ref-type="bibr" rid="B9">2012</xref>; Machado and Herrgard, <xref ref-type="bibr" rid="B32">2014</xref>), tools for integration of metabolomic data have not yet been made assessable to a broader research community. Some methods for the generation of contextualized metabolic submodels allow consideration of intracellular metabolomic data and the presence of reactions producing a set of detected metabolites is ensured (Jerby et al., <xref ref-type="bibr" rid="B26">2010</xref>; Schmidt et al., <xref ref-type="bibr" rid="B47">2013</xref>; Vlassis et al., <xref ref-type="bibr" rid="B55">2014</xref>). However, the downstream analysis of contextualized metabolic submodels and their predicted metabolic phenotypes is not supported by these methods. The constraint-based modeling and analysis (COBRA) toolbox (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>) provides an extensive set of functions for the computational analysis of metabolic models and a tutorial is available assisting in the interpretation of model predictions (Orth et al., <xref ref-type="bibr" rid="B39">2010</xref>). Despite the presence of these resources, a step-by-step guide, which captures the entire workflow of data analysis and phenotype prediction, is currently not available. With this protocol, the MetaboTools, and the accompanied tutorials, we close this gap and make a comprehensive set of methods available to the broader research community (Figure <xref ref-type="fig" rid="F1">1</xref>).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>This protocol and the MetaboTools provide comprehensive support for the integration of extracellular metabolomic data and for the analysis and phenotypic stratification of metabolic models</bold>. The workflow captures the integration of processed and annotated metabolomic data sets, the generation of contextualized submodels, and the computational model analysis to distinguish metabolic phenotypes. Each part of the workflow is discussed in detail in the protocol and supported by the MetaboTools Matlab functions. The tutorials (Supplementary Tutorial <xref ref-type="supplementary-material" rid="SM2">I</xref>, <xref ref-type="supplementary-material" rid="SM3">II</xref>) demonstrate two use-cases of the workflow and MetaboTools.</p></caption>
<graphic xlink:href="fphys-07-00327-g0001.tif"/>
</fig>
<p>This work was developed and tested with our recent work (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>), where we integrated extracellular metabolomic data of two T-cell lines with a human metabolic model to characterize the emergent phenotypic properties <italic>in silico</italic>. Furthermore, we recently mapped published metabolomic data from the NCI-60 cell lines (Jain et al., <xref ref-type="bibr" rid="B24">2012</xref>) onto a human metabolic model and developed a suite of computational analysis tools that can be used to predict distinct metabolic features, e.g., the use of distinct pathways for energy production by the cancer cell lines (Aurich et al., unpublished). The protocol discusses important considerations at individual steps to ensure successfully completion of the workflow (Figure <xref ref-type="fig" rid="F1">1</xref>). The tips and stipulations are derived from the aforementioned publications but also from our experience with curation and expansion of the human metabolic model using metabolomic data (Aurich and Thiele, <xref ref-type="bibr" rid="B5">2012</xref>; Thiele et al., <xref ref-type="bibr" rid="B52">2013</xref>; Sahoo et al., <xref ref-type="bibr" rid="B43">2014</xref>).</p>
<sec>
<title>This protocol covers</title>
<p>This protocol provides support for the integration of metabolomic data into the network context and the generation of contextualized models. These contextualized models comprise a subset of the metabolic model and are primed to the prediction of the intracellular pathways, which may give rise to differences in the uptake and secretion profile of different cells or under different environmental conditions, using the minExCard method (Aurich et al., unpublished). Additionally, this work provides tools for the analysis of any metabolic model.</p>
<p>The tutorials exemplify the workflows for intra-model analysis for (1) quantitative and (2) semi-quantitative extracellular metabolomic data (Figure <xref ref-type="fig" rid="F1">1</xref>, see also Supplementary Tutorial <xref ref-type="supplementary-material" rid="SM2">I</xref>, <xref ref-type="supplementary-material" rid="SM3">II</xref>), and make it facilitate the reproduction of our previous work (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>, unpublished). Importantly, the tutorials demonstrate the downstream analysis of the generated models. Additionally, we provide the data that are needed for the different integration steps (Table <xref ref-type="table" rid="T1">1</xref>) and we discuss traits of metabolomic data sets to provide for a basis for their successful integration into the metabolic model (Supplementary Table <xref ref-type="supplementary-material" rid="SM1">1</xref>).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p><bold>Additional data used for the intra-model analysis of metabolomic data</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"><bold>Data type</bold></th>
<th valign="top" align="left"><bold>Unit</bold></th>
<th valign="top" align="left"><bold>Use case I: semi-quantitative data</bold></th>
<th valign="top" align="left"><bold>Use case II: quantitative data</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Cell medium composition (e.g., RPMI medium)</td>
<td valign="top" align="left">mM</td>
<td valign="top" align="left">Yes</td>
<td valign="top" align="left">No</td>
</tr>
<tr>
<td valign="top" align="left">Concentration of Ions and other compounds (e.g., O<sub>2</sub>, CO<sub>2</sub>)</td>
<td valign="top" align="left">mM</td>
<td valign="top" align="left">O<sub>2</sub> defined based on literature</td>
<td valign="top" align="left">O<sub>2</sub> defined based on literature for one of the cell lines</td>
</tr>
<tr>
<td valign="top" align="left">Cell-weight</td>
<td valign="top" align="left">Preferable gdryweight</td>
<td valign="top" align="left">Experimental measurement</td>
<td valign="top" align="left">Defined based on literature for one of the cell lines</td>
</tr>
<tr>
<td valign="top" align="left">Cell count</td>
<td valign="top" align="left">Cells per ml</td>
<td valign="top" align="left">Experimental measurement</td>
<td valign="top" align="left">Not required</td>
</tr>
<tr>
<td valign="top" align="left">Experimental duration (in hours)</td>
<td/>
<td valign="top" align="left">Experimental duration</td>
<td valign="top" align="left">Not required</td>
</tr>
<tr>
<td valign="top" align="left">Detection limits for all detected metabolites (mass spectrometer)</td>
<td valign="top" align="left">Instrumental limit of detection in ng/mL or LODs in mM</td>
<td valign="top" align="left">Experimental measurement</td>
<td valign="top" align="left">Not required</td>
</tr>
<tr>
<td valign="top" align="left">Doubling time</td>
<td valign="top" align="left">Hours or growth rate</td>
<td valign="top" align="left">Experimental measurement</td>
<td valign="top" align="left">Defined in the experiment if possible</td>
</tr>
<tr>
<td valign="top" align="left">Transcriptomic or proteomic data</td>
<td valign="top" align="left">List of absent genes</td>
<td valign="top" align="left">Experimental measurement from the same experiment</td>
<td valign="top" align="left">Not required</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>This protocol does not cover</title>
<p>The protocol provides limited discussion on the integration of other omics data. The compatibility of MetaboTools with the COBRA toolbox (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>) allows the user to apply additionally the transcriptomic data analysis tools provided in the COBRA toolbox (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>). The protocol does not describe the intra-model analysis of intracellular metabolomic, untargeted metabolomic, or isotope labeling data. Furthermore, this protocol does not cover any steps concerning cell culture, mass spectrometry, data processing, and metabolite annotations. We ask the reader to refer to literature and dedicated tools from the respective fields (Fitzpatrick et al., <xref ref-type="bibr" rid="B17">2014</xref>; Beisken et al., <xref ref-type="bibr" rid="B8">2015</xref>; Misra and van der Hooft, <xref ref-type="bibr" rid="B36">2016</xref>).</p>
<p>Genome-scale metabolic models comprise the superset of metabolic pathways appearing in all cells throughout the human body collapsed into one model. Hence, the approach as presented in this protocol cannot be used to predict the contribution of individual cell or tissue types to the changes in human serum or plasma.</p>
</sec>
</sec>
<sec id="s2">
<title>Experimental design</title>
<sec>
<title>The protocol is divided into three stages</title>
<p>The first stage provides the basis for the integration of extracellular metabolomic data, i.e., it ensures that a maximal number of metabolites can be integrated with a model. The second stage discusses the application of constraints and the generation of contextualized models. The third stage discusses the quality control of the contextualized models, the computational analysis tools provided by MetaboTools, and finally the validation of the model predictions. Several iterations of the steps in the second and the third stage may be needed to generate high-quality contextualized models and to obtain biologically-plausible model predictions (Table <xref ref-type="table" rid="T2">2</xref>). Throughout the text, functions are written in italic. Input and output variables are indicated by asterisks (<sup>&#x0002A;</sup>&#x02026;<sup>&#x0002A;</sup>). Matlab code is indicated through &#x0003E;&#x0003E;. Flux units are commonly reported in the Unit mmol/g<sub>dryweight</sub>/hr (U); however, the unit can be varied depending on data.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p><bold>Test case illustrating possible loophole in the reaction constraints</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"><bold>Test case</bold></th>
<th valign="top" align="left"><bold>Missing constraints</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Expectation</td>
<td valign="top" align="left">A human model requires oxygen, no constraints are applied to oxygen exchange.</td>
</tr>
<tr>
<td valign="top" align="left">Reality</td>
<td valign="top" align="left">Contextualized models secrete oxygen.</td>
</tr>
<tr>
<td valign="top" align="left">Consequence</td>
<td valign="top" align="left">Additional constraints need to be applied to prevent oxygen secretion.</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Stage 1: preparation of extracellular metabolomic data and models</title>
<sec>
<title>Associate metabolite IDs of the data with the metabolic model (Step 1)</title>
<p>As a first step, the names of detected metabolites need to be associated with the metabolite abbreviations in the model (Figure <xref ref-type="fig" rid="F2">2A</xref>, see Supplementary Material for an introduction to the model structure). Different standards exist to report metabolite identity and the human genome-scale reconstruction contains annotations for multiple identifiers, e.g., KEGG (Ogata et al., <xref ref-type="bibr" rid="B38">1999</xref>), ChEBI (Degtyarenko et al., <xref ref-type="bibr" rid="B15">2008</xref>), HMDB (Wishart et al., <xref ref-type="bibr" rid="B56">2013</xref>), because none of the databases covers all its metabolites (Thiele et al., <xref ref-type="bibr" rid="B52">2013</xref>). Association of a detected metabolite with a wrong counterpart in the model can lead to irrelevant predictions and conclusions. Moreover, new reactions might be introduced into the model as a consequence of the association and reused by researchers in or outside the working group, often without questioning why these reactions were added (Figure <xref ref-type="fig" rid="F2">2C</xref>). Hence, manual association of the metabolite identifiers is the method of choice, even though tools have been developed to facilitate the matching (e.g., Haraldsdottir et al., <xref ref-type="bibr" rid="B22">2014</xref>). The association is simplest based on, e.g., KEGG or HMDB metabolite identifiers. When matching metabolite names, one should consider synonyms and alternative naming conventions, e.g., palmitic acid is the traditional name of hexadecanoic acid (common name). Metabolite formulae are non-unique, and thus can only be used as additional clue to match metabolites, e.g., glucose and fructose have both C<sub>6</sub>H<sub>12</sub>O<sub>6</sub> as formula.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p><bold>Stage 1: Preparations for the integration of the metabolomic data. (A)</bold> First, the detected metabolites need to be matched to the metabolite ID used in the model. This step is simplified if the metabolomic data are annotated with standard metabolite IDs [e.g., from KEGG (Ogata et al., <xref ref-type="bibr" rid="B38">1999</xref>) or HMDB (Wishart et al., <xref ref-type="bibr" rid="B56">2013</xref>)]. <bold>(B)</bold> Check if transport and exchange reactions exist in the model for each of the matched metabolites using the model metabolite ID. In case of the human genome-scale reconstruction [Recon 2 (Thiele et al., <xref ref-type="bibr" rid="B52">2013</xref>)], you can check for reactions using the virtual metabolic human database (VMH, <ext-link ext-link-type="uri" xlink:href="http://vmh.life">http://vmh.life</ext-link>) or directly in your model with the COBRA toolbox function <italic>findRxnsFromMets</italic>.The illustrated VMH query for glutamine shows two of the glutamine transport reactions (highlighted in blue) and the exchange reaction (highlighted in green) of glutamine. Exchange reactions are by definition written as in the given example. <bold>(C)</bold> Transport reactions need to be identified as comprehensively as possible from the literature. Based on the information gathered about the transport mechanisms, by which a metabolite is transported into and out of the cell, the transport reactions can be formulated. The transport and exchange reactions can be added to the model using rBioNet (Thorleifsson and Thiele, <xref ref-type="bibr" rid="B53">2011</xref>).</p></caption>
<graphic xlink:href="fphys-07-00327-g0002.tif"/>
</fig>
<p>The step results in one group of metabolites successfully associated with model metabolite IDs and a second group of metabolites that does not yet exist in the metabolic model. The addition of novel anabolic or catabolic pathways to include the latter group of metabolites into the model can be time-consuming and requires extensive work as well as testing of the model functionality. The necessary steps have been described in detail elsewhere (Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>). Thus, only the steps needed to prepare the integration of associated metabolites will be considered in this protocol.</p>
</sec>
<sec>
<title>Can metabolites be transported into and out of the cell? (Step 2)</title>
<p>Although a metabolite is present in the model, this does not mean that it can be transported between the intracellular [c] and the extracellular [e] compartment (Figure <xref ref-type="fig" rid="F3">3A</xref>). Hence, it needs to be confirmed that transport reactions exist for all associated metabolites (Figure <xref ref-type="fig" rid="F2">2B</xref>). Transport reactions (e.g., ATP-dependent transport) can be irreversible, and transport reactions might need to be added that allow secretion or uptake of a metabolite. One exchange reaction needs to exist in the model for every associated metabolite (Figure <xref ref-type="fig" rid="F2">2B</xref>), since these (artificial) reactions mediate the supply or removal of metabolites to and from the extracellular environment of the model. These exchange reactions are used for the integration of extracellular metabolomic data into the model (Figure <xref ref-type="fig" rid="F3">3B</xref>).</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p><bold>Shaping the model to predict condition-specific metabolic states (contextualized model)</bold>. <bold>(A)</bold> In order for the model to follow the measured metabolite uptake and secretion profile, both exchange reactions and transport reactions need to be present to force the metabolite into (uptake) and out of the model (secretion). If those do not exist in the model, the transporters along with the mechanisms need to be identified in order to allow the model to follow the uptake and secretion profile of the experimental data. <bold>(B)</bold> The uptake of metabolites is constrained based on the concentrations of metabolites available to the conditions that should be investigated. For example, the composition of defined experimental medium can be used. Also, the maximum uptake per cell and time unit can be calculated from the concentrations of nutrients, the concentration of cells, the cell weight, and the duration of the experiment. Otherwise, those constraints would be infinite and relative differences in the metabolite uptake would be less bound to the actual environmental conditions one wants to investigate. <bold>(C)</bold> Metabolomic data are mapped as constraints to the exchange reactions. Glutamine, glyceraldehyde, and citrulline have to be secreted by the model. <bold>(D)</bold> Transcriptomic or proteomic data are mapped to the internal network reactions (qualitatively), restricting which reactions a cell can use to transport and metabolize the metabolites, e.g., the enforced secretion of glutamine.</p></caption>
<graphic xlink:href="fphys-07-00327-g0003.tif"/>
</fig>
</sec>
<sec>
<title>Identify missing metabolite transporter (Step 3)</title>
<p>Metabolomic data sets often contain metabolites for which no transport and exchange reactions exist in the models since (i) high-throughput techniques detect more and more comprehensively metabolites in extracellular environments (e.g., body fluids or spent medium), (ii) these metabolites were outside the scope of previous reconstruction efforts and applications (Sahoo et al., <xref ref-type="bibr" rid="B43">2014</xref>), (iii) their existence was unknown, or (iv) their metabolism was unknown (Figures <xref ref-type="fig" rid="F2">2B</xref>, <xref ref-type="fig" rid="F3">3A</xref>).</p>
<p>The correct representation of transport mechanisms is important to accurately simulate cellular metabolism; thus, the metabolic reconstructions are continuously extended (Thiele et al., <xref ref-type="bibr" rid="B49">2011</xref>, <xref ref-type="bibr" rid="B52">2013</xref>; Sahoo et al., <xref ref-type="bibr" rid="B43">2014</xref>; Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>; Heavner and Price, <xref ref-type="bibr" rid="B23">2015</xref>). Hence, before getting started with this step, ensure that the most recent reconstruction version is obtained (e.g., the human metabolic reconstruction is downloadable from <ext-link ext-link-type="uri" xlink:href="http://vmh.life">http://vmh.life</ext-link>).</p>
<p>If extracellular transport reactions are missing for certain metabolites, they need to be identified from the literature. The identification of transport systems can take considerable time, which varies, depending on the number of metabolites and the extent to which the corresponding transport systems have been characterized (Sahoo et al., <xref ref-type="bibr" rid="B43">2014</xref>). Diffusion reactions should only be added if the transport system is unknown or diffusion of the metabolite has been reported. The model can use diffusion reactions to transport the metabolite &#x0201C;for free.&#x0201D; As a consequence, energy and material costs of the metabolite transport will be underestimated in simulations. Thus, the exact transport mechanisms, all alternate and co-substrates, transport proteins, isozymes and ratio of subunits in protein complexes and their encoding genes, need to be identified. Correct gene-protein-reaction associations (see <bold>Appendix</bold>) are particularly important for integrating transcriptomic or proteomic data as well as for investigating the effect of genetic alternation in metabolite transporters. After the literature has been mined thoroughly, the new mass- and charge-balanced transport reactions have to be formulated (Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>) and the transport reactions need to be added to the model (Figure <xref ref-type="fig" rid="F2">2C</xref>). References to the primary studies, on which the addition of the transporter is based, should be documented (Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>).</p>
</sec>
<sec>
<title>Addition of the transport and exchange reactions (Step 4)</title>
<p>Transport reactions should be added in a quality controlled manner to avoid typos in the metabolite abbreviations or whitespaces in the reaction formula. Typos easily go unnoticed until much later, since the functions to add reactions in the COBRA toolbox also automatically add new metabolites. Hence, reactions should be added in a quality controlled manner using rBioNet (Thorleifsson and Thiele, <xref ref-type="bibr" rid="B53">2011</xref>). The addition of reactions (and metabolites) to the source SBML file is discouraged as they circumvent any quality-assurance and quality-control measures, and as such, are often a source of errors in the resulting model.</p>
</sec>
</sec>
<sec>
<title>Stage 2: addition of constraints and model generation</title>
<sec>
<title>Define basic constraints (Step 5)</title>
<p>Metabolic networks are often distributed as reconstructions and not as condition-specific models. Hence, exchange and internal reactions are unconstrained, i.e., they have &#x0201C;infinite bounds&#x0201D; (Figure <xref ref-type="fig" rid="F4">4</xref>, <bold>Appendix</bold>, Supplementary Material). Alternatively, models may be distributed that mimick with their constraints a particular environmental or genetic condition, e.g., enabling growth on minimal medium under anoxic condition. Hence, the existing constraints of a reconstruction or model may not be a useful starting point for the one&#x00027;s own application. Whereas the directionality of transport reactions and internal reactions is consistent with current biological and thermodynamical data, the definition of the extracellular medium, i.e., the constraints on the exchange reactions (Figure <xref ref-type="fig" rid="F4">4</xref>), depends on the cell type and condition one wants to simulate. The application of a context-specific set of constraints on the exchange reactions ensures, together with the network topology, that the metabolic model closely resembles the cell type and experimental condition one wants to investigate, e.g., oxygen needs to be restricted to investigate hypoxia. The exchanges are best defined based on the experimental condition that one aims to model, e.g., culture medium composition, substrate, and oxygen uptake rates. In absence of matching experimental data, literature values may substitute missing information (Thiele et al., <xref ref-type="bibr" rid="B51">2005</xref>; Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>), but it should be noted that they can vary substantially between experimental setups and hence, may affect the prediction accuracy of the condition-specific model.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p><bold>Application of constraints on the bounds of exchange reactions</bold>. Infinite bounds (here, &#x02212;1000 to 1000) express the unlimited supply and removal of metabolites to and from the system. A negative flux through an exchange reactions corresponds to an uptake (red) and a positive flux corresponds to the secretion of a metabolite (blue). Maximal uptake can be constraint by restricting the lower bound (lb &#x0003D; &#x02212;600). The directionality of the exchange can be defined by setting a negative value as the upper bound (ub) for an uptake or by setting a positive value as the lower bound for secretion. These constraints could be based on the limit of detection (LOD) or quantification for the metabolite. Relative differences in the uptake and secretion of a metabolite can be expressed as the relative difference from maximal possible uptake rate (purple as compared to red) and as the relative difference from the minimal secretion rate. Absolute concentration changes over time can be converted to flux values and added to the constraints, considering a user-defined error to the flux to define lower bound and upper bound.</p></caption>
<graphic xlink:href="fphys-07-00327-g0004.tif"/>
</fig>
<p>The function <italic>setMediumConstraints</italic> allows the definition of the model constraints and provides options for various configurations. If the composition of the cell culture medium is defined, the metabolite concentrations can be converted into fluxes that define metabolite uptake in the model using the function <italic>setMediumConstraints</italic> (Figure <xref ref-type="fig" rid="F3">3B</xref>). For this, cell number, cell dry weight (Supplementary Material), and experiment duration need to be known. The rationale of the added constraints is to restrict the model&#x00027;s metabolite uptake flux to the amount that was available to one cell and per 1 h of the experiment. The medium composition can thus be used to reproduce <italic>in silico</italic> the experimental, or cell-type specific, condition (Figure <xref ref-type="fig" rid="F3">3B</xref>).</p>
<p>The model requires certain inputs and outputs to have a non-zero value for an objective function. For example, for the production of biomass of a human cell, the uptake of essential amino acids, ions, and other compounds needs to be provided to the model to render the objective function feasible (i.e., non-zero; see <bold>Appendix</bold>). Essential uptake reactions can be identified, e.g., using flux variability analysis (see <bold>Appendix</bold>).</p>
<p>The function <italic>setMediumConstraints</italic> includes an option to change the infinite bound (which is often defined as &#x02212;1000 U for reverse reaction flux and &#x0002B;1000 U for the forward reaction flux), if it is necessary to prevent that the model is artificially constrained by imposed &#x0201C;infinite&#x0201D; bounds (see Step 16B). If the growth rate, or doubling time, for the given experiment is available, it can be set as constraint on the biomass reaction using the function <italic>setMediumConstraints</italic> or <italic>changeRxnBounds</italic>.</p>
</sec>
<sec>
<title>Integration of metabolomic data (Step 6&#x02013;13)</title>
<p>Metabolomic data can be integrated with metabolic models by enforcing exchange rates to uptake or secrete in accordance with the experimental data (Figures <xref ref-type="fig" rid="F3">3B,C</xref>). To enforce the respective directionality, minimal flux values for uptake and secretion should be defined, e.g., by using information on the detection limit for each metabolite (Figure <xref ref-type="fig" rid="F4">4</xref>). The underlying rationale is that as the metabolite has been measured at a higher or lower level after a certain time and hence, the secretion/uptake had to be above the corresponding detection limit. The conversion of the limits of detection from ng/ml to mM can be done using the function <italic>calculateLODs</italic> and using the molecular weight of the metabolites (see Supplementary Supplementary Material). Uptake and secretion profiles for each sample are generated from an input data matrix using the function <italic>defineUptakeSecretionProfiles</italic>. See Supplementary Tutorial <xref ref-type="supplementary-material" rid="SM2">I</xref> for an example of the input data matrix. The directionality of exchange is defined based on the change over time in the spent medium and with respect to the change in the controls to rule out effects of spontaneous metabolite degradation (Figures <xref ref-type="fig" rid="F5">5A,B</xref>). The direction of the exchange might change when the controls are taken into consideration because the signal might drop over time in these medium controls, whereas it seems to remain stable in the cell culture medium due to secretion of the cells. Such cases need to be looked at carefully and it might be worth to exclude those data points. Mass spectrometric measurements are not exact and generally associated with an error. The calculated change between control and sample is also highly sensitive to the <italic>SD</italic>. A calculated net change of 5% can be meaningless if the <italic>SD</italic> is 10%. Hence, caution should be taken when incorporating changes in metabolite abundance, when the change is below or close to the <italic>SD</italic>. The tutorials illustrate how the constraints can be adjusted to one&#x00027;s data set at the different parts of the workflow.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p><bold>Applying semi-quantitative constraints</bold>. Relative differences in the uptake and secretion of metabolites from and into the extracellular medium can be imposed on the models, emphasizing the differences in metabolite uptake and secretion between samples. <bold>(A)</bold> A slope ratio is calculated based on the data as the relative difference in uptake of a metabolite between two samples and compared to the control (medium). Flux values are in the unit of mmol/g<sub>dryweight</sub>/hr. The result of the preparation is a set of new lower bounds, which can be applied to the model. Note that the adjusted bound is the gray number, whereas the orange number constitutes the flux value, which was defined based on the medium composition (negative bounds for maximal possible uptake) or based on the minimal detection limits (positive numbers for minimal possible secretion). <bold>(B)</bold> Illustration of the trend in quantitative differences in glucose uptake between cell lines. A difference in the measured intensity can be observed between time point 0 and 48 h. The signal also decreases in the control (medium). <bold>(C)</bold> Relative differences of metabolite uptake and secretion are translated into relative differences of the constraints on exchange reactions of the cell line models, forcing the models to consume or release metabolites in the same relation as observed experimentally.</p></caption>
<graphic xlink:href="fphys-07-00327-g0005.tif"/>
</fig>
<p>The uptake and secretion profiles are combined with the detection limits using the function <italic>calculateQuantitativeDiffs</italic> and integrated with the model using the function <italic>setQualitativeConstraints</italic>. As a consequence, the flux through an exchange reaction must lay between the smallest detectable and the highest possible flux in case of uptake (defined by the medium composition), and between the minimal detectable efflux and the &#x0201C;infinite&#x0201D; flux value for secreted metabolites (Figure <xref ref-type="fig" rid="F4">4</xref>).</p>
<p>In an additional step, relative differences in metabolite uptake and secretion can be integrated to compare pairs of models (Figures <xref ref-type="fig" rid="F4">4</xref>, <xref ref-type="fig" rid="F5">5C</xref>). The relative differences are defined using the function <italic>calculateQuantitativeDiffs</italic> based on the comparison of change between the samples and with respect to the controls (slope ratio, Figure <xref ref-type="fig" rid="F5">5A</xref>). Subsequently, the quantitative differences are applied to the two models (Figures <xref ref-type="fig" rid="F3">3</xref>, <xref ref-type="fig" rid="F5">5A,C</xref>) using the function <italic>setSemiQuantConstraints</italic>.</p>
<p>If absolute concentrations have been obtained for at least two time points, they can be converted into fluxes using the function <italic>conc2rate</italic> and applied as bounds on the exchange reactions considering a user-defined error (Figure <xref ref-type="fig" rid="F4">4</xref>). Individual uptake and secretion profiles are produced from an input data matrix of flux values with samples (columns) and metabolites (rows) using the function <italic>prepIntegrationQuant</italic> (see tutorial II). Negative values will be interpreted as uptake and positive values are interpreted as secretion. Based on the input model and user-defined minimal and maximal values, the function <italic>prepIntegrationQuant</italic> tests whether the uptake and/or secretion of each individual exchange in the input data matrix is feasible, using flux balance analysis (Orth et al., <xref ref-type="bibr" rid="B39">2010</xref>). If a metabolite cannot be consumed or secreted by the model due to missing synthesis or degradation pathways, these metabolite exchanges will be removed automatically from the exchange profiles. If only the secretion is infeasible, the secretion value is eliminated from the profiles, whereas the uptake value of the same metabolite will be kept. The function <italic>checkExchangeProfiles</italic> can be used to generate statistics on the number and identity of uptake and secretions added per sample.</p>
<p>After individual uptake and secretion profiles have been generated for each sample, i.e., cell types or conditions, these can be integrated with the metabolic model using the function <italic>setQuantConstraints</italic>. The function <italic>setQuantConstraints</italic> offers the option to add or eliminate constraints, e.g., if quantities or combination of constraints render the model infeasible. The function also allows the user to specify a lower bound for the objective function, which ensures that the output model is able to grow or to perform a specified metabolic task (e.g., lactate production), while the upper bound remains unconstrained. Which objective function is chosen should be carefully decided based on the experimental context (see Aurich and Thiele, <xref ref-type="bibr" rid="B6">2016</xref> for discussion on use of different biomass objective functions for human cells). The output of <italic>setQuantConstraints</italic> is a contextualized submodel for each sample. The integration of quantitative extracellular metabolomic data can be performed for large sample collections.</p>
</sec>
<sec>
<title>Generation of contextualized metabolic models (Step 14)</title>
<p>The function <italic>setQuantConstraints</italic> automatically generates a contextualized model for each sample by calling the function <italic>generateCompactExchModel.</italic> These contextualized models are based on a minimization of the cardinality of exchange reactions of the constrained model, which means that the number of exchanges, in addition to those defined by constraints (e.g., metabolomic data), is minimized in the resulting model (Aurich et al., unpublished). As the function <italic>generateCompactExchModel</italic> relies on an approximation, which may not be minimal (Aurich et al., unpublished), the minimization is repeated until the number of added exchange reactions cannot be further reduced. Additional exchanges may be required as untargeted metabolomics methods can still not measure and identify the entire metabolome, despite continuous improvements in the field (Verdegem et al., <xref ref-type="bibr" rid="B54">2016</xref>). In contrast, targeted metabolomics methods measure only a defined subset of a given metabolome, and thus, more metabolites may be exchanged with the environment by the cell. Our computational approach was set up to deal with these technical limitations by adding the required minimal set of metabolites that would, together with the defined uptake and secretion profile, explain the measured differences in the cell phenotypes (Aurich et al., unpublished).</p>
<p>After the minimal set of required exchanges is defined, blocked (i.e., flux inconsistent) reactions are identified (Vlassis et al., <xref ref-type="bibr" rid="B55">2014</xref>) and a flux-consistent submodel (&#x0201C;pruned&#x0201D;) is extracted. The pruned model contains the predicted minimal set of exchange reactions (including constraints based on the quantitative data) as well as an active set of internal reactions. The constrained pruned and the constrained unpruned model are returned from the function <italic>setQuantConstraints</italic> as a structure variable <italic>ResultsAllCellLines</italic>. Additionally, an overview table is returned (<italic>OverViewResults</italic>), which summarizes the numbers of reactions, metabolites, and genes for each contextualized model of the sample set. The information in these variables are extended by the downstream analysis functions (see Step 17).</p>
<p>Note that the function <italic>generateCompactExchModel</italic> only returns one of multiple alternative solutions. The relevance of the set of metabolite exchanges added to the model needs to be evaluated, e.g., by comparison with the carbon sources commonly used by the cell type or organism based on experimental data. The function <italic>generateCompactExchModel</italic> can also be applied to generate a contextualized model after qualitative or semi-quantitative constraints have been applied.</p>
<p>The function <italic>extractConditionSpecificModel</italic> has previously been used to extract a flux consistent model in Aurich et al. (<xref ref-type="bibr" rid="B7">2015</xref>). The &#x0201C;minimal&#x0201D; set of exchanges identified through this function is also not unique and the number and chosen additional exchange reactions depended on the order, in which the tested exchange reactions were closed.</p>
</sec>
<sec>
<title>Multi-omics integration (Step 15)</title>
<p>MetaboTools supports the integration of gene expression and proteomic data. The function <italic>integrateGeneExpressionData</italic> can be applied to qualitatively integrate transcriptomic or proteomic data along with the metabolomic data. The function disables reactions (i.e., it sets the lower and upper bound to 0) associated with the user-defined set of unexpressed genes. This stringent treatment may lead to an infeasible model, if any metabolite required for the objective cannot be produced anymore by the model. The manual assessment and curation of gene expression data integration has been previously described for a signaling model (Aurich and Thiele, <xref ref-type="bibr" rid="B5">2012</xref>). The same principles apply to a metabolic network. A multitude of other methods exists for the integration of transcriptomic data (Machado and Herrgard, <xref ref-type="bibr" rid="B32">2014</xref>). Whether to curate an infeasible model based on literature or to use a different approach for gene expression data integration [e.g., <italic>createTissueSpecificModel</italic> as implemented in the COBRA toolbox (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>)] needs to be determined for each case.</p>
<p>Proteomic data can be integrated in a similar way as transcriptomic data. In this case, the protein identifiers need to be matched to the gene IDs in a model, whereby the same attention should be paid to the conversion of protein to gene IDs as for the association of metabolite IDs to the model metabolites. Subsequently, the set of gene IDs that is associated with the absent proteins constitutes the input for <italic>integrateGeneExpressionData</italic>. It is recommended to treat missing gene/protein data points as present rather than absent. The additional omics constraints can be applied either before integrating metabolomic data, after executing <italic>setMediumConstraints</italic>, or after generating the contextualized models (i.e., after executing either <italic>setQuantConstraints</italic> or <italic>generateCompactExchModel</italic>).</p>
</sec>
</sec>
<sec>
<title>Stage 3: model validation and prediction of phenotypes</title>
<sec>
<title>Assessment of constraints and expectations (Step 16)</title>
<p>The workflow supported by MetaboTools allows rapid generation of contextualized models. Yet, during optimization, a minimal set of exchanges, consistent with the provided experimental data, will be chosen without consideration of the biology. Furthermore, the complexity and redundancy of the metabolic network allows the prediction of submodels and results that comply with the applied set of constraints and the biologically well informed network topology, but which may not be necessarily biologically meaningful. For instance, cellular processes, such as signaling and regulation, influence metabolism and might prevent possible functional states <italic>in vivo</italic> or <italic>in vitro</italic> but they are not included in the model. Thus, the applied constraints and predicted exchanges need to be manually evaluated against the biological knowledge before proceeding with further computational analysis. If falling below the error range or exceeding the infinite bounds, constraints might need to be scaled (see Supplementary Material). All added exchanges and directions of exchange should be controlled to identify missing or erroneous constraints. For example, in our previous study, the initially generated set of cancer models predicted consumption of superoxide and secretion of oxygen because the constraints had not been appropriately defined (Aurich et al., unpublished). The example illustrates the importance of manual inspection and biological insight when generating condition-specific models from experimental data (Table <xref ref-type="table" rid="T2">2</xref>). Table <xref ref-type="table" rid="T3">3</xref> lists questions to ask and data to consider during this initial validation of the contextualized models.</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p><bold>Use expectations to compare the generated models against</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"><bold>Question to address for model validation</bold></th>
<th valign="top" align="left"><bold>Example used in Leukemia cell lines (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>) or NCI-60 cell lines (Aurich et al., unpublished)</bold></th>
<th valign="top" align="left"><bold>Check using MetaboTools<sup>&#x0002A;</sup>, models, or alternative resource</bold></th>
</tr>
</thead>
<tbody>
<tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left">What metabolic pathways does/does not my model include that would (not) be expected for the target cell?</td>
<td valign="top" align="left">Transcriptomic data integration caused absence of complex I of the electron transport chain in the models, which complied with literature (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>).</td>
<td valign="top" align="left">model.subsystems, model.rxns, metabolic functions (Thiele et al., <xref ref-type="bibr" rid="B52">2013</xref>)</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left">To what extend does the model capture metabolites detected in the intracellular metabolome?</td>
<td/>
<td valign="top" align="left">model.mets</td>
</tr>
<tr>
<td valign="top" align="left">Are the models able to achieve experimental growth rates given the applied constraints?</td>
<td valign="top" align="left" style="border-bottom: thin solid #000000;">
<list list-type="simple">
<list-item><p>&#x02212;Analysis was conducted using biomass constraints (Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>).</p></list-item></list></td>
<td valign="top" align="left" style="border-bottom: thin solid #000000;"><italic>setConstraintsOnBiomassReaction</italic><sup>&#x0002A;</sup> or <italic>changeRxnBounds</italic> (add constraint)</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">
<list list-type="simple">
<list-item><p>&#x02212;The vast majority of the models was able to grow at experimental growth rates (Aurich et al., unpublished).</p></list-item></list></td>
<td valign="top" align="left" style="border-bottom: thin solid #000000;"><italic>optimizeCbModel</italic> (perform FBA)</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td/>
<td/>
<td valign="top" align="left">(<italic>changeObejctive&#x02014;</italic>set objective function in model.c)</td>
</tr>
<tr>
<td valign="top" align="left">Which exchange reactions have been added? Are the cells known to use/ secrete these substrates?</td>
<td valign="top" align="left">Cancer cells are known to use fatty acids to support their growth (Aurich et al., unpublished).</td>
<td valign="top" align="left"><italic>statisticsAddedExchanges</italic><sup>&#x0002A;</sup></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>The table lists examples of questions and data that can be used to validate contextualized models along with existing examples and MetaboTools functions that can be used for this analysis.</italic></p>
</table-wrap-foot>
</table-wrap>
<p>The ability of the contextualized models to grow at the same rate as in the experiment can also be used to validate the contextualized model (Aurich et al., unpublished). The optimization of biomass can be applied to cells in the exponential growth phase, and optimizing for biomass assumes that the cells are thriving toward optimal biomass production [see for explanation on the biomass composition (Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>)]. However, growth might not be the suitable when dealing with primary human cells, where alternative biomass reactions, e.g., for maintenance of cells, may be assumed (Aurich and Thiele, <xref ref-type="bibr" rid="B6">2016</xref>). If doubling times are available for the experiment, the function <italic>setConstraintsOnBiomassReaction</italic> can be used to incorporate constraints on the biomass reaction, while considering a user-defined measurement error (e.g., &#x000B1;20%) to separate upper and lower bound. Even slight differences in the culture conditions may have an impact on the growth performance of the cells.</p>
<p>MetaboTools contains a set of functions to investigate different aspects of the metabolic model (Step 24A&#x02013;F), particularly when generating multiple models from a large sample set. The choice of the analysis to be conducted depends on the biological question to be addressed. Prior knowledge of pathways to focus the analysis on will prevent getting overwhelmed by the amount of output data, and will help to identify inaccuracies in the model(s) before dedicating too much time on the analysis (Table <xref ref-type="table" rid="T2">2</xref>). To facilitate the interpretation especially for large model sets, MetaboTools contains functions that organize the analysis output into statistics and digestible tables.</p>
</sec>
<sec>
<title>Define essential genes across a set of contextualized models (Step 17A)</title>
<p>The function <italic>analyzeSingleGeneDeletion</italic> predicts and summarizes essential genes of one or multiple models (Figure <xref ref-type="fig" rid="F6">6</xref>). The function returns the number of essential genes per model and a table, which sorts all genes that appear in one or more models into the three categories: &#x0201C;no effect,&#x0201D; &#x0201C;all KO,&#x0201D; and &#x0201C;partial effect&#x0201D; along with the frequency of each effect among the tested set of models. Based on this table, interesting essential genes can be identified, e.g., those affecting only a subset of models, or all models equally (Table <xref ref-type="table" rid="T4">4</xref>). The results for the individual model are added to the <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup> structure.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p><bold>Heat-map depicting differences in single gene deletion across 120 NCI-60 cell line models</bold>. The growth ratio is defined as the maximal objective value of the model divided by the maximal objective value of the model when the gene was deleted when optimizing for biomass production. Genes that were absent in individual models have a growth ratio value of &#x02013;1. Genes that were absent in all models and genes whose deletion did not affect any model are not illustrated. The coloring in the heat-map corresponds to the maximal objective values obtained from flux balance analysis at each step of the analysis.</p></caption>
<graphic xlink:href="fphys-07-00327-g0006.tif"/>
</fig>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p><bold>Questions to guide the analysis of predicted sets of essential genes</bold>.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"><bold>Purpose</bold></th>
<th valign="top" align="left"><bold>Question</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Stratify models into groups</td>
<td valign="top" align="left">How much does the number of essential genes vary across models? Does this variation coincide with model size or growth rates, or with phenotypes predicted by another analysis?</td>
</tr>
<tr>
<td/>
<td valign="top" align="left" style="border-bottom: thin solid #000000;">Which genes are essential only in a small subset of the submodels? Which essential genes affect all models in the set of model?</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td/>
<td valign="top" align="left">Are the essential genes directly connected to an enforced metabolite exchanges?</td>
</tr>
<tr style="border-bottom: thin solid #000000;">
<td valign="top" align="left">Validation, generate testable hypothesis</td>
<td valign="top" align="left">Are the predicted essential genes known or already used for therapeutical purposes?</td>
</tr>
<tr>
<td valign="top" align="left">Generate testable hypothesis</td>
<td valign="top" align="left">Do you find interesting essential genes, pathways affected in single models or model groups? Could predicted essential genes constitute interesting targets (e.g., drug targets)?</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>Identify essential reactions (Step 17B)</title>
<p>A gene being essential for a model means that one or more reactions (i.e., combinations of reactions), which are associated with this gene, need to carry flux in the model in order to satisfy the defined objective function. However, the reactions associated with a gene can be distributed across different pathways, and depending on the pathway, the reaction may be more or less interesting for a biological question. E.g., an antimetabolite designed to target a non-essential reaction is useless because it would not stop a cell from proliferating. Hence, the function <italic>checkEffectRxnKO</italic> identifys the subset of essential reactions that are associated with a specified set of (essential) genes.</p>
</sec>
<sec>
<title>Investigate common and distinctive features of a set of models (Step 17C)</title>
<p>Common and distinctive features between condition specific models can be insightful, e.g., to build a generic tissue model from a set of context specific tissue models. The function <italic>makeSummaryModels</italic> generates both, a union model and an intersect model, which sum either the common or the superset of reaction, metabolites, and genes of a set of contextualized models.</p>
</sec>
<sec>
<title>Analyze flux splits (Step 17D)</title>
<p>Cells use different pathways to produce energy and other crucial metabolites (Aurich et al., unpublished). The function <italic>predictFluxSplits</italic> predicts how a metabolite of interest (e.g., ATP) is produced or consumed by the different reactions in the models (Figure <xref ref-type="fig" rid="F7">7</xref>). The analysis is based on a flux vector generated by using parsimonious flux balance analysis (Lewis et al., <xref ref-type="bibr" rid="B31">2012</xref>).</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p><bold>Models can be stratified into distinct metabolic phenotypes based on the pathway that they use prevailingly</bold>.</p></caption>
<graphic xlink:href="fphys-07-00327-g0007.tif"/>
</fig>
<p>The function <italic>predictFluxSplits</italic> can also be used to predict a &#x0201C;metabolite yield,&#x0201D; i.e., the sum of flux producing a metabolite (e.g., ATP) divided by the uptake flux of a user-defined carbon-source, e.g., glucose exchange. Because no additional constraints are applied for this analysis, the, e.g., ATP generated by the model will not only be produced from glucose but also other substrates available to the model depending on the constraints on the exchange reactions of the individual model. Nevertheless, the metabolite yield constitutes a valuable measure to stratify metabolic models (Aurich et al., unpublished).</p>
<p>The results generated by <italic>predictFluxSplits</italic> can be summarized using the function <italic>sumFluxSplits</italic>, which provides a table listing for each model the reaction that produces the highest amount of the metabolite (highest flux among the reactions producing/consuming the metabolite of interest). Another output table provides the flux values to allow a comparison of the metabolite producing reactions across the model set. Based on the different strategies of how models produce or consume different relevant metabolites, sets of models can be divided into phenotypes (Aurich et al., unpublished).</p>
</sec>
<sec>
<title>Sampling the solution space (Step 17E)</title>
<p>Sampling is a method to explore the metabolic phenotype of a contextualized model without relying on an objective function (Price et al., <xref ref-type="bibr" rid="B42">2004</xref>; Thiele et al., <xref ref-type="bibr" rid="B51">2005</xref>); and hence, it is particularly suitable for modeling of human cells and biomedical applications (Aurich and Thiele, <xref ref-type="bibr" rid="B6">2016</xref>). The function <italic>performSampling</italic> performs the sampling analysis, including a priori generation of warm-up points using the functions of the COBRA toolbox (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>). After a specified number of flux vectors (sampling points) has been collected from the solution space of the model, the result of the analysis is illustrated as the probability distribution of flux for individual reactions in the model (Price et al., <xref ref-type="bibr" rid="B42">2004</xref>; Schellenberger and Palsson, <xref ref-type="bibr" rid="B45">2009</xref>; Supplementary Material). The function <italic>summarizeSamplingResults</italic> obtains statistics on the sampling points and for each reaction (mean, median, and minimal and maximum flux values determined through flux variability analysis). It also generates histograms of the probability distributions for a set of user-defined reactions (Figure <xref ref-type="fig" rid="F8">8</xref>). Distinct use of pathways or reactions (e.g., directionality) can be directly observed from the histograms (Thiele et al., <xref ref-type="bibr" rid="B51">2005</xref>; Mo et al., <xref ref-type="bibr" rid="B37">2009</xref>; Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>).</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p><bold>Interpreting the results of the sampling analysis</bold>. <bold>(A)</bold> During the sampling analysis, a large set of sampling points is collected (red dots, each comprising a flux distribution). The fluxes collected from the sampling points can be illustrated as probability distribution for individual reactions. <bold>(B)</bold> Comparing the histograms of the probability flux distributions through the glutamine exchange reaction in two models (blue and green) reveals a shift of the feasible steady-state solution space for this reaction. <bold>(C)</bold> The irregular histogram is typical for an unbounded reaction (distribution ranges from &#x02212;1000 to 1000). <bold>(D)</bold> A premature flux distribution of the glutamine exchange reaction. Even though the final shape of the distributions can be guessed, additional sampling points need to be generated to get a unimodal distribution of the fluxes. Generation of additional points could shift the distribution. U &#x0003D; flux units.</p></caption>
<graphic xlink:href="fphys-07-00327-g0008.tif"/>
</fig>
</sec>
<sec>
<title>Predict response to environmental changes (Step 17F)</title>
<p>Contextualized models can react differently to perturbations of the existing constraints (Aurich et al., unpublished). The function <italic>performPPP</italic> can be used to analyze the impact of stepwise variations of flux forced through two exchange reactions. The &#x0201C;behavior&#x0201D; of the model is equal to the model being able to satisfy the stated objective. In other words, a flux balance analysis is performed at each step of the analysis, which means after the constraints of one of the two exchange reactions have been modulated. The variations can be either uptake or secretion, and the direction can differ between the two exchange reactions. This analysis was used to test the models response to variations in oxygen uptake and lactate secretion (Aurich et al., unpublished). The results of the analysis can be illustrated as a heat-map using the function <italic>illustrate_ppp</italic>. The size and the shape of the feasible solution space within the heat map was used to manually distinguish different phenotypes among the set of contextualized models (Aurich et al., unpublished).</p>
</sec>
<sec>
<title>Validation of the model predictions (Step 18)</title>
<p>The predicted set of essential genes (<italic>analyzeSingleGeneDeletion</italic>), preferential pathway use (<italic>predictFluxSplits</italic>), and feasible uptake rates (<italic>performPPP</italic>), constitute hypotheses and need to be validated. The validation of model predictions is an indispensable part of the computational workflow. In many studies the results are experimentally validated to substantiate the computational results (Ahn et al., <xref ref-type="bibr" rid="B3">2011</xref>; Frezza et al., <xref ref-type="bibr" rid="B18">2011</xref>; Fan et al., <xref ref-type="bibr" rid="B16">2013</xref>; Agren et al., <xref ref-type="bibr" rid="B2">2014</xref>; Yizhak et al., <xref ref-type="bibr" rid="B57">2014</xref>; Aurich et al., <xref ref-type="bibr" rid="B7">2015</xref>). Others relate the model predictions to the analysis of omics data sets from cell cultures or patients (Stempler et al., <xref ref-type="bibr" rid="B48">2014</xref>; Mardinoglu et al., <xref ref-type="bibr" rid="B35">2014a</xref>). In case model predictions cannot be experimentally validated, model predictions should be supported by literature evidences (Agren et al., <xref ref-type="bibr" rid="B1">2012</xref>; Mardinoglu et al., <xref ref-type="bibr" rid="B34">2014b</xref>). As many results as possible should be validated, but at least all main results of the study. The validation of the model prediction completes the workflow for the integration of extracellular metabolomic data and phenotype prediction.</p>
</sec>
</sec>
</sec>
<sec sec-type="materials" id="s3">
<title>Materials</title>
<sec>
<title>Equipment</title>
<sec>
<title>Hardware</title>
<list list-type="simple">
<list-item><p>&#x000B0; Personal computer</p></list-item>
</list>
</sec>
<sec>
<title>Software</title>
<list list-type="simple">
<list-item><p>&#x000B0; Matlab (Mathworks, Inc.)</p></list-item>
<list-item><p>&#x000B0; COBRA Toolbox v2.0 &#x00026; MetaboTools.</p></list-item>
<list-item><p>&#x000B0; fastFVA (<ext-link ext-link-type="uri" xlink:href="http://wwwen.uni.lu/lcsb/research/mol_systems_physiology/software">http://wwwen.uni.lu/lcsb/research/mol_systems_physiology/software</ext-link>).</p></list-item>
<list-item><p>&#x000B0; A linear programming solver. We recommend the industrial quality solver cplex (IBM Inc.) as it can be used under a free academic license. Note that <italic>generateCompactExchModel</italic> requires cplex (IBM Inc.) to be installed and called from Matlab.</p></list-item>
<list-item><p>&#x000B0; Obtain model (e.g., download the most recent version of the human metabolic genome scale model and numerous gut microbe metabolic models from the virtual metabolic human database (VMH, <ext-link ext-link-type="uri" xlink:href="http://vmh.life">http://vmh.life</ext-link>).</p></list-item>
</list>
</sec>
<sec>
<title>Knowledge</title>
<list list-type="simple">
<list-item><p>&#x000B0; Knowledge on the use of COBRA toolbox.</p></list-item>
<list-item><p>&#x000B0; Knowledge on the use of matlab.</p></list-item>
</list>
</sec>
<sec>
<title>Additional training in COBRA can be acquired from</title>
<list list-type="simple">
<list-item><p>&#x000B0; Detailed description on the installation of the COBRA toolbox v2.0, are provided in a previous protocol on the COBRA toolbox (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>).</p></list-item>
<list-item><p>&#x000B0; Consider the COBRA toolbox forum for help (<ext-link ext-link-type="uri" xlink:href="https://groups.google.com/forum/#!forum/cobra-toolbox">https://groups.google.com/forum/&#x00023;!forum/cobra-toolbox</ext-link>).</p></list-item>
<list-item><p>&#x000B0; FBA primer Supplementary tutorial (Orth et al., <xref ref-type="bibr" rid="B39">2010</xref>).</p></list-item>
</list>
</sec>
</sec>
<sec>
<title>Equipment setup</title>
<list list-type="simple">
<list-item><p>&#x000B0; Install Matlab.</p></list-item>
<list-item><p>&#x000B0; Download COBRA toolbox (incuding MetaboTools) from (<ext-link ext-link-type="uri" xlink:href="https://github.com/opencobra/cobratoolbox">https://github.com/opencobra/cobratoolbox</ext-link>) and add to Matlab path.</p></list-item>
<list-item><p>&#x000B0; <bold>Hint:</bold> Specifically, follow procedure steps 1&#x02013;4 of the COBRA toolbox protocol (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>) to ensure a functional COBRA toolbox. Functions that are not further explained in this protocol are part of the COBRA toolbox and their use has been described in detail in the COBRA toolbox protocol (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>).</p></list-item>
<list-item><p>&#x000B0; Install solver.</p></list-item>
<list-item><p>&#x000B0; Obtain a metabolic model (e.g., <ext-link ext-link-type="uri" xlink:href="http://vmh.life">http://vmh.life</ext-link>).</p></list-item>
</list>
</sec>
<sec>
<title>Input data when integrating metabolomic data</title>
<sec>
<title>Mandatory input data</title>
<list list-type="bullet">
<list-item><p>Extracellular metabolomic data (minimum two time points to calculate fluxes, see tutorials for format requirements).</p></list-item>
<list-item><p>For conversion of metabolomic data to fluxes: cell weight, cell concentration\ml, duration of the experiment.</p></list-item>
<list-item><p>Information about medium composition.</p></list-item>
<list-item><p>Serum in medium (yes/no).</p></list-item>
<list-item><p>Detection limits of the measured molecules.</p></list-item>
</list>
</sec>
<sec>
<title>Optional input data</title>
<list list-type="bullet">
<list-item><p>Growth curves/ doubling times (hours).</p></list-item>
<list-item><p>Transcriptomic or proteomic data (A/P calls).</p></list-item>
<list-item><p>Additional measurements (e.g., oxygen consumption, CO<sub>2</sub>).</p></list-item>
</list>
</sec>
</sec>
</sec>
<sec id="s4">
<title>Procedure</title>
<sec>
<title>Stage 1: preparations for the integration of the data (Steps 1&#x02013;5)</title>
<list list-type="order">
<list-item><p><bold>Associate Metabolite Identifiers with Metabolite IDs, Trouble Shooting</bold>. Manually relate the metabolite identifiers in the metabolomic data to the corresponding metabolite abbreviation in the model (Figure <xref ref-type="fig" rid="F2">2A</xref>). If no HMDB (Wishart et al., <xref ref-type="bibr" rid="B56">2013</xref>) or corresponding IDs exist, associate the metabolites based on the metabolite name using metabolite databases. Find the exact matches.</p></list-item>
<list-item><p><bold>Identify Metabolites that Have no Transport or Exchange Reaction, Trouble Shooting</bold>. Compile a list and check off metabolites that have transport reactions (e.g., gln_L[e] &#x0003C;=&#x0003E; gln_L[c]) and exchange reactions [&#x0201C;EX_gln_L(e)&#x0201D;] in the model. This can be done manually using the VMH database (<ext-link ext-link-type="uri" xlink:href="http://vmh.life">http://vmh.life</ext-link>, Figure <xref ref-type="fig" rid="F2">2B</xref>) or the models reaction list:</p>
<p>Alternatively use the function <italic>findRxnsFromMets</italic> to generate a list of reactions (<sup>&#x0002A;</sup>rxnList<sup>&#x0002A;</sup>) that are associated with the list of successfully associated metabolites (<sup>&#x0002A;</sup>metList<sup>&#x0002A;</sup>):</p>
<p>&#x0003E;&#x0003E; [rxnList, rxnFormulaList] = findRxnsFromMets(model, metList)</p>
<p>Check also the lower and upper bounds of the transport and exchange reactions to confirm that the directionality corresponds to the reaction formula.</p>
<p>To print the reaction list use:</p>
<p>&#x0003E;&#x0003E; a = printRxnFormula(model, rxnList,0,0,0,&#x0201D;,0);</p>
<p>Note that the reversibility vector (<sup>&#x0002A;</sup>model.rev<sup>&#x0002A;</sup>) is not updated by all functions in the COBRA toolbox. Most functions rely on the definition of the lower and upper bounds rather than the reversibility vector. Use the following code to make the reversibility vector consistent with the lower and upper bounds:</p>
<p>&#x0003E;&#x0003E; model.rev = zeros(length(model.rxns));</p>
<p>&#x0003E;&#x0003E; model.rev(find(model.lb&#x0003C;0)) = 1;</p></list-item>
<list-item><p><bold>Identify Metabolite Transporter</bold>. Manually identify and define as detailed as possible the extracellular metabolite transport systems for all associated metabolites lacking extracellular transport reactions based on the relevant literature (Figure <xref ref-type="fig" rid="F2">2C</xref>; (Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>; Sahoo et al., <xref ref-type="bibr" rid="B43">2014</xref>)). Start, e.g., by typing &#x0201C;metabolite AND transport&#x0201D; into a search engine or the NCBI PubMed database (<ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/pubmed/">http://www.ncbi.nlm.nih.gov/pubmed/</ext-link>). Variations of the key words will provide you with a first impression on the amount of literature that exists on the transport systems of individual metabolites. Transporters vary between compartments. Hence, specifically identify extracellular transport systems. Check for organism, tissue- and cell-type specific metabolite transport mechanisms. Does the literature describe or indicate active or passive transport (primary transport, secondary transport, or simple diffusion)? Identify additional substrates and co-substrates (such as ions, energy currency, or other metabolites), as well as the direction of transport (antiport vs. symport). What is the reaction stoichiometry of the transported compounds? Identify the genes that encode the transport proteins. Consider the existence of isoforms and multiple subunits of protein complexes. Keep track of references to all aspects of the transport. Take notes on contradictory information to enable yourself or others to recapitulate decisions at a later stage. Identify all existing transport mechanisms. Keep the number of diffusion reactions as low as possible by resolving as many transport mechanisms and as detailed as possible. When using information from databases, confirm the correctness of the information based on the primary literature, e.g., confirm that it is extracellular transport and appears in your cell or organism.</p></list-item>
<list-item><p><bold>Add Reactions</bold></p>
<p>Reconstruct the transport reactions based on your notes and add them to the model using rBioNet (Thorleifsson and Thiele, <xref ref-type="bibr" rid="B53">2011</xref>) in Matlab. Add missing exchange reactions using rBioNet (Thorleifsson and Thiele, <xref ref-type="bibr" rid="B53">2011</xref>).</p></list-item>
</list>
</sec>
<sec>
<title>Stage 2: set constraints and derive contextualized models</title>
<list list-type="simple">
<list-item><p>(5) <bold>Define Basic Constraints, Trouble Shooting</bold></p>
<p>Use the function <italic>setMediumConstraints</italic> to impose the condition-specific sets of constraints to a model (<sup>&#x0002A;</sup>model<sup>&#x0002A;</sup>). When data values exceed the infinite bounds, increase the current bounds (<sup>&#x0002A;</sup>current_inf<sup>&#x0002A;</sup>) such that the infinite bounds no longer act as constraints (<sup>&#x0002A;</sup>set_inf<sup>&#x0002A;</sup>). Based on cell concentration (<sup>&#x0002A;</sup>cellConc<sup>&#x0002A;</sup>), the duration (<sup>&#x0002A;</sup>t<sup>&#x0002A;</sup>) of the cultivation, and the cell dry weight (<sup>&#x0002A;</sup>cellWeight<sup>&#x0002A;</sup>) fluxes are calculated from metabolite concentrations given in mM (<sup>&#x0002A;</sup>met_Conc_mM<sup>&#x0002A;</sup>) for a defined set of metabolites exchange reactions (<sup>&#x0002A;</sup>medium_composition<sup>&#x0002A;</sup>), which were part of the defined cell culture medium, and the model is constrained with these fluxes. Uptake of additional compounds, e.g., ions or vitamins can be restricted (<sup>&#x0002A;</sup>mediumCompounds<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>mediumCompounds_lb<sup>&#x0002A;</sup>). The optional input variable <sup>&#x0002A;</sup>customizedConstraints<sup>&#x0002A;</sup> allows individual definition of additional reaction constraints, e.g., growth rates.</p>
<p>&#x0003E;&#x0003E; [modelMedium, basisMedium] = setMedium Constraints(model, set_inf, current_inf, medium_composition, met_Conc_mM, cellConc, t, cellWeight, mediumCompounds, mediumCompounds_lb, [customized Constraints], [customizedConstraints_ub], [customizedConstraints_lb], [close_exchanges])</p></list-item>
<list-item><p>(6) <bold>Transform the LOD from ng/ml to mM</bold></p>
<p>Use the molecular weight (<sup>&#x0002A;</sup>theo_mass<sup>&#x0002A;</sup>) of the metabolites and the respective exchange reaction for the metabolites (<sup>&#x0002A;</sup>ex_RXNS<sup>&#x0002A;</sup>) to transform the LOD from ng/ml (<sup>&#x0002A;</sup>lod_ngmL<sup>&#x0002A;</sup>) to mM (<sup>&#x0002A;</sup>lod_mM<sup>&#x0002A;</sup>).</p>
<p>&#x0003E;&#x0003E; [LODmM] = calculateLODs(ex_RXNS, theo_MASS, LODngmL);</p></list-item>
<list-item><p>(7) <bold>Define Uptake and Secretion Profiles (No Absolute Quantification)</bold></p>
<p>Define sets of metabolites that are consumed (<sup>&#x0002A;</sup>cond1_uptake<sup>&#x0002A;</sup> and <sup>&#x0002A;</sup>cond2_uptake<sup>&#x0002A;</sup>) and released (<sup>&#x0002A;</sup>cond1_secretion<sup>&#x0002A;</sup> and <sup>&#x0002A;</sup>cond2_secretion<sup>&#x0002A;</sup>) based on the individual data matrices (<sup>&#x0002A;</sup>input_A<sup>&#x0002A;</sup> and <sup>&#x0002A;</sup>input_B<sup>&#x0002A;</sup>) and the corresponding exchange reactions (<sup>&#x0002A;</sup>data_RXNS<sup>&#x0002A;</sup>) using the function <italic>defineUptakeSecretionProfiles</italic> for sample pairs. Manually define the threshold (<sup>&#x0002A;</sup>tol<sup>&#x0002A;</sup>) to accept a change as uptake or secretion. The function contains further options to manually tailor the uptake (<sup>&#x0002A;</sup>exclude_upt<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>add_upt<sup>&#x0002A;</sup>) and secretion profiles (<sup>&#x0002A;</sup>exclude_secr<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>add_secr<sup>&#x0002A;</sup>).</p>
<p>&#x0003E;&#x0003E; [cond1_uptake, cond2_uptake, cond1_secretion, cond2_secretion, slope_Ratio, data_RXNS] = defineUptakeSecretionProfiles(input_A, input_B, data_RXNS, tol, essAA_excl, exclude_upt, exclude_secr, add_secr, add_upt);</p></list-item>
<list-item><p>(8) <bold>Calculate Semi-Quantitative Differences</bold></p>
<p>Use the function <italic>calculateQuantitativeDiffs</italic> to add the LODs to the uptake and secretion profiles and to obtain the values for the relative adjustment of constraints (<sup>&#x0002A;</sup>cond1_upt_higher<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond2_upt_higher<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond2_secr_higher<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond1_secr_higher<sup>&#x0002A;</sup>) based on the <sup>&#x0002A;</sup>slope_Ratio<sup>&#x0002A;</sup> of the commonly consumed and released metabolites (Figure <xref ref-type="fig" rid="F5">5A</xref>). Additional inputs are the uptake and secretion profiles generated in the previous steps by the functions <italic>defineUptakeSecretionProfiles</italic> and <italic>calculateLODs</italic>. The input <sup>&#x0002A;</sup>LODmM<sup>&#x0002A;</sup> is of the same length as the vector specifying the exchange reactions <sup>&#x0002A;</sup>ex_RXNS<sup>&#x0002A;</sup>.</p>
<p>&#x0003E;&#x0003E; [cond1_upt_higher, cond2_upt_higher, cond2_secr_higher, cond1_secr_higher, cond1_uptake_LODs, cond2_ uptake_LODs, cond1_secretion_LODs, cond2_secretion_LODs] = calculateQuantitative Diffs(data_RXNS, slope_Ratio, ex_RXNS, lod_mM, cond1_uptake, cond2_uptake, cond1_secretion, cond2_secretion);</p></list-item>
<list-item><p>(9) <bold>Set Qualitative Constraints</bold></p>
<p>Use the function <italic>setQualitativeConstraints</italic> to apply individual uptake (<sup>&#x0002A;</sup>cond_uptake<sup>&#x0002A;</sup>) and secretion (<sup>&#x0002A;</sup>cond_secretion<sup>&#x0002A;</sup>) profile to a model by using the detection limits to enforce uptakes and secretions (<sup>&#x0002A;</sup>cond1_uptake_LODs<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond2_uptake_LODs<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond1_secretion_LODs<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond2_secretion_LODs<sup>&#x0002A;</sup>). Execute this function for each model individually:</p>
<p>&#x0003E;&#x0003E; [modelLOD] = setQualitativeConstraints(model, cond_uptake, cond_uptake_LODs, cond_secretion, cond_secretion_LODs, cellConc, t, cellWeight, ambiguous_metabolites, basisMedium);</p>
<p>Use the input variable <sup>&#x0002A;</sup>ambiguous_metabolites<sup>&#x0002A;</sup> to keep exchanges open and let the model freely consume or release the associated metabolites, e.g., if direction of exchange is undefined or differs between biological replicates. All lower bounds of exchange reactions, apart from those defined as ambiguous, mediumCompounds, or from the uptake and secretion profiles, will be constrained to zero. The output model <sup>&#x0002A;</sup>modelLOD<sup>&#x0002A;</sup> has the same size of the input model.</p></list-item>
<list-item><p>(10) <bold>Apply Semi-Quantitative Differences</bold></p>
<p>Use the function <italic>setSemiQuantConstraints</italic> to apply the semi-quantitative differences to two models <sup>&#x0002A;</sup>modelA<sup>&#x0002A;</sup> and <sup>&#x0002A;</sup>modelB<sup>&#x0002A;</sup>, which were previously defined by the function <italic>calculateQuantitativeDiffs</italic> (<sup>&#x0002A;</sup>cond1_upt_higher<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond2_upt_higher<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond2_ secr_higher<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>cond1_secr_ higher<sup>&#x0002A;</sup>). This step is performed simultaneously for the two models.</p>
<p>&#x0003E;&#x0003E; [modelA_QUANT,modelB_QUANT] = setSemiQuantConstraints(modelA, modelB, cond1_upt_higher, cond2_upt_higher, cond2_secr_higher, cond1_secr_higher);</p></list-item>
<list-item><p>(11) <bold>Obtain Uptake and Secretion Profiles [Integration of Absolute Concentration Changes], Trouble Shooting</bold></p>
<p>Use the function <italic>prepIntegrationQuant</italic> to generate individual uptake and secretion profiles from a data matrix (<sup>&#x0002A;</sup>metData<sup>&#x0002A;</sup>) of fluxes, where the rows are the metabolite exchanges (<sup>&#x0002A;</sup>exchanges<sup>&#x0002A;</sup>) and the columns are the conditions (<sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>). Negative values are interpreted as uptake and positive values are interpreted as secretion. The individual exchange profile is saved to the user-defined location (<sup>&#x0002A;</sup>path<sup>&#x0002A;</sup>). The minimal and maximal flux values (<sup>&#x0002A;</sup>test_max<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>test_min<sup>&#x0002A;</sup>) are used to test whether the <sup>&#x0002A;</sup>model<sup>&#x0002A;</sup> can consume and secrete the <sup>&#x0002A;</sup>exchanges<sup>&#x0002A;</sup>. All fluxes below a user-defined tolerance value (<sup>&#x0002A;</sup>tol<sup>&#x0002A;</sup>) are set to zero. The output consists of the flux values to be applied to the upper and lower bounds, which are based user-defined variation (of, e.g., 20%, <sup>&#x0002A;</sup>variation<sup>&#x0002A;</sup>) for uptake and secretion, and written to a file named according to the same name to the specified location.</p>
<p>&#x0003E;&#x0003E; prepIntegrationQuant(model, metData, exchanges, samples, test_max, test_min, path, tol, variation);</p></list-item>
<list-item><p>(12) <bold>Check the Exchange Profiles</bold></p>
<p>Check if additional metabolites have been removed from the uptake and secretion profiles. Use the function <italic>checkExchangeProfiles</italic> to generate statistics on the number and identity (<sup>&#x0002A;</sup>mapped_exchanges<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>mapped_uptake<sup>&#x0002A;</sup>, and <sup>&#x0002A;</sup>mapped_secretion<sup>&#x0002A;</sup>) of uptake and secretions added per sample (<sup>&#x0002A;</sup>minMax<sup>&#x0002A;</sup>). Specify the number of metabolites in the data set (<sup>&#x0002A;</sup>nmets<sup>&#x0002A;</sup>). The function loads the exchange profiles generated by using the definition of the <sup>&#x0002A;</sup>path<sup>&#x0002A;</sup> and the sample names (<sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>).</p>
<p>&#x0003E;&#x0003E; [mapped_exchanges, minMax, mapped_uptake, mapped_secretion] = checkExchangeProfiles(samples, path, nmets);</p></list-item>
<list-item><p>(13) <bold>Integrate Quantitative Constraints, Trouble Shooting</bold></p>
<p>Use the function <italic>setQuantConstraints</italic> to generate a contextualized model (<sup>&#x0002A;</sup>ResultsAllCellLines.sample.modelPruned<sup>&#x0002A;</sup>) for each sample (<sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>). A minimal flux value (<sup>&#x0002A;</sup>minGrowth<sup>&#x0002A;</sup>) can be specified for a defined objective function (<sup>&#x0002A;</sup>obj<sup>&#x0002A;</sup>). A set of metabolite exchanges (<sup>&#x0002A;</sup>medium<sup>&#x0002A;</sup>) can be specified, which will be part of the retained minimal set of exchange reactions in the output model. Allow additional secretion of metabolites (<sup>&#x0002A;</sup>addExtraExch<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>addExtraExch_value<sup>&#x0002A;</sup>). The exchange profile is loaded from the specified location (<sup>&#x0002A;</sup>path<sup>&#x0002A;</sup>). The default value of epsilon is 1e<sup>&#x02212;4</sup>, see Vlassis et al. (<xref ref-type="bibr" rid="B55">2014</xref>) for a detailed description.</p>
<p>&#x0003E;&#x0003E; [ResultsAllCellLines,OverViewResults] = setQuantConstraints(model, samples, tol, minGrowth, obj, no_secretion, no_uptake, medium, addExtraExch, addExtraExch_value, path, [epsilon]);</p>
<p>The output structure <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup> contains the pruned and unpruned but constrained contextualized model for each sample (<sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>). <sup>&#x0002A;</sup>OverViewResults<sup>&#x0002A;</sup> is a table which lists statistics of the generated models.</p></list-item>
<list-item><p>(14) <bold>Generate the Contextualized Subnetworks</bold></p>
<list list-type="alpha-upper">
<list-item><p>Use <italic>generateCompactExchModel</italic> to generate a submodel. This pruned model is based on the prediction of a minimal set of metabolite exchanges for a given, constrained model, e.g., the model resulting from running <italic>setQualitativeConstraints</italic> or <italic>setSemiQuantConstraints</italic>, while permitting a feasible steady state flux distribution. The prediction of the additional metabolite exchanges is based on the minimization if the cardinality of the exchange reactions (Aurich et al., unpublished). Define the minimal flux value (<sup>&#x0002A;</sup>minGrowth<sup>&#x0002A;</sup>) that should be achieved by a defined objective (<sup>&#x0002A;</sup>biomassRxn<sup>&#x0002A;</sup>) in the output model (<sup>&#x0002A;</sup>modelMin<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>modelPruned<sup>&#x0002A;</sup>). The use of fast flux variability analysis (Gudmundsson and Thiele, <xref ref-type="bibr" rid="B21">2010</xref>) (<sup>&#x0002A;</sup>fastFVA<sup>&#x0002A;</sup>) is optional.</p>
<p>&#x0003E;&#x0003E; [modelMin, modelPruned, Ex_Rxns] = generateCompactExchModel(model, minGrowth, biomassRxn, prune, fastFVA);</p></list-item>
<list-item><p>Alternatively, use <italic>extractConditionSpecificModel</italic> to extract the submodel using the approach as in Aurich et al. (<xref ref-type="bibr" rid="B7">2015</xref>). Specify the cutoff (<sup>&#x0002A;</sup>theshold<sup>&#x0002A;</sup>) for calling a flux value zero (e.g., 1e<sup>&#x02212;8</sup>).</p>
<p>&#x0003E;&#x0003E; [modelPruned] = extractConditionSpecificModel(model, theshold);</p></list-item></list></list-item>
<list-item><p>(15) <bold>Integrate Gene Expression Data</bold></p>
<p>Use the function <italic>integrateGeneExpressionData</italic> to integrate transcriptomic data (set of genes found to be unexpressed (<sup>&#x0002A;</sup>dataGenes<sup>&#x0002A;</sup>)) with the <sup>&#x0002A;</sup>model<sup>&#x0002A;</sup>.</p>
<p>&#x0003E;&#x0003E; [modelGE] &#x0003D; integrateGeneExpressionData(model, dataGenes);</p></list-item>
</list>
</sec>
<sec>
<title>Stage 3: validation and prediction</title>
<list list-type="simple">
<list-item><p>(16) <bold>Validation of the Model, Trouble Shooting</bold> Perform a quality control of the models by checking constraints against biological insight. The steps 16E&#x02013;F can only be performed if the data exists.</p>
<list list-type="alpha-upper">
<list-item><p><bold>Create an expectation</bold></p>
<p>If not done already, review the literature to learn about the biological background of your cells, organisms, and what to expect from the analysis: Identify metabolic traits and inabilities of the target cell and what is known about the respective set of environmental conditions and its response to perturbations. Validate the generated models based on these biological insights, e.g., by asking questions such as those given in Table <xref ref-type="table" rid="T3">3</xref>.</p></list-item>
<list-item><p><bold>Check constraints, Trouble Shooting</bold></p>
<p>Check lower and upper reaction bounds in the generated models. Check that all constraints have been applied as intended, e.g., typos in the exchange reaction names might have prevented that constraints were applied. Are all exchange reaction constrained to zero that should have been closed? Do constraints exceed the infinite bounds? Are any constraints below the threshold and thus equal to zero? Are there any constraints that do not concur with the expectation, e.g., uptake of oxygen?</p></list-item>
<list-item><p><bold>Analyze added exchanges, Trouble Shooting</bold></p>
<p>Summarize the set of added exchanges using the functions <italic>statisticsAddedExchanges</italic> and <italic>mkTableOfAddedExchanges</italic>:</p>
<p>&#x0003E;&#x0003E; [Ex_added_all_unique] = statisticsAddedExchanges(ResultsAllCellLines, samples);</p>
<p>&#x0003E;&#x0003E; [Added_all] = mkTableOfAddedExchanges(ResultsAllCellLines, samples, Ex_added_all_unique);</p>
<p>Check the additional exchanges that were added to the model. Are the metabolites predicted to be consumed part of the medium composition? Was serum added to the culture medium? For all metabolites, which the model needs to secrete, could these metabolites have been detected? Were they targeted by the metabolomic analysis? Could they have been below the limit of detection? Does untargeted metabolomic data support the presence of these metabolites in the extracellular medium?</p></list-item>
<list-item><p><bold>Check metabolic functions, Trouble Shooting</bold></p>
<p>After confirming that the constraints are accurately set, check the functionality of the model against the expectation build earlier. Does the model include metabolic pathways known to be operated by the cell and in the considered condition? Which pathways are in the model that are not expected to be present in the modeled cell type? Keep in mind that the model was optimized to explain the uptake and secretion profile and that the internal reaction redundancy remains, if no additional omics data is included. Check, using flux variability analysis, if the unexpected pathways have to carry flux. What imposed exchanges are responsible for the flux through such a pathway?</p></list-item>
<list-item><p><bold>Validate the contextualized model based on experimental data</bold></p>
<p>Use, e.g., intracellular metabolomic data. Check to which extend metabolites reported in intracellular metabolomic data are captured by the contextualized model (i.e., are the metabolites part of model.mets). Do the models reflect sample-specific differences?</p></list-item>
<list-item><p><bold>Test for condition-specific growth rates</bold></p>
<p>If growth rates were not applied as constraints during the model building, use the function <italic>setConstraintsOnBiomassReaction</italic> to apply constraints to the biomass reaction based on doubling times (<sup>&#x0002A;</sup>dT<sup>&#x0002A;</sup>). The upper and lower bounds of the biomass objective function (<sup>&#x0002A;</sup>of<sup>&#x0002A;</sup>) are adjusted with a <sup>&#x0002A;</sup>tolerance<sup>&#x0002A;</sup> around the calculated growth rate (e.g., 10%).</p>
<p>&#x0003E;&#x0003E; [modelBM] = setConstraintsOnBiomassReaction(model, of, dT, tolerance);</p>
<p>Alternatively, use the function <italic>changeRxnBounds</italic> to apply growth rates to the model. Make sure the objective is set in the model (use the function <italic>changeObjective</italic> to change the objective in the model).</p>
<p>If no doubling times or growth rates exist for the data set, literature derived rates can provide an approximation for the expected growth rates, as growth rates can vary depending on the culture conditions (e.g., serum or no serum). Use flux balance analysis (<italic>optimizeCbModel</italic>) to see if the model can produce biomass at experimental rates.</p></list-item>
</list></list-item>
<list-item><p>(17) <bold>Predict Metabolic Phenotypes, Trouble Shooting</bold></p>
<p>Choose the most suitable analysis (e.g., 17A&#x02013;E) based on the individual biological question to gain insight into the use of the most relevant pathways, reactions, or metabolites by individual or groups of models.</p>
<list list-type="alpha-upper">
<list-item><p><bold>Summarize and illustrate the set of essential genes</bold></p>
<p>Use the function <italic>analyzeSingleGeneDeletion</italic> to define and to analyze the set of essential genes for single or large set of models (<sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>). Define through the input variable <sup>&#x0002A;</sup>heat<sup>&#x0002A;</sup> if a heat map should be generated, illustrating the differences across the model set (Figure <xref ref-type="fig" rid="F6">6</xref>). Save the output at the specified location (<sup>&#x0002A;</sup>path<sup>&#x0002A;</sup>).</p>
<p>&#x0003E;&#x0003E; [genes,ResultsAllCellLines,OverViewResults] = analyzeSingleGeneDeletion (ResultsAllCellLines, path, samples, cutoff, OverViewResults);</p>
<p>The output variable <sup>&#x0002A;</sup>genes<sup>&#x0002A;</sup> contains a table that lists per unique gene the number of models with &#x0201C;no effect,&#x0201D; &#x0201C;partial effect,&#x0201D; essential genes or &#x0201C;KO,&#x0201D; and in how many models the gene is not present. Additionally, the number of essential genes is added to <sup>&#x0002A;</sup>OverViewResults<sup>&#x0002A;</sup> and the output of the single gene deletion is added to <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup>.</p></list-item>
<list-item><p><bold>Identify the essential reactions driving gene essentiality, Trouble Shooting</bold></p>
<p>Use the function <italic>checkEffectRxnKO</italic> to identify, which reactions are essential. Provide the set or subset of models (<sup>&#x0002A;</sup>samples_to_test<sup>&#x0002A;</sup>) from <sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup> that should be tested. The functions tests all individual reactions associated with a set of specified genes (<sup>&#x0002A;</sup>genes_to_test<sup>&#x0002A;</sup>). The variable <sup>&#x0002A;</sup>fill<sup>&#x0002A;</sup> defines what to add into the output matrix if a reaction is not in the model, e.g., 100, num (&#x0201C;NAN&#x0201D;).</p>
<p>&#x0003E;&#x0003E; [FBA_Rxns_KO, ListResults] = checkEffectRxnKO(samples_to_test, fill, Genes_to_test, samples, ResultsAllCellLines);</p>
<p>The output variable <sup>&#x0002A;</sup>FBA_Rxns_KO<sup>&#x0002A;</sup> contains the FBA results for constraining one reaction at a time to zero. The second output <sup>&#x0002A;</sup>ListResults<sup>&#x0002A;</sup> lists the reactions associated with the input gene list in the same order as <sup>&#x0002A;</sup>FBA_Rxns_KO<sup>&#x0002A;</sup>.</p></list-item>
<list-item><p><bold>Generate intersect and union model</bold></p>
<p>Use the function <italic>makeSummaryModels</italic> to find the shared and superset of reactions, metabolites and genes of a set of models by creating a union (<sup>&#x0002A;</sup>unionModel<sup>&#x0002A;</sup>) and an intersect model (<sup>&#x0002A;</sup>intersectModel<sup>&#x0002A;</sup>). The models are generated based on the generic model (<sup>&#x0002A;</sup>model<sup>&#x0002A;</sup>) from which the subnetworks have been generated.</p>
<p>&#x0003E;&#x0003E; [unionModel, intersectModel, diffRxns, diffExRxns] = makeSummaryModels(ResultsAllCellLines, samples, model, mk_union, mk_intersect, mk_reactionDiff);</p>
<p>Both output models (<sup>&#x0002A;</sup>unionModel<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>intersectModel<sup>&#x0002A;</sup>) and differential reaction sets (<sup>&#x0002A;</sup>diffRxns<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>diffExRxns<sup>&#x0002A;</sup>) are generated by default.</p></list-item>
<list-item><p><bold>Predict flux splits</bold></p>
<p>Use the function <italic>predictFluxSplits</italic> to predict either production or consumption (<sup>&#x0002A;</sup>dir<sup>&#x0002A;</sup>) of metabolites (e.g., <sup>&#x0002A;</sup>met2test<sup>&#x0002A;</sup> &#x0003D; {&#x0201C;atp&#x0201D;}) for the models in <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup> defined by <sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>. Define the objective function (<sup>&#x0002A;</sup>obj<sup>&#x0002A;</sup>) that should be used to generate the flux vector, from which the reaction contributions to production or consumption of the considered metabolite are calculated. Define a full sized model (<sup>&#x0002A;</sup>model<sup>&#x0002A;</sup>), as the set of models can use distinct subsets of the reactions of the full model to produce or consume the metabolite of interest. A default value (eucNorm = 1e<sup>&#x02212;6</sup>) is set for the parsimonious flux balance analysis. Set a quadratic programming solver [<italic>changeCobraSolver</italic>(solver, &#x0201C;QP&#x0201D;)] before running <italic>predictFluxSplits</italic>.</p>
<p>&#x0003E;&#x0003E; [BMall, ResultsAllCellLines, metRsall, maximum_contributing_rxn, maximum_ contributing_flux, ATPyield] = predictFluxSplits(model, obj, met2test, samples, ResultsAllCellLines, dir, transportRxns, ATPprod, carbon_source, eucNorm);</p>
<p>Exclude reactions, which do not produce or consume the metabolite, e.g., reactions that transport the metabolite between compartments. Define all reactions that produce/consume the metabolite in a first run (<sup>&#x0002A;</sup>transportRxns<sup>&#x0002A;</sup> = []), and subsequently, exclude unwanted contributors by adding them to <sup>&#x0002A;</sup>transportRxns<sup>&#x0002A;</sup>.</p>
<p>In case that the production of ATP is predicted, additional statistics on the use of glycolysis, the citric acid cycle, and the oxidative phosphorylation can be automatically generated (<sup>&#x0002A;</sup>ATPprod<sup>&#x0002A;</sup> &#x0003D; 1). With this option, the <sup>&#x0002A;</sup>ATPyield<sup>&#x0002A;</sup> is calculated, which relates the total ATP production to a user-defined carbon source [default: <sup>&#x0002A;</sup>carbon_source<sup>&#x0002A;</sup> = &#x0201C;EX_glc(e)&#x0201D;;].</p>
<p>The output lists the reaction with highest flux value for producing or consuming a defined metabolite across analyzed samples (<sup>&#x0002A;</sup>maximum_contributing_rxn<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>maximum_contributing_flux<sup>&#x0002A;</sup>) to simplify the analysis over large groups of samples (and metabolites of interest). Detailed results of the analysis are added to <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup>.</p></list-item>
<list-item><p><bold>Sampling the steady-state solution space</bold></p>
<p>Use the function <italic>performSampling</italic> to sample the solution space of a model:</p>
<p>&#x0003E;&#x0003E; performSampling(model, warmupn, fileName, nFiles, pointsPerFile, stepsPerPoint, fileBaseNo, maxTime, path);</p>
<p>The function is based on COBRA toolbox, refer to the corresponding protocol for details (Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>). Subsequently, use the function <italic>summarizeSamplingResults:</italic></p>
<p>&#x0003E;&#x0003E; [stats, statsR] = summarizeSamplingResults(modelA, modelB, path, nFiles, pointsPerFile, starting_Model, dataGenes, show_rxns, fonts);</p>
<p>Inspect the histograms automatically saved to the user-defined location (<sup>&#x0002A;</sup>path<sup>&#x0002A;</sup>, Figure <xref ref-type="fig" rid="F8">8</xref>, Supplementary Material). If the distributions are not unimodal (only bounded reactions will reach this, but not loop reactions, see <bold>Appendix</bold>), generate more sample points by using points from the last file as starting point (see tutorial_I). Analyze the results: Are the distributions shifted apart for any reactions or pathways that were expected or unexpected for a certain condition or group of samples? Make sure that your interpretations do not rely on unbounded reactions (Figure <xref ref-type="fig" rid="F8">8</xref>).</p></list-item>
<list-item><p><bold>Predict behavior to environmental changes</bold></p>
<p>Use the function <italic>performPPP</italic> to predict the simultaneous variation of two parameters (<sup>&#x0002A;</sup>mets<sup>&#x0002A;</sup>) at a time and for one or more submodels (<sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup> in <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup>). Define the range of flux rates (uptake or secretion defined in <sup>&#x0002A;</sup>direct<sup>&#x0002A;</sup>) through the variables <sup>&#x0002A;</sup>step_size<sup>&#x0002A;</sup> (flux units) and number of steps <sup>&#x0002A;</sup>step_num<sup>&#x0002A;</sup>. This can be individually defined for each exchange reaction. The output is added to <sup>&#x0002A;</sup>ResultsAllCellLines<sup>&#x0002A;</sup>.</p>
<p>&#x0003E;&#x0003E; [ResultsAllCellLines] = performPPP(ResultsAllCellLines, mets, step_size, samples, step_num, direct);</p>
<p>Illustrate your results with heat-maps using the function <italic>illustrate_ppp</italic>.</p>
<p>&#x0003E;&#x0003E; illustrate_ppp(ResultsAllCellLines, mets, path, samples, label, fonts, tol);</p>
<p>The heat maps are saved to the defined <sup>&#x0002A;</sup>path<sup>&#x0002A;</sup>. The function uses flux variability analysis (Gudmundsson and Thiele, <xref ref-type="bibr" rid="B21">2010</xref>; Schellenberger et al., <xref ref-type="bibr" rid="B46">2011</xref>), and the zero cutoff (<sup>&#x0002A;</sup>tol<sup>&#x0002A;</sup>, e.g., 1e<sup>&#x02212;8</sup>) needs to be specified. The function allows some additional inputs, i.e., label and font size (<sup>&#x0002A;</sup>label<sup>&#x0002A;</sup>, <sup>&#x0002A;</sup>fonts<sup>&#x0002A;</sup>), to customize the illustrations. Analyze the output, e.g., by manually grouping the models based on the similarity of the planes in the heat maps (e.g., size and shape).</p></list-item>
</list></list-item>
<list-item><p>(18) <bold>Validate the Predicted, Metabolic Phenotypes</bold></p>
<list list-type="alpha-upper">
<list-item><p><bold>Compare to experimental data</bold></p>
<p>Compare the results of the previous steps to data sets, e.g., cell culture and perturbation experiments, or compare the predictions to the results of the analysis of additional omics data, e.g., mRNA. Does regulation in metabolic genes support predicted metabolic differences between cells or conditions?</p></list-item>
<list-item><p><bold>Compare to literature</bold></p>
<p>Check if the results of the predictions generated in the previous step agree with what is reported in the literature. For example, has the cell line been previously reported to heavily rely on an alternative pathway, e.g., reverse flux through the citric acid cycle? Are the essential genes already known to be essential in this cell type, or under the experimental conditions, such as hypoxia?</p></list-item></list></list-item></list>
</sec>
</sec>
<sec id="s5">
<title>Trouble shooting</title>
<list list-type="simple">
<list-item><p><bold>Step 1: Metabolites Cannot Be Associated with Model Metabolites</bold></p>
<p>Exclude metabolites, which are not part of the model. Leaving out constraints has as consequence that physiologically irrelevant flux distributions (network states) may remain part of the steady-state solution space. However, no wrong flux distributions are introduced! Another solution would be to add demand reactions (see <bold>Appendix</bold>; Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>) that &#x0201C;artificially&#x0201D; remove metabolites from the system, which were experimentally consumed but that could not be consumed by the model. A sink reaction (see <bold>Appendix</bold>; (Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>)) could be included to represent an intracellular source for a metabolite, which cannot be produced by the model. However, such reactions have only an effect on the model if, e.g., the transport of the metabolite is dependent on energy or other substrates and might otherwise also be ignored. The consecutive addition of demand and sink reactions is not recommended.</p></list-item>
<list-item><p><bold>Step 2: Exchange Reactions Are Constrained Although the Formula Indicates that They Are Reversible</bold></p>
<p>Change reaction bounds on the transport reaction using the function <italic>changeRxnBounds</italic>. Reactions might be closed to prevent thermodynamically infeasible cycles. Opening these reactions might lead to a leaking model (i.e., the model is able to produce metabolites, such as ATP without substrates). Thus, the model should be tested for leakage before proceeding to further steps (see Thiele and Palsson, <xref ref-type="bibr" rid="B50">2010</xref>).</p></list-item>
<list-item><p><bold>Step 3: Transporter Is Unknown</bold></p>
<p>Add a diffusion reaction.</p></list-item>
<list-item><p><bold>Step 4: Existing Reactions Need to Be Modified. New Substrates Have Been Identified for an Existing Transporter</bold></p>
<p>Add, replace, or modify reactions if literature provides novel, convincing clues on the metabolite transport mechanisms. If diffusion is unlikely for a metabolite, consider removing the diffusion reaction that allow the transport &#x0201C;for free.&#x0201D; Add a reaction if the metabolite constitutes an additional substrate to an existing transporter. Make sure that the new substrate is transported in the same way as the original one before duplicating the reaction. Does the reaction mechanism correspond to that in the model? Check if the reaction stoichiometry, directionality, co-substrates, genes, and Gene-protein-reaction association <bold>(</bold>GPR) of the existing reaction agrees with your notes. Add the reaction with a new name corresponding to the transported metabolite. If the transport mechanism is different from the reaction mechanism already present in the model (particularly for diffusion reactions), review whether the original reaction needs to be updated based on the novel literature clues. The mechanism might have been better resolved since the original reconstruction (see references associated with the reaction, e.g., VMH database for the human genome scale reconstruction, <ext-link ext-link-type="uri" xlink:href="http://vmh.life">http://vmh.life</ext-link>). Correct the original reaction in the model based on the result of the literature review. Remove diffusion reactions if no longer adequate.</p></list-item>
<list-item><p><bold>Step 5: Identify Minimal Set of Exchanges for a Model and Objective</bold></p>
<p>Use flux variability analysis (FVA) to identify mandatory metabolite uptakes (negative non-zero minimal and maximal flux).</p></list-item>
<list-item><p><bold>Step 7: Detection Limits Are Unavailable</bold></p>
<p>An arbitrary low value may be used to set the upper bounds on uptake fluxes and lower bounds on secretion fluxes that is close to the cutoff value (e.g., &#x02013;0.00001/0.00001).</p></list-item>
<list-item><p><bold>Step 13: Generate Metabolic Fluxes</bold></p>
<p>Use the function <italic>conc2rate</italic> to convert concentration changes (<sup>&#x0002A;</sup>metConc<sup>&#x0002A;</sup>) measured over the time course of the experiment (<sup>&#x0002A;</sup>t<sup>&#x0002A;</sup>), for a certain number of cells (<sup>&#x0002A;</sup>cellConc<sup>&#x0002A;</sup>), and dry weight (<sup>&#x0002A;</sup>cellWeight<sup>&#x0002A;</sup>) into flux (<sup>&#x0002A;</sup>flux<sup>&#x0002A;</sup>).</p>
<p>&#x0003E;&#x0003E; [flux] = conc2Rate(metConc, cellConc, t, cellWeight);</p></list-item>
<list-item><p><bold>Step 16B: Constraints Are Too Small and Fall Below the Error Range and/or Exceed the Infinite Bounds (Cobra Toolbox Default Is 1e</bold><sup>&#x02212;8</sup><bold>)</bold></p>
<p>Multiply or divide all reaction bounds (except infinite constraints) with the same factor. Adjust the unit the fluxes accordingly using the same factor. Scale the unit the fluxes are reported in with the same factor. Repeat the previous steps to apply the reconciled constraints. If scaling is not possible because the range of fluxes is too wide (e.g., &#x02212;1000 to 1000), the infinite bounds can be increased (<italic>setMediumConstraints</italic>).</p></list-item>
<list-item><p><bold>Step 16C: Additional Metabolite Exchanges Are Unlikely From a Biological Point of View</bold></p>
<p>Close exchange reaction in the starting model and repeat the model building by <italic>setQuantConstraints</italic> (or <italic>generateCompactExchModel</italic>).</p></list-item>
<list-item><p><bold>Step 16D: The Model Contains Unexpected Pathways</bold></p>
<p>Keep in mind that the integration of metabolomic data only indirectly causes the removal of metabolic pathways. Pathways are only removed if they become blocked as a consequence of exchanges being closed. An additional reduction of the internal metabolic network can be achieved by the integration of additional omics data sets, if the imposed flux rates are not deterministic enough. <bold>The contextualized models miss central features of the cells or certain metabolic functions cannot be performed</bold>. Note that the models constructed herein are condition-specific. Are the reported pathways really active in the considered experimental condition? Identify whether there is an exchange connected to the pathway, which is not defined by the consumed metabolites. Could these be missing from set of targeted metabolites? You can add the metabolite to the medium composition (e.g.,<sup>&#x0002A;</sup>ambiguous_metabolites<sup>&#x0002A;</sup>) to prevent that it is removed during model building. Iterate until models are conform to the expectation.</p></list-item>
<list-item><p><bold>Step 17: Generate the Variables</bold> <bold><italic>ResultsAllCellLines</italic> and</bold> <bold><italic>OverViewResults</italic></bold> <bold>to Collect the Information of the Downstream Analysis for Models Not Generated Herein</bold></p></list-item>
<list-item><p>For models of name <sup>&#x0002A;</sup><italic>model</italic><sup>&#x0002A;</sup>, <sup>&#x0002A;</sup><italic>model2</italic><sup>&#x0002A;</sup><italic>, &#x02026;</italic> loaded in the workspace, execute:</p></list-item>
<list-item><p>&#x0003E;&#x0003E; samples = {&#x02018;model&#x02019;, &#x02018;model2&#x02019;, &#x02026;};</p></list-item>
<list-item><p>&#x0003E;&#x0003E; for i=1:length(samples)</p></list-item>
<list-item><p>&#x0003E;&#x0003E; model_name= samples{i}</p></list-item>
<list-item><p>&#x0003E;&#x0003E; eval([&#x02018;ResultsAllCellLines.&#x02019; model_name &#x00027;.modelMin =&#x00027; model_name]);</p></list-item>
<list-item><p>&#x0003E;&#x0003E; eval([&#x02018;ResultsAllCellLines.&#x02019; model_name &#x00027;.modelPruned =&#x00027; model_name]);</p></list-item>
<list-item><p>&#x0003E;&#x0003E; end</p></list-item>
<list-item><p>The difference between the models is that the <sup>&#x0002A;</sup>modelMin<sup>&#x0002A;</sup> has all reactions, whereas the pruned model is the reduced model. If only one exist, both can be equal. In the workflow the <sup>&#x0002A;</sup>modelMin<sup>&#x0002A;</sup> is used for the single gene deletion, instead of the <sup>&#x0002A;</sup>modelPruned<sup>&#x0002A;</sup>.</p></list-item>
<list-item><p>To generate the variable <italic>OverViewResults</italic>, execute:</p></list-item>
<list-item><p>&#x0003E;&#x0003E; samples = {&#x02018;model&#x02019;, &#x02018;model2&#x02019;};</p></list-item>
<list-item><p>&#x0003E;&#x0003E; cntO=1;</p></list-item>
<list-item><p>&#x0003E;&#x0003E; OverViewResults{1,cntO} = &#x02018;samples&#x02019;;</p></list-item>
<list-item><p>&#x0003E;&#x0003E; for i=1:length(samples)</p></list-item>
<list-item><p>&#x0003E;&#x0003E; OverViewResults{i&#x0002B;1,cntO} = samples{i};</p></list-item>
<list-item><p>&#x0003E;&#x0003E; end</p></list-item>
<list-item><p>Some of the analysis require the specification of a generic model, which is a superset of the models specified in <sup>&#x0002A;</sup>samples<sup>&#x0002A;</sup>.</p></list-item>
</list>
</sec>
<sec id="s6">
<title>Timing</title>
<list list-type="simple">
<list-item><p>Step 1, Map metabolite identifiers to Recon IDs, Timing: &#x0007E;hours.</p></list-item>
<list-item><p>Step 2, Find which metabolites cannot be transported in the model, Timing: &#x0007E;minutes.</p></list-item>
<list-item><p>Step 3, Identify missing metabolite transporter, Timing: depends on number &#x0007E; hours&#x02014;days.</p></list-item>
<list-item><p>Step 4, Add reactions, Timing: &#x0007E;hours.</p></list-item>
<list-item><p>Step 5, Define medium constraints, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 6, Calculate detection limits, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 7, Define uptake and secretion profiles, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 8, Calculate semi-quantitative differences, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 9, Set qualitative constraints, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 10, Apply semi-quantitative differences, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 11, Obtain uptake and secretion profiles (flux rates), Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 12, Check the exchange profiles, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 13, Integrate quantitative constraints and generate minimal exchange model, Computational Time: &#x0007E;minutes per model.</p></list-item>
<list-item><p>Step 14, Generate the subnetwork by pruning model, Computational Time: &#x0007E;minutes.</p></list-item>
<list-item><p>Step 15, Integrate gene expression data, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Step 16, Validate the model, Timing: &#x0007E; days&#x02013;weeks.</p>
<list list-type="alpha-upper">
<list-item><p>Literatue review to create an expectation, Timing: &#x0007E; days to weeks.</p></list-item>
<list-item><p>Check constraints, Timing: &#x0007E; minutes to hours.</p></list-item>
<list-item><p>Analyze added exchanges, Timing: &#x0007E; minutes to hours.</p></list-item>
<list-item><p>Check metabolic functions, Timing: &#x0007E; minutes to hours.</p></list-item>
<list-item><p>Comparison to experimental data, Timing: &#x0007E; days to weeks.</p></list-item>
<list-item><p>Test growth rates, Computational Time: &#x0007E; seconds.</p></list-item>
</list></list-item>
<list-item><p>Step 17, predict metabolic phenotypes, Timing: &#x0007E; hours to weeks.</p>
<list list-type="alpha-upper">
<list-item><p>Define essential genes, Computational Time: &#x0007E;minutes.</p></list-item>
<list-item><p>Identify essential reactions behind the gene essentiality, Computational Time: &#x0007E;seconds.</p></list-item>
<list-item><p>Generate intersect and union model, Computational Time: &#x0007E;seconds to minutes.</p></list-item>
<list-item><p>Predict flux splits, Computational Time: &#x0007E;seconds per model.</p></list-item>
<list-item><p>Sampling the steady-state solution space, Computational Time: &#x0007E;hours to days per model.</p></list-item>
<list-item><p>Predict behavior to environmental changes, Computational Time: &#x0007E;minutes to hours per model.</p></list-item>
</list></list-item>
<list-item><p>Step 18, Validate predicted, metabolic phenotypes, Timing: &#x0007E; days to weeks (or months)</p></list-item>
</list>
</sec>
<sec id="s7">
<title>Author contributions</title>
<p>Contributed code to MetaboTools: IT, MA, RF. Designed the tutorials: MA. Wrote the paper: MA, RF, and IT.</p>
</sec>
<sec id="s8">
<title>Funding</title>
<p>This work is supported by the Luxembourg National Research Fund (FNR) through the National Centre of Excellence in Research (NCER) on Parkinson&#x00027;s disease, by the FNR ATTRACT program grant (FNR/A12/01; IT and MA). RF is funded by the U.S. Department of Energy, Offices of Advanced Scientific Computing Research and the Biological and Environmental Research as part of the Scientific Discovery Through Advanced Computing program, grant &#x00023;DE-SC0010429. This project has also received funding from the European Union&#x00027;s Horizon 2020 research and innovation programme under grant agreement No. 668738.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack><p>We thank Alberto Noronha, Dr. Nathalie Poupin, and Dr. Averina Nicolae for testing and commenting on the tutorials and the manuscript.</p>
</ack>
<sec sec-type="supplementary-material" id="s9">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="http://journal.frontiersin.org/article/10.3389/fphys.2016.00327">http://journal.frontiersin.org/article/10.3389/fphys.2016.00327</ext-link></p>
<supplementary-material xlink:href="DataSheet1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="DataSheet2.PDF" id="SM2" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="DataSheet3.PDF" id="SM3" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Agren</surname> <given-names>R.</given-names></name> <name><surname>Bordel</surname> <given-names>S.</given-names></name> <name><surname>Mardinoglu</surname> <given-names>A.</given-names></name> <name><surname>Pornputtapong</surname> <given-names>N.</given-names></name> <name><surname>Nookaew</surname> <given-names>I.</given-names></name> <name><surname>Nielsen</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Reconstruction of genome-scale active metabolic networks for 69 human cell types and 16 cancer types using INIT</article-title>. <source>PLoS Comput. Biol.</source> <volume>8</volume>:<fpage>e1002518</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002518</pub-id><pub-id pub-id-type="pmid">22615553</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Agren</surname> <given-names>R.</given-names></name> <name><surname>Mardinoglu</surname> <given-names>A.</given-names></name> <name><surname>Asplund</surname> <given-names>A.</given-names></name> <name><surname>Kampf</surname> <given-names>C.</given-names></name> <name><surname>Uhlen</surname> <given-names>M.</given-names></name> <name><surname>Nielsen</surname> <given-names>J.</given-names></name></person-group> (<year>2014</year>). <article-title>Identification of anticancer drugs for hepatocellular carcinoma through personalized genome-scale metabolic modeling</article-title>. <source>Mol. Syst. Biol.</source> <volume>10</volume>, <fpage>721</fpage>. <pub-id pub-id-type="doi">10.1002/msb.145122</pub-id><pub-id pub-id-type="pmid">24646661</pub-id></citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ahn</surname> <given-names>S. Y.</given-names></name> <name><surname>Jamshidi</surname> <given-names>N.</given-names></name> <name><surname>Mo</surname> <given-names>M. L.</given-names></name> <name><surname>Wu</surname> <given-names>W.</given-names></name> <name><surname>Eraly</surname> <given-names>S. A.</given-names></name> <name><surname>Dnyanmote</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Linkage of organic anion transporter-1 to metabolic pathways through integrated &#x0201C;omics&#x0201D;-driven network and functional analysis</article-title>. <source>J. Biol. Chem.</source> <volume>286</volume>, <fpage>31522</fpage>&#x02013;<lpage>31531</lpage>. <pub-id pub-id-type="doi">10.1074/jbc.M111.272534</pub-id><pub-id pub-id-type="pmid">21757732</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Allen</surname> <given-names>J.</given-names></name> <name><surname>Davey</surname> <given-names>H. M.</given-names></name> <name><surname>Broadhurst</surname> <given-names>D.</given-names></name> <name><surname>Rowland</surname> <given-names>J. J.</given-names></name> <name><surname>Oliver</surname> <given-names>S. G.</given-names></name> <name><surname>Kell</surname> <given-names>D. B.</given-names></name></person-group> (<year>2004</year>). <article-title>Discrimination of modes of action of antifungal substances by use of metabolic footprinting</article-title>. <source>Appl. Environ. Microbiol.</source> <volume>70</volume>, <fpage>6157</fpage>&#x02013;<lpage>6165</lpage>. <pub-id pub-id-type="doi">10.1128/AEM.70.10.6157-6165.2004</pub-id><pub-id pub-id-type="pmid">15466562</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aurich</surname> <given-names>M. K.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name></person-group> (<year>2012</year>). <article-title>Contextualization procedure and modeling of monocyte specific TLR signaling</article-title>. <source>PLoS ONE</source> <volume>7</volume>:<fpage>e49978</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0049978</pub-id><pub-id pub-id-type="pmid">23236359</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aurich</surname> <given-names>M. K.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name></person-group> (<year>2016</year>). <article-title>Computational modeling of human metabolism and its application to systems biomedicine</article-title>. <source>Methods Mol. Biol.</source> <volume>1386</volume>, <fpage>253</fpage>&#x02013;<lpage>281</lpage>. <pub-id pub-id-type="doi">10.1007/978-1-4939-3283-2_12</pub-id><pub-id pub-id-type="pmid">26677187</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aurich</surname> <given-names>M.</given-names></name> <name><surname>Paglia</surname> <given-names>G.</given-names></name> <name><surname>Rolfsson</surname> <given-names>&#x000D3;.</given-names></name> <name><surname>Hrafnsd&#x000F3;ttir</surname> <given-names>S.</given-names></name> <name><surname>Magn&#x000FA;sd&#x000F3;ttir</surname> <given-names>M.</given-names></name> <name><surname>Stefaniak</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Prediction of intracellular metabolic states from extracellular metabolomic data</article-title>. <source>Metabolomics</source> <volume>11</volume>, <fpage>603</fpage>&#x02013;<lpage>619</lpage>. <pub-id pub-id-type="doi">10.1007/s11306-014-0721-3</pub-id><pub-id pub-id-type="pmid">25972769</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beisken</surname> <given-names>S.</given-names></name> <name><surname>Eiden</surname> <given-names>M.</given-names></name> <name><surname>Salek</surname> <given-names>R. M.</given-names></name></person-group> (<year>2015</year>). <article-title>Getting the right answers: understanding metabolomics challenges</article-title>. <source>Expert Rev. Mol. Diagn.</source> <volume>15</volume>, <fpage>97</fpage>&#x02013;<lpage>109</lpage>. <pub-id pub-id-type="doi">10.1586/14737159.2015.974562</pub-id><pub-id pub-id-type="pmid">25354566</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blazier</surname> <given-names>A. S.</given-names></name> <name><surname>Papin</surname> <given-names>J. A.</given-names></name></person-group> (<year>2012</year>). <article-title>Integration of expression data in genome-scale metabolic network reconstructions</article-title>. <source>Front. Physiol.</source> <volume>3</volume>:<issue>299</issue>. <pub-id pub-id-type="doi">10.3389/fphys.2012.00299</pub-id><pub-id pub-id-type="pmid">22934050</pub-id></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bordbar</surname> <given-names>A.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2012</year>). <article-title>Using the reconstructed genome-scale human metabolic network to study physiology and pathology</article-title>. <source>J. Intern. Med.</source> <volume>271</volume>, <fpage>131</fpage>&#x02013;<lpage>141</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-2796.2011.02494.x</pub-id><pub-id pub-id-type="pmid">22142339</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bordbar</surname> <given-names>A.</given-names></name> <name><surname>Lewis</surname> <given-names>N. E.</given-names></name> <name><surname>Schellenberger</surname> <given-names>J.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name> <name><surname>Jamshidi</surname> <given-names>N.</given-names></name></person-group> (<year>2010</year>). <article-title>Insight into human alveolar macrophage and <italic>M. tuberculosis</italic> interactions via metabolic reconstructions</article-title>. <source>Mol. Syst. Biol.</source> <volume>6</volume>, <fpage>422</fpage>. <pub-id pub-id-type="doi">10.1038/msb.2010.68</pub-id><pub-id pub-id-type="pmid">20959820</pub-id></citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bordbar</surname> <given-names>A.</given-names></name> <name><surname>Mo</surname> <given-names>M. L.</given-names></name> <name><surname>Nakayasu</surname> <given-names>E. S.</given-names></name> <name><surname>Schrimpe-Rutledge</surname> <given-names>A. C.</given-names></name> <name><surname>Kim</surname> <given-names>Y. M.</given-names></name> <name><surname>Metz</surname> <given-names>T. O.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Model-driven multi-omic data analysis elucidates metabolic immunomodulators of macrophage activation</article-title>. <source>Mol. Syst. Biol.</source> <volume>8</volume>, <fpage>558</fpage>. <pub-id pub-id-type="doi">10.1038/msb.2012.21</pub-id><pub-id pub-id-type="pmid">22735334</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cottret</surname> <given-names>L.</given-names></name> <name><surname>Wildridge</surname> <given-names>D.</given-names></name> <name><surname>Vinson</surname> <given-names>F.</given-names></name> <name><surname>Barrett</surname> <given-names>M. P.</given-names></name> <name><surname>Charles</surname> <given-names>H.</given-names></name> <name><surname>Sagot</surname> <given-names>M. F.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>MetExplore: a web server to link metabolomic experiments and genome-scale metabolic networks</article-title>. <source>Nucleic Acids Res.</source> <volume>38</volume>, <fpage>W132</fpage>&#x02013;<lpage>W137</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkq312</pub-id><pub-id pub-id-type="pmid">20444866</pub-id></citation>
</ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cuperlovic-Culf</surname> <given-names>M.</given-names></name> <name><surname>Barnett</surname> <given-names>D. A.</given-names></name> <name><surname>Culf</surname> <given-names>A. S.</given-names></name> <name><surname>Chute</surname> <given-names>I.</given-names></name></person-group> (<year>2010</year>). <article-title>Cell culture metabolomics: applications and future directions</article-title>. <source>Drug Discov. Today</source> <volume>15</volume>, <fpage>610</fpage>&#x02013;<lpage>621</lpage>. <pub-id pub-id-type="doi">10.1016/j.drudis.2010.06.012</pub-id><pub-id pub-id-type="pmid">20601091</pub-id></citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Degtyarenko</surname> <given-names>K.</given-names></name> <name><surname>de Matos</surname> <given-names>P.</given-names></name> <name><surname>Ennis</surname> <given-names>M.</given-names></name> <name><surname>Hastings</surname> <given-names>J.</given-names></name> <name><surname>Zbinden</surname> <given-names>M.</given-names></name> <name><surname>McNaught</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2008</year>). <article-title>ChEBI: a database and ontology for chemical entities of biological interest</article-title>. <source>Nucleic Acids Res.</source> <volume>36</volume>, <fpage>D344</fpage>&#x02013;<lpage>D350</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gkm791</pub-id><pub-id pub-id-type="pmid">17932057</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fan</surname> <given-names>J.</given-names></name> <name><surname>Kamphorst</surname> <given-names>J. J.</given-names></name> <name><surname>Mathew</surname> <given-names>R.</given-names></name> <name><surname>Chung</surname> <given-names>M. K.</given-names></name> <name><surname>White</surname> <given-names>E.</given-names></name> <name><surname>Shlomi</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Glutamine-driven oxidative phosphorylation is a major ATP source in transformed mammalian cells in both normoxia and hypoxia</article-title>. <source>Mol. Syst. Biol.</source> <volume>9</volume>, <fpage>712</fpage>. <pub-id pub-id-type="doi">10.1038/msb.2013.65</pub-id><pub-id pub-id-type="pmid">24301801</pub-id></citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fitzpatrick</surname> <given-names>M. A.</given-names></name> <name><surname>McGrath</surname> <given-names>C. M.</given-names></name> <name><surname>Young</surname> <given-names>S. P.</given-names></name></person-group> (<year>2014</year>). <article-title>Pathomx: an interactive workflow-based tool for the analysis of metabolomic data</article-title>. <source>BMC Bioinform.</source> <volume>15</volume>:<fpage>396</fpage>. <pub-id pub-id-type="doi">10.1186/s12859-014-0396-9</pub-id><pub-id pub-id-type="pmid">25490956</pub-id></citation>
</ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frezza</surname> <given-names>C.</given-names></name> <name><surname>Zheng</surname> <given-names>L.</given-names></name> <name><surname>Folger</surname> <given-names>O.</given-names></name> <name><surname>Rajagopalan</surname> <given-names>K. N.</given-names></name> <name><surname>MacKenzie</surname> <given-names>E. D.</given-names></name> <name><surname>Jerby</surname> <given-names>L.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Haem oxygenase is synthetically lethal with the tumour suppressor fumarate hydratase</article-title>. <source>Nature</source> <volume>477</volume>, <fpage>225</fpage>&#x02013;<lpage>228</lpage>. <pub-id pub-id-type="doi">10.1038/nature10363</pub-id><pub-id pub-id-type="pmid">21849978</pub-id></citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fu</surname> <given-names>Z.</given-names></name> <name><surname>Verderame</surname> <given-names>T. D.</given-names></name> <name><surname>Leighton</surname> <given-names>J. M.</given-names></name> <name><surname>Sampey</surname> <given-names>B. P.</given-names></name> <name><surname>Appelbaum</surname> <given-names>E. R.</given-names></name> <name><surname>Patel</surname> <given-names>P. S.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Exometabolome analysis reveals hypoxia at the up-scaling of a Saccharomyces cerevisiae high-cell density fed-batch biopharmaceutical process</article-title>. <source>Microb. Cell Fact.</source> <volume>13</volume>:<fpage>32</fpage>. <pub-id pub-id-type="doi">10.1186/1475-2859-13-32</pub-id><pub-id pub-id-type="pmid">24593159</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ghaffari</surname> <given-names>P.</given-names></name> <name><surname>Mardinoglu</surname> <given-names>A.</given-names></name> <name><surname>Asplund</surname> <given-names>A.</given-names></name> <name><surname>Shoaie</surname> <given-names>S.</given-names></name> <name><surname>Kampf</surname> <given-names>C.</given-names></name> <name><surname>Uhlen</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Identifying anti-growth factors for human cancer cell lines through genome-scale metabolic modeling</article-title>. <source>Sci. Rep.</source> <volume>5</volume>:<fpage>8183</fpage>. <pub-id pub-id-type="doi">10.1038/srep08183</pub-id><pub-id pub-id-type="pmid">25640694</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gudmundsson</surname> <given-names>S.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name></person-group> (<year>2010</year>). <article-title>Computationally efficient flux variability analysis</article-title>. <source>BMC Bioinformatics</source> <volume>11</volume>:<fpage>489</fpage>. <pub-id pub-id-type="doi">10.1186/1471-2105-11-489</pub-id><pub-id pub-id-type="pmid">20920235</pub-id></citation>
</ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haraldsdottir</surname> <given-names>H. S.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Fleming</surname> <given-names>R. M.</given-names></name></person-group> (<year>2014</year>). <article-title>Comparative evaluation of open source software for mapping between metabolite identifiers in metabolic network reconstructions: application to Recon 2</article-title>. <source>J. Cheminform.</source> <volume>6</volume>:<fpage>2</fpage>. <pub-id pub-id-type="doi">10.1186/1758-2946-6-2</pub-id><pub-id pub-id-type="pmid">24468196</pub-id></citation>
</ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heavner</surname> <given-names>B. D.</given-names></name> <name><surname>Price</surname> <given-names>N. D.</given-names></name></person-group> (<year>2015</year>). <article-title>Transparency in metabolic network reconstruction enables scalable biological discovery</article-title>. <source>Curr. Opin. Biotechnol.</source> <volume>34</volume>:<fpage>105</fpage>&#x02013;<lpage>109</lpage>. <pub-id pub-id-type="doi">10.1016/j.copbio.2014.12.010</pub-id><pub-id pub-id-type="pmid">25562137</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jain</surname> <given-names>M.</given-names></name> <name><surname>Nilsson</surname> <given-names>R.</given-names></name> <name><surname>Sharma</surname> <given-names>S.</given-names></name> <name><surname>Madhusudhan</surname> <given-names>N.</given-names></name> <name><surname>Kitami</surname> <given-names>T.</given-names></name> <name><surname>Souza</surname> <given-names>A. L.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Metabolite profiling identifies a key role for glycine in rapid cancer cell proliferation</article-title>. <source>Science</source> <volume>36</volume>, <fpage>1040</fpage>&#x02013;<lpage>1044</lpage>. <pub-id pub-id-type="doi">10.1126/science.1218595</pub-id><pub-id pub-id-type="pmid">22628656</pub-id></citation>
</ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jamshidi</surname> <given-names>N.</given-names></name> <name><surname>Miller</surname> <given-names>F. J.</given-names></name> <name><surname>Mandel</surname> <given-names>J.</given-names></name> <name><surname>Evans</surname> <given-names>T.</given-names></name> <name><surname>Kuo</surname> <given-names>M. D.</given-names></name></person-group> (<year>2011</year>). <article-title>Individualized therapy of HHT driven by network analysis of metabolomic profiles</article-title>. <source>BMC Syst. Biol.</source> <volume>5</volume>:<fpage>200</fpage>. <pub-id pub-id-type="doi">10.1186/1752-0509-5-200</pub-id><pub-id pub-id-type="pmid">22185482</pub-id></citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jerby</surname> <given-names>L.</given-names></name> <name><surname>Shlomi</surname> <given-names>T.</given-names></name> <name><surname>Ruppin</surname> <given-names>E.</given-names></name></person-group> (<year>2010</year>). <article-title>Computational reconstruction of tissue-specific metabolic models: application to human liver metabolism</article-title>. <source>Mol. Syst. Biol.</source> <volume>6</volume>:<fpage>401</fpage>. <pub-id pub-id-type="doi">10.1038/msb.2010.56</pub-id><pub-id pub-id-type="pmid">20823844</pub-id></citation>
</ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Joyce</surname> <given-names>A. R.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2006</year>). <article-title>The model organism as a system: integrating &#x02018;omics&#x02019; data sets</article-title>. <source>Nat. Rev. Mol. Cell Biol.</source> <volume>7</volume>, <fpage>198</fpage>&#x02013;<lpage>210</lpage>. <pub-id pub-id-type="doi">10.1038/nrm1857</pub-id><pub-id pub-id-type="pmid">16496022</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kell</surname> <given-names>D. B.</given-names></name></person-group> (<year>2004</year>). <article-title>Metabolomics and systems biology: making sense of the soup</article-title>. <source>Curr. Opin. Microbiol.</source> <volume>7</volume>, <fpage>296</fpage>&#x02013;<lpage>307</lpage>. <pub-id pub-id-type="doi">10.1016/j.mib.2004.04.012</pub-id><pub-id pub-id-type="pmid">15196499</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krug</surname> <given-names>S.</given-names></name> <name><surname>Kastenmuller</surname> <given-names>G.</given-names></name> <name><surname>Stuckler</surname> <given-names>F.</given-names></name> <name><surname>Rist</surname> <given-names>M. J.</given-names></name> <name><surname>Skurk</surname> <given-names>T.</given-names></name> <name><surname>Sailer</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>The dynamic range of the human metabolome revealed by challenges</article-title>. <source>FASEB J.</source> <volume>26</volume>, <fpage>2607</fpage>&#x02013;<lpage>2619</lpage>. <pub-id pub-id-type="doi">10.1096/fj.11-198093</pub-id><pub-id pub-id-type="pmid">22426117</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kucharzewska</surname> <given-names>P.</given-names></name> <name><surname>Christianson</surname> <given-names>H. C.</given-names></name> <name><surname>Belting</surname> <given-names>M.</given-names></name></person-group> (<year>2015</year>). <article-title>Global profiling of metabolic adaptation to hypoxic stress in human glioblastoma cells</article-title>. <source>PLoS ONE</source> <volume>10</volume>:<fpage>e0116740</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0116740</pub-id><pub-id pub-id-type="pmid">25633823</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lewis</surname> <given-names>N. E.</given-names></name> <name><surname>Nagarajan</surname> <given-names>H.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2012</year>). <article-title>Constraining the metabolic genotype-phenotype relationship using a phylogeny of in silico methods</article-title>. <source>Nat. Rev. Microbiol.</source> <volume>10</volume>, <fpage>291</fpage>&#x02013;<lpage>305</lpage>. <pub-id pub-id-type="doi">10.1038/nrmicro2737</pub-id><pub-id pub-id-type="pmid">22367118</pub-id></citation>
</ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Machado</surname> <given-names>D.</given-names></name> <name><surname>Herrgard</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <article-title>Systematic evaluation of methods for integration of transcriptomic data into constraint-based models of metabolism</article-title>. <source>PLoS Comput. Biol.</source> <volume>10</volume>:<fpage>e1003580</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1003580</pub-id><pub-id pub-id-type="pmid">24762745</pub-id></citation>
</ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mardinoglu</surname> <given-names>A.</given-names></name> <name><surname>Agren</surname> <given-names>R.</given-names></name> <name><surname>Kampf</surname> <given-names>C.</given-names></name> <name><surname>Asplund</surname> <given-names>A.</given-names></name> <name><surname>Nookaew</surname> <given-names>I.</given-names></name> <name><surname>Jacobson</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Integration of clinical data with a genome-scale metabolic model of the human adipocyte</article-title>. <source>Mol. Syst. Biol.</source> <volume>9</volume>, <fpage>649</fpage>. <pub-id pub-id-type="doi">10.1038/msb.2013.5</pub-id><pub-id pub-id-type="pmid">23511207</pub-id></citation>
</ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mardinoglu</surname> <given-names>A.</given-names></name> <name><surname>Agren</surname> <given-names>R.</given-names></name> <name><surname>Kampf</surname> <given-names>C.</given-names></name> <name><surname>Asplund</surname> <given-names>A.</given-names></name> <name><surname>Uhlen</surname> <given-names>M.</given-names></name> <name><surname>Nielsen</surname> <given-names>J.</given-names></name></person-group> (<year>2014b</year>). <article-title>Genome-scale metabolic modelling of hepatocytes reveals serine deficiency in patients with non-alcoholic fatty liver disease</article-title>. <source>Nat. Commun.</source> <volume>5</volume>:<fpage>3083</fpage>. <pub-id pub-id-type="doi">10.1038/ncomms4083</pub-id><pub-id pub-id-type="pmid">24419221</pub-id></citation>
</ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mardinoglu</surname> <given-names>A.</given-names></name> <name><surname>Kampf</surname> <given-names>C.</given-names></name> <name><surname>Asplund</surname> <given-names>A.</given-names></name> <name><surname>Fagerberg</surname> <given-names>L.</given-names></name> <name><surname>Hallstrom</surname> <given-names>B. M.</given-names></name> <name><surname>Edlund</surname> <given-names>K.</given-names></name> <etal/></person-group>. (<year>2014a</year>). <article-title>Defining the human adipose tissue proteome to reveal metabolic alterations in obesity</article-title>. <source>J. Proteome Res.</source> <volume>13</volume>, <fpage>5106</fpage>&#x02013;<lpage>5119</lpage>. <pub-id pub-id-type="doi">10.1021/pr500586e</pub-id><pub-id pub-id-type="pmid">25219818</pub-id></citation>
</ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Misra</surname> <given-names>B. B.</given-names></name> <name><surname>van der Hooft</surname> <given-names>J. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Updates in metabolomics tools and resources: 2014&#x02013;2015</article-title>. <source>Electrophoresis</source> <volume>37</volume>, <fpage>86</fpage>&#x02013;<lpage>110</lpage>. <pub-id pub-id-type="doi">10.1002/elps.201500417</pub-id><pub-id pub-id-type="pmid">26464019</pub-id></citation>
</ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mo</surname> <given-names>M. L.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name> <name><surname>Herrgard</surname> <given-names>M. J.</given-names></name></person-group> (<year>2009</year>). <article-title>Connecting extracellular metabolomic measurements to intracellular flux states in yeast</article-title>. <source>BMC Syst. Biol.</source> <volume>3</volume>:<fpage>37</fpage>. <pub-id pub-id-type="doi">10.1186/1752-0509-3-37</pub-id><pub-id pub-id-type="pmid">19321003</pub-id></citation>
</ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ogata</surname> <given-names>H.</given-names></name> <name><surname>Goto</surname> <given-names>S.</given-names></name> <name><surname>Sato</surname> <given-names>K.</given-names></name> <name><surname>Fujibuchi</surname> <given-names>W.</given-names></name> <name><surname>Bono</surname> <given-names>H.</given-names></name> <name><surname>Kanehisa</surname> <given-names>M.</given-names></name></person-group> (<year>1999</year>). <article-title>KEGG: Kyoto Encyclopedia of Genes and Genomes</article-title>. <source>Nucleic Acids Res.</source> <volume>27</volume>, <fpage>29</fpage>&#x02013;<lpage>34</lpage>. <pub-id pub-id-type="doi">10.1093/nar/27.1.29</pub-id><pub-id pub-id-type="pmid">9847135</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Orth</surname> <given-names>J. D.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2010</year>). <article-title>What is flux balance analysis?</article-title> <source>Nat. Biotechnol.</source> <volume>28</volume>, <fpage>245</fpage>&#x02013;<lpage>248</lpage>. <pub-id pub-id-type="doi">10.1038/nbt.1614</pub-id><pub-id pub-id-type="pmid">20212490</pub-id></citation>
</ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paglia</surname> <given-names>G.</given-names></name> <name><surname>Hrafnsdottir</surname> <given-names>S.</given-names></name> <name><surname>Magnusdottir</surname> <given-names>M.</given-names></name> <name><surname>Fleming</surname> <given-names>R. M.</given-names></name> <name><surname>Thorlacius</surname> <given-names>S.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Monitoring metabolites consumption and secretion in cultured cells using ultra-performance liquid chromatography quadrupole-time of flight mass spectrometry (UPLC-Q-ToF-MS)</article-title>. <source>Anal. Bioanal. Chem.</source> <volume>402</volume>, <fpage>1183</fpage>&#x02013;<lpage>1198</lpage>. <pub-id pub-id-type="doi">10.1007/s00216-011-5556-4</pub-id><pub-id pub-id-type="pmid">22159369</pub-id></citation>
</ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Petersen</surname> <given-names>A. K.</given-names></name> <name><surname>Zeilinger</surname> <given-names>S.</given-names></name> <name><surname>Kastenmuller</surname> <given-names>G.</given-names></name> <name><surname>Romisch-Margl</surname> <given-names>W.</given-names></name> <name><surname>Brugger</surname> <given-names>M.</given-names></name> <name><surname>Peters</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Epigenetics meets metabolomics: an epigenome-wide association study with blood serum metabolic traits</article-title>. <source>Hum. Mol. Genet.</source> <volume>23</volume>, <fpage>534</fpage>&#x02013;<lpage>545</lpage>. <pub-id pub-id-type="doi">10.1093/hmg/ddt430</pub-id><pub-id pub-id-type="pmid">24014485</pub-id></citation>
</ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Price</surname> <given-names>N. D.</given-names></name> <name><surname>Schellenberger</surname> <given-names>J.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2004</year>). <article-title>Uniform sampling of steady-state flux spaces: means to design experiments and to interpret enzymopathies</article-title>. <source>Biophys. J.</source> <volume>87</volume>, <fpage>2172</fpage>&#x02013;<lpage>2186</lpage>. <pub-id pub-id-type="doi">10.1529/biophysj.104.043000</pub-id><pub-id pub-id-type="pmid">15454420</pub-id></citation>
</ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sahoo</surname> <given-names>S.</given-names></name> <name><surname>Aurich</surname> <given-names>M. K.</given-names></name> <name><surname>Jonsson</surname> <given-names>J. J.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name></person-group> (<year>2014</year>). <article-title>Membrane transporters in a human genome-scale metabolic knowledgebase and their implications for disease</article-title>. <source>Front. Physiol.</source> <volume>5</volume>:<issue>91</issue>. <pub-id pub-id-type="doi">10.3389/fphys.2014.00091</pub-id><pub-id pub-id-type="pmid">24653705</pub-id></citation>
</ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saito</surname> <given-names>K.</given-names></name> <name><surname>Matsuda</surname> <given-names>F.</given-names></name></person-group> (<year>2010</year>). <article-title>Metabolomics for functional genomics, systems biology, and biotechnology</article-title>. <source>Annu. Rev. Plant Biol.</source> <volume>61</volume>, <fpage>463</fpage>&#x02013;<lpage>489</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.arplant.043008.092035</pub-id><pub-id pub-id-type="pmid">19152489</pub-id></citation>
</ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schellenberger</surname> <given-names>J.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2009</year>). <article-title>Use of randomized sampling for analysis of metabolic networks</article-title>. <source>J. Biol. Chem.</source> <volume>284</volume>, <fpage>5457</fpage>&#x02013;<lpage>5461</lpage>. <pub-id pub-id-type="doi">10.1074/jbc.R800048200</pub-id><pub-id pub-id-type="pmid">18940807</pub-id></citation>
</ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schellenberger</surname> <given-names>J.</given-names></name> <name><surname>Que</surname> <given-names>R.</given-names></name> <name><surname>Fleming</surname> <given-names>R. M.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Orth</surname> <given-names>J. D.</given-names></name> <name><surname>Feist</surname> <given-names>A. M.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Quantitative prediction of cellular metabolism with constraint-based models: the COBRA Toolbox v2.0</article-title>. <source>Nat. Protoc.</source> <volume>6</volume>, <fpage>1290</fpage>&#x02013;<lpage>1307</lpage>. <pub-id pub-id-type="doi">10.1038/nprot.2011.308</pub-id><pub-id pub-id-type="pmid">21886097</pub-id></citation>
</ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmidt</surname> <given-names>B. J.</given-names></name> <name><surname>Ebrahim</surname> <given-names>A.</given-names></name> <name><surname>Metz</surname> <given-names>T. O.</given-names></name> <name><surname>Adkins</surname> <given-names>J. N.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name> <name><surname>Hyduke</surname> <given-names>D. R.</given-names></name></person-group> (<year>2013</year>). <article-title>GIM3E: condition-specific models of cellular metabolism developed from metabolomics and expression data</article-title>. <source>Bioinformatics</source> <volume>29</volume>, <fpage>2900</fpage>&#x02013;<lpage>2908</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btt493</pub-id><pub-id pub-id-type="pmid">23975765</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stempler</surname> <given-names>S.</given-names></name> <name><surname>Yizhak</surname> <given-names>K.</given-names></name> <name><surname>Ruppin</surname> <given-names>E.</given-names></name></person-group> (<year>2014</year>). <article-title>Integrating transcriptomics with metabolic modeling predicts biomarkers and drug targets for Alzheimer&#x00027;s disease</article-title>. <source>PLoS ONE</source> <volume>9</volume>:<fpage>e105383</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0105383</pub-id><pub-id pub-id-type="pmid">25127241</pub-id></citation>
</ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Hyduke</surname> <given-names>D. R.</given-names></name> <name><surname>Steeb</surname> <given-names>B.</given-names></name> <name><surname>Fankam</surname> <given-names>G.</given-names></name> <name><surname>Allen</surname> <given-names>D. K.</given-names></name> <name><surname>Bazzani</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>A community effort towards a knowledge-base and mathematical model of the human pathogen Salmonella Typhimurium LT2</article-title>. <source>BMC Syst. Biol.</source> <volume>5</volume>:<fpage>8</fpage>. <pub-id pub-id-type="doi">10.1186/1752-0509-5-8</pub-id><pub-id pub-id-type="pmid">21244678</pub-id></citation>
</ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2010</year>). <article-title>A protocol for generating a high-quality genome-scale metabolic reconstruction</article-title>. <source>Nat. Protoc.</source> <volume>5</volume>, <fpage>93</fpage>&#x02013;<lpage>121</lpage>. <pub-id pub-id-type="doi">10.1038/nprot.2009.203</pub-id><pub-id pub-id-type="pmid">20057383</pub-id></citation>
</ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Price</surname> <given-names>N. D.</given-names></name> <name><surname>Vo</surname> <given-names>T. D.</given-names></name> <name><surname>Palsson</surname> <given-names>B. O.</given-names></name></person-group> (<year>2005</year>). <article-title>Candidate metabolic network states in human mitochondria. Impact of diabetes, ischemia, and diet</article-title>. <source>J. Biol. Chem.</source> <volume>280</volume>, <fpage>11683</fpage>&#x02013;<lpage>11695</lpage>. <pub-id pub-id-type="doi">10.1074/jbc.M409072200</pub-id><pub-id pub-id-type="pmid">15572364</pub-id></citation>
</ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thiele</surname> <given-names>I.</given-names></name> <name><surname>Swainston</surname> <given-names>N.</given-names></name> <name><surname>Fleming</surname> <given-names>R. M.</given-names></name> <name><surname>Hoppe</surname> <given-names>A.</given-names></name> <name><surname>Sahoo</surname> <given-names>S.</given-names></name> <name><surname>Aurich</surname> <given-names>M. K.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>A community-driven global reconstruction of human metabolism</article-title>. <source>Nat. Biotechnol.</source> <volume>31</volume>, <fpage>419</fpage>&#x02013;<lpage>425</lpage>. <pub-id pub-id-type="doi">10.1038/nbt.2488</pub-id><pub-id pub-id-type="pmid">23455439</pub-id></citation>
</ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thorleifsson</surname> <given-names>S. G.</given-names></name> <name><surname>Thiele</surname> <given-names>I.</given-names></name></person-group> (<year>2011</year>). <article-title>rBioNet: a COBRA toolbox extension for reconstructing high-quality biochemical networks</article-title>. <source>Bioinformatics</source> <volume>27</volume>, <fpage>2009</fpage>&#x02013;<lpage>2010</lpage>. <pub-id pub-id-type="doi">10.1093/bioinformatics/btr308</pub-id><pub-id pub-id-type="pmid">21596791</pub-id></citation>
</ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Verdegem</surname> <given-names>D.</given-names></name> <name><surname>Lambrechts</surname> <given-names>D.</given-names></name> <name><surname>Carmeliet</surname> <given-names>P.</given-names></name> <name><surname>Ghesqui&#x000E8;re</surname> <given-names>B.</given-names></name></person-group> (<year>2016</year>). <article-title>Improved metabolite identification with MIDAS and MAGMa through MS/MS spectral dataset-driven parameter optimization</article-title>. <source>Metabolomics</source> <volume>12</volume>, <fpage>1</fpage>&#x02013;<lpage>16</lpage>. <pub-id pub-id-type="doi">10.1007/s11306-016-1036-3</pub-id></citation>
</ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vlassis</surname> <given-names>N.</given-names></name> <name><surname>Pacheco</surname> <given-names>M. P.</given-names></name> <name><surname>Sauter</surname> <given-names>T.</given-names></name></person-group> (<year>2014</year>). <article-title>Fast reconstruction of compact context-specific metabolic network models</article-title>. <source>PLoS Comput. Biol.</source> <volume>10</volume>:<fpage>e1003424</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1003424</pub-id><pub-id pub-id-type="pmid">24453953</pub-id></citation>
</ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wishart</surname> <given-names>D. S.</given-names></name> <name><surname>Jewison</surname> <given-names>T.</given-names></name> <name><surname>Guo</surname> <given-names>A. C.</given-names></name> <name><surname>Wilson</surname> <given-names>M.</given-names></name> <name><surname>Knox</surname> <given-names>C.</given-names></name> <name><surname>Liu</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>HMDB 3.0&#x02013;The Human Metabolome Database in 2013</article-title>. <source>Nucleic Acids Res.</source> <volume>41</volume>, <fpage>D801</fpage>&#x02013;<lpage>D807</lpage>. <pub-id pub-id-type="doi">10.1093/nar/gks1065</pub-id><pub-id pub-id-type="pmid">23161693</pub-id></citation>
</ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yizhak</surname> <given-names>K.</given-names></name> <name><surname>Gaude</surname> <given-names>E.</given-names></name> <name><surname>Le Devedec</surname> <given-names>S.</given-names></name> <name><surname>Waldman</surname> <given-names>Y. Y.</given-names></name> <name><surname>Stein</surname> <given-names>G. Y.</given-names></name> <name><surname>van de Water</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Phenotype-based cell-specific metabolic modeling reveals metabolic liabilities of cancer</article-title>. <source>Elife</source> <volume>3</volume>:<fpage>e03641</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.03641</pub-id><pub-id pub-id-type="pmid">25415239</pub-id></citation>
</ref>
</ref-list>
<app-group>
<app id="A1">
<title>Appendix</title>
<sec>
<title>Glossary</title>
<boxed-text>
<p><bold>Antimetabolite&#x02014;</bold>structurally similar metabolite that inhibits the use of the original metabolite by an enzyme and thus, can diminish proliferation.</p>
<p><bold>Cell-type or tissue-specific model</bold>&#x02014;model that contains all reactions and pathways a cell type or tissue can use in under any set of environmental and/or genetic condition. A condition-specific model contains a subset of reactions of the cell-type or tissue-specific model.</p>
<p><bold>Closed exchange reaction</bold>&#x02014;reaction, whose lower and upper bounds are set to zero and which, due to these constraints, cannot carry any flux (flux value is zero).</p>
<p><bold>Constraints</bold>&#x02014;limits set on reactions in the metabolic model and defined through the upper bound (&#x0201C;ub&#x0201D;) and lower bound (&#x0201C;lb&#x0201D;) variable vector in the model. Possible computed flux values for a reaction can only lie between or on these bounds.</p>
<p><bold>Contextualized model</bold>&#x02014;model that has been tailored toward a particular experimental condition.</p>
<p><bold>Data integration</bold>&#x02014;applying constraints based on experimental (e.g., high-throughput) measurements.</p>
<p><bold>Data mapping</bold>&#x02014;matching names of the metabolites in the reconstruction and the data.</p>
<p><bold>Demand reaction</bold>&#x02014;unbalanced network reactions, which allow accumulation of metabolites in the model and as such circumvent the steady-state assumption underlying constraint-based modeling.</p>
<p><bold>Exchange profile&#x02014;</bold>the profile of a sample (e.g., cell line, hypoxic condition, etc.), detailing, which metabolites are consumed and which metabolites are released. It will be used to established constraints during the data integration process.</p>
<p><bold>Feasible model</bold>&#x02014;a model that can satisfy the user-defined objective function while being consistent with the applied constraints.</p>
<p><bold>Gap-filling approaches</bold>&#x02014;predict possible ways to fill network gaps using pathway and reaction information from other organisms.</p>
<p><bold>Generic model</bold>&#x02014;a model that captures all metabolic functions and pathways known to be active in at least one cell and/or under at least one condition in organism.</p>
<p><bold>Gene-protein-reaction association (GPRs)</bold>&#x02014;a reaction is associated with one or more genes encoding for one or more enzymes, which catalyze the reaction. The gene-protein-reaction associations are formulated as Boolean rules, whereby isozymes are associated with an OR and subunits of the functional protein complex are associated with an AND in the GPRs.</p>
<p><bold>Infinite constraint</bold>&#x02014;an arbitrary high value that does not limit reaction flux.</p>
<p><bold>Loop reactions</bold>&#x02014;cyclic internal reactions that do not depend on the inputs and outputs of the model. Loop reactions are thermodynamically infeasible and common artifacts in metabolic models due to missing constraints (e.g., temporal separation of pathways, regulation).</p>
<p><bold>Open model</bold>&#x02014;all exchange reactions in the model are unconstrained.</p>
<p><bold>Sample</bold>&#x02014;one experimental condition.</p>
<p><bold>Sampling point</bold>&#x02014;each sampling point contains an entire flux vector, and thus contains a flux value for each reactions in the metabolic model.</p>
<p><bold>Sink reaction</bold>&#x02014;adds compounds that cannot be produced by the metabolic model, because they originate from pathways outside metabolism or because the production pathways are unknown.</p>
<p><bold>Steady-state assumption</bold>&#x02014;the modeled system is assumed to be in steady state, i.e., no metabolites are accumulated over time (dx/dt = 0).</p>
<p><bold>Unbounded reactions</bold>&#x02014;reactions, whose fluxes are not limited through the network topology and applied constraints, but which expand over the entire span between the constraints (i.e., infinite bounds).</p>
<p><bold>Unconstrained</bold>&#x02014;the upper and lower bounds are set to infinite.</p>
</boxed-text>
</sec>
</app>
</app-group>
</back>
</article>