<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neuroinform.</journal-id>
<journal-title>Frontiers in Neuroinformatics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neuroinform.</abbrev-journal-title>
<issn pub-type="epub">1662-5196</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fninf.2022.790966</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>BOLD Monitoring in the Neural Simulator ANNarchy</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Maith</surname> <given-names>Oliver</given-names></name>
<xref ref-type="author-notes" rid="fn001"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1248280/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Dinkelbach</surname> <given-names>Helge &#x000DC;lo</given-names></name>
<xref ref-type="author-notes" rid="fn001"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/228444/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Baladron</surname> <given-names>Javier</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/1549600/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Vitay</surname> <given-names>Julien</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/4783/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Hamker</surname> <given-names>Fred H.</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/6370/overview"/>
</contrib>
</contrib-group>
<aff><institution>Department of Computer Science, Chemnitz University of Technology</institution>, <addr-line>Chemnitz</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Kelly Shen, Simon Fraser University, Canada</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Dominic Standage, University of Birmingham, United Kingdom; Erin Lindsay Mazerolle, St. Francis Xavier University, Canada</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Fred H. Hamker <email>fred.hamker&#x00040;informatik.tu-chemnitz.de</email></corresp>
<fn fn-type="equal" id="fn001"><p>&#x02020;These authors have contributed equally to this work</p></fn></author-notes>
<pub-date pub-type="epub">
<day>22</day>
<month>03</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>16</volume>
<elocation-id>790966</elocation-id>
<history>
<date date-type="received">
<day>07</day>
<month>10</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>08</day>
<month>02</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2022 Maith, Dinkelbach, Baladron, Vitay and Hamker.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Maith, Dinkelbach, Baladron, Vitay and Hamker</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Multi-scale network models that simultaneously simulate different measurable signals at different spatial and temporal scales, such as membrane potentials of single neurons, population firing rates, local field potentials, and blood-oxygen-level-dependent (BOLD) signals, are becoming increasingly popular in computational neuroscience. The transformation of the underlying simulated neuronal activity of these models to simulated non-invasive measurements, such as BOLD signals, is particularly relevant. The present work describes the implementation of a BOLD monitor within the neural simulator ANNarchy to allow an on-line computation of simulated BOLD signals from neural network models. An active research topic regarding the simulation of BOLD signals is the coupling of neural processes to cerebral blood flow (CBF) and cerebral metabolic rate of oxygen (CMRO2). The flexibility of ANNarchy allows users to define this coupling with a high degree of freedom and thus, not only allows to relate mesoscopic network models of populations of spiking neurons to experimental BOLD data, but also to investigate different hypotheses regarding the coupling between neural processes, CBF and CMRO2 with these models. In this study, we demonstrate how simulated BOLD signals can be obtained from a network model consisting of multiple spiking neuron populations. We first demonstrate the use of the Balloon model, the predominant model for simulating BOLD signals, as well as the possibility of using novel user-defined models, such as a variant of the Balloon model with separately driven CBF and CMRO2 signals. We emphasize how different hypotheses about the coupling between neural processes, CBF and CMRO2 can be implemented and how these different couplings affect the simulated BOLD signals. With the BOLD monitor presented here, ANNarchy provides a tool for modelers who want to relate their network models to experimental MRI data and for scientists who want to extend their studies of the coupling between neural processes and the BOLD signal by using modeling approaches. This facilitates the investigation and model-based analysis of experimental BOLD data and thus improves multi-scale understanding of neural processes in humans.</p></abstract>
<kwd-group>
<kwd>blood-oxygen-level-dependent signal</kwd>
<kwd>neural simulator</kwd>
<kwd>spiking networks</kwd>
<kwd>rate-coded networks</kwd>
<kwd>Balloon model</kwd>
<kwd>neurovascular coupling</kwd>
<kwd>cerebral blood flow</kwd>
<kwd>cerebral metabolic rate of oxygen</kwd>
</kwd-group>
<contract-num rid="cn001">HA2630/11-1</contract-num>
<contract-num rid="cn001">HA2630/11-2</contract-num>
<contract-sponsor id="cn001">Deutsche Forschungsgemeinschaft<named-content content-type="fundref-id">10.13039/501100001659</named-content></contract-sponsor>
<counts>
<fig-count count="8"/>
<table-count count="2"/>
<equation-count count="1"/>
<ref-count count="58"/>
<page-count count="17"/>
<word-count count="12805"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>Network models are simulated neural networks composed of multiple computational units that model the dynamics of biological neurons at various levels of complexity: macroscopic mean-field or neural mass models simulate the average dynamics of large groups of neurons, rate-coded point neuron models simulate the instantaneous mean firing rate of individual neurons, spiking point neuron models simulate precise spike timings, while multi-compartmental neuron models also consider the 3D structure of the neurons. Such network models can exhibit complex dynamics due to the recurrent connectivity between the simulated neurons and can be validated against a large amount of experimental data and make extensive predictions at different scales, such as patterns in spike timing, local field potentials or electroencephalography, and blood-oxygen-level-dependent (BOLD) signals from magnetic resonance imaging (MRI). Large-scale network models are becoming increasingly common in computational neuroscience (see Einevoll et al., <xref ref-type="bibr" rid="B20">2019</xref> for a review about brain simulations with network models). Concerning MRI data, network models can be used primarily to examine the underlying neural mechanisms of the experimental non-invasive data or, for example, to better understand the relationship between the structural connectivity and the functional dynamics of neural circuits (Popovych et al., <xref ref-type="bibr" rid="B42">2019</xref>).</p>
<p>The ANNarchy neural simulator (Vitay et al., <xref ref-type="bibr" rid="B57">2015</xref>) provides a user-friendly equation-based interface which can be used to create large-scale rate-coded and spiking network models at different levels of biological realism. Recently, the ANNarchy neural simulator has been combined with the whole-brain neural simulator The Virtual Brain (TVB) (Ritter et al., <xref ref-type="bibr" rid="B45">2013</xref>; Sanz Leon et al., <xref ref-type="bibr" rid="B47">2013</xref>; Meier et al., <xref ref-type="bibr" rid="B40">2021</xref>) to allow the creation of multi-scale network models. This allows to study how processes in detailed spiking network models of specific brain regions such as the basal ganglia created in ANNarchy affect the dynamics of the whole cortex simulated in TVB (Meier et al., <xref ref-type="bibr" rid="B40">2021</xref>). To further improve the usability of ANNarchy, we introduce a BOLD signal monitoring module (called BOLD monitor in ANNarchy) that allows obtaining simulated BOLD signals from spiking and rate-coded network models in an on-line manner.</p>
<p>Several modeling tools already provide utilities to obtain simulated BOLD signals from network models TVB, Dynamic Causal Modeling (Friston et al., <xref ref-type="bibr" rid="B21">2003</xref>) in SPM (Penny et al., <xref ref-type="bibr" rid="B41">2011</xref>), neuRosim (Welvaert et al., <xref ref-type="bibr" rid="B58">2011</xref>), which so far have been applied mainly to network models at the macroscopic level of detail (Vanni et al., <xref ref-type="bibr" rid="B56">2015</xref>). These methods mainly use variants of the Balloon model to compute simulated BOLD signals (Buxton et al., <xref ref-type="bibr" rid="B10">1998</xref>, <xref ref-type="bibr" rid="B9">2004</xref>; Stephan et al., <xref ref-type="bibr" rid="B53">2007</xref>). Hereafter, we will refer to the Balloon model and other such models that convert an input time signal into a simulated BOLD signal, generally as BOLD models. A critical open issue when simulating BOLD signals from network models is the neurovascular coupling, i.e., which neural mechanisms are associated with the metabolism and dynamics of the blood vessels that ultimately cause the BOLD signal. This is essential information needed to meaningfully couple a network model with a BOLD model. The issue of the neurovascular coupling remains unsolved and is an active area of research (Vanni et al., <xref ref-type="bibr" rid="B56">2015</xref>; Buxton, <xref ref-type="bibr" rid="B6">2021</xref>; Howarth et al., <xref ref-type="bibr" rid="B31">2021</xref>). Recently, it has been proposed that cerebral blood flow (CBF) and cerebral metabolic rate of oxygen (CMRO2) may be driven separately by distinct neural processes (Buxton, <xref ref-type="bibr" rid="B5">2012</xref>, <xref ref-type="bibr" rid="B6">2021</xref>). As these variations are not captured by the classic Balloon model implementations in current tools, researchers need more flexible tools that allow them to define their own BOLD models.</p>
<p>The neural simulator ANNarchy is primarily concerned with models ranging from the mesoscopic to the microscopic level that simulate biological neurons as single units and can thus account for more detailed processes, which can include different ionic membrane currents and account for the dynamics of specific classes of real neurons (Humphries et al., <xref ref-type="bibr" rid="B33">2009</xref>; Corbit et al., <xref ref-type="bibr" rid="B15">2016</xref>; Goenner et al., <xref ref-type="bibr" rid="B25">2021</xref>). Thus, ANNarchy allows to consider various neural processes for the implementation and investigation of neurovascular coupling. The BOLD monitor not only allows linking predefined BOLD models (e.g., the Balloon model variants, Stephan et al., <xref ref-type="bibr" rid="B53">2007</xref>) to a rate-coded or spiking network model but also gives the user freedom in defining the neurovascular coupling and the BOLD model itself, allowing to investigate different hypotheses regarding the link between neural processes and BOLD signals.</p>
<p>In this article, we present the rationale, implementation and use of the BOLD monitor in ANNarchy. We first demonstrate the use of the classic Balloon model as a BOLD model for the BOLD monitor. We then demonstrate how to create a user-defined BOLD model. Finally, using a simple network model as an example, we demonstrate how the BOLD monitor can be used to compare various hypotheses about neurovascular coupling in simulation.</p>
</sec>
<sec id="s2">
<title>2. The Balloon Model</title>
<sec>
<title>2.1. The Classic Balloon Model</title>
<p>The Balloon model was originally designed by Buxton et al. (<xref ref-type="bibr" rid="B10">1998</xref>). It describes the changes in the BOLD signal of a tissue region, often called region of interest (ROI), as a function of normalized CBF (<italic>f</italic><sub><italic>in</italic></sub>). According to this model, the BOLD signal corresponds to the sum of the extravascular and intravascular signal resulting from the normalized total deoxyhemoglobin content (<italic>q</italic>) and the normalized venous volume fraction (<italic>v</italic>). The normalized venous volume fraction is described as a balloon that expands with increasing inflow and slowly recovers after a stimulus. The normalized deoxyhemoglobin content is determined by the dynamics of the volume fraction and the blood oxygen extraction fraction (<italic>E</italic>), whose behavior is based on the oxygen limitation model (Buxton and Frank, <xref ref-type="bibr" rid="B7">1997</xref>).</p>
<p>Friston et al. (<xref ref-type="bibr" rid="B22">2000</xref>) extended the Balloon model so that it can be used to simulate BOLD signals using network models. The extension included a neurovascular coupling component that links the normalized CBF of the Balloon model to simulated neuronal activity. Based on this extension, the normalized CBF is modeled as a damped oscillator that is stimulated by neuronal activity. This extension allows the Balloon model to be used to simulate a change in the BOLD signal due to a change in some type of simulated neuronal activity (hereafter, more generally referred to as input signal). In this form, the Balloon model has been used in several studies to compute simulated BOLD signals from network models (Friston et al., <xref ref-type="bibr" rid="B21">2003</xref>; Smith et al., <xref ref-type="bibr" rid="B51">2011</xref>; Deco and Jirsa, <xref ref-type="bibr" rid="B18">2012</xref>; Van Hartevelt et al., <xref ref-type="bibr" rid="B55">2014</xref>; Bennett et al., <xref ref-type="bibr" rid="B3">2015</xref>; Maith et al., <xref ref-type="bibr" rid="B39">2021</xref>). The individual components of the extended Balloon model and their dynamics following a rectangular input signal change are shown in <xref ref-type="fig" rid="F1">Figure 1A</xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>(A)</bold> Schematic overview of the classic Balloon model (Buxton et al., <xref ref-type="bibr" rid="B10">1998</xref>) with the neurovascular coupling extension of Friston et al. (<xref ref-type="bibr" rid="B22">2000</xref>). The data was simulated using ANNarchy&#x00027;s default BOLD monitor which recorded a single artificial neuron, whose activity (the source variable for the BOLD monitor) was manually set. The activity of the neuron and thus the input signal (<italic>I</italic><sub><italic>CBF</italic></sub>) were manually increased from zero to 0.2 for 20 s. The normalized CBF (<italic>f</italic><sub><italic>in</italic></sub>) changes as a function of the CBF-driving signal (<italic>s</italic><sub><italic>CBF</italic></sub>), which is subject to negative feedback from itself and <italic>f</italic><sub><italic>in</italic></sub>. <italic>f</italic><sub><italic>in</italic></sub> is coupled to the blood oxygen extraction fraction (<italic>E</italic>) and increases the normalized volume fraction of the venous compartment (<italic>v</italic>), which behaves like a balloon and decreases with outflowing blood (<italic>f</italic><sub><italic>out</italic></sub>). The normalized total deoxyhemoglobin content (<italic>q</italic>) increases by oxygen extraction of inflowing blood and decreases with outflowing deoxyhemoglobin-containing blood. Finally, relative changes of the BOLD signal are calculated. The gray horizontal lines correspond to one for the quantities normalized to their baseline in the Balloon model (<italic>f</italic><sub><italic>in</italic></sub>, <italic>f</italic><sub><italic>out</italic></sub>, <italic>v</italic>, <italic>q</italic>). For <italic>I</italic><sub><italic>CBF</italic></sub>, <italic>s</italic><sub><italic>CBF</italic></sub> and <italic>BOLD</italic> the gray horizontal lines correspond to zero and for <italic>E</italic> to <italic>E</italic><sub>0</sub>. <bold>(B)</bold> Balloon model with parallel driven CBF and CMRO2. Instead of coupling the increase in <italic>q</italic> with <italic>f</italic><sub><italic>in</italic></sub> <italic>via</italic> <italic>E</italic>, the normalized CMRO2 (<italic>r</italic>) is used directly (see Buxton et al., <xref ref-type="bibr" rid="B9">2004</xref>), which is driven by a second input signal (<italic>I</italic><sub><italic>CMRO</italic>2</sub>) like the normalized CBF (increased to 0.05 for 20 s). Further, <italic>f</italic><sub><italic>out</italic></sub> is described by the equations of Buxton et al. (<xref ref-type="bibr" rid="B9">2004</xref>) which causes <italic>v</italic> to decrease slower. Besides these changes, the processes are the same as in <bold>(A)</bold> and the plots of the same quantities have the same limits in <bold>(A,B)</bold>. The equations of both models can be found in <xref ref-type="supplementary-material" rid="SM1">Supplementary Sections 2, 4.2</xref>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0001.tif"/>
</fig>
<p>Different values for the parameters and even variations of some equations of the model can be found in the literature. We use a version from Stephan et al. (<xref ref-type="bibr" rid="B53">2007</xref>) with a non-linear BOLD equation with revised coefficients for our default BOLD monitor. The other versions of Stephan et al. (<xref ref-type="bibr" rid="B53">2007</xref>) are also implemented in ANNarchy and available as alternatives. All equations are summarized in <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 2</xref>. The implementation of the default model in ANNarchy is described in Section 3.4.</p>
</sec>
<sec>
<title>2.2. The Two-Input Balloon Model</title>
<p>In the classic Balloon model, CBF and CMRO2 are tightly coupled. The greater increase in CBF compared to CMRO2 in response to a stimulus is explained by the oxygen limitation model (Buxton and Frank, <xref ref-type="bibr" rid="B7">1997</xref>). This model is based on the assumptions that oxygen coming from the capillaries is completely metabolized in the tissue and that all brain capillaries are perfused at rest. As a consequence, an increase in CMRO2 would only be possible by increasing the transport of oxygen from the capillaries to the tissue, and an increase in CBF would be accompanied by an increase in capillary blood velocity. Because an increase in CBF increases the available oxygen in the capillaries, but also decreases the fraction of oxygen extracted from the capillaries, an increase in CMRO2 (i.e., oxygen transport from the capillaries to the tissue) requires a disproportionate increase in CBF (for further details, see Buxton and Frank, <xref ref-type="bibr" rid="B7">1997</xref>).</p>
<p>However, in recent years, it has been proposed that CBF and CMRO2 are driven in parallel by different sources rather than being tightly coupled (Buxton, <xref ref-type="bibr" rid="B5">2012</xref>, <xref ref-type="bibr" rid="B6">2021</xref>; Buxton et al., <xref ref-type="bibr" rid="B8">2014</xref>). Recently, Buxton (<xref ref-type="bibr" rid="B6">2021</xref>) has put forward a new theory, based on the thermodynamics of metabolism, that could explain why CBF needs to increase more than CMRO2 in response to a stimulus and has proposed that CBF and CMRO2 are both driven in parallel in a feed-forward manner. The open question here is by which neural signals CBF and CMRO2 are driven. One suggestion is that CMRO2 is tightly coupled to the energy consumption of neurons, whereas CBF is controlled by vasodilatory signals. These vasodilatory signals are not necessarily coupled to energy consumption and are caused, for example, by activated astrocytes (Buxton, <xref ref-type="bibr" rid="B5">2012</xref>; Howarth et al., <xref ref-type="bibr" rid="B31">2021</xref>). Network models, in which a wide variety of populations can be simulated and manipulated in a controlled manner, may be useful in investigating this question. Therefore, not only the classic Balloon model with tightly coupled CBF and CMRO2 can be used in our BOLD monitor, but also user-defined BOLD models, potentially using more than one input signal from the network model.</p>
<p>We demonstrate how to define BOLD models with multiple input signals for the BOLD monitor in ANNarchy by implementing a modified version of the Balloon model where CBF and CMRO2 are driven in parallel by separate input signals (hereafter referred to as two-input Balloon model). For simplicity, in the two-input Balloon model, we describe both, the normalized CBF and CMRO2, as damped oscillators similar to the normalized CBF in the classic Balloon model version of Friston et al. (<xref ref-type="bibr" rid="B22">2000</xref>). Equal input signals elicit responses with equal amplitudes for the normalized CBF and CMRO2. Thus, the coupling between CBF and CMRO2 is determined by the coupling of the two input signals. <xref ref-type="fig" rid="F1">Figure 1B</xref> demonstrates how the individual components of the two-input Balloon model change during stimulation. Compared to the normalized CBF, the normalized CMRO2 responds faster to a changing input signal and without an overshoot or undershoot. The faster response allows for an initial dip in the BOLD signal. For the transformation from normalized CBF and CMRO2 to <italic>q</italic> and <italic>v</italic>, we use the Balloon model equations from Buxton et al. (<xref ref-type="bibr" rid="B9">2004</xref>). This is a slightly modified version of the classic Balloon model, which additionally considers viscoelastic effects causing the venous volume fraction to lag behind its steady-state relation with the outflow during transient changes. Thus, a post-stimulus undershoot in the BOLD signal is caused by the undershoot of the CBF (based on the damped oscillator modeling approach) as well as by the slow recovery of the venous volume fraction (based on the viscoelastic effects). Finally, the change in the BOLD signal is computed by the non-linear BOLD equation with revised coefficients from Stephan et al. (<xref ref-type="bibr" rid="B53">2007</xref>). A more detailed description including the equations of the two-input Balloon model summarized here can be found in <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 4.2</xref>.</p>
</sec>
</sec>
<sec id="s3">
<title>3. BOLD Monitor</title>
<sec>
<title>3.1. ANNarchy Neural Simulator</title>
<p>The ANNarchy neural simulator is intended for the simulation of network models at the single-unit level using rate-coded and spiking neuron models. The equation-based interface of ANNarchy allows a flexible and easy implementation of network models by defining equations describing the dynamics of specific neuron types in so called neuron models and equations defining synaptic transmission dynamics (e.g., plasticity) in so called synapse models (Vitay et al., <xref ref-type="bibr" rid="B57">2015</xref>). For efficiency, the model description is transformed into optimized C&#x0002B;&#x0002B; code, optionally using parallel programming frameworks such as openMP for multi-core CPUs or CUDA for GPUs (Dinkelbach et al., <xref ref-type="bibr" rid="B19">2019</xref>). An earlier version of the BOLD monitor in ANNarchy relied on the normalization of pre-synaptic activity and was used in Maith et al. (<xref ref-type="bibr" rid="B39">2021</xref>). This implementation was limited to one specific BOLD model and allowed only a few parameter variations, unlike the version presented here. All the simulations in this work use the version 4.7.0.1 of the neural simulator ANNarchy. All references to neurons, populations, synapses, BOLD signals and other neural quantities and data in the following sections refer to simulated values from a network model.</p>
</sec>
<sec>
<title>3.2. General Concept</title>
<p>BOLD models, for example the Balloon model (Buxton et al., <xref ref-type="bibr" rid="B10">1998</xref>) or the Davis model (Davis et al., <xref ref-type="bibr" rid="B17">1998</xref>), are based on signals that characterize the dynamics of an entire ROI, such as the change in the normalized CBF or CMRO2 (<xref ref-type="fig" rid="F2">Figure 2</xref>, <italic>f</italic><sub><italic>in</italic></sub>, <italic>r</italic>). To combine such a BOLD model with a network model, it is necessary to bridge the gap between these ROI-wide signals and the individual components of the ROI in the network model (e.g., multiple populations, individual neurons). In this section, we will focus on the processes necessary to obtain the input signals for a BOLD model from a ROI that represents part of a network model consisting of multiple populations. <xref ref-type="fig" rid="F2">Figure 2</xref> shows the general functionality of the BOLD monitor in ANNarchy.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Schematic overview of how the BOLD monitor calculates the input signals (here I<sub>CBF</sub>, I<sub>CMRO2</sub>) for a BOLD model (e.g., Balloon model). The ROI from which the BOLD signal should be calculated can consist of multiple populations (here pop1, pop2). In the neuron models of each population, the variables (var<sub>CBF</sub>, var<sub>CMRO2</sub>) have to be defined, which are used to calculate the input signals (referred to as source variables). Three preprocessing steps are applied to the source variables per population: (1) averaging over all neurons of the population, (2) optional normalization, (3) scaling by proportion of the population in the ROI. Finally, the signals resulting from the preprocessed source variables are summed across all populations and fed into the BOLD model as input signals. x, the averaged signal; B, baseline; N<sub>pop</sub>, size of the population; N<sub>region</sub>, total number of neurons in the ROI.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0002.tif"/>
</fig>
<p>First, the populations of the network model that are part of the ROI for the BOLD computation have to be specified and instantiated. In the example shown in <xref ref-type="fig" rid="F2">Figure 2</xref>, the ROI consists of two populations labeled pop1 and pop2. From the definition of their neuron models, variables must be selected or defined (hereafter referred to as source variables) which will be used to derive the input signals of the BOLD model. In <xref ref-type="fig" rid="F2">Figure 2</xref>, two different source variables are defined: one variable <italic>var</italic><sub><italic>CBF</italic></sub> that causes the input signal of the CBF (<italic>I</italic><sub><italic>CBF</italic></sub>) and one variable <italic>var</italic><sub><italic>CMRO2</italic></sub> that causes the input signal of the CMRO2 (<italic>I</italic><sub><italic>CMRO2</italic></sub>). These source variables can correspond to any variables or combinations of variables present in the neuron models (membrane potential, firing rate, etc.).</p>
<p>After defining the ROI and the mapping between source variables in the neuron models and the input variables of the BOLD model, the BOLD monitor implements four preprocessing steps. First, the source variables are averaged over all the neurons for each population of the ROI, resulting in only one signal per population and source variable. This averaging is followed by an optional population-wide normalization that computes the relative deviation of the signal from a baseline value. The baseline corresponds to the mean of the raw averaged source variable signal calculated over a specified initial period. This normalization is useful when deviations from the resting-state are required as input signal in the BOLD model. After the optional normalization, the signals are scaled per population. By default, the signals of each population are scaled based on the ratio between the size of the population and the total number of neurons in the ROI. Thus, the larger a population, the greater its influence on the input variables of the BOLD model. Finally, the population signals are summed across all populations of the ROI, resulting in one input signal for each input variable of the BOLD model.</p>
</sec>
<sec>
<title>3.3. A Simple Example</title>
<p>This section describes a minimal example demonstrating the use of the BOLD monitor in the ANNarchy framework. ANNarchy modules and the BOLD extension must first be imported:</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0001.tif"/></p>
<p>The evaluation of equations is performed with the forward Euler numerical method using a fixed time grid of step <italic>dt</italic> (in ms):</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0002.tif"/></p>
<p>Two populations, both composed of 100 Izhikevich spiking neurons are then created (line 4, 5). The Izhikevich neuron model is part of the standard models pre-implemented in ANNarchy, with equations and parameters derived from Izhikevich (<xref ref-type="bibr" rid="B34">2003</xref>). Initially, the baseline activity in both populations is defined by setting their <italic>noise</italic> variables to 5.0 (line 7). The term <italic>noise</italic> refers to an internal variable of the pre-implemented Izhikevich neuron model in ANNarchy which simply determines a baseline current in the membrane potential equation.</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0003.tif"/></p>
<p>To keep the example simple and still have a modulation in the source variable of the BOLD monitor, the baseline activity (the <italic>noise</italic> variable) is varied during the simulation to mimic the effect of external inputs. The mean-firing rate <italic>r</italic> of the individual neurons is used as the source variable for the computation of the BOLD signal. As the computation of this value requires an additional overhead, it must be enabled explicitly. The time window for the averaged activity is set to 100 ms:</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0004.tif"/></p>
<p>The BOLD monitor is then created and initialized (line 10&#x02013;16). The populations in the ROI have to be assigned in the <italic>populations</italic> argument in form of a list of or a single population (line 11). The desired BOLD model can be optionally defined in the argument <italic>bold_model</italic> by assigning the corresponding BOLD model object (line 12). The BOLD model can be either one of the built-in BOLD models provided by the module or user-defined as we will demonstrate in Section 3.4. The default BOLD model is the built-in implementation <italic>balloon_RN</italic> containing the Balloon model with revised coefficients and a non-linear BOLD equation (described in Section 2, implementation shown in Section 3.4).</p>
<p>The mapping between the source variables of the populations (here mean-firing rate <italic>r</italic>) and the input signals of the BOLD model (referred to as input variables, here <italic>I_CBF</italic>) has to be defined in the <italic>mapping</italic> argument by providing a dictionary for each input variable-source variable pair (line 13).</p>
<p>A time window relevant to the normalization of the source variables can be optionally defined (in ms, line 14), whose purpose we explain in Section 4.2. By default, no normalization is performed.</p>
<p>Finally, the variables of the BOLD model which should be recorded during the simulation can be optionally assigned in the <italic>recorded_variables</italic> argument (line 15) as a string or list of strings. All variables of the BOLD model can be recorded. By default, the output variable of the BOLD model (here the variable <italic>BOLD</italic>) defined in the BOLD model implementation (see Section 3.4) is recorded.</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0005.tif"/></p>
<p>The C&#x0002B;&#x0002B; code representing the model (network model and BOLD monitor) can now be generated and compiled:</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0006.tif"/></p>
<p>The last part of this section describes a sample simulation to demonstrate the BOLD recording on our simple example. A short simulation period (1,000 ms, line 19) ensures that the network reaches a stable state, which is necessary for a meaningful baseline calculation (required for the normalization outlined in Section 4.2). The recording of BOLD signals is started (line 22) and the simulation is run for 5 s (line 25). After this, the baseline activity (<italic>noise</italic> variable) of half of the recorded neurons (one population, pop0) is increased for 5 s (lines 26, 27) and afterwards set back to the previous value (line 28, 29).</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0007.tif"/></p>
<p>This leads to an increased mean firing rate in the recorded area and consequently to a BOLD signal response as depicted in <xref ref-type="fig" rid="F3">Figure 3</xref>. The figure shows that the increase of the <italic>noise</italic> variable in <italic>pop0</italic> leads to an increase in the mean-firing rate, which is the source variable for the BOLD monitor (<xref ref-type="fig" rid="F3">Figure 3A</xref>, blue line). This increase of activity results in an increase of the input signal (input variable <italic>I_CBF</italic>) of the BOLD model depicted in <xref ref-type="fig" rid="F3">Figure 3B</xref>, consequently leading to an increase of the BOLD signal depicted in <xref ref-type="fig" rid="F3">Figure 3C</xref>. After resetting the <italic>noise</italic> variable, the firing rates of both populations reach again the same level, which reduces the input signal of the BOLD model as well as the resulting BOLD signal.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>A simple simulation using the ANNarchy BOLD monitor. In this example, we obtain a BOLD signal from two populations <italic>pop0</italic> and <italic>pop1</italic>. Both populations contribute their mean-firing rate <italic>r</italic> <bold>(A)</bold> to the BOLD model which we defined in Section 3.4. After 5 s of simulation, the <italic>noise</italic> variable in <italic>pop0</italic> is increased which leads to a higher mean-firing rate. This increases the input signal <italic>I_CBF</italic> <bold>(B)</bold> and consequently the computed BOLD signal <bold>(C)</bold>. For clarity, the vertical lines depict three relevant time points (left to right): end of baseline period, time point of increased <italic>noise</italic> variable, time point of reset <italic>noise</italic> variable.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0003.tif"/>
</fig>
</sec>
<sec>
<title>3.4. BOLD Model Definition</title>
<p>In the previous example, the default Balloon model (<italic>balloon_RN</italic>) was used as the BOLD model, but ANNarchy allows users to create their own BOLD model by defining a <italic>BoldModel</italic> object representing the desired equations. We describe the definition of a <italic>BoldModel</italic> object using the BOLD model <italic>balloon_RN</italic> (described in Section 2, applied in Section 3.3) as an example. This BOLD model is implemented as follows:</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0008.tif"/></p>
<p>A <italic>BoldModel</italic> object requires a <italic>parameters</italic> argument (line 2), which is a string defining all constants of the BOLD model in a key-value pair notation, i.e., a parameter name on the left and the initialization value on the right side of the assignment operator.</p>
<p>The <italic>equations</italic> argument (line 10) describes all time-dependent variables, defined either by regular equations or ordinary differential equations evaluated on a fixed time grid. Note that parameters resulting from the combination of other parameters can also be defined here (in this example <italic>k_1, k_2, k_3</italic>). In the case of a regular equation, the variable name is on the left side and the update performed in each step on the right side. If the update is defined by a differential equation, the left side needs to contain a <inline-formula><mml:math id="M1"><mml:mfrac><mml:mrow><mml:mi>d</mml:mi><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mi>v</mml:mi><mml:mi>a</mml:mi><mml:mi>r</mml:mi></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mfrac></mml:math></inline-formula> symbol. To limit the range of values taken by a variable, the <italic>min</italic> and <italic>max</italic> keywords can be used. The initial value for variables is 0.0 by default, but it can be changed by providing an <italic>init</italic> keyword.</p>
<p>The <italic>inputs</italic> argument (line 30) specifies which input signals are expected by the BOLD model. It consists of a single string or a list of strings. These variables can be accessed in the BOLD model definition by using <italic>sum(NAME)</italic> in the <italic>equations</italic> argument, where <italic>NAME</italic> corresponds to the name of the variable (here <italic>I_CBF</italic>, line 12).</p>
<p>Finally, in the <italic>output</italic> argument (line 31), one output variable of the BOLD model is defined, which is automatically recorded by the BOLD monitor. In the following implementation example and all other BOLD models implemented in ANNarchy mentioned in this work, this default output variable corresponds to the BOLD signal (variable <italic>BOLD</italic>), which is also the default value for the <italic>output</italic> argument (here only defined for demonstration purposes).</p>
<p>The <italic>balloon_RN</italic> model is one of the four pre-implemented BOLD models (<italic>balloon_RN, balloon_RL, balloon_CN</italic> and <italic>balloon_CL</italic>, Stephan et al., <xref ref-type="bibr" rid="B53">2007</xref>) and therefore does not need to be defined by the user (but its parameters can be changed dynamically). With the <italic>BoldModel</italic> object, the user can implement new models with the same equation-based interface. For example, a user might want to additionally implement the Davis model (Davis et al., <xref ref-type="bibr" rid="B17">1998</xref>) described by Equation 1 to calculate the change of the BOLD signal &#x00394;<italic>BOLD</italic> from normalized CBF <italic>f</italic> and CMRO2 <italic>r</italic>.</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M2"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mo>&#x00394;</mml:mo><mml:mstyle mathvariant="italic"><mml:mi>B</mml:mi><mml:mi>O</mml:mi><mml:mi>L</mml:mi><mml:mi>D</mml:mi></mml:mstyle><mml:mo>=</mml:mo><mml:mi>M</mml:mi><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mn>1</mml:mn><mml:mo>-</mml:mo><mml:msup><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msup><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="true">(</mml:mo><mml:mrow><mml:mfrac><mml:mrow><mml:mi>r</mml:mi></mml:mrow><mml:mrow><mml:mi>f</mml:mi></mml:mrow></mml:mfrac></mml:mrow><mml:mo stretchy="true">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mi>&#x003B2;</mml:mi></mml:mrow></mml:msup></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Here, <italic>M</italic>, &#x003B1;, and &#x003B2; are additional parameters of the Davis model. In the <italic>BoldModel</italic> above, the normalized CBF is already defined (<italic>f</italic><sub><italic>in</italic></sub>). Thus, only the calculation of the normalized CMRO2 (<italic>r</italic>) must be added. This could be done with the term <inline-formula><mml:math id="M3"><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>&#x000B7;</mml:mo><mml:mfrac><mml:mrow><mml:mi>E</mml:mi></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>E</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:math></inline-formula> (see also Buxton et al., <xref ref-type="bibr" rid="B9">2004</xref>). The following code demonstrates how the previous <italic>BoldModel</italic> could be extended to additionally compute the normalized CMRO2 (<italic>r</italic>, line 34) and the Davis model BOLD signal (line 35) in the <italic>equations</italic> argument:</p>
<p><inline-graphic xlink:href="fninf-16-790966-i0009.tif"/></p>
<p>This way, a custom <italic>BoldModel</italic> is obtained, where the BOLD signal is additionally calculated according to the Davis model and the modified signal (<italic>BOLD</italic><sub><italic>Davis</italic></sub>) can additionally be recorded. In addition, the parameters of the Davis model would have to be added to the <italic>parameters</italic> argument, which we have not shown explicitly (but see <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 4.3</xref> for a full implementation).</p>
</sec>
</sec>
<sec id="s4">
<title>4. Example Use Cases</title>
<sec>
<title>4.1. Model Description</title>
<p>In this section, we implement a simple network model of a cortical microcircuit (hereafter referred to as microcircuit model) to further demonstrate use cases of the BOLD monitor. The microcircuit model consists of a population of excitatory neurons and a population of inhibitory interneurons. As neuron models, we use a regular spiking cortical neuron model for the excitatory population (corE) and a fast-spiking cortical interneuron model for the inhibitory population (corI), both introduced in Izhikevich (<xref ref-type="bibr" rid="B35">2007</xref>). The two populations receive excitatory inputs from another population whose neurons randomly emit spikes such that their inter-spike intervals correspond to a Poisson process (hereafter referred to as Poisson neurons). The structure of the microcircuit model is shown in <xref ref-type="fig" rid="F4">Figure 4A</xref>. The projections of the microcircuit model include feed-forward excitation (Poisson neurons &#x02192; corE), feed-forward inhibition (Poisson neurons &#x02192; corI &#x02192; corE), and feedback inhibition (corE &#x02192; corI &#x02192; corE). The ratio between excitatory neurons and inhibitory interneurons is 4:1, as found, for example, for the visual cortex (Beaulieu et al., <xref ref-type="bibr" rid="B2">1992</xref>; Potjans and Diesmann, <xref ref-type="bibr" rid="B44">2014</xref>). The equations and parameters of the microcircuit model can be found in <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 3</xref>.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Overview of the microcircuit model. <bold>(A)</bold> The structure of the microcircuit model. Rectangles represent the populations and arrows the projections. The numbers at the projections indicate the factors which scale the weights of each projection. <bold>(B)</bold> Probability density function (PDF) and histogram of the firing rate distribution of the neurons of the corE and corI populations (top) and PDF and histogram of the excitatory post-synaptic potentials (EPSPs) evoked by single spikes in the excitatory and inhibitory neurons (bottom). The weights for the projections of the microcircuit model were drawn from a weight distribution which was tuned to generate the EPSPs distribution of Song et al. (<xref ref-type="bibr" rid="B52">2005</xref>) (indicated in black). The weights of each projection were further scaled so that the corE and corI populations produce the firing rate distribution of Buzs&#x000E1;ki and Mizuseki (<xref ref-type="bibr" rid="B11">2014</xref>) (indicated in black). The scaling factors were optimized, for more details see <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 3.3</xref>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0004.tif"/>
</fig>
<p>Each neuron receives synaptic input from 10 random neurons in the pre-synaptic population for each projection. Following our previous modeling approaches (Baladron et al., <xref ref-type="bibr" rid="B1">2019</xref>; Goenner et al., <xref ref-type="bibr" rid="B25">2021</xref>; Maith et al., <xref ref-type="bibr" rid="B39">2021</xref>), we model synaptic inputs as conductance-based synapses in our neuron models. Therefore, the synaptic currents (which drive the membrane potential of the neurons) are proportional to the product of a voltage difference (between the membrane potential and the synaptic reversal potential) and a conductance variable representing the spike input of the corresponding synapse (see <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 3</xref> for equations). We model only two different types of conductance-based synapses, excitatory synapses (AMPA) and inhibitory synapses (GABA). The conductance variables of the synapses are instantaneously increased by a fixed value (by the weight of the synaptic connection) for each incoming spike and otherwise decay exponentially to zero with a time constant of 10 ms.</p>
<p>A conductance greater than zero causes a synaptic current that drives the membrane potential toward the reversal potential associated with the synapse (0 mV for AMPA synapses and &#x02212;90 mV for GABA synapses). All synaptic weights are drawn from a log-normal distribution and scaled by a factor for each projection during model initialization. The weights and scaling factors were optimized to replicate distributions from excitatory post-synaptic potentials (Song et al., <xref ref-type="bibr" rid="B52">2005</xref>) and firing rates (Buzs&#x000E1;ki and Mizuseki, <xref ref-type="bibr" rid="B11">2014</xref>) with the microcircuit model (see <xref ref-type="fig" rid="F4">Figure 4B</xref>). Further details about obtaining the distributions and optimizing the parameters can be found in <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 3.3</xref>.</p>
<p>Although the use of neuron models mimicking spiking patterns of real cortical neurons and tuning the parameters to replicate experimental data can provide more realistic network models (see e.g., Humphries et al., <xref ref-type="bibr" rid="B32">2006</xref>; G&#x000FC;nay et al., <xref ref-type="bibr" rid="B26">2008</xref>; Pospischil et al., <xref ref-type="bibr" rid="B43">2008</xref>; Goenner et al., <xref ref-type="bibr" rid="B25">2021</xref>), the microcircuit model presented here only aims at demonstrating the application of the BOLD monitor and not at replicating any particular experimental data. To keep the model simple, we chose a network model with two spiking populations and multiple excitatory and inhibitory projections. No particular functional processing takes place in this microcircuit model, as it consists of only two small homogeneous populations, the connectivity is random and synaptic plasticity, important neurotransmitters such as NMDA, the effect of neuromodulators and potential dynamic changes in activity were not taken into account during construction. However, the applicability of the BOLD monitor to larger-scale network models is demonstrated in Section 4.4.</p>
</sec>
<sec>
<title>4.2. Normalization for Resting-State Activity</title>
<p>We first demonstrate the effect of baseline normalization in the BOLD monitor using the microcircuit model. To do so, we simulate a brief stimulus presentation corresponding to studies of the event-based BOLD response (Glover, <xref ref-type="bibr" rid="B24">1999</xref>; Serences, <xref ref-type="bibr" rid="B50">2004</xref>) by briefly increasing the mean firing rate of the Poisson neurons and meanwhile recording the BOLD response.</p>
<p>All simulations start with an initialization period of 2 s to allow the microcircuit model to enter its steady-state. After that, the recordings are started. A 10-s resting-period is simulated, after which the mean firing rates of the Poisson neurons are increased by a factor of five for 100 ms (hereafter referred to as stimulus pulse). Finally, another post-stimulus resting-period is simulated until a total simulation time of 25 s. This procedure is performed for 40 different random microcircuit model initializations (each with different seeds producing different synaptic contacts, weights, and mean firing rates of Poisson neurons). Additionally, we run 40 simulations without a stimulus pulse, in which only a 25 s resting-period is simulated for comparison.</p>
<p>The BOLD response is recorded simultaneously using two differently initialized BOLD monitors. Both BOLD monitors use the default BOLD model (<italic>balloon_RN</italic>) shown in Section 3.4 and determine the BOLD signal of the ROI which comprises both the corE and corI populations. The source variable for the BOLD monitor is the synaptic activity of the neurons normalized by the number of afferent connections, which has already been used and described in Maith et al. (<xref ref-type="bibr" rid="B39">2021</xref>). The key difference between the two BOLD monitors is the baseline normalization. One BOLD monitor uses no baseline normalization and the other BOLD monitor uses a baseline computed over the first 5 s after the 2-s initialization period.</p>
<p><xref ref-type="fig" rid="F5">Figure 5</xref> shows the recorded variables of the BOLD model: the input variable (I<sub>CBF</sub>) of the BOLD model and the resulting BOLD signal. Although the response of the microcircuit model to the stimulus pulse can be clearly seen in the I<sub>CBF</sub> of both BOLD monitors, an important difference is that the I<sub>CBF</sub> of the BOLD monitor without baseline normalization has an offset greater than zero, while the I<sub>CBF</sub> with baseline normalization fluctuates around zero. It is also noticeable that I<sub>CBF</sub> with baseline normalization is zero in the first 5 s. This is because the input variable for the BOLD model is not calculated during the time in which the baseline for normalization is determined. In the normalized CBF signal and the BOLD signal, one can clearly see the effect of baseline normalization on the Balloon model dynamics. The response to the stimulus pulse is much more pronounced for the BOLD monitor with baseline normalization. Without baseline normalization, the normalized CBF signal and BOLD signal at rest have an offset greater than zero, whereas with baseline normalization, the signals fluctuate around one and zero, respectively.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Recordings from two BOLD monitors with (right) and without (left) baseline normalization. Shown are the averaged recordings of 40 resting-state simulations (black) and 40 simulations with a 100 ms stimulus pulse (red). Both BOLD monitors use the same source variable of the same underlying microcircuit model. For the BOLD monitor with baseline normalization, the input signal to the Balloon model (<italic>I</italic><sub>CBF</sub>) corresponds to the relative change in the signal from the source variable, thus fluctuates around zero. Whereas, without baseline normalization, the input signal has an offset greater than zero. Thus, with baseline normalization only, the normalized CBF signal and the BOLD signal of the Balloon model during the resting-state are approximately one and zero, respectively, corresponding to the definition of the Balloon model. The response to the stimulus pulse is more pronounced with baseline normalization. For visualization, <italic>I</italic><sub>CBF</sub> values are shown divided by their maximum value.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0005.tif"/>
</fig>
<p>The CBF and BOLD signals are defined in the Balloon model relative to their value at rest (normalized CBF and relative change of BOLD). Therefore, the normalized CBF signal or the BOLD signal should only deviate from one or zero, respectively, when the underlying system deviates from its resting-state. For models with resting-state activity, we recommend using the baseline normalization of the BOLD monitor when using the Balloon model.</p>
</sec>
<sec>
<title>4.3. The Effect of Different Source Variables</title>
<p>One important motivation for developing the BOLD monitor is to provide a simple way to flexibly adjust both the source variables and the BOLD model itself. In Section 3.4, we have already shown how to implement a user-defined BOLD model. Here, we also want to show the possibility to use different variables of the neurons as source variables. The underlying neural processes influencing CBF and CMRO2, and thus ultimately the BOLD signal, are still rather unclear (Howarth et al., <xref ref-type="bibr" rid="B31">2021</xref>). Many different hypotheses and modeling approaches can be found in the literature (Smith et al., <xref ref-type="bibr" rid="B51">2011</xref>; Van Hartevelt et al., <xref ref-type="bibr" rid="B55">2014</xref>; Bennett et al., <xref ref-type="bibr" rid="B3">2015</xref>; Heikkinen et al., <xref ref-type="bibr" rid="B28">2015</xref>; Schmidt et al., <xref ref-type="bibr" rid="B49">2018</xref>). The flexible BOLD monitor in ANNarchy allows us to easily create and compare BOLD models implementing different hypotheses on spiking or rate-coded network models. In this section, we demonstrate this by implementing six different hypotheses using our microcircuit model. For each hypothesis, we add a different BOLD monitor to the microcircuit model, each with different source variables. The six different BOLD monitors are summarized in <xref ref-type="table" rid="T1">Table 1</xref>. The source code for adding them to the microcircuit model can be found in <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 4</xref>. Note that the simulated BOLD signals are not compared with experimental data, so we do not make any statements about the validity of the hypotheses. Such an analysis would require an extensive underlying network model, tailored to the brain region under investigation.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>The input and source variables of the 6 different BOLD monitors of Section 4.3.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left"><bold>Monitor ID</bold></th>
<th valign="top" align="left"><bold>BOLD model</bold></th>
<th valign="top" align="left"><bold>Input variables</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>Source variables</bold></th>
</tr>
<tr>
<th/>
<th/>
<th/>
<th valign="top" align="center" colspan="2"><bold>corE</bold>&#x000A0;&#x000A0;<bold>corI</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">A</td>
<td valign="top" align="left"><italic>balloon_RN</italic></td>
<td valign="top" align="left"><italic>I</italic><sub>CBF</sub></td>
<td valign="top" align="center" colspan="2"><italic>syn</italic></td>
</tr>
<tr>
<td valign="top" align="left">B</td>
<td valign="top" align="left"><italic>balloon_RN</italic></td>
<td valign="top" align="left"><italic>I</italic><sub>CBF</sub></td>
<td valign="top" align="center" colspan="2"><italic>g</italic><sub>AMPA</sub></td>
</tr>
<tr>
<td valign="top" align="left">C</td>
<td valign="top" align="left"><italic>balloon_RN</italic></td>
<td valign="top" align="left"><italic>I</italic><sub>CBF</sub></td>
<td valign="top" align="center" colspan="2"><italic>r</italic></td>
</tr>
<tr>
<td valign="top" align="left">D</td>
<td valign="top" align="left"><italic>balloon_two_inputs</italic></td>
<td valign="top" align="left"><italic>I</italic><sub>CBF</sub></td>
<td valign="top" align="center" colspan="2"><italic>I</italic><sub>AMPA</sub>&#x0002B;1.5<italic>I</italic><sub>GABA</sub></td>
</tr>
<tr>
<td/>
<td/>
<td valign="top" align="left"><italic>I</italic><sub>CMRO2</sub></td>
<td valign="top" align="center" colspan="2"><italic>I</italic><sub>AMPA</sub></td>
</tr>
<tr>
<td valign="top" align="left">E</td>
<td valign="top" align="left"><italic>balloon_two_inputs</italic></td>
<td valign="top" align="left"><italic>I</italic><sub>CBF</sub></td>
<td valign="top" align="center" colspan="2"><italic>I</italic><sub>AMPA</sub>&#x0002B;1.5<italic>I</italic><sub>GABA</sub></td>
</tr>
<tr>
<td/>
<td/>
<td valign="top" align="left"><italic>I</italic><sub>CMRO2</sub></td>
<td valign="top" align="center" colspan="2"><italic>I</italic><sub>AMPA</sub> <italic>r</italic></td>
</tr>
<tr>
<td valign="top" align="left">F</td>
<td valign="top" align="left"><italic>balloon_two_inputs</italic></td>
<td valign="top" align="left"><italic>I</italic><sub>CBF</sub></td>
<td valign="top" align="center" colspan="2"><italic>I</italic><sub>AMPA</sub>&#x0002B;1.5<italic>I</italic><sub>GABA</sub></td>
</tr>
<tr>
<td/>
<td/>
<td valign="top" align="left"><italic>I</italic><sub>CMRO2</sub></td>
<td valign="top" align="center" colspan="2"><inline-formula><mml:math id="M4"><mml:msubsup><mml:mrow><mml:mi>I</mml:mi></mml:mrow><mml:mrow><mml:mstyle class="text"><mml:mtext class="textrm" mathvariant="normal">AMPA</mml:mtext></mml:mstyle></mml:mrow><mml:mrow><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:mfrac></mml:mrow></mml:msubsup></mml:math></inline-formula></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>If the source variables of a specific input variable are different for excitatory and inhibitory neurons (corE and corI populations), they are given separately for corE and corI. I<sub>CBF</sub>, CBF-driving input; I<sub>CMRO2</sub>, CMRO2-driving input; syn, normalized total synaptic activity; g<sub>AMPA</sub>, conductance variable of AMPA synapse; r, neuron firing rate; I<sub>AMPA</sub>, current caused by AMPA synapses; I<sub>GABA</sub>, current caused by GABA synapses</italic>.</p>
</table-wrap-foot>
</table-wrap>
<p>We again use the stimulus pulse simulation from Section 4.2 to compare the different BOLD signal responses (see <xref ref-type="fig" rid="F6">Figure 6</xref>). The first three hypotheses are based on previous studies that used the classic Balloon model. Thus, we also use the classic Balloon model (BOLD model <italic>balloon_RN</italic>) for the BOLD calculation, which includes a single CBF-driving input signal (see <xref ref-type="fig" rid="F1">Figure 1A</xref>) whose source variable we vary for each hypothesis. The first hypothesis we implement is that the CBF or the BOLD signal is driven by the total synaptic activity of the neurons (as in Van Hartevelt et al., <xref ref-type="bibr" rid="B55">2014</xref>; Schmidt et al., <xref ref-type="bibr" rid="B49">2018</xref>; Maith et al., <xref ref-type="bibr" rid="B39">2021</xref>). To implement this, we use the normalized synaptic activity as the source variable of the BOLD monitor (BOLD monitor A), as previously in Section 4.2. The second hypothesis we implement is that the CBF or the BOLD signal is driven only by the excitatory (glutamatergic) synaptic activity (similar to Heikkinen et al., <xref ref-type="bibr" rid="B28">2015</xref>). For this, we use the conductance variable of the excitatory synapses of the neurons as source variable for the BOLD monitor (BOLD monitor B). The third hypothesis is that the CBF or the BOLD signal is driven by the neuronal output of the neurons, for example, the mean firing rate (as in Smith et al., <xref ref-type="bibr" rid="B51">2011</xref>; Bennett et al., <xref ref-type="bibr" rid="B3">2015</xref>). Thus, for this BOLD monitor (BOLD monitor C), we use the mean firing rate of the neurons as source variable, as in Section 3.3. <xref ref-type="fig" rid="F6">Figures 6A&#x02013;C</xref> shows that the normalized CBF and BOLD responses vary for these three BOLD monitors with different source variables. The response based on the mean firing rates (<xref ref-type="fig" rid="F6">Figure 6C</xref>) is the strongest, because the firing rates change more relatively to the resting-state compared to the two other source variables. However, the shape of the responses is almost identical.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>Normalized CBF, CMRO2, and BOLD (relative change) responses of six different BOLD monitors including different source variables. The averaged recordings of 40 simulations with a 100 ms stimulus pulse are shown. The vertical gray bar in columns two and three indicate the time window of the active stimulus pulse. The left column illustrates, which compartments of the microcircuit model were used as source variables for the BOLD monitors. red, CBF-driving; blue, CMRO2-driving; purple, CBF and CMRO2-driving. For a more detailed description about the source variables see Section 4.3 and <xref ref-type="table" rid="T1">Table 1</xref>. The BOLD monitors <bold>(A&#x02013;C)</bold> using the classic Balloon model with a single CBF-driving input signal. The BOLD monitors <bold>(D&#x02013;F)</bold> using the two-input Balloon model defined in this work with two input signals driving CBF and CMRO2 separately.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0006.tif"/>
</fig>
<p>As mentioned in Section 2.2, it has also been proposed that the CBF and CMRO2 are driven in parallel in a feed-forward manner. Therefore, for the following three BOLD monitors, we use the two-input Balloon model defined in Section 2.2 (<italic>balloon_two_inputs</italic>), which requires two input signals (<italic>I</italic><sub>CBF</sub>, <italic>I</italic><sub>CMRO2</sub>, see <xref ref-type="fig" rid="F1">Figure 1</xref>). The source variables used to obtain <italic>I</italic><sub>CBF</sub> and <italic>I</italic><sub>CMRO2</sub> can be freely chosen from the neuron models of the corE and corI populations.</p>
<p>The first hypothesis considering CBF and CMRO2 being driven in parallel proposes that the CMRO2 is driven only by excitatory synaptic processes and that the CBF is driven by both excitatory and inhibitory synaptic processes (Buxton, <xref ref-type="bibr" rid="B5">2012</xref>, <xref ref-type="bibr" rid="B6">2021</xref>). To implement this hypothesis in BOLD monitor D, we define the current caused by AMPA synapses (<italic>I</italic><sub>AMPA</sub>) as the CMRO2-driving source variable, and the sum of <italic>I</italic><sub>AMPA</sub> and the current caused by GABA synapses (<italic>I</italic><sub>GABA</sub>) as the CBF-driving source variable. These source variables have to be additionally defined in the neuron models of the neurons of the corE and corI populations (see <xref ref-type="supplementary-material" rid="SM1">Supplementary Section 4.1</xref>).</p>
<p>The next hypothesis is similar, but additionally states that in inhibitory interneurons, energy consumption, and thus CMRO2, is driven by neuronal output rather than synaptic input (in contrast to excitatory neurons) (Howarth et al., <xref ref-type="bibr" rid="B31">2021</xref>). To implement this in BOLD monitor E, the mean firing rate of the neurons rather than <italic>I</italic><sub>AMPA</sub> is defined as the CMRO2-driving source variable for the inhibitory interneurons of the corI population. For the excitatory neurons of the corE population, the same source variables are used as in the previous BOLD monitor.</p>
<p><xref ref-type="fig" rid="F6">Figures 6D,E</xref> show that the normalized CBF, CMRO2, and BOLD (relative change) responses of these two BOLD monitors are significantly different from the previous ones (with a single input). The BOLD signal shows a much stronger initial dip as CMRO2 increases much faster than CBF. There is little difference between the responses of the two BOLD monitors. The CMRO2 of BOLD monitor E is slightly lower because the firing rate of the inhibitory interneurons increases less than their synaptic current caused by AMPA synapses. However, because the inhibitory interneurons only contribute one-fifth to the input signal of the BOLD monitor (due to the ratio between corE and corI sizes), there is only a small difference from BOLD monitor D to E.</p>
<p>In the last BOLD monitor (<xref ref-type="fig" rid="F6">Figure 6F</xref>), we use almost the same source variables as in BOLD monitor D. We only introduce an additional non-linear operation for the source variable driving CMRO2 by defining the current caused by the AMPA synapses, to the power of one third, as the source variable (instead of the current itself). As a result, energy consumption or CMRO2 no longer increases linearly with the current. Thus, we are still basically following the same general hypothesis (CMRO2 driven by AMPA synaptic processes, CBF driven by AMPA and GABA synaptic processes), but assuming different mathematical relationships for CMRO2. This change causes CMRO2 to increase much less due to the stimulus pulse, as shown in <xref ref-type="fig" rid="F6">Figure 6F</xref>. Thus, the initial dip in the BOLD response is smaller than for the BOLD monitors D &#x00026; E.</p>
<p>In summary, the BOLD monitor allows users to determine the BOLD signal based on individually chosen source variables. Without much effort, we can define different source variables and even compare different BOLD models (e.g., a model with two input variables). With the classic Balloon model, the BOLD response for our microcircuit model hardly differs for different source variables. Since all variables in the microcircuit model increase similarly in response to the stimulus pulse, the BOLD response also looks similar and only differs in amplitude. When driving CBF and CMRO2 in parallel with different source variables, the choice of the source variable is much more important, because the relationship between them critically affects the shape of the BOLD response not only the amplitude. Nevertheless, the effect of changing the source variable on the resulting BOLD signal may be different for other underlying network models with different dynamics of the different variables (e.g., synaptic currents, mean firing rate, etc.), even when the classic Balloon model is used.</p>
<p>In a second experiment, we perform a simulation with sustained stimulation (longer stimulus pulse) with our six different BOLD monitors. The firing rate of the Poisson neurons is increased by a factor of 1.2 for 20 s. Like in the stimulus pulse simulations, the responses of the first three BOLD monitors (A-C) are very similar and only differ in amplitude (<xref ref-type="fig" rid="F7">Figure 7</xref>, left). The CBF or BOLD responses show a slight initial overshoot, then reach a plateau, and finally, show a slight post-stimulus undershoot. The three BOLD monitor variants with two input signals (D-F) again show significant differences from the three BOLD monitors using the classic Balloon model. The BOLD monitors D and E showed almost identical responses consisting of an initial undershoot a negative plateau and a post-stimulus over- and undershoot (for results of BOLD monitor E see <xref ref-type="supplementary-material" rid="SM1">Supplementary Figure 1</xref>). It is particularly noticeable that the plateau is negative for the BOLD monitors D &#x00026; E but not for BOLD monitor F because only for BOLD monitor F, the CBF increases more than the CMRO2. This again illustrates how critical the choice of source variables is when CBF and CMRO2 are driven in parallel by them.</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>Normalized CBF, CMRO2, and BOLD (relative change) responses of the different BOLD monitors (<bold>A&#x02013;C</bold>, left), (<bold>D</bold>, mid), and (<bold>F</bold>, right) including different source variables. The averaged recordings of 40 simulations with a 20 s stimulus pulse are shown. The background highlighted in gray indicates the time window of the active stimulus. Here, the firing rate of the Poisson neurons is increased by a factor of 1.2 for 20 s. For a more detailed description about the source variables see Section 4.3 and <xref ref-type="table" rid="T1">Table 1</xref>. The BOLD monitors <bold>(A&#x02013;C)</bold> using the classic Balloon model with a single CBF-driving input. The BOLD monitors <bold>(D&#x02013;F)</bold> using the two-input Balloon model defined in this work with separately driven CBF and CMRO2. The responses of BOLD monitor E are shown in the <xref ref-type="supplementary-material" rid="SM1">Supplementary Figure 1</xref> as they are almost identical to those of BOLD monitor <bold>(D)</bold>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0007.tif"/>
</fig>
</sec>
<sec>
<title>4.4. Computational Time Analysis</title>
<p>In this section, we study the additional computational time introduced by the BOLD monitor (hereafter referred to as computational overhead). We use a scaled version of the microcircuit model described in Section 4.1, by incrementally increasing the number of neurons for the populations and leaving the number of synaptic inputs for a neuron fixed to 10 connections (from 10 different neurons of the pre-synaptic population) per projection. <xref ref-type="table" rid="T2">Table 2</xref> shows an overview of the total number of neurons and connections for each network model instance.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Overview on the network model sizes used for the computational time analysis.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="center"><bold>Number of</bold></th>
<th valign="top" align="center"><bold>Number of</bold></th>
<th valign="top" align="center"><bold>Number of</bold></th>
</tr>
<tr>
<th valign="top" align="center"><bold>recorded neurons</bold></th>
<th valign="top" align="center"><bold>neurons</bold></th>
<th valign="top" align="center"><bold>connections</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="center">250</td>
<td valign="top" align="center">450</td>
<td valign="top" align="center">5,500</td>
</tr>
<tr>
<td valign="top" align="center">500</td>
<td valign="top" align="center">900</td>
<td valign="top" align="center">11,000</td>
</tr>
<tr>
<td valign="top" align="center">1,000</td>
<td valign="top" align="center">1,800</td>
<td valign="top" align="center">22,000</td>
</tr>
<tr>
<td valign="top" align="center">2,000</td>
<td valign="top" align="center">3,600</td>
<td valign="top" align="center">44,000</td>
</tr>
<tr>
<td valign="top" align="center">4,000</td>
<td valign="top" align="center">7,200</td>
<td valign="top" align="center">88,000</td>
</tr>
<tr>
<td valign="top" align="center">8,000</td>
<td valign="top" align="center">14,400</td>
<td valign="top" align="center">176,000</td>
</tr>
<tr>
<td valign="top" align="center">16,000</td>
<td valign="top" align="center">28,800</td>
<td valign="top" align="center">352,000</td>
</tr>
<tr>
<td valign="top" align="center">32,000</td>
<td valign="top" align="center">57,600</td>
<td valign="top" align="center">704,000</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>The first column are the number of recorded neurons (i.e., corE and corI populations), the second column the number of all neurons (additionally the Poisson population) within the network model and the third column the overall number of connections</italic>.</p>
</table-wrap-foot>
</table-wrap>
<p><xref ref-type="fig" rid="F8">Figure 8</xref> depicts the single thread computational time in seconds as a function of the number of recorded neurons with (blue line) and without (orange line) BOLD recording. For each configuration, we performed 10 runs, each simulating 25 s biological time and we measured the elapsed real time with the Python <italic>time</italic> module. The relative standard deviation was in the range of 0.55% to 2.53% which is too small to be depicted meaningfully in the graph and was therefore omitted.</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p>Computational time for a simulation with (blue) and without (orange) BOLD recording as a function of the number of recorded neurons. The gray bars indicate the percentage of the computational overhead of the BOLD recording in the total computation time. This value was computed on the average values and therefore no standard deviation is depicted. The computational overhead is higher for small network models and gets smaller for larger models.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fninf-16-790966-g0008.tif"/>
</fig>
<p>For all simulated configurations, the computational time with and without BOLD recording is globally similar (between 1% and 8% of overhead depending on the model&#x00027;s size). The relative computational overhead (visualized as gray bars) is larger for small network models but shrinks when the model size increases. Therefore, if network models get more complex, in the sense of number of neurons, complexity of neuron models and the number of connections, one can expect that the share of the computational overhead will shrink accordingly. Overall, the computational time is dominated by the complexity of the network model and the BOLD recording plays a minor role, especially in complex network models.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s5">
<title>5. Discussion</title>
<p>In this work, we presented a BOLD monitor for obtaining simulated BOLD signals from spiking or rate-coded network models in the ANNarchy neural simulator. All variants of the Balloon model summarized by Stephan et al. (<xref ref-type="bibr" rid="B53">2007</xref>), thus the currently prevailing BOLD models, are available as built-in models. The integrated BOLD monitor makes it easy for users to connect their network models to a mathematical BOLD model such as the Balloon model (Buxton et al., <xref ref-type="bibr" rid="B10">1998</xref>) or their own user-defined BOLD models. Users only need to specify from which populations they want to record the BOLD signal, which BOLD model they want to use and which variables of the neurons should be mapped to the input signal(s) of the BOLD model.</p>
<p>The optional baseline normalization of the source variables is a useful feature, as it allows the use of variables with arbitrary magnitudes for the BOLD calculation (including, for example, negative membrane potentials or large synaptic currents), since it sets the relative change of the source variables as the input signal for the BOLD calculation. This is a simple and effective alternative to the previous normalization approaches of the input signals (Schmidt et al., <xref ref-type="bibr" rid="B49">2018</xref>; Maith et al., <xref ref-type="bibr" rid="B39">2021</xref>). Another advantage of baseline normalization is that the resulting input signal for the BOLD model is approximately zero at rest and thus suitable for the Balloon model. A limitation is that it can only use variables that have a relatively constant non-zero mean in the resting-state of the network model. It is highly recommended that users verify that the normalization is appropriate for their chosen variables and used BOLD model. For example, an unsuitable source variable would be the mean firing rate of neurons that are quiescent during the baseline calculation phase and are activated due to a model manipulation after the baseline calculation phase (e.g., during an experiment with input presentation). Another example would be if the selected source variable must first enter a steady-state at the beginning of the simulation (e.g., increase from 0 to a constant non-zero value) and one conducts the baseline calculation during this ramp-up period. This would lead to a too low baseline and thus to a permanently positive normalized signal during recording.</p>
<p>The implementation of the BOLD monitor is flexible enough so that the source variables for the BOLD calculation can be any of the variables present in the neuron models (e.g., a combination of different synaptic currents). Recently, an energy-dependent leaky integrate-and-fire neuron model has been developed that accounts for the neuron&#x00027;s energy consumption by calculating adenosine triphosphate (ATP) dynamics (Jaras et al., <xref ref-type="bibr" rid="B36">2021</xref>). The variables involved there, which are associated with the brain&#x00027;s metabolism, could be of great interest for calculating the BOLD signal and could be easily linked to BOLD models in ANNarchy using the BOLD monitor. Such flexibility makes ANNarchy with the BOLD monitor an useful environment for investigating hypotheses about the coupling between neural processes and BOLD signals, which is an active area of research (Buxton, <xref ref-type="bibr" rid="B6">2021</xref>; Howarth et al., <xref ref-type="bibr" rid="B31">2021</xref>). Since the coupling between neural processes and BOLD signals is still quite unclear, there is no recommended standard method for obtaining simulated BOLD signals with network models (Einevoll et al., <xref ref-type="bibr" rid="B20">2019</xref>). We have demonstrated here how to use the BOLD monitor to study the role of different source variables in a simple network model of a cortical microcircuit. As such, ANNarchy and the new BOLD monitor can support research in neurovascular coupling, which may lead to the development of better BOLD models in the future and possibly to a better understanding of the BOLD response.</p>
<p>The ability to easily obtain BOLD signals from network models opens up more potential applications for ANNarchy, particularly in the area of model-based analysis of neuroimaging data (see Popovych et al., <xref ref-type="bibr" rid="B42">2019</xref> for a review). The basic idea here is to adjust network models to replicate experimental MRI data while simulating underlying neural processes that cannot be inferred from the MRI data alone. Especially for the study of neuronal diseases in humans, model-based analysis offers new opportunities. Network models customized to patients can be compared with network models customized to healthy controls, or the customized network models can be used as a virtual test bed for specific treatments (Cabral et al., <xref ref-type="bibr" rid="B13">2013</xref>; Van Hartevelt et al., <xref ref-type="bibr" rid="B55">2014</xref>; Jirsa et al., <xref ref-type="bibr" rid="B37">2017</xref>; Meier et al., <xref ref-type="bibr" rid="B40">2021</xref>). Since this approach has been mainly performed with macroscopic network models, ANNarchy can extend this approach by being used mainly in the study of processes at the mesoscopic level of detail. A possible application would be the study of deep brain stimulation (DBS) in, e.g., Parkinson&#x00027;s disease patients, the mechanisms of which may be more extensively and realistically implemented in ANNarchy (similar to other mesoscopic network models, e.g., Rubin and Terman, <xref ref-type="bibr" rid="B46">2004</xref>; Hahn and McIntyre, <xref ref-type="bibr" rid="B27">2010</xref>) than in macroscopic network models (e.g., Meier et al., <xref ref-type="bibr" rid="B40">2021</xref>). Similar to the recently proposed approach to predict DBS-induced clinical improvements using MRI data from Parkinson&#x00027;s disease patients (Horn et al., <xref ref-type="bibr" rid="B29">2017</xref>, <xref ref-type="bibr" rid="B30">2019</xref>), predictors for clinical improvements could also be obtained from model-based analysis of the MRI data. Speculatively, these predictive approaches could potentially even be used in combination with intraoperative MRI (Cui et al., <xref ref-type="bibr" rid="B16">2016</xref>) in the future to optimize electrode positions during DBS electrode implementation. In addition, model-based analysis of MRI data could potentially provide new biomarkers for mental disorders for which MRI data alone are not well-suited (Linden, <xref ref-type="bibr" rid="B38">2012</xref>).</p>
<p>The BOLD monitor is already quite flexible and user friendly, but a potential improvement may be an optional delay for the input signals of the BOLD model. This was demonstrated, for example, for the Balloon model in Buxton et al. (<xref ref-type="bibr" rid="B9">2004</xref>). A delayed CBF relative to the CMRO2 could be the cause for the initial dip in the BOLD signal (Buxton et al., <xref ref-type="bibr" rid="B9">2004</xref>; Buxton, <xref ref-type="bibr" rid="B5">2012</xref>). In our two-input Balloon model, we currently implement this with a faster responding for CMRO2 than for CBF. However, whether the initial dip in the BOLD response is actually caused by a faster CMRO2 response is still a matter of debate in the literature (Buxton, <xref ref-type="bibr" rid="B5">2012</xref>). Another useful extension would be individual scaling factors for each source variable signal in the preprocessing of the BOLD monitor. This would allow, for example, one population to be heavily weighted for CBF and another population for CMRO2. Currently, the scaling factor is based on the size of the population and can optionally be adjusted. One of the most important possible further developments concerns the simulation of realistic noise components of the BOLD signal. Experimentally collected BOLD signals are subject to physiological noise, especially motion, cardiac, and respiratory artifacts, as well as instrumental noise (Birn et al., <xref ref-type="bibr" rid="B4">2008</xref>; Chang et al., <xref ref-type="bibr" rid="B14">2009</xref>; Caballero-Gaudes and Reynolds, <xref ref-type="bibr" rid="B12">2017</xref>). To meaningfully compare simulated and experimental signals, these noise sources should also be considered.</p>
<p>We have demonstrated the properties of the BOLD monitor using a simple network model of a cortical microcircuit. However, we did not focus on a use case that includes a comparison of a realistic network model with experimentally obtained BOLD data. Our microcircuit model is not such a use case, but mainly functions as a means to demonstrate the possibilities of the BOLD monitor. Thus, the simulated BOLD responses should not be overinterpreted. Our implementation could be helpful for researchers to compare different BOLD models. Our simulations showed that different source variables of the same underlying network model can affect the simulated BOLD signal differently and, most importantly, that this can be easily tested with the BOLD monitor in ANNarchy. To actually link experimental BOLD signals to their underlying neural processes, more realistic and detailed network models should be used (Vanni et al., <xref ref-type="bibr" rid="B56">2015</xref>).</p>
<p>In this work, we implemented a modified version of the Balloon model in which CBF and CMRO2 are driven in parallel by two different input signals. This two-input Balloon model was composed of model components from previous publications (Buxton et al., <xref ref-type="bibr" rid="B10">1998</xref>, <xref ref-type="bibr" rid="B9">2004</xref>; Friston et al., <xref ref-type="bibr" rid="B22">2000</xref>). By implementing this BOLD model, we demonstrated how ANNarchy allows users to define their own systems of equations as a BOLD model. A BOLD model considering parallel excitation of CBF and CMRO2 will be necessary for future model-based investigation of current hypotheses regarding the origin of the BOLD signal (Buxton, <xref ref-type="bibr" rid="B6">2021</xref>).</p>
<p>Other modeling tools also provide the ability to simulate BOLD signals or analyze MRI data in a model-based manner. One of the best known is Dynamic Causal Modeling (DCM) by Friston et al. (<xref ref-type="bibr" rid="B21">2003</xref>), which is included in the Matlab Software Package SPM (Penny et al., <xref ref-type="bibr" rid="B41">2011</xref>). DCM can be used to obtain the effective connectivity of network models from MRI data. The model implementation in DCM differs significantly from that in ANNarchy, where more complex network models can be implemented at finer scales, for example with spiking neurons, detailed neuron and synapse definitions. In DCM, the focus is not on explicitly implementing neural processing, but on investigating how brain regions interact: the dynamics of the brain regions are usually simulated by an activity vector which depends on a connectivity matrix and driving and modulating inputs defined by an experimental paradigm. The length of the activity vector usually corresponds to the number of regions included, i.e., each region is described by one activity value. Simulated BOLD signals for the different brain regions are obtained from the activities of the regions using the Balloon model versions of Stephan et al. (<xref ref-type="bibr" rid="B53">2007</xref>). Based on this, free parameters (e.g., the connectivity matrix) are optimized using Bayesian inference to replicate the MRI data and keep the model complexity low (also called Bayesian model inversion). In DCM, other BOLD models than the Balloon model are not available. DCM is not designed to flexibly test hypotheses regarding neurovascular coupling. Therefore, DCM in SPM and ANNarchy with the new BOLD monitor are designed for different applications.</p>
<p>Another modeling tool that incorporates simulation of BOLD signals is The Virtual Brain (TVB) (Ritter et al., <xref ref-type="bibr" rid="B45">2013</xref>; Sanz Leon et al., <xref ref-type="bibr" rid="B47">2013</xref>). TVB is a neural simulator to create large-scale network models usually of the whole cortex and not a mathematical setup for model inversion using BOLD data as DCM, which is only one possible application of TVB. In TVB, network models are usually implemented as a combination of neural mass models, sets of equations that describe the average dynamics of large neuron populations (macroscopic models), but neglect processes at the single-neuron level. Therefore, a TVB &#x02013; multi-scale co-simulation toolbox that links TVB and neural simulators which model the lower scale processes such as ANNarchy and NEST (Gewaltig and Diesmann, <xref ref-type="bibr" rid="B23">2007</xref>), has been recently introduced (Meier et al., <xref ref-type="bibr" rid="B40">2021</xref>; Schirner et al., <xref ref-type="bibr" rid="B48">2022</xref>). BOLD simulation in TVB is mainly used to validate large-scale network models on experimental MRI data. In TVB, the different versions of the Balloon model of Stephan et al. (<xref ref-type="bibr" rid="B53">2007</xref>) are available. However, a flexible definition of source variables or the BOLD model is not currently available because the focus is not on examining the relationship between the BOLD signal and detailed neural processes.</p>
<p>Several successful neural simulators, such as NEST (Gewaltig and Diesmann, <xref ref-type="bibr" rid="B23">2007</xref>) and Brian2 (Stimberg et al., <xref ref-type="bibr" rid="B54">2019</xref>), do not yet have an integrated BOLD simulation routine. For these simulators, users currently have to use external tools for BOLD simulation like the R package neuRosim (Welvaert et al., <xref ref-type="bibr" rid="B58">2011</xref>). Several hemodynamic response functions (HRF) are available in neuRosim, including the Balloon model from Buxton et al. (<xref ref-type="bibr" rid="B9">2004</xref>), which can be used to calculate a BOLD response from a given stimulus signal. The stimulus signal typically follows an experimental design, with 1 indicating the presence and 0 the absence of a stimulus. Simulating the BOLD signal based on specific neural processes is actually not the intended use of neuRosim. Nevertheless, neuRosim can be applied to specific simulated signals from network models (Schmidt et al., <xref ref-type="bibr" rid="B49">2018</xref>). A separate definition of the BOLD model (or the HRF in neuRosim) is not currently available. The strengths of neuRosim are the possibility to define spatial positions and the extent of BOLD activation and the modeling of different noise sources of the BOLD signal.</p>
<p>An important advantage of on-line BOLD computation in ANNarchy over off-line computation such as using neuRosim is that simulated data of the recorded neurons (e.g., membrane potentials or synaptic currents) do not need to be stored separately to be used for BOLD computation after simulation. The latter can result in significant increased memory requirements, especially for larger network models. On the other hand, the on-line BOLD computation increases the computation time of the simulations. However, this is a less crucial factor than, for example, the size of the network model, as we show in Section 4.4. Moreover, the share of the on-line BOLD computation in the computation time decreases as the complexity of the model increases. Therefore, the use of the BOLD monitor is also appropriate for larger network models than those used in this work.</p>
<p>In summary, we introduced the BOLD monitor in ANNarchy which allows the on-line computation of simulated BOLD signals directly from spiking or rate-coded network models. Highlights of the BOLD monitor are the flexible definition of source variables in the neuron models of the recorded network model and the possibility to use new user-defined BOLD models. We demonstrated here how this can be done and how this can be used, for example, to compare different hypotheses regarding neurovascular coupling. This tool allows both the validation and optimization of network models with experimental MRI data and the model-based analysis of the BOLD response for a better understanding of its neural basis.</p>
</sec>
<sec sec-type="data-availability" id="s6">
<title>Data Availability Statement</title>
<p>All used source code is publicly available. This data can be found here: the ANNarchy neural simulator (4.7.0 release) is available on github: <ext-link ext-link-type="uri" xlink:href="https://github.com/ANNarchy/ANNarchy">https://github.com/ANNarchy/ANNarchy</ext-link>. The simulation code of this work is available on github: <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.5547665">https://doi.org/10.5281/zenodo.5547665</ext-link>.</p>
</sec>
<sec id="s7">
<title>Author Contributions</title>
<p>OM and HD: designed the research, performed the research, programming, data analysis, and writing (first draft). JB, JV, and FH: guided the research. FH: acquired the funding. OM, HD, JB, JV, and FH: writing (reviewing) and editing. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="s8">
<title>Funding</title>
<p>This work was supported by the Deutsche Forschungsgemeinschaft (DFG) SPP-2041 Computational Connectomics as part of the project Clinical Connectomics: A network approach to deep brain stimulation (DFG HA2630/11-2 and HA2630/11-1) and in part by Auto-tuning for neural simulations on different parallel hardware (DFG HA2630/9-1). The publication of this article was funded by Chemnitz University of Technology and by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - 491193532.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<sec sec-type="supplementary-material" id="s10">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fninf.2022.790966/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fninf.2022.790966/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baladron</surname> <given-names>J.</given-names></name> <name><surname>Nambu</surname> <given-names>A.</given-names></name> <name><surname>Hamker</surname> <given-names>F. H.</given-names></name></person-group> (<year>2019</year>). <article-title>The subthalamic nucleus-external globus pallidus loop biases exploratory decisions towards known alternatives: a neuro-computational study</article-title>. <source>Eur. J. Neurosci.</source> <volume>49</volume>, <fpage>754</fpage>&#x02013;<lpage>767</lpage>. <pub-id pub-id-type="doi">10.1111/ejn.13666</pub-id><pub-id pub-id-type="pmid">28833676</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beaulieu</surname> <given-names>C.</given-names></name> <name><surname>Kisvarday</surname> <given-names>Z.</given-names></name> <name><surname>Somogyi</surname> <given-names>P.</given-names></name> <name><surname>Cynader</surname> <given-names>M.</given-names></name> <name><surname>Cowey</surname> <given-names>A.</given-names></name></person-group> (<year>1992</year>). <article-title>Quantitative distribution of gaba-immunopositive and-immunonegative neurons and synapses in the monkey striate cortex (area 17)</article-title>. <source>Cereb. Cortex</source> <volume>2</volume>, <fpage>295</fpage>&#x02013;<lpage>309</lpage>. <pub-id pub-id-type="doi">10.1093/cercor/2.4.295</pub-id><pub-id pub-id-type="pmid">1330121</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bennett</surname> <given-names>M. R.</given-names></name> <name><surname>Farnell</surname> <given-names>L.</given-names></name> <name><surname>Gibson</surname> <given-names>W. G.</given-names></name> <name><surname>Lagopoulos</surname> <given-names>J.</given-names></name></person-group> (<year>2015</year>). <article-title>Cortical network models of firing rates in the resting and active states predict bold responses</article-title>. <source>PLoS ONE</source> <volume>10</volume>, <fpage>e0144796</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0144796</pub-id><pub-id pub-id-type="pmid">26659399</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Birn</surname> <given-names>R. M.</given-names></name> <name><surname>Smith</surname> <given-names>M. A.</given-names></name> <name><surname>Jones</surname> <given-names>T. B.</given-names></name> <name><surname>Bandettini</surname> <given-names>P. A.</given-names></name></person-group> (<year>2008</year>). <article-title>The respiration response function: the temporal dynamics of fMRI signal fluctuations related to changes in respiration</article-title>. <source>Neuroimage</source> <volume>40</volume>, <fpage>644</fpage>&#x02013;<lpage>654</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2007.11.059</pub-id><pub-id pub-id-type="pmid">18234517</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buxton</surname> <given-names>R. B.</given-names></name></person-group> (<year>2012</year>). <article-title>Dynamic models of bold contrast</article-title>. <source>Neuroimage</source> <volume>62</volume>, <fpage>953</fpage>&#x02013;<lpage>961</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2012.01.012</pub-id><pub-id pub-id-type="pmid">22245339</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buxton</surname> <given-names>R. B.</given-names></name></person-group> (<year>2021</year>). <article-title>The thermodynamics of thinking: connections between neural activity, energy metabolism and blood flow</article-title>. <source>Philos. Trans. R. Soc. B</source> <volume>376</volume>, <fpage>20190624</fpage>. <pub-id pub-id-type="doi">10.1098/rstb.2019.0624</pub-id><pub-id pub-id-type="pmid">33190604</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buxton</surname> <given-names>R. B.</given-names></name> <name><surname>Frank</surname> <given-names>L. R.</given-names></name></person-group> (<year>1997</year>). <article-title>A model for the coupling between cerebral blood flow and oxygen metabolism during neural stimulation</article-title>. <source>J. Cereb. Blood Flow Metab.</source> <volume>17</volume>, <fpage>64</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1097/00004647-199701000-00009</pub-id><pub-id pub-id-type="pmid">8978388</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buxton</surname> <given-names>R. B.</given-names></name> <name><surname>Griffeth</surname> <given-names>V. E.</given-names></name> <name><surname>Simon</surname> <given-names>A. B.</given-names></name> <name><surname>Moradi</surname> <given-names>F.</given-names></name></person-group> (<year>2014</year>). <article-title>Variability of the coupling of blood flow and oxygen metabolism responses in the brain: a problem for interpreting bold studies but potentially a new window on the underlying neural activity</article-title>. <source>Front. Neurosci.</source> <volume>8</volume>, <fpage>139</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2014.00139</pub-id><pub-id pub-id-type="pmid">24966808</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buxton</surname> <given-names>R. B.</given-names></name> <name><surname>Uluda&#x0011F;</surname> <given-names>K.</given-names></name> <name><surname>Dubowitz</surname> <given-names>D. J.</given-names></name> <name><surname>Liu</surname> <given-names>T. T.</given-names></name></person-group> (<year>2004</year>). <article-title>Modeling the hemodynamic response to brain activation</article-title>. <source>Neuroimage</source> <volume>23</volume>, <fpage>S220</fpage>&#x02013;<lpage>S233</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2004.07.013</pub-id><pub-id pub-id-type="pmid">15501093</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buxton</surname> <given-names>R. B.</given-names></name> <name><surname>Wong</surname> <given-names>E. C.</given-names></name> <name><surname>Frank</surname> <given-names>L. R.</given-names></name></person-group> (<year>1998</year>). <article-title>Dynamics of blood flow and oxygenation changes during brain activation: the balloon model</article-title>. <source>Magnet. Reson. Med.</source> <volume>39</volume>, <fpage>855</fpage>&#x02013;<lpage>864</lpage>. <pub-id pub-id-type="doi">10.1002/mrm.1910390602</pub-id><pub-id pub-id-type="pmid">9621908</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buzs&#x000E1;ki</surname> <given-names>G.</given-names></name> <name><surname>Mizuseki</surname> <given-names>K.</given-names></name></person-group> (<year>2014</year>). <article-title>The log-dynamic brain: how skewed distributions affect network operations</article-title>. <source>Nat. Rev. Neurosci.</source> <volume>15</volume>, <fpage>264</fpage>&#x02013;<lpage>278</lpage>. <pub-id pub-id-type="doi">10.1038/nrn3687</pub-id><pub-id pub-id-type="pmid">24569488</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Caballero-Gaudes</surname> <given-names>C.</given-names></name> <name><surname>Reynolds</surname> <given-names>R. C.</given-names></name></person-group> (<year>2017</year>). <article-title>Methods for cleaning the bold fMRI signal</article-title>. <source>Neuroimage</source> <volume>154</volume>, <fpage>128</fpage>&#x02013;<lpage>149</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2016.12.018</pub-id><pub-id pub-id-type="pmid">27956209</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cabral</surname> <given-names>J.</given-names></name> <name><surname>Fernandes</surname> <given-names>H. M.</given-names></name> <name><surname>Van Hartevelt</surname> <given-names>T. J.</given-names></name> <name><surname>James</surname> <given-names>A. C.</given-names></name> <name><surname>Kringelbach</surname> <given-names>M. L.</given-names></name> <name><surname>Deco</surname> <given-names>G.</given-names></name></person-group> (<year>2013</year>). <article-title>Structural connectivity in schizophrenia and its impact on the dynamics of spontaneous functional networks</article-title>. <source>Chaos</source> <volume>23</volume>, <fpage>046111</fpage>. <pub-id pub-id-type="doi">10.1063/1.4851117</pub-id><pub-id pub-id-type="pmid">24387590</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chang</surname> <given-names>C.</given-names></name> <name><surname>Cunningham</surname> <given-names>J. P.</given-names></name> <name><surname>Glover</surname> <given-names>G. H.</given-names></name></person-group> (<year>2009</year>). <article-title>Influence of heart rate on the bold signal: the cardiac response function</article-title>. <source>Neuroimage</source> <volume>44</volume>, <fpage>857</fpage>&#x02013;<lpage>869</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2008.09.029</pub-id><pub-id pub-id-type="pmid">18951982</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Corbit</surname> <given-names>V. L.</given-names></name> <name><surname>Whalen</surname> <given-names>T. C.</given-names></name> <name><surname>Zitelli</surname> <given-names>K. T.</given-names></name> <name><surname>Crilly</surname> <given-names>S. Y.</given-names></name> <name><surname>Rubin</surname> <given-names>J. E.</given-names></name> <name><surname>Gittis</surname> <given-names>A. H.</given-names></name></person-group> (<year>2016</year>). <article-title>Pallidostriatal projections promote &#x003B2; oscillations in a dopamine-depleted biophysical network model</article-title>. <source>J. Neurosci.</source> <volume>36</volume>, <fpage>5556</fpage>&#x02013;<lpage>5571</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0339-16.2016</pub-id><pub-id pub-id-type="pmid">27194335</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cui</surname> <given-names>Z.</given-names></name> <name><surname>Pan</surname> <given-names>L.</given-names></name> <name><surname>Song</surname> <given-names>H.</given-names></name> <name><surname>Xu</surname> <given-names>X.</given-names></name> <name><surname>Xu</surname> <given-names>B.</given-names></name> <name><surname>Yu</surname> <given-names>X.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Intraoperative MRI for optimizing electrode placement for deep brain stimulation of the subthalamic nucleus in Parkinson disease</article-title>. <source>J. Neurosurg.</source> <volume>124</volume>, <fpage>62</fpage>&#x02013;<lpage>69</lpage>. <pub-id pub-id-type="doi">10.3171/2015.1.JNS141534</pub-id><pub-id pub-id-type="pmid">26274983</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Davis</surname> <given-names>T. L.</given-names></name> <name><surname>Kwong</surname> <given-names>K. K.</given-names></name> <name><surname>Weisskoff</surname> <given-names>R. M.</given-names></name> <name><surname>Rosen</surname> <given-names>B. R.</given-names></name></person-group> (<year>1998</year>). <article-title>Calibrated functional MRI: mapping the dynamics of oxidative metabolism</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>95</volume>, <fpage>1834</fpage>&#x02013;<lpage>1839</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.95.4.1834</pub-id><pub-id pub-id-type="pmid">9465103</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deco</surname> <given-names>G.</given-names></name> <name><surname>Jirsa</surname> <given-names>V. K.</given-names></name></person-group> (<year>2012</year>). <article-title>Ongoing cortical activity at rest: criticality, multistability, and ghost attractors</article-title>. <source>J. Neurosci.</source> <volume>32</volume>, <fpage>3366</fpage>&#x02013;<lpage>3375</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2523-11.2012</pub-id><pub-id pub-id-type="pmid">22399758</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dinkelbach</surname> <given-names>H. &#x000DC;.</given-names></name> <name><surname>Vitay</surname> <given-names>J.</given-names></name> <name><surname>Hamker</surname> <given-names>F. H.</given-names></name></person-group> (<year>2019</year>). <article-title>&#x0201C;Scalable simulation of rate-coded and spiking neural networks on shared memory systems,&#x0201D;</article-title> in <source>2019 Conference on Cognitive Computational Neuroscience</source> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Cognitive Computational Neuroscience</publisher-name>), <fpage>526</fpage>&#x02013;<lpage>529</lpage>. <pub-id pub-id-type="doi">10.32470/CCN.2019.1109-0</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Einevoll</surname> <given-names>G. T.</given-names></name> <name><surname>Destexhe</surname> <given-names>A.</given-names></name> <name><surname>Diesmann</surname> <given-names>M.</given-names></name> <name><surname>Gr&#x000FC;n</surname> <given-names>S.</given-names></name> <name><surname>Jirsa</surname> <given-names>V.</given-names></name> <name><surname>de Kamps</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>The scientific case for brain simulations</article-title>. <source>Neuron</source> <volume>102</volume>, <fpage>735</fpage>&#x02013;<lpage>744</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2019.03.027</pub-id><pub-id pub-id-type="pmid">31121126</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>K. J.</given-names></name> <name><surname>Harrison</surname> <given-names>L.</given-names></name> <name><surname>Penny</surname> <given-names>W.</given-names></name></person-group> (<year>2003</year>). <article-title>Dynamic causal modelling</article-title>. <source>Neuroimage</source> <volume>19</volume>, <fpage>1273</fpage>&#x02013;<lpage>1302</lpage>. <pub-id pub-id-type="doi">10.1016/S1053-8119(03)00202-7</pub-id><pub-id pub-id-type="pmid">12948688</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Friston</surname> <given-names>K. J.</given-names></name> <name><surname>Mechelli</surname> <given-names>A.</given-names></name> <name><surname>Turner</surname> <given-names>R.</given-names></name> <name><surname>Price</surname> <given-names>C. J.</given-names></name></person-group> (<year>2000</year>). <article-title>Nonlinear responses in fMRI: the Balloon model, volterra kernels, and other hemodynamics</article-title>. <source>Neuroimage</source> <volume>12</volume>, <fpage>466</fpage>&#x02013;<lpage>477</lpage>. <pub-id pub-id-type="doi">10.1006/nimg.2000.0630</pub-id><pub-id pub-id-type="pmid">10988040</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gewaltig</surname> <given-names>M.-O.</given-names></name> <name><surname>Diesmann</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>Nest (neural simulation tool)</article-title>. <source>Scholarpedia</source> <volume>2</volume>, <fpage>1430</fpage>. <pub-id pub-id-type="doi">10.4249/scholarpedia.1430</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Glover</surname> <given-names>G. H.</given-names></name></person-group> (<year>1999</year>). <article-title>Deconvolution of impulse response in event-related bold fMRI1</article-title>. <source>Neuroimage</source> <volume>9</volume>, <fpage>416</fpage>&#x02013;<lpage>429</lpage>. <pub-id pub-id-type="doi">10.1006/nimg.1998.0419</pub-id><pub-id pub-id-type="pmid">10191170</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goenner</surname> <given-names>L.</given-names></name> <name><surname>Maith</surname> <given-names>O.</given-names></name> <name><surname>Koulouri</surname> <given-names>I.</given-names></name> <name><surname>Baladron</surname> <given-names>J.</given-names></name> <name><surname>Hamker</surname> <given-names>F. H.</given-names></name></person-group> (<year>2021</year>). <article-title>A spiking model of basal ganglia dynamics in stopping behavior supported by arkypallidal neurons</article-title>. <source>Eur. J. Neurosci.</source> <volume>53</volume>, <fpage>2296</fpage>&#x02013;<lpage>2321</lpage>. <pub-id pub-id-type="doi">10.1111/ejn.15082</pub-id><pub-id pub-id-type="pmid">33316152</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>G&#x000FC;nay</surname> <given-names>C.</given-names></name> <name><surname>Edgerton</surname> <given-names>J. R.</given-names></name> <name><surname>Jaeger</surname> <given-names>D.</given-names></name></person-group> (<year>2008</year>). <article-title>Channel density distributions explain spiking variability in the globus pallidus: a combined physiology and computer simulation database approach</article-title>. <source>J. Neurosci.</source> <volume>28</volume>, <fpage>7476</fpage>&#x02013;<lpage>7491</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.4198-07.2008</pub-id><pub-id pub-id-type="pmid">18650326</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hahn</surname> <given-names>P. J.</given-names></name> <name><surname>McIntyre</surname> <given-names>C. C.</given-names></name></person-group> (<year>2010</year>). <article-title>Modeling shifts in the rate and pattern of subthalamopallidal network activity during deep brain stimulation</article-title>. <source>J. Comput. Neurosci.</source> <volume>28</volume>, <fpage>425</fpage>&#x02013;<lpage>441</lpage>. <pub-id pub-id-type="doi">10.1007/s10827-010-0225-8</pub-id><pub-id pub-id-type="pmid">20309620</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heikkinen</surname> <given-names>H.</given-names></name> <name><surname>Sharifian</surname> <given-names>F.</given-names></name> <name><surname>Vigario</surname> <given-names>R.</given-names></name> <name><surname>Vanni</surname> <given-names>S.</given-names></name></person-group> (<year>2015</year>). <article-title>Feedback to distal dendrites links fMRI signals to neural receptive fields in a spiking network model of the visual cortex</article-title>. <source>J. Neurophysiol.</source> <volume>114</volume>, <fpage>57</fpage>&#x02013;<lpage>69</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00169.2015</pub-id><pub-id pub-id-type="pmid">25925319</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horn</surname> <given-names>A.</given-names></name> <name><surname>Reich</surname> <given-names>M.</given-names></name> <name><surname>Vorwerk</surname> <given-names>J.</given-names></name> <name><surname>Li</surname> <given-names>N.</given-names></name> <name><surname>Wenzel</surname> <given-names>G.</given-names></name> <name><surname>Fang</surname> <given-names>Q.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Connectivity predicts deep brain stimulation outcome in Parkinson disease</article-title>. <source>Ann. Neurol.</source> <volume>82</volume>, <fpage>67</fpage>&#x02013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.1002/ana.24974</pub-id><pub-id pub-id-type="pmid">28586141</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horn</surname> <given-names>A.</given-names></name> <name><surname>Wenzel</surname> <given-names>G.</given-names></name> <name><surname>Irmen</surname> <given-names>F.</given-names></name> <name><surname>Huebl</surname> <given-names>J.</given-names></name> <name><surname>Li</surname> <given-names>N.</given-names></name> <name><surname>Neumann</surname> <given-names>W.-J.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Deep brain stimulation induced normalization of the human functional connectome in Parkinson&#x00027;s disease</article-title>. <source>Brain</source> <volume>142</volume>, <fpage>3129</fpage>&#x02013;<lpage>3143</lpage>. <pub-id pub-id-type="doi">10.1093/brain/awz239</pub-id><pub-id pub-id-type="pmid">31412106</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Howarth</surname> <given-names>C.</given-names></name> <name><surname>Mishra</surname> <given-names>A.</given-names></name> <name><surname>Hall</surname> <given-names>C. N.</given-names></name></person-group> (<year>2021</year>). <article-title>More than just summed neuronal activity: how multiple cell types shape the bold response</article-title>. <source>Philos. Trans. R. Soc. B</source> <volume>376</volume>, <fpage>20190630</fpage>. <pub-id pub-id-type="doi">10.1098/rstb.2019.0630</pub-id><pub-id pub-id-type="pmid">33190598</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Humphries</surname> <given-names>M. D.</given-names></name> <name><surname>Stewart</surname> <given-names>R. D.</given-names></name> <name><surname>Gurney</surname> <given-names>K. N.</given-names></name></person-group> (<year>2006</year>). <article-title>A physiologically plausible model of action selection and oscillatory activity in the basal ganglia</article-title>. <source>J. Neurosci.</source> <volume>26</volume>, <fpage>12921</fpage>&#x02013;<lpage>12942</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.3486-06.2006</pub-id><pub-id pub-id-type="pmid">17167083</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Humphries</surname> <given-names>M. D.</given-names></name> <name><surname>Wood</surname> <given-names>R.</given-names></name> <name><surname>Gurney</surname> <given-names>K.</given-names></name></person-group> (<year>2009</year>). <article-title>Dopamine-modulated dynamic cell assemblies generated by the gabaergic striatal microcircuit</article-title>. <source>Neural Netw.</source> <volume>22</volume>, <fpage>1174</fpage>&#x02013;<lpage>1188</lpage>. <pub-id pub-id-type="doi">10.1016/j.neunet.2009.07.018</pub-id><pub-id pub-id-type="pmid">19646846</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Izhikevich</surname> <given-names>E. M.</given-names></name></person-group> (<year>2003</year>). <article-title>Simple model of spiking neurons</article-title>. <source>IEEE Trans. Neural Netw.</source> <volume>14</volume>, <fpage>1569</fpage>&#x02013;<lpage>1572</lpage>. <pub-id pub-id-type="doi">10.1109/TNN.2003.820440</pub-id><pub-id pub-id-type="pmid">18244602</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Izhikevich</surname> <given-names>E. M.</given-names></name></person-group> (<year>2007</year>). <source>Dynamical Systems in Neuroscience</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>MIT Press</publisher-name>.</citation>
</ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jaras</surname> <given-names>I.</given-names></name> <name><surname>Harada</surname> <given-names>T.</given-names></name> <name><surname>Orchard</surname> <given-names>M. E.</given-names></name> <name><surname>Maldonado</surname> <given-names>P. E.</given-names></name> <name><surname>Vergara</surname> <given-names>R. C.</given-names></name></person-group> (<year>2021</year>). <article-title>Extending the integrate-and-fire model to account for metabolic dependencies</article-title>. <source>Eur. J. Neurosci.</source> <volume>54</volume>, <fpage>5249</fpage>&#x02013;<lpage>5260</lpage>. <pub-id pub-id-type="doi">10.1111/ejn.15326</pub-id><pub-id pub-id-type="pmid">34109698</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jirsa</surname> <given-names>V. K.</given-names></name> <name><surname>Proix</surname> <given-names>T.</given-names></name> <name><surname>Perdikis</surname> <given-names>D.</given-names></name> <name><surname>Woodman</surname> <given-names>M. M.</given-names></name> <name><surname>Wang</surname> <given-names>H.</given-names></name> <name><surname>Gonzalez-Martinez</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>The virtual epileptic patient: individualized whole-brain models of epilepsy spread</article-title>. <source>Neuroimage</source> <volume>145</volume>, <fpage>377</fpage>&#x02013;<lpage>388</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2016.04.049</pub-id><pub-id pub-id-type="pmid">27477535</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Linden</surname> <given-names>D. E.</given-names></name></person-group> (<year>2012</year>). <article-title>The challenges and promise of neuroimaging in psychiatry</article-title>. <source>Neuron</source> <volume>73</volume>, <fpage>8</fpage>&#x02013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2011.12.014</pub-id><pub-id pub-id-type="pmid">22243743</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maith</surname> <given-names>O.</given-names></name> <name><surname>Villagrasa Escudero</surname> <given-names>F.</given-names></name> <name><surname>Dinkelbach</surname> <given-names>H. &#x000DC;.</given-names></name> <name><surname>Baladron</surname> <given-names>J.</given-names></name> <name><surname>Horn</surname> <given-names>A.</given-names></name> <name><surname>Irmen</surname> <given-names>F.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>A computational model-based analysis of basal ganglia pathway changes in Parkinson&#x00027;s disease inferred from resting-state fMRI</article-title>. <source>Eur. J. Neurosci.</source> <volume>53</volume>, <fpage>2278</fpage>&#x02013;<lpage>2295</lpage>. <pub-id pub-id-type="doi">10.1111/ejn.14868</pub-id><pub-id pub-id-type="pmid">32558966</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Meier</surname> <given-names>J.</given-names></name> <name><surname>Perdikis</surname> <given-names>D.</given-names></name> <name><surname>Blickensd&#x000F6;rfer</surname> <given-names>A.</given-names></name> <name><surname>Stefanovski</surname> <given-names>L.</given-names></name> <name><surname>Liu</surname> <given-names>Q.</given-names></name> <name><surname>Maith</surname> <given-names>O.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Virtual deep brain stimulation: multiscale co-simulation of a spiking basal ganglia model and a whole-brain mean-field model with the virtual brain</article-title>. <source>bioRxiv</source>, 1&#x02013;38. <pub-id pub-id-type="doi">10.1101/2021.05.05.442704</pub-id></citation>
</ref>
<ref id="B41">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Penny</surname> <given-names>W. D.</given-names></name> <name><surname>Friston</surname> <given-names>K. J.</given-names></name> <name><surname>Ashburner</surname> <given-names>J. T.</given-names></name> <name><surname>Kiebel</surname> <given-names>S. J.</given-names></name> <name><surname>Nichols</surname> <given-names>T. E.</given-names></name></person-group> (<year>2011</year>). <source>Statistical Parametric Mapping: The Analysis of Functional Brain Images</source>. <publisher-loc>London</publisher-loc>: <publisher-name>Elsevier</publisher-name>. <pub-id pub-id-type="pmid">10497381</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Popovych</surname> <given-names>O. V.</given-names></name> <name><surname>Manos</surname> <given-names>T.</given-names></name> <name><surname>Hoffstaedter</surname> <given-names>F.</given-names></name> <name><surname>Eickhoff</surname> <given-names>S. B.</given-names></name></person-group> (<year>2019</year>). <article-title>What can computational models contribute to neuroimaging data analytics?</article-title> <source>Front. Syst. Neurosci.</source> <volume>12</volume>, <fpage>68</fpage>. <pub-id pub-id-type="doi">10.3389/fnsys.2018.00068</pub-id><pub-id pub-id-type="pmid">30687028</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pospischil</surname> <given-names>M.</given-names></name> <name><surname>Toledo-Rodriguez</surname> <given-names>M.</given-names></name> <name><surname>Monier</surname> <given-names>C.</given-names></name> <name><surname>Piwkowska</surname> <given-names>Z.</given-names></name> <name><surname>Bal</surname> <given-names>T.</given-names></name> <name><surname>Fr&#x000E9;gnac</surname> <given-names>Y.</given-names></name> <etal/></person-group>. (<year>2008</year>). <article-title>Minimal Hodgkin&#x02013;Huxley type models for different classes of cortical and thalamic neurons</article-title>. <source>Biol. Cybernet.</source> <volume>99</volume>, <fpage>427</fpage>&#x02013;<lpage>441</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-008-0263-8</pub-id><pub-id pub-id-type="pmid">19011929</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Potjans</surname> <given-names>T. C.</given-names></name> <name><surname>Diesmann</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <article-title>The cell-type specific cortical microcircuit: relating structure and activity in a full-scale spiking network model</article-title>. <source>Cereb. Cortex</source> <volume>24</volume>, <fpage>785</fpage>&#x02013;<lpage>806</lpage>. <pub-id pub-id-type="doi">10.1093/cercor/bhs358</pub-id><pub-id pub-id-type="pmid">23203991</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ritter</surname> <given-names>P.</given-names></name> <name><surname>Schirner</surname> <given-names>M.</given-names></name> <name><surname>McIntosh</surname> <given-names>A. R.</given-names></name> <name><surname>Jirsa</surname> <given-names>V. K.</given-names></name></person-group> (<year>2013</year>). <article-title>The virtual brain integrates computational modeling and multimodal neuroimaging</article-title>. <source>Brain Connect.</source> <volume>3</volume>, <fpage>121</fpage>&#x02013;<lpage>145</lpage>. <pub-id pub-id-type="doi">10.1089/brain.2012.0120</pub-id><pub-id pub-id-type="pmid">23442172</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rubin</surname> <given-names>J. E.</given-names></name> <name><surname>Terman</surname> <given-names>D.</given-names></name></person-group> (<year>2004</year>). <article-title>High frequency stimulation of the subthalamic nucleus eliminates pathological thalamic rhythmicity in a computational model</article-title>. <source>J. Comput. Neurosci.</source> <volume>16</volume>, <fpage>211</fpage>&#x02013;<lpage>235</lpage>. <pub-id pub-id-type="doi">10.1023/B:JCNS.0000025686.47117.67</pub-id><pub-id pub-id-type="pmid">15114047</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sanz Leon</surname> <given-names>P.</given-names></name> <name><surname>Knock</surname> <given-names>S. A.</given-names></name> <name><surname>Woodman</surname> <given-names>M. M.</given-names></name> <name><surname>Domide</surname> <given-names>L.</given-names></name> <name><surname>Mersmann</surname> <given-names>J.</given-names></name> <name><surname>McIntosh</surname> <given-names>A. R.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>The virtual brain: a simulator of primate brain network dynamics</article-title>. <source>Front. Neuroinform.</source> <volume>7</volume>, <fpage>10</fpage>. <pub-id pub-id-type="doi">10.3389/fninf.2013.00010</pub-id><pub-id pub-id-type="pmid">23781198</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schirner</surname> <given-names>M.</given-names></name> <name><surname>Domide</surname> <given-names>L.</given-names></name> <name><surname>Perdikis</surname> <given-names>D.</given-names></name> <name><surname>Triebkorn</surname> <given-names>P.</given-names></name> <name><surname>Stefanovski</surname> <given-names>L.</given-names></name> <name><surname>Pai</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Brain modelling as a service: the virtual brain on ebrains</article-title>. <source>NeuroImage</source>, <volume>251</volume>:<fpage>118973</fpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2022.118973</pub-id><pub-id pub-id-type="pmid">35131433</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmidt</surname> <given-names>M.</given-names></name> <name><surname>Bakker</surname> <given-names>R.</given-names></name> <name><surname>Shen</surname> <given-names>K.</given-names></name> <name><surname>Bezgin</surname> <given-names>G.</given-names></name> <name><surname>Diesmann</surname> <given-names>M.</given-names></name> <name><surname>van Albada</surname> <given-names>S. J.</given-names></name></person-group> (<year>2018</year>). <article-title>A multi-scale layer-resolved spiking network model of resting-state dynamics in macaque visual cortical areas</article-title>. <source>PLoS Comput. Biol.</source> <volume>14</volume>, <fpage>e1006359</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1006359</pub-id><pub-id pub-id-type="pmid">30335761</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Serences</surname> <given-names>J. T.</given-names></name></person-group> (<year>2004</year>). <article-title>A comparison of methods for characterizing the event-related bold timeseries in rapid fMRI</article-title>. <source>Neuroimage</source> <volume>21</volume>, <fpage>1690</fpage>&#x02013;<lpage>1700</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2003.12.021</pub-id><pub-id pub-id-type="pmid">15050591</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>S. M.</given-names></name> <name><surname>Miller</surname> <given-names>K. L.</given-names></name> <name><surname>Salimi-Khorshidi</surname> <given-names>G.</given-names></name> <name><surname>Webster</surname> <given-names>M.</given-names></name> <name><surname>Beckmann</surname> <given-names>C. F.</given-names></name> <name><surname>Nichols</surname> <given-names>T. E.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Network modelling methods for fMRI</article-title>. <source>Neuroimage</source> <volume>54</volume>, <fpage>875</fpage>&#x02013;<lpage>891</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2010.08.063</pub-id><pub-id pub-id-type="pmid">20817103</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Song</surname> <given-names>S.</given-names></name> <name><surname>Sj&#x000F6;str&#x000F6;m</surname> <given-names>P. J.</given-names></name> <name><surname>Reigl</surname> <given-names>M.</given-names></name> <name><surname>Nelson</surname> <given-names>S.</given-names></name> <name><surname>Chklovskii</surname> <given-names>D. B.</given-names></name></person-group> (<year>2005</year>). <article-title>Highly nonrandom features of synaptic connectivity in local cortical circuits</article-title>. <source>PLoS Biol.</source> <volume>3</volume>, <fpage>e68</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pbio.0030068</pub-id><pub-id pub-id-type="pmid">15737062</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stephan</surname> <given-names>K. E.</given-names></name> <name><surname>Weiskopf</surname> <given-names>N.</given-names></name> <name><surname>Drysdale</surname> <given-names>P. M.</given-names></name> <name><surname>Robinson</surname> <given-names>P. A.</given-names></name> <name><surname>Friston</surname> <given-names>K. J.</given-names></name></person-group> (<year>2007</year>). <article-title>Comparing hemodynamic models with DCM</article-title>. <source>Neuroimage</source> <volume>38</volume>, <fpage>387</fpage>&#x02013;<lpage>401</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2007.07.040</pub-id><pub-id pub-id-type="pmid">17884583</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stimberg</surname> <given-names>M.</given-names></name> <name><surname>Brette</surname> <given-names>R.</given-names></name> <name><surname>Goodman</surname> <given-names>D. F.</given-names></name></person-group> (<year>2019</year>). <article-title>Brian 2, an intuitive and efficient neural simulator</article-title>. <source>eLife</source> <volume>8</volume>, <fpage>e47314</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.47314.028</pub-id><pub-id pub-id-type="pmid">31429824</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van Hartevelt</surname> <given-names>T. J.</given-names></name> <name><surname>Cabral</surname> <given-names>J.</given-names></name> <name><surname>Deco</surname> <given-names>G.</given-names></name> <name><surname>M&#x000F8;ller</surname> <given-names>A.</given-names></name> <name><surname>Green</surname> <given-names>A. L.</given-names></name> <name><surname>Aziz</surname> <given-names>T. Z.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Neural plasticity in human brain connectivity: the effects of long term deep brain stimulation of the subthalamic nucleus in Parkinson&#x00027;s disease</article-title>. <source>PLoS ONE</source> <volume>9</volume>, <fpage>e86496</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0086496</pub-id><pub-id pub-id-type="pmid">24466120</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vanni</surname> <given-names>S.</given-names></name> <name><surname>Sharifian</surname> <given-names>F.</given-names></name> <name><surname>Heikkinen</surname> <given-names>H.</given-names></name> <name><surname>Vig&#x000E1;rio</surname> <given-names>R.</given-names></name></person-group> (<year>2015</year>). <article-title>Modeling fMRI signals can provide insights into neural processing in the cerebral cortex</article-title>. <source>J. Neurophysiol.</source> <volume>114</volume>, <fpage>768</fpage>&#x02013;<lpage>780</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00332.2014</pub-id><pub-id pub-id-type="pmid">25972586</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vitay</surname> <given-names>J.</given-names></name> <name><surname>Dinkelbach</surname> <given-names>H. &#x000DC;.</given-names></name> <name><surname>Hamker</surname> <given-names>F. H.</given-names></name></person-group> (<year>2015</year>). <article-title>ANNarchy: a code generation approach to neural simulations on parallel hardware</article-title>. <source>Front. Neuroinform.</source> <volume>9</volume>, <fpage>19</fpage>. <pub-id pub-id-type="doi">10.3389/fninf.2015.00019</pub-id><pub-id pub-id-type="pmid">26283957</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Welvaert</surname> <given-names>M.</given-names></name> <name><surname>Durnez</surname> <given-names>J.</given-names></name> <name><surname>Moerkerke</surname> <given-names>B.</given-names></name> <name><surname>Berdoolaege</surname> <given-names>G.</given-names></name> <name><surname>Rosseel</surname> <given-names>Y.</given-names></name></person-group> (<year>2011</year>). <article-title>neurosim: an r package for generating fMRI data</article-title>. <source>J. Stat. Softw.</source> <volume>44</volume>, <fpage>1</fpage>&#x02013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.18637/jss.v044.i10</pub-id></citation>
</ref>
</ref-list> 
</back>
</article>