<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Comput. Neurosci.</journal-id>
<journal-title>Frontiers in Computational Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Comput. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5188</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fncom.2018.00009</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Self-Consistent Scheme for Spike-Train Power Spectra in Heterogeneous Sparse Networks</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Pena</surname> <given-names>Rodrigo F. O.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/149523/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Vellmer</surname> <given-names>Sebastian</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/497517/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Bernardi</surname> <given-names>Davide</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/496724/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Roque</surname> <given-names>Antonio C.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/7532/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Lindner</surname> <given-names>Benjamin</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/8238/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Laborat&#x000F3;rio de Sistemas Neurais, Department of Physics, School of Philosophy, Sciences and Letters of Ribeir&#x000E3;o Preto, University of S&#x000E3;o Paulo</institution>, <addr-line>S&#x000E3;o Paulo</addr-line>, <country>Brazil</country></aff>
<aff id="aff2"><sup>2</sup><institution>Theory of Complex Systems and Neurophysics, Bernstein Center for Computational Neuroscience</institution>, <addr-line>Berlin</addr-line>, <country>Germany</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Physics, Humboldt Universit&#x000E4;t zu Berlin</institution>, <addr-line>Berlin</addr-line>, <country>Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Markus Diesmann, Forschungszentrum J&#x000FC;lich, Germany</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Maurizio Mattia, Istituto Superiore di Sanit&#x000E0;, Italy; Alex Roxin, Centre de Recerca Matem&#x000E0;tica, Spain</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Rodrigo F. O. Pena <email>rfdop&#x00040;uol.com.br</email></p></fn>
<fn fn-type="other" id="fn002"><p>&#x02020;These authors have contributed equally to this work.</p></fn></author-notes>
<pub-date pub-type="epub">
<day>02</day>
<month>03</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>12</volume>
<elocation-id>9</elocation-id>
<history>
<date date-type="received">
<day>29</day>
<month>09</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>07</day>
<month>02</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2018 Pena, Vellmer, Bernardi, Roque and Lindner.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Pena, Vellmer, Bernardi, Roque and Lindner</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>Recurrent networks of spiking neurons can be in an asynchronous state characterized by low or absent cross-correlations and spike statistics which resemble those of cortical neurons. Although spatial correlations are negligible in this state, neurons can show pronounced temporal correlations in their spike trains that can be quantified by the autocorrelation function or the spike-train power spectrum. Depending on cellular and network parameters, correlations display diverse patterns (ranging from simple refractory-period effects and stochastic oscillations to slow fluctuations) and it is generally not well-understood how these dependencies come about. Previous work has explored how the single-cell correlations in a homogeneous network (excitatory and inhibitory integrate-and-fire neurons with nearly balanced mean recurrent input) can be determined numerically from an iterative single-neuron simulation. Such a scheme is based on the fact that every neuron is driven by the network noise (i.e., the input currents from all its presynaptic partners) but also contributes to the network noise, leading to a self-consistency condition for the input and output spectra. Here we first extend this scheme to homogeneous networks with strong recurrent inhibition and a synaptic filter, in which instabilities of the previous scheme are avoided by an averaging procedure. We then extend the scheme to heterogeneous networks in which (i) different neural subpopulations (e.g., excitatory and inhibitory neurons) have different cellular or connectivity parameters; (ii) the number and strength of the input connections are random (Erd&#x00151;s-R&#x000E9;nyi topology) and thus different among neurons. In all heterogeneous cases, neurons are lumped in different classes each of which is represented by a single neuron in the iterative scheme; in addition, we make a Gaussian approximation of the input current to the neuron. These approximations seem to be justified over a broad range of parameters as indicated by comparison with simulation results of large recurrent networks. Our method can help to elucidate how network heterogeneity shapes the asynchronous state in recurrent neural networks.</p></abstract>
<kwd-group>
<kwd>complex networks</kwd>
<kwd>stochastic models</kwd>
<kwd>neural noise</kwd>
<kwd>recurrent neural networks</kwd>
<kwd>neural dynamics</kwd>
<kwd>spike-train statistics</kwd>
<kwd>spike-train power spectrum</kwd>
</kwd-group>
<contract-num rid="cn001">2015/50122-0</contract-num>
<contract-num rid="cn001">2013/07699-0</contract-num>
<contract-num rid="cn001">2013/25667-8</contract-num>
<contract-num rid="cn002">IRTG 1740</contract-num>
<contract-num rid="cn002">GRK 1589/2</contract-num>
<contract-num rid="cn003">01GQ1001A</contract-num>
<contract-num rid="cn004">306251/2014-0</contract-num>
<contract-sponsor id="cn001">Funda&#x000E7;&#x000E3;o de Amparo &#x000E0; Pesquisa do Estado de S&#x000E3;o Paulo<named-content content-type="fundref-id">10.13039/501100001807</named-content></contract-sponsor>
<contract-sponsor id="cn002">Deutsche Forschungsgemeinschaft<named-content content-type="fundref-id">10.13039/501100001659</named-content></contract-sponsor>
<contract-sponsor id="cn003">Bundesministerium f&#x000FC;r Bildung und Forschung<named-content content-type="fundref-id">10.13039/501100002347</named-content></contract-sponsor>
<contract-sponsor id="cn004">Conselho Nacional de Desenvolvimento Cient&#x000ED;fico e Tecnol&#x000F3;gico<named-content content-type="fundref-id">10.13039/501100003593</named-content></contract-sponsor>
<counts>
<fig-count count="13"/>
<table-count count="1"/>
<equation-count count="19"/>
<ref-count count="82"/>
<page-count count="19"/>
<word-count count="12799"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>The autonomous dynamics of recurrent networks of spiking neurons is an important topic in computational neuroscience. Networks of randomly connected excitatory and inhibitory integrate-and-fire (IF) neurons are often used in the study of this problem, because this model is computationally efficient for numerical simulations and even sometimes permits analytical insights (see e.g., Abbott and van Vreeswijk, <xref ref-type="bibr" rid="B1">1993</xref>; Brunel, <xref ref-type="bibr" rid="B7">2000</xref>; Lindner et al., <xref ref-type="bibr" rid="B42">2005</xref>; Richardson, <xref ref-type="bibr" rid="B59">2009</xref>; Deger et al., <xref ref-type="bibr" rid="B11">2014</xref>). Exploring the possible spike statistics in such network models may help us to further our understanding of healthy and pathological neural activity in different brain areas and brain states. Moreover, understanding the autonomous (i.e., spontaneous) activity is also a necessary prerequisite for the comprehension of the network response to external signals and signal transmission and processing capabilities of the network in general.</p>
<p>Recurrent networks of IF neurons can already show a rich repertoire of activity states (Brunel, <xref ref-type="bibr" rid="B7">2000</xref>) shaped by pronounced synchronization and by oscillations on which many computational studies have focused (see e.g., van Vreeswijk et al., <xref ref-type="bibr" rid="B78">1994</xref>; Hopfield and Herz, <xref ref-type="bibr" rid="B32">1995</xref>; Ermentrout et al., <xref ref-type="bibr" rid="B20">2001</xref>; Timme et al., <xref ref-type="bibr" rid="B73">2006</xref>; Ladenbauer et al., <xref ref-type="bibr" rid="B39">2012</xref>). One state that lacks obvious collective effects but still can show a statistically rich behavior is the asynchronous state with low or absent cross-correlations among neurons. This state is found in many network models (van Vreeswijk and Sompolinsky, <xref ref-type="bibr" rid="B79">1996</xref>; Brunel, <xref ref-type="bibr" rid="B7">2000</xref>; Renart et al., <xref ref-type="bibr" rid="B57">2010</xref>; Helias et al., <xref ref-type="bibr" rid="B31">2014</xref>) and also in experimental recordings in different brain areas in the awake and attentive animal (Poulet and Petersen, <xref ref-type="bibr" rid="B56">2008</xref>; Harris and Thiele, <xref ref-type="bibr" rid="B29">2011</xref>).</p>
<p>Although it is frequently assumed in theoretical studies, approximating the asynchronous activity as Poisson spiking with a total lack of temporal correlations is generally not justified. Despite the characteristic absence or weakness of <italic>spatial</italic> correlations among neurons, neural spike trains in the asynchronous state can still show a pronounced <italic>temporal</italic> correlation: experiments have revealed non-flat (i.e., non-Poissonian) spike-train power spectra exhibiting reduced power at low frequency (Edwards et al., <xref ref-type="bibr" rid="B17">1993</xref>; Bair et al., <xref ref-type="bibr" rid="B4">1994</xref>), peaks attained at frequencies close to the firing rate and multiples (Pesaran et al., <xref ref-type="bibr" rid="B55">2002</xref>) or increased power at low frequencies indicating slow fluctuations or bursting (Bair et al., <xref ref-type="bibr" rid="B4">1994</xref>). Some of these features (but also additional ones) have been found for spike-train power spectra from neurons in the sensory periphery (Neiman and Russell, <xref ref-type="bibr" rid="B50">2011</xref>; Grewe et al., <xref ref-type="bibr" rid="B26">2017</xref>) that lack synaptic input from other neurons but are subject to channel noise and other signal-unrelated fluctuations. Theoretically, some (but not all) of these spectral shapes can be already understood if we consider simple stochastic models, e.g., a Poisson process with refractory period (Bair et al., <xref ref-type="bibr" rid="B4">1994</xref>; Jarvis and Mitra, <xref ref-type="bibr" rid="B35">2001</xref>) or, more elaborate, integrate-and-fire models driven by white (Lindner et al., <xref ref-type="bibr" rid="B43">2002</xref>; Richardson, <xref ref-type="bibr" rid="B58">2008</xref>; Vilela and Lindner, <xref ref-type="bibr" rid="B81">2009b</xref>) or colored noise (Middleton et al., <xref ref-type="bibr" rid="B49">2003</xref>; Bauermeister et al., <xref ref-type="bibr" rid="B5">2013</xref>; Droste and Lindner, <xref ref-type="bibr" rid="B15">2017</xref>).</p>
<p>Interestingly, even if completely deterministic neuron models are connected in a random network, corresponding observations of random spiking can be made: the total chaotic input from the network impinging on the single cell acts as an effectively stochastic drive and the resulting spike-train power spectra exhibit in many cases a non-trivial (in particular, non-flat, i.e., non-Poissonian) shape. Depending on cellular parameters as the reset value after spiking (Dummer et al., <xref ref-type="bibr" rid="B16">2014</xref>) or on the strength of synaptic coupling (Ostojic, <xref ref-type="bibr" rid="B53">2014</xref>; Wieland et al., <xref ref-type="bibr" rid="B82">2015</xref>), the spectrum can change drastically (e.g., from strongly peaked spectra to low-frequency dominated spectra with a 1/<italic>f</italic><sup>&#x003B1;</sup> form). How spike-train power spectra depend on system parameters in a recurrent network is generally poorly understood [for some effects of presynaptic refractoriness, slow presynaptic rate changes, and short-term synaptic plasticity, see (Schwalger et al., <xref ref-type="bibr" rid="B65">2015</xref>), for effects of the postsynaptic refractory period, see (Bair et al., <xref ref-type="bibr" rid="B4">1994</xref>; Franklin and Bair, <xref ref-type="bibr" rid="B22">1995</xref>)]. Some progress has been achieved though for a related but distinct statistics at a higher modeling level, namely, the power spectrum of the population activity, for which different approximations and numerical schemes have been put forward (Knight, <xref ref-type="bibr" rid="B37">1972</xref>; Brunel and Hakim, <xref ref-type="bibr" rid="B8">1999</xref>; Spiridon and Gerstner, <xref ref-type="bibr" rid="B72">1999</xref>; Mattia and Giudice, <xref ref-type="bibr" rid="B47">2002</xref>; Lindner et al., <xref ref-type="bibr" rid="B42">2005</xref>; Trousdale et al., <xref ref-type="bibr" rid="B76">2012</xref>; Deger et al., <xref ref-type="bibr" rid="B11">2014</xref>; Schwalger et al., <xref ref-type="bibr" rid="B64">2017</xref>). In our paper we focus exclusively on single spike-train power spectra.</p>
<p>According to early work by Mari (<xref ref-type="bibr" rid="B45">2000</xref>) and, particularly, by Lerchner et al. (<xref ref-type="bibr" rid="B40">2006</xref>), a strong theoretical argument against the white-noise approximation is the self-consistency of the fluctuation statistics. If we think of a homogeneous network of statistically equivalent neurons (identical neural parameters and a fixed number of input connections as in the popular Brunel network; Brunel, <xref ref-type="bibr" rid="B7">2000</xref>), the output statistics of a cell should be related to the input statistics because in the network every driven cell is also a driving cell. In the simple case of current-pulse-coupled IF neurons without a synaptic filter (homogeneous Brunel network), the power spectrum of the input current should be proportional to the power spectrum of the spike train generated by the neuron. As the output power spectrum of a white-noise driven IF neuron is generally not flat (Poisson-like) (Lindner et al., <xref ref-type="bibr" rid="B43">2002</xref>; Vilela and Lindner, <xref ref-type="bibr" rid="B80">2009a</xref>) and, contrary to some claims in the literature, summing many presynaptic spike trains does not remove the temporal correlations of the single process (Lindner, <xref ref-type="bibr" rid="B41">2006</xref>), the flat white-noise spectrum cannot be a self-consistent solution for the network neuron, unless all neurons are poised deep in the subthreshold fluctuation-driven regime of very rare firing (rates are smaller than 1Hz).</p>
<p>The self-consistency of the temporal correlations of input and output in random networks is not an entirely new idea: in statistical physics it has been used to derive correlation functions of disordered spin systems (Sompolinsky and Zippelius, <xref ref-type="bibr" rid="B70">1982</xref>; Eissfeller and Opper, <xref ref-type="bibr" rid="B18">1992</xref>); in neuroscience, it was applied to random networks of coupled rate units by Sompolinsky et al. (<xref ref-type="bibr" rid="B69">1988</xref>) (for various recent extensions, see Aljadeff et al., <xref ref-type="bibr" rid="B2">2015</xref>; Kadmon and Sompolinsky, <xref ref-type="bibr" rid="B36">2015</xref>; Mastrogiuseppe and Ostojic, <xref ref-type="bibr" rid="B46">2017</xref>). Generally, the self-consistency condition of the asynchronous state can be employed to determine correlation functions or power spectra without actually simulating the network but by simulating a single element iteratively. If we make a Gaussian approximation for the incoming stream of input spikes, we may ask how correlated (&#x0201C;colored&#x0201D;) this Gaussian noise has to be to evoke a neural spike train with a temporal correlation proportional to that of the driving noise; equivalently, we can ask about the proportionality of power spectra. This idea can be translated into an iterative scheme that finds this solution numerically (if it exists). Such a scheme has first been developed for a spin system (Eissfeller and Opper, <xref ref-type="bibr" rid="B18">1992</xref>); in the neural context it works essentially as follows (Lerchner et al., <xref ref-type="bibr" rid="B40">2006</xref>; Dummer et al., <xref ref-type="bibr" rid="B16">2014</xref>): A single neuron is driven by a Gaussian noise, the output spike train is recorded, its power spectrum is estimated and serves to generate a new Gaussian noise to again stimulate the neuron in the next generation (step in the iterative scheme). Repeating this procedure over a few generations only, for a network with (nearly) balanced recurrent input and moderate synaptic amplitudes, yields an excellent quantitative agreement with the single-cell statistics of a neuron in a large network (Dummer et al., <xref ref-type="bibr" rid="B16">2014</xref>) (Lerchner et al., <xref ref-type="bibr" rid="B40">2006</xref> used the equivalent correlation function). The simplest version of the procedure fails in the case of strong inhibition and is naturally restricted to homogeneous networks, in which all neurons (excitatory and inhibitory ones) share the same cellular and presynaptic connection parameters. Cortical neural networks are strongly heterogeneous (Meunier et al., <xref ref-type="bibr" rid="B48">2010</xref>; Tomov et al., <xref ref-type="bibr" rid="B75">2014</xref>; Harrison et al., <xref ref-type="bibr" rid="B30">2015</xref>) and, hence, an extension of the method to cases in which neural and connection parameters vary across the network is desirable.</p>
<p>The purpose of the present study is to extend the iterative scheme in several directions. First, we develop a simple method to deal with the instability of the iterative scheme at strong recurrent inhibition, which makes the scheme applicable to a much broader range of network parameters. Secondly, as sketched in Figure <xref ref-type="fig" rid="F1">1</xref>, we study a heterogeneous network, in which excitatory and inhibitory neurons have different parameters (either cellular or with respect to their connectivity) or we consider even several (more than two) populations, which differ in their parameters. As indicated in Figure <xref ref-type="fig" rid="F1">1</xref>, every population is then represented by a single cell in the iterative scheme, and the input statistics to each cell in a certain generation will be determined from all output spectra of the previous generation.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Heterogenous network of excitatory and inhibitory neurons differing in intrinsic parameters. Sketch of the network <bold>(left)</bold> and the corresponding iterative scheme where a single neuron is simulated to represent one population <bold>(right)</bold>. The input of a neuron in the next generation is composed of all power spectra from the previous generations. The power spectrum of each population converges after the nth generation.</p></caption>
<graphic xlink:href="fncom-12-00009-g0001.tif"/>
</fig>
<p>The third extension, illustrated in Figure <xref ref-type="fig" rid="F2">2</xref> concerns the number and strength of synaptic input connections that is in reality certainly not constant and fixed, respectively, as in the Brunel network studied with the iterative scheme by Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>). Just choosing a simple Erd&#x00151;s-R&#x000E9;nyi topology, yields a broad distribution of firing rates and this kind of heterogeneity can be captured in the iterative scheme as well if we simulate a sufficient number of representative neurons, i.e., a sample of the network neurons (cf. Figure <xref ref-type="fig" rid="F2">2</xref>).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Heterogeneous network with distributed numbers and strengths of synaptic connections (Erd&#x00151;s-R&#x000E9;nyi) where the number of presynaptic neurons and the synaptic weights follow a distribution <bold>(left)</bold> and the corresponding iterative scheme where few neurons represent the distributions <bold>(right)</bold>. For each neuron in each generation these parameters are drawn from a distribution and the input is composed randomly from all power spectra from the previous generation. The average power spectrum over all neurons converges after the nth generation.</p></caption>
<graphic xlink:href="fncom-12-00009-g0002.tif"/>
</fig>
<p>Our motivation for all these extensions of the method is twofold. For once, in cases in which the single-neuron correlation statistics is of interest, e.g., for the emergence of slow fluctuations in recurrent networks (Litwin-Kumar and Doiron, <xref ref-type="bibr" rid="B44">2012</xref>; Ostojic, <xref ref-type="bibr" rid="B53">2014</xref>; Wieland et al., <xref ref-type="bibr" rid="B82">2015</xref>), our extended scheme provides a numerically efficient method that does not require large-network simulations. Hence, if the temporal correlation statistics of the asynchronous state is studied, our results permit to explore the role of network heterogeneity in shaping those correlations. The second purpose of our study is to trigger interest in the self-consistent description of the Gaussian colored noise generated by recurrent spiking networks. Showing that the numerical scheme works in a physiologically relevant parameter regime can also be regarded as a demonstration of the colored-Gaussian-noise approximation&#x00027;s validity and may encourage looking for an analytical description of the network noise via Markovian embedding (Schwalger et al., <xref ref-type="bibr" rid="B65">2015</xref>).</p>
<p>Our paper is organized as follows. Section 2 presents the neuron and network models, introduces important spike-train statistics, shows how to stabilize the iterative procedure such that it works also for strong recurrent inhibition and how to incorporate a synaptic filter, and extends the scheme to the different heterogeneous cases. In section 3, we consider first the fluctuation statistics of the spike trains in the so-called &#x0201C;heterogeneous asynchronous state&#x0201D; of a homogeneous network with strong recurrent inhibition (Ostojic, <xref ref-type="bibr" rid="B53">2014</xref>). Here we demonstrate that slow fluctuations emerge due to their preferred amplification by the network. We review briefly the effect of a synaptic filter and then turn to the different heterogeneous cases. All power spectra found with the iterative scheme are compared to numerical simulations of large and sparse networks. We conclude with a brief discussion of our findings.</p>
</sec>
<sec sec-type="methods" id="s2">
<title>2. Methods</title>
<sec>
<title>2.1. Neuron model and spike-train statistics</title>
<p>A single neuron is described by the standard leaky integrate-and-fire neuron model (Gerstner et al., <xref ref-type="bibr" rid="B23">2014</xref>). The membrane voltage <italic>v</italic> evolves according to:</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>m</mml:mi></mml:msub><mml:mover accent='true'><mml:mi>v</mml:mi><mml:mo>&#x002D9;</mml:mo></mml:mover><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x02212;</mml:mo><mml:mi>v</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mi>R</mml:mi><mml:mi>I</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>When <italic>v</italic>(<italic>t</italic>) &#x0003E; <italic>v</italic><sub><italic>th</italic></sub>, a spike is emitted and, after a refractory period of &#x003C4;<sub><italic>R</italic></sub> &#x0003D; 2 ms, the voltage is reset to <italic>v</italic>(<italic>t</italic>) &#x0003D; <italic>v</italic><sub><italic>r</italic></sub>. The parameter &#x003C4;<sub><italic>m</italic></sub> in Equation (1) is the membrane time constant, which may be different depending on whether the neuron belongs to the excitatory or the inhibitory population. The input current (scaled by the membrane resistance <italic>R</italic>), is denoted by <italic>RI</italic>.</p>
<p>The statistics inspected in this work are based on spike-trains, which are defined as sums of Delta functions</p>
<disp-formula id="E2"><label>(2)</label><mml:math id="M2"><mml:mrow><mml:mi>x</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mstyle displaystyle='true'><mml:munder><mml:mo>&#x02211;</mml:mo><mml:mi>i</mml:mi></mml:munder><mml:mi>&#x003B4;</mml:mi></mml:mstyle><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>t</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where <italic>t</italic><sub><italic>i</italic></sub> is the time instant of the <italic>i</italic>th spike. The instantaneous firing rate &#x003BD; is the (generally time-dependent) average of the spike train, &#x003BD; &#x0003D; &#x02329;<italic>x</italic>(<italic>t</italic>)&#x0232A;, and can be determined for a specific neuron within the network by an average over different runs with randomized initial conditions. We are only interested in the asynchronous state, in which &#x003BD; does not depend on time. In practice, we often average the rate over the population (if appropriate, i.e., if the neurons are statistically equivalent) which is indicated by &#x02329;.&#x0232A; (ensemble average) and over time:</p>
<disp-formula id="E3"><label>(3)</label><mml:math id="M3"><mml:mrow><mml:mi>&#x003BD;</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mn>1</mml:mn><mml:mi>T</mml:mi></mml:mfrac><mml:mstyle displaystyle='true'><mml:mrow><mml:munderover><mml:mo>&#x0222B;</mml:mo><mml:mn>0</mml:mn><mml:mi>T</mml:mi></mml:munderover><mml:mrow><mml:mi>x</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mrow></mml:mstyle><mml:mtext>&#x000A0;</mml:mtext><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>For the calculation of spectral measures, we define the Fourier transform by</p>
<disp-formula id="E4"><label>(4)</label><mml:math id="M4"><mml:mrow><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mstyle displaystyle='true'><mml:mrow><mml:msubsup><mml:mo>&#x0222B;</mml:mo><mml:mn>0</mml:mn><mml:mi>T</mml:mi></mml:msubsup><mml:mi>d</mml:mi></mml:mrow></mml:mstyle><mml:mi>t</mml:mi><mml:msup><mml:mi>e</mml:mi><mml:mrow><mml:mn>2</mml:mn><mml:mi>&#x003C0;</mml:mi><mml:mi>i</mml:mi><mml:mi>f</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msup><mml:mi>x</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where <italic>T</italic> is our time window and is set in our simulations to <italic>T</italic> &#x0003D; 2 s if not mentioned otherwise. In all simulations we neglect a transient period of 1 s before extracting the statistics over the next <italic>T</italic> &#x0003D; 2 s. The power spectrum of a spike train is then defined by</p>
<disp-formula id="E5"><label>(5)</label><mml:math id="M5"><mml:mrow><mml:msub><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:mrow><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:msup><mml:mover accent='true'><mml:mi>x</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mo>&#x0002A;</mml:mo></mml:msup></mml:mrow><mml:mo>&#x0232A;</mml:mo></mml:mrow></mml:mrow><mml:mi>T</mml:mi></mml:mfrac><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M6"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mo>&#x0002A;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> is the complex conjugate of <inline-formula><mml:math id="M7"><mml:mover accent="true"><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover></mml:math></inline-formula>. We note that the power spectrum saturates for infinite frequency at the firing rate, <inline-formula><mml:math id="M8"><mml:mrow><mml:munder><mml:mrow><mml:mi>lim</mml:mi></mml:mrow><mml:mrow><mml:mi>f</mml:mi><mml:mo>&#x02192;</mml:mo><mml:mi>&#x0221E;</mml:mi></mml:mrow></mml:munder><mml:msub><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mi>&#x003BD;</mml:mi></mml:mrow></mml:math></inline-formula>.</p>
<p>Two important statistical measures can be extracted from the power spectrum. The first is the Fano factor <italic>FF</italic> which is defined as the variance of the spike count <inline-formula><mml:math id="M9"><mml:mrow><mml:mi>N</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:msubsup><mml:mo>&#x0222B;</mml:mo><mml:mn>0</mml:mn><mml:mi>T</mml:mi></mml:msubsup><mml:mi>d</mml:mi></mml:mrow><mml:mi>t</mml:mi><mml:mi>x</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></inline-formula> over its mean, an expression that can be related to the power spectrum at zero frequency:</p>
<disp-formula id="E6"><label>(6)</label><mml:math id="M10"><mml:mrow><mml:mi>F</mml:mi><mml:mi>F</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:mrow><mml:mi>&#x00394;</mml:mi><mml:msup><mml:mi>N</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:mrow><mml:mo>&#x0232A;</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:mi>N</mml:mi><mml:mo>&#x0232A;</mml:mo></mml:mrow></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:msub><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo>&#x02192;</mml:mo><mml:mn>0</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mfrac><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>The second statistical measure is the correlation time &#x003C4;<sub><italic>c</italic></sub>. Following Neiman et al. (<xref ref-type="bibr" rid="B51">2007</xref>) and Wieland et al. (<xref ref-type="bibr" rid="B82">2015</xref>), we consider the spike train&#x00027;s correlation function <italic>c</italic>(&#x003C4;) &#x0003D; &#x02329;<italic>x</italic>(<italic>t</italic>)<italic>x</italic>(<italic>t</italic> &#x0002B; &#x003C4;)&#x0232A;&#x02212;&#x02329;<italic>x</italic>(<italic>t</italic>)&#x0232A;&#x02329;<italic>x</italic>(<italic>t</italic> &#x0002B; &#x003C4;)&#x0232A; (note that here &#x02329;.&#x0232A; indicates a time average) and its continuous part &#x00109;(&#x003C4;) &#x0003D; <italic>c</italic>(&#x003C4;)&#x02212;&#x003BD;&#x003B4;(&#x003C4;) to define the correlation time as an integral over the squared and normalized &#x00109;(&#x003C4;)</p>
<disp-formula id="E7"><label>(7)</label><mml:math id="M11"><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>c</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:mrow><mml:munderover><mml:mo>&#x0222B;</mml:mo><mml:mrow><mml:mo>&#x02212;</mml:mo><mml:mi>&#x0221E;</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x0002B;</mml:mo><mml:mi>&#x0221E;</mml:mi></mml:mrow></mml:munderover><mml:mrow><mml:mi>d</mml:mi><mml:mi>&#x003C4;</mml:mi><mml:msup><mml:mrow><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mfrac><mml:mrow><mml:mover accent='true'><mml:mi>c</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003C4;</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mrow><mml:mover accent='true'><mml:mi>c</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mn>0</mml:mn><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mfrac></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:mrow></mml:mstyle><mml:mo>=</mml:mo><mml:mstyle displaystyle='true'><mml:mrow><mml:munderover><mml:mo>&#x0222B;</mml:mo><mml:mrow><mml:mo>&#x02212;</mml:mo><mml:mi>&#x0221E;</mml:mi></mml:mrow><mml:mrow><mml:mo>&#x0002B;</mml:mo><mml:mi>&#x0221E;</mml:mi></mml:mrow></mml:munderover><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi><mml:mfrac><mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:msub><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x02212;</mml:mo><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow><mml:mrow><mml:msup><mml:mi>&#x003BD;</mml:mi><mml:mn>4</mml:mn></mml:msup></mml:mrow></mml:mfrac></mml:mrow></mml:mrow></mml:mstyle><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>an integral which in turn can be related to an integral over the power spectrum via the Parseval theorem on the right side.</p>
</sec>
<sec>
<title>2.2. Network model</title>
<p>Different network compositions are studied, many of which are based on the work of Brunel (<xref ref-type="bibr" rid="B7">2000</xref>), specifically on his Model B, a heterogeneous random network with fixed in-degree. In contrast to Brunel (<xref ref-type="bibr" rid="B7">2000</xref>), we use a larger number of neurons, i.e., an excitatory population size <inline-formula><mml:math id="M12"><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:msup><mml:mrow><mml:mn>0</mml:mn></mml:mrow><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula> instead of <inline-formula><mml:math id="M13"><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:msup><mml:mrow><mml:mn>0</mml:mn></mml:mrow><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>. Independently of the number of populations, there is always a mixture of excitatory to inhibitory neurons with a ratio of 4:1, i.e., <italic>N</italic><sub><italic>I</italic></sub> &#x0003D; &#x003B3;<italic>N</italic><sub><italic>E</italic></sub> where &#x003B3; &#x0003D; 0.25. Therefore, the total network size is <italic>N</italic> &#x0003D; <italic>N</italic><sub><italic>E</italic></sub> &#x0002B; <italic>N</italic><sub><italic>I</italic></sub>.</p>
<p>The &#x02113;th neuron from the network has the dynamics</p>
<disp-formula id="E8"><label>(8)</label><mml:math id="M14"><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mover><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>&#x02113;</mml:mi></mml:msub></mml:mrow><mml:mo>.</mml:mo></mml:mover><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>&#x02113;</mml:mi></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mi>R</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>l</mml:mi><mml:mi>o</mml:mi><mml:mi>c</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x02113;</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>The external input current to each neuron and its membrane time constant depend on the population it belongs to which is here indicated by index &#x003B1;. The &#x02113;th neuron receives a fixed number of <inline-formula><mml:math id="M15"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02113;</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> (<inline-formula><mml:math id="M16"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02113;</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula>) excitatory (inhibitory) randomly selected neurons connections from population &#x003B1; &#x0003D; {<italic>E, I</italic>}. The local input is described by:</p>
<disp-formula id="E9"><label>(9)</label><mml:math id="M17"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mi>R</mml:mi><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>l</mml:mi><mml:mi>o</mml:mi><mml:mi>c</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x02113;</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>k</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>&#x02113;</mml:mi><mml:mi>E</mml:mi></mml:msubsup></mml:mrow></mml:munderover><mml:mrow><mml:msub><mml:mi>J</mml:mi><mml:mrow><mml:mi>&#x02113;</mml:mi><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>&#x02113;</mml:mi><mml:mo>,</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub></mml:mrow></mml:mstyle><mml:msub><mml:mi>x</mml:mi><mml:mrow><mml:msub><mml:mi>m</mml:mi><mml:mrow><mml:mi>&#x02113;</mml:mi><mml:mo>,</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x02212;</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>D</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mrow><mml:mrow><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>g</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>&#x02113;</mml:mi><mml:mi>I</mml:mi></mml:msubsup></mml:mrow></mml:munderover><mml:mrow><mml:msub><mml:mi>J</mml:mi><mml:mrow><mml:mi>&#x02113;</mml:mi><mml:msub><mml:mi>n</mml:mi><mml:mrow><mml:mi>&#x02113;</mml:mi><mml:mo>,</mml:mo><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub></mml:mrow></mml:mstyle><mml:msub><mml:mi>x</mml:mi><mml:mrow><mml:msub><mml:mi>n</mml:mi><mml:mrow><mml:mi>&#x02113;</mml:mi><mml:mo>,</mml:mo><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mo>&#x02212;</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>D</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>&#x02217;</mml:mo><mml:mi>K</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>,</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>g</italic><sub>&#x003B1;</sub> is the ratio between average inhibitory and average excitatory synaptic weights, which depends via &#x003B1; on the target neuron (&#x003B1; &#x02208; <italic>E, I</italic>) The number of presynaptic neurons <inline-formula><mml:math id="M18"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02113;</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi><mml:mo>,</mml:mo><mml:mi>I</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> will be constant in some cases (fixed in-degree, in sections 2.3 and 2.4 as well as from 3.1 to 3.3) and random in others (as a consequence of a Erd&#x00151;s-R&#x000E9;nyi topology in sections 2.5 and 3.4). The excitatory (inhibitory) input neurons are picked randomly from the network and the set of the neuron indexes is denoted by <italic>m</italic><sub>&#x02113;,<italic>k</italic></sub> and <italic>n</italic><sub>&#x02113;,<italic>i</italic></sub>. The synaptic coupling strength (also called synaptic weight or synaptic efficacy) will be either constant, <italic>J</italic><sub>&#x02113;<italic>j</italic></sub> &#x0003D; <italic>J</italic>, (in sections 2.3&#x02013;3.4) or exponentially distributed with mean value &#x02329;<italic>J</italic><sub>&#x02113;<italic>j</italic></sub>&#x0232A; &#x0003D; <italic>J</italic> (in section 3.4). We fix the transmission delay at &#x003C4;<sub><italic>D</italic></sub> &#x0003D; 1.5 ms unless otherwise indicated, and <italic>K</italic>(<italic>t</italic>) is a an optional synaptic filter. In most cases, the filter is not used, which means <italic>K</italic>(<italic>t</italic>) &#x0003D; &#x003B4;(<italic>t</italic>). Otherwise, it is a simple exponential filter:</p>
<disp-formula id="E10"><label>(10)</label><mml:math id="M19"><mml:mrow><mml:mi>K</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mi>&#x003B8;</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mfrac><mml:mrow><mml:mi>exp</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mo>&#x02212;</mml:mo><mml:mi>t</mml:mi><mml:mo>/</mml:mo><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>s</mml:mi></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>s</mml:mi></mml:msub></mml:mrow></mml:mfrac><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where &#x003B8;(<italic>t</italic>) is the Heaviside function and &#x003C4;<sub><italic>s</italic></sub> is the synaptic filter time. Note that in the limit &#x003C4;<sub><italic>s</italic></sub> &#x02192; 0, the case without synaptic filter is recovered. If not explicitly stated otherwise, we use the parameter values that are given in Table <xref ref-type="table" rid="T1">1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Summary of standard parameters for the iterative scheme with different populations.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="center" colspan="3"><bold>PARAMETERS</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left"><bold>Name</bold></td>
<td valign="top" align="center"><bold>Value</bold></td>
<td valign="top" align="left"><bold>Description</bold></td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left" colspan="3" style="background-color:#bbbdc0"><bold>NETWORK CONNECTIVITY PARAMETERS</bold></td>
</tr>
<tr>
<td valign="top" align="left"><italic>N</italic><sub><italic>E</italic></sub></td>
<td valign="top" align="center">10<sup>5</sup></td>
<td valign="top" align="left">Size of excitatory population</td>
</tr>
<tr>
<td valign="top" align="left"><italic>N</italic><sub><italic>I</italic></sub></td>
<td valign="top" align="center">&#x003B3;<italic>N</italic><sub><italic>E</italic></sub></td>
<td valign="top" align="left">Size of inhibitory population where &#x003B3; &#x0003D; 0.25</td>
</tr>
<tr>
<td valign="top" align="left"><italic>C</italic><sup><italic>E</italic></sup></td>
<td valign="top" align="center">1,000</td>
<td valign="top" align="left">Number of excitatory synapses per neuron</td>
</tr>
<tr>
<td valign="top" align="left"><italic>C</italic><sup><italic>I</italic></sup></td>
<td valign="top" align="center">&#x003B3;<italic>C</italic><sup><italic>E</italic></sup></td>
<td valign="top" align="left">Number of inhibitory synapses per neuron</td>
</tr>
<tr>
<td valign="top" align="left" colspan="3" style="background-color:#bbbdc0"><bold>NEURON PARAMETERS</bold></td>
</tr>
<tr>
<td valign="top" align="left"><italic>v</italic><sub><italic>th</italic></sub></td>
<td valign="top" align="center">20 mV</td>
<td valign="top" align="left">Firing threshold</td>
</tr>
<tr>
<td valign="top" align="left"><italic>v</italic><sub><italic>t</italic></sub></td>
<td valign="top" align="center">10 mV</td>
<td valign="top" align="left">Reset potential</td>
</tr>
<tr>
<td valign="top" align="left">&#x003C4;<sub><italic>R</italic></sub></td>
<td valign="top" align="center">2 ms</td>
<td valign="top" align="left">Refractory period</td>
</tr>
<tr>
<td valign="top" align="left"><italic>RI</italic><sub><italic>ext</italic></sub></td>
<td valign="top" align="center">30 mV</td>
<td valign="top" align="left">External input</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec>
<title>2.3. Self-consistent scheme for a homogeneous population&#x02014;stabilization of the scheme for strong recurrent inhibition</title>
<p>The iterative self-consistent scheme developed by Lerchner et al. (<xref ref-type="bibr" rid="B40">2006</xref>) and Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>) is able to reproduce the single-spike-train power spectrum for homogeneous populations close to the balanced regime. In this procedure, in one generation a single neuron is stimulated with a colored noise over many trials, the power spectrum of its spike train is estimated, and using this spectrum and the output firing rate, a new surrogate colored Gaussian noise is generated which is used as the stimulus in the next generation. This procedure is repeated iteratively until the mean value and the spectrum of the driving noise matches in a self-consistent manner approximately the firing rate and the power spectrum of the resulting spike train. We present in detail the heterogeneous iterative self-consistent scheme in section 2.4, for further details of the homogeneous scheme we refer to Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>).</p>
<p>The version of the scheme by Lerchner et al. (<xref ref-type="bibr" rid="B40">2006</xref>) and Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>) is unable to reproduce self-consistently the statistics of single neurons in a recurrent network with strong relative inhibition <italic>g</italic>. More specifically, in cases where the inhibition is high, the scheme loses stability and the measured firing rate &#x003BD; oscillates as a function of the generations (Dummer et al., <xref ref-type="bibr" rid="B16">2014</xref>) (a numerical instability in the balanced case is reported in Lerchner et al., <xref ref-type="bibr" rid="B40">2006</xref>, which is unrelated to the instability at strong recurrent inhibition). As a result, network regimes of low firing rate (such as those seen in cortex) cannot be captured.</p>
<p>Here, we propose a method to ensure convergence even with strong recurrent inhibition. We observed that the firing rate oscillations are around the target firing rate, therefore we can use the average firing rate over all past <italic>n</italic> generations as input to the next generation:</p>
<disp-formula id="E11"><label>(11)</label><mml:math id="M20"><mml:mrow><mml:msub><mml:mover accent='true'><mml:mi>&#x003BD;</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mi>n</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mi>n</mml:mi></mml:mfrac><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>q</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mrow><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mi>q</mml:mi></mml:msub></mml:mrow></mml:mstyle><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>This procedure stabilizes the scheme, see Figure <xref ref-type="fig" rid="F3">3</xref> for a numerical example. Note that averaging over a higher number of past generations can yield a faster convergence (cf. Figures <xref ref-type="fig" rid="F3">3B,C</xref>). The effect can be visualized using a similar approach as in Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>): a map from the input rate to the output rate. We calculate the output rate from the input rate with the approximation for synaptically filtered white noise (Brunel and Sergi, <xref ref-type="bibr" rid="B9">1998</xref>). The effect of the averaging over resulting output rate and input can be captured by the functions &#x003BD;<sub><italic>out</italic>,0</sub> &#x0003D; &#x003BD;<sub><italic>out</italic></sub>(&#x003BD;<sub><italic>in</italic></sub>), <inline-formula><mml:math id="M21"><mml:msub><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mrow><mml:mi>o</mml:mi><mml:mi>u</mml:mi><mml:mi>t</mml:mi><mml:mo>,</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mrow><mml:mi>o</mml:mi><mml:mi>u</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mrow><mml:mi>o</mml:mi><mml:mi>u</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:mfrac></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>,&#x02026;, which are shown in Figure <xref ref-type="fig" rid="F3">3D</xref>. These functions display an increasingly flatter shape in the dependence on the initial firing rate illustrating the stabilizing effect of the averaging.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Stabilization of the iterative scheme by averaging over previous generations (inhibition-dominated regime). Convergence of the firing rate in the iterative scheme (blue line) using different procedures. Parameters are <italic>g</italic> = 5.5, <italic>J</italic> = 0.2 mV, &#x003C4;<sub><italic>s</italic></sub> &#x0003D; 10 ms, &#x003B3; &#x0003D; 0.25, and <italic>RI</italic><sub><italic>ext</italic></sub> &#x0003D; 30 mV. Recurrent network (red line) is firing at &#x003BD; &#x0003D; 9.1 Hz. <bold>(A)</bold> No average is considered, only the previous generation. <bold>(B)</bold> Firing rate is averaged over the past two generations. <bold>(C)</bold> Firing rate is averaged over all past generations. <bold>(D)</bold> Visualization of the averaging procedure: firing rate resulting from <italic>i</italic> iterations of the averaging procedure &#x003BD;<sub><italic>out,i</italic></sub> of a neuron driven by the firing rate &#x003BD;<sub><italic>in</italic></sub> (see text). The function &#x003BD;<sub><italic>out</italic></sub>(&#x003BD;<sub><italic>in</italic></sub>) is approximated using the expression for a LIF neuron driven by synaptically filtered white noise (Brunel and Sergi, <xref ref-type="bibr" rid="B9">1998</xref>). The fixed point &#x003BD;<sub><italic>in</italic></sub> &#x0003D; &#x003BD;<sub><italic>out</italic>, 1</sub> is unstable because |<italic>d&#x003BD;</italic><sub><italic>out</italic></sub>/<italic>d&#x003BD;</italic><sub><italic>in</italic></sub>| &#x0003E; 1 (see Dummer et al., <xref ref-type="bibr" rid="B16">2014</xref>). Few iterations suffice to yield a flat curve indicating a stable fixed point.</p></caption>
<graphic xlink:href="fncom-12-00009-g0003.tif"/>
</fig>
<p>The procedure of averaging the rate over the past generations will be used only in cases of unstable convergence. Typically, if excitation and inhibition are (nearly) balanced, the scheme is stable and we do not need to apply the averaging procedure.</p>
</sec>
<sec>
<title>2.4. The self-consistent scheme for several populations</title>
<p>The self-consistent scheme for a homogeneous population can be generalized in different ways. First of all, real networks consist of several types of neurons, that all differ with respect to their physiological parameters. A first important step is to distinguish between excitatory and inhibitory neurons not solely with respect to their postsynaptic effect but to endow inhibitory neurons also with other cellular parameters (membrane time constant, leak potential, mean input current) than excitatory cells. Generally, we distinguish between <italic>P</italic><sup><italic>E</italic></sup> excitatory and <italic>P</italic><sup><italic>I</italic></sup> inhibitory populations. In the self-consistent scheme each population is represented by one neuron.</p>
<sec>
<title>2.4.1. Determination of the second-order statistics</title>
<p>In the situation considered here, every neuron in the network receives a fixed number of inputs. First of all, the mean recurrent input to a given population &#x003B1; is determined by the firing rates of the presynaptic neurons and by the connection parameters in the network:</p>
<disp-formula id="E12"><label>(12)</label><mml:math id="M22"><mml:mrow><mml:msub><mml:mi>&#x003BC;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mi>J</mml:mi><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mi>k</mml:mi><mml:mrow><mml:msup><mml:mi>P</mml:mi><mml:mi>E</mml:mi></mml:msup></mml:mrow></mml:munderover><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>E</mml:mi></mml:msubsup></mml:mrow></mml:mstyle><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mrow><mml:mi>E</mml:mi><mml:mo>,</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:msub><mml:mo>&#x02212;</mml:mo><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mi>k</mml:mi><mml:mrow><mml:msup><mml:mi>P</mml:mi><mml:mi>I</mml:mi></mml:msup></mml:mrow></mml:munderover><mml:mrow><mml:msub><mml:mi>g</mml:mi><mml:mi>k</mml:mi></mml:msub></mml:mrow></mml:mstyle><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>I</mml:mi></mml:msubsup><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mrow><mml:mi>I</mml:mi><mml:mo>,</mml:mo><mml:mi>k</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where &#x003BD;<sub><italic>E,k</italic></sub> and &#x003BD;<sub><italic>I,k</italic></sub> are the excitatory and inhibitory firing rates determined by the <italic>k</italic>th presynaptic neuron. Furthermore, by writing the effective input in the Fourier domain, we can obtain the power spectrum of the effective input <inline-formula><mml:math id="M23"><mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> to a neuron in the &#x003B1; population given by:</p>
<disp-formula id="E13"><label>(13)</label><mml:math id="M24"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:msub><mml:mover accent='true'><mml:mi>S</mml:mi><mml:mo>&#x000AF;</mml:mo></mml:mover><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:mrow><mml:mi>R</mml:mi><mml:mover accent='true'><mml:mi>I</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:msub><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mi>R</mml:mi><mml:msup><mml:mover accent='true'><mml:mi>I</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mo>&#x0002A;</mml:mo></mml:msup><mml:msub><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mi>&#x003B1;</mml:mi></mml:msub></mml:mrow><mml:mo>&#x0232A;</mml:mo></mml:mrow></mml:mrow><mml:mi>T</mml:mi></mml:mfrac></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:msubsup><mml:mi>&#x003C4;</mml:mi><mml:mi>&#x003B1;</mml:mi><mml:mn>2</mml:mn></mml:msubsup><mml:msup><mml:mi>J</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mi>k</mml:mi><mml:mrow><mml:msup><mml:mi>P</mml:mi><mml:mi>E</mml:mi></mml:msup></mml:mrow></mml:munderover><mml:mo stretchy='false'>&#x0007C;</mml:mo></mml:mstyle><mml:mover accent='true'><mml:mi>K</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:msup><mml:mo stretchy='false'>&#x0007C;</mml:mo><mml:mn>2</mml:mn></mml:msup><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>E</mml:mi></mml:msubsup><mml:msubsup><mml:mi>S</mml:mi><mml:mi>k</mml:mi><mml:mi>E</mml:mi></mml:msubsup><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x0002B;</mml:mo><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mi>l</mml:mi><mml:mrow><mml:msup><mml:mi>P</mml:mi><mml:mi>I</mml:mi></mml:msup></mml:mrow></mml:munderover><mml:mrow><mml:msubsup><mml:mi>g</mml:mi><mml:mi>l</mml:mi><mml:mn>2</mml:mn></mml:msubsup></mml:mrow></mml:mstyle><mml:mo stretchy='false'>&#x0007C;</mml:mo><mml:mover accent='true'><mml:mi>K</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:msup><mml:mo stretchy='false'>&#x0007C;</mml:mo><mml:mn>2</mml:mn></mml:msup><mml:msubsup><mml:mi>C</mml:mi><mml:mi>l</mml:mi><mml:mi>I</mml:mi></mml:msubsup><mml:msubsup><mml:mi>S</mml:mi><mml:mi>l</mml:mi><mml:mi>I</mml:mi></mml:msubsup><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mtext>&#x000A0;&#x000A0;</mml:mtext><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M25"><mml:msubsup><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M26"><mml:msubsup><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> are the spike-train power spectra from the <italic>k</italic>th E and <italic>l</italic>th I-cells that provide synaptic input to the population &#x003B1;, respectively, and <inline-formula><mml:math id="M27"><mml:mover accent="true"><mml:mrow><mml:mi>K</mml:mi></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> is the Fourier transformed synaptic filter in Equation (10). Note that in order to distinguish it from the output spectra, the input spectra to the population &#x003B1; is identified by a bar, i.e., <inline-formula><mml:math id="M28"><mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>. If more than two populations are present, in Equations (12, 13) their contributions are taken into account by the number <italic>P</italic><sup><italic>E</italic></sup> and <italic>P</italic><sup><italic>I</italic></sup> of populations.</p>
</sec>
<sec>
<title>2.4.2. Gaussian approximation of the input</title>
<p>We want to use Equations (12, 13) to create an input with the same first- and second-order statistics. For a large number of presynaptic neurons that are only weakly correlated, this statistics will be approximately Gaussian by virtue of the central limit theorem<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref>. To generate an input to a neuron embedded in the &#x003B1;th population with a prescribed power spectrum, we generate the Fourier transform</p>
<disp-formula id="E14"><label>(14)</label><mml:math id="M29"><mml:mrow><mml:mi>R</mml:mi><mml:msub><mml:mover accent='true'><mml:mi>I</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mrow><mml:mi>G</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:msqrt><mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mover accent='true'><mml:mi>S</mml:mi><mml:mo>&#x000AF;</mml:mo></mml:mover><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn><mml:mi>&#x00394;</mml:mi><mml:mi>f</mml:mi></mml:mrow></mml:mfrac></mml:mrow></mml:msqrt><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:msub><mml:mover accent='true'><mml:mi>&#x003B7;</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mi>r</mml:mi></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mi>i</mml:mi><mml:msub><mml:mover accent='true'><mml:mi>&#x003B7;</mml:mi><mml:mo>&#x002DC;</mml:mo></mml:mover><mml:mi>i</mml:mi></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:math></disp-formula>
<p>of a time-dependent function <italic>RI</italic><sub><italic>G</italic>,&#x003B1;</sub>(<italic>t</italic>) by drawing two independent Gaussian numbers <inline-formula><mml:math id="M30"><mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003B7;</mml:mi></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>r</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula>, <inline-formula><mml:math id="M31"><mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003B7;</mml:mi></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> with unit variance and zero mean in each frequency bin. The frequency resolution is set by the length of the time window, &#x00394;<italic>f</italic> &#x0003D; <italic>T</italic><sup>&#x02212;1</sup>. Finally, we generate the time-dependent current <italic>RI</italic><sub><italic>G</italic>,&#x003B1;</sub>(<italic>t</italic>) by inverse Fourier transformation of <italic>R&#x00128;</italic><sub><italic>G</italic>,&#x003B1;</sub>(<italic>f</italic>).</p>
<p>We start with Gaussian white noise as input as the 0-<italic>th</italic> generation in the scheme and drive <italic>P</italic> neurons, where <italic>P</italic> &#x0003D; <italic>P</italic><sup><italic>E</italic></sup> &#x0002B; <italic>P</italic><sup><italic>I</italic></sup> is the number of populations. The neurons are simulated over a number of trials, the output spike-trains are measured and their power spectra, <inline-formula><mml:math id="M32"><mml:msubsup><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi><mml:mo>,</mml:mo><mml:mi>I</mml:mi></mml:mrow></mml:msubsup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>, are estimated (1st generation). For the next generation, an input is created using the spike-train power spectra of the first generation in the Gaussian approximation described above. The procedure is repeated until the output power spectra matches the input power spectra, i.e., self-consistency is achieved. In all simulations of the scheme we observed that iterating up to the 30th generation and using 10,000 trials for each generation was enough to reach a self-consistent solution, provided that the scheme converged for the given parameters.</p>
<p>In summary, we simulate the single LIF neuron representing the population &#x003B1; with</p>
<disp-formula id="E15"><label>(15)</label><mml:math id="M33"><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:msub><mml:mover accent='true'><mml:mi>v</mml:mi><mml:mo>&#x002D9;</mml:mo></mml:mover><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mi>&#x003BC;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mi>R</mml:mi><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>x</mml:mi><mml:mi>t</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>G</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>t</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
</sec>
</sec>
<sec>
<title>2.5. Self-consistent scheme for a single population with distributed connection parameters</title>
<p>Here, we generalize the iterative scheme to the case where the number of input neurons and the synaptic weights are not the same for the same type of neuron. We deal with a fixed connection probability (Erd&#x00151;s-R&#x000E9;nyi topology) and an exponential distribution of synaptic weights, resulting in heterogeneity of firing rates and spike-train spectra. For simplicity, we use the same membrane time constant for inhibitory and excitatory neurons &#x003C4;<sub><italic>E</italic></sub> &#x0003D; &#x003C4;<sub><italic>I</italic></sub> &#x0003D; &#x003C4; &#x0003D; 20 ms and do not use a synaptic filter. We represent the neurons of the network in the iterative scheme by a number of <italic>M</italic> neurons in each generation. The connection parameters of each neuron in each generation are randomly drawn from the assumed distributions. The input to each neuron in the subsequent generation is determined independently from the other neurons taking into account all power spectra of the previous generation.</p>
<p>In case of an Erd&#x00151;s-R&#x000E9;nyi topology the numbers of presynaptic neurons are binomially distributed. Likewise, in the scheme we draw binomially distributed random numbers <inline-formula><mml:math id="M34"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> and <inline-formula><mml:math id="M35"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> as numbers of presynaptic neurons connected to neuron &#x003B1; with power spectrum <italic>S</italic><sub><italic>k</italic></sub>(<italic>f</italic>) from the previous generation. The mean of these random numbers is <inline-formula><mml:math id="M36"><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:mrow><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo>&#x0232A;</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msup><mml:mo>/</mml:mo><mml:mi>M</mml:mi></mml:math></inline-formula> and <inline-formula><mml:math id="M37"><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:mrow><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msubsup></mml:mrow><mml:mo>&#x0232A;</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msup><mml:mo>/</mml:mo><mml:mi>M</mml:mi></mml:math></inline-formula> respectively. In case of exponentially distributed synaptic weights we draw <inline-formula><mml:math id="M38"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> excitatory synaptic weights <inline-formula><mml:math id="M39"><mml:msubsup><mml:mrow><mml:mi>J</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> and <inline-formula><mml:math id="M40"><mml:msubsup><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> inhibitory synaptic weights <inline-formula><mml:math id="M41"><mml:msubsup><mml:mrow><mml:mi>J</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:msup><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>&#x02032;</mml:mi></mml:mrow></mml:msup></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msubsup></mml:math></inline-formula> for each neuron in the previous generation from the exponential distribution. The input current to the &#x003B1;th neuron is constructed with the mean input</p>
<disp-formula id="E16"><label>(16)</label><mml:math id="M42"><mml:mrow><mml:msub><mml:mi>&#x003BC;</mml:mi><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mi>&#x003C4;</mml:mi><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>k</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>M</mml:mi></mml:munderover><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>l</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>E</mml:mi></mml:msubsup></mml:mrow></mml:munderover><mml:mrow><mml:msubsup><mml:mi>J</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>l</mml:mi></mml:mrow><mml:mi>E</mml:mi></mml:msubsup></mml:mrow></mml:mstyle><mml:mo>&#x02212;</mml:mo><mml:mi>g</mml:mi><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:msup><mml:mi>l</mml:mi><mml:mo>&#x02032;</mml:mo></mml:msup><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>I</mml:mi></mml:msubsup></mml:mrow></mml:munderover><mml:mrow><mml:msubsup><mml:mi>J</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:msup><mml:mi>l</mml:mi><mml:mo>&#x02032;</mml:mo></mml:msup></mml:mrow><mml:mi>I</mml:mi></mml:msubsup></mml:mrow></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mi>k</mml:mi></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mstyle><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>and with the power spectrum of the effective input that is now taken to be</p>
<disp-formula id="E17"><label>(17)</label><mml:math id="M43"><mml:mrow><mml:msub><mml:mover accent='true'><mml:mi>S</mml:mi><mml:mo>&#x000AF;</mml:mo></mml:mover><mml:mi>&#x003B1;</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mi>&#x003C4;</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>k</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>M</mml:mi></mml:munderover><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>l</mml:mi><mml:mtext>&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>E</mml:mi></mml:msubsup></mml:mrow></mml:munderover><mml:mrow><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:msubsup><mml:mi>J</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>l</mml:mi></mml:mrow><mml:mi>E</mml:mi></mml:msubsup><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:mstyle><mml:mo>&#x0002B;</mml:mo><mml:msup><mml:mi>g</mml:mi><mml:mn>2</mml:mn></mml:msup><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:msup><mml:mi>l</mml:mi><mml:mo>&#x02032;</mml:mo></mml:msup><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msubsup><mml:mi>C</mml:mi><mml:mi>k</mml:mi><mml:mi>I</mml:mi></mml:msubsup></mml:mrow></mml:munderover><mml:mrow><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:msubsup><mml:mi>J</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:msup><mml:mi>l</mml:mi><mml:mo>&#x02032;</mml:mo></mml:msup></mml:mrow><mml:mi>I</mml:mi></mml:msubsup><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:mstyle></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow></mml:mstyle><mml:msub><mml:mi>S</mml:mi><mml:mi>k</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>.</mml:mo></mml:mrow></mml:math></disp-formula>
<p>We assume here that <italic>E</italic> and <italic>I</italic> cells have the same spectrum if their connection parameters are equal. With given spectrum and mean input we calculate the voltage dynamics of neuron &#x003B1; as in section 2.4. To adapt the stabilization method described in section 2.3 to the case of a single heterogeneous population described by <italic>M</italic> single neurons, we sum a constant to all firing rates in the <italic>n</italic>-th generation, in order to set its mean firing rate to the average of all generations</p>
<disp-formula id="E18"><label>(18)</label><mml:math id="M44"><mml:mrow><mml:msub><mml:mover accent='true'><mml:mi>&#x003BD;</mml:mi><mml:mo>&#x0005E;</mml:mo></mml:mover><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0232A;</mml:mo></mml:mrow><mml:mi>k</mml:mi></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mi>n</mml:mi></mml:mfrac><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>q</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>n</mml:mi></mml:munderover><mml:mrow><mml:msub><mml:mrow><mml:mo>&#x02329;</mml:mo><mml:msub><mml:mi>&#x003BD;</mml:mi><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>q</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0232A;</mml:mo></mml:mrow><mml:mi>k</mml:mi></mml:msub></mml:mrow></mml:mstyle><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where &#x003BD;<sub><italic>k,n</italic></sub> is the firing rate of the <italic>k</italic>-th neuron in generation <italic>n</italic> and <inline-formula><mml:math id="M45"><mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> is the transformed firing rate that should be used to calculate the input of the next generation. Note that the mean of the first two terms is zero. These <inline-formula><mml:math id="M46"><mml:msub><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mo>^</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mi>k</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:math></inline-formula> are used in place of &#x003BD;<sub><italic>k</italic></sub> in Equation (16) to stabilize the scheme in case of strong inhibition.</p>
<p>For the simulation of these networks, we use the Brian spiking network simulator (Goodman and Brette, <xref ref-type="bibr" rid="B25">2009</xref>).</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3. Results</title>
<sec>
<title>3.1. Homogeneous network with strong recurrent inhibition and additional synaptic filtering</title>
<p>We would like to start with results for the inhibition-dominated network (<italic>g</italic> &#x0003E; 4), in which firing rates are low. In this regime, the iterative scheme as proposed by Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>) is highly unstable and we only obtain convergence with the averaging procedure described in section 2.3. To demonstrate that the averaging procedure works in such a situation, we consider in Figure <xref ref-type="fig" rid="F4">4</xref> the network studied by Ostojic (<xref ref-type="bibr" rid="B53">2014</xref>) who found two contrasting asynchronous states when varying the synaptic strength <italic>J</italic>.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Large amplification of slow fluctuations explains heterogeneous asynchronous state in a homogeneous network. Same set-up as in Ostojic (<xref ref-type="bibr" rid="B53">2014</xref>), &#x003C4;<sub><italic>E</italic></sub> &#x0003D; &#x003C4;<sub><italic>I</italic></sub> &#x0003D; 20 ms, <italic>RI</italic><sub><italic>ext</italic></sub> &#x0003D; 24 mV, &#x003B3; &#x0003D; 0.25, &#x003C4;<sub><italic>D</italic></sub> &#x0003D; 0.55 ms, <italic>g</italic> &#x0003D; 5, and &#x003C4;<sub><italic>R</italic></sub> &#x0003D; 0.5 ms. This is a parameter region where the network fires at low-frequency regime and high inhibition <italic>g</italic> &#x0003D; 5 is set. <bold>(A)</bold> Single-neuron spike-train power spectra from recurrent network (circles for <italic>N</italic><sub><italic>E</italic></sub> &#x0003D; 80,000 and squares for <italic>N</italic><sub><italic>E</italic></sub> &#x0003D; 8,000) and self-consistent scheme (solid lines) for different values of <italic>J</italic>. Inset: power spectra for a large network (<italic>N</italic><sub><italic>E</italic></sub> &#x0003D; 100, 000) of exponential IF neurons (single-neuron dynamics is <inline-formula><mml:math id="M47"><mml:msub><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi></mml:mrow></mml:msub><mml:mover accent="true"><mml:mrow><mml:mi>v</mml:mi></mml:mrow><mml:mo>.</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mo>-</mml:mo><mml:mi>v</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x00394;</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msub><mml:mo class="qopname">exp</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mfrac><mml:mrow><mml:mi>v</mml:mi><mml:mo>-</mml:mo><mml:msub><mml:mrow><mml:mi>v</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mi>h</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x00394;</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>&#x0002B;</mml:mo><mml:mi>R</mml:mi><mml:mi>I</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> where &#x003C4;<sub><italic>E</italic></sub> &#x0003D; &#x003C4;<sub><italic>I</italic></sub> &#x0003D; 20 ms, <italic>RI</italic><sub><italic>ext</italic></sub> &#x0003D; 30 mV, &#x003B3; &#x0003D; 0.25, &#x003C4;<sub><italic>D</italic></sub> &#x0003D; 0.55 ms, <italic>g</italic> &#x0003D; 5, &#x003C4;<sub><italic>R</italic></sub> &#x0003D; 0.5 ms, and &#x00394;<sub><italic>T</italic></sub> &#x0003D; 0.2) for two different values of the synaptic coupling, showing the same qualitative difference in low-frequency power as the LIF networks. <bold>(B,C)</bold> Raster plots containing 100 neurons from the LIF network with <italic>N</italic><sub><italic>E</italic></sub> &#x0003D; 80,000 for <italic>J</italic> &#x0003D; 0.2 mV, and <italic>J</italic> &#x0003D; 0.8 mV, respectively. <bold>(D&#x02013;F)</bold> Firing rate &#x003BD;, correlation time &#x003C4;<sub><italic>c</italic></sub>, and Fano factor for different values of <italic>J</italic> for both recurrent and self-consistent scheme evaluated in a simulation of <italic>T</italic> &#x0003D; 100 s.</p></caption>
<graphic xlink:href="fncom-12-00009-g0004.tif"/>
</fig>
<p>In Figure <xref ref-type="fig" rid="F4">4A</xref> spike-train spectra for strong recurrent inhibition (<italic>g</italic> &#x0003D; 5) for different values of <italic>J</italic> and different network sizes are shown. The power spectra of these network simulations are close to those of the iterative scheme in most cases. For weak coupling, the agreement between spectra is always good; discrepancies for large <italic>J</italic> become smaller with increasing network size because cross-correlations become less important in this limit. An additional reason for discrepancy is that the Gaussian approximation becomes less accurate for strong synaptic strength. The change in spike-train power spectra upon increase of the synaptic coupling does not hinge on the specific nature of the subthreshold function in the IF model. If we replace the leaky IF model by an exponential IF model (Fourcaud-Trocm&#x000E9; et al., <xref ref-type="bibr" rid="B21">2003</xref>) in the network and in the recurrent scheme, we observe a similarly drastic change in low-frequency power if the synaptic strength is doubled (inset of Figure <xref ref-type="fig" rid="F4">4A</xref>). Also for this single-neuron model the agreement between spectra from the network and from the self-consistent scheme is fairly good.</p>
<p>When the coupling strength <italic>J</italic> increases, the firing rate first decreases and then increases (Figure <xref ref-type="fig" rid="F4">4D</xref>). More interestingly, with increasing coupling we see a transition from Poisson-like irregular firing (Figure <xref ref-type="fig" rid="F4">4B</xref>) to bursty firing of single neurons (Figure <xref ref-type="fig" rid="F4">4C</xref>), i.e., periods of strong firing are separated by pauses. In the latter state one can observe a broad distribution of spike counts, and that is why this state has been referred to as heterogeneous asynchronous state (Ostojic, <xref ref-type="bibr" rid="B53">2014</xref>). In terms of the power spectrum this transition becomes manifest as an amplification at low frequencies (Wieland et al., <xref ref-type="bibr" rid="B82">2015</xref>); correspondingly the Fano factor increases (Figure <xref ref-type="fig" rid="F4">4F</xref>). Together with the minimum in the correlation time (Figure <xref ref-type="fig" rid="F4">4E</xref>) (attained at a coupling where the Fano factor is about unity), our results confirm that the transition described by Ostojic (<xref ref-type="bibr" rid="B53">2014</xref>) in the inhibition-dominated regime is essentially the same as the one observed and explained by Wieland et al. (<xref ref-type="bibr" rid="B82">2015</xref>) for the balanced case <italic>g</italic> &#x0003D; 4.</p>
<p>In summary, the results in Figure <xref ref-type="fig" rid="F4">4</xref> indicate that the emergence of a new heterogeneous asynchronous state for strong synaptic coupling can be explained only using the properties of a single neuron and the self-consistency condition, here demonstrated by our iterative single-neuron scheme.</p>
<p>We now investigate the effect of a finite synaptic filter, Equation (10). Not surprisingly, a pronounced synaptic filter (large &#x003C4;<sub><italic>s</italic></sub>) leads to a long time scale in the network dynamics, as revealed by the increased power at low frequencies (Figure <xref ref-type="fig" rid="F5">5</xref>). The synaptic filter, Equation (10) is scaled such that the total charge per input spike remains constant. Therefore, an increased time constant for the exponential decay renders the postsynaptic response smaller in amplitude and longer in duration. This longer duration of postsynaptic responses extends the range of temporal correlations in the input to the neuron, which in turn causes the slow fluctuations in the neuron&#x00027;s activity. The resulting power spectrum (Figure <xref ref-type="fig" rid="F5">5A</xref>), especially for long synaptic time constant, looks similar to that of a colored-noise driven perfect IF model (see Figure 9 in Middleton et al., <xref ref-type="bibr" rid="B49">2003</xref>). We emphasize that the emergence of the slow time scale is here imposed by the long-lasting synaptic filter which is in marked contrast to the network amplification of slow fluctuations for strong synaptic coupling discussed before in Figure <xref ref-type="fig" rid="F4">4</xref>.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Self-consistent scheme also works for a network with synaptic filtering. <bold>(A)</bold> Effect of &#x003C4;<sub><italic>s</italic></sub> on the recurrent network and iterative scheme, the plot displays power spectra for different values of &#x003C4;<sub><italic>s</italic></sub>. This is an inhibition-dominated regime with exponential synapses and <italic>J</italic> &#x0003D; 0.2 mV. In this region, the network fires at low firing rates. In <bold>(B,C)</bold> we fix &#x003C4;<sub><italic>s</italic></sub> at 10 ms and show Fano factor and correlation time &#x003C4;<sub><italic>c</italic></sub> for different values of <italic>J</italic> for both recurrent and self-consistent scheme. Other parameters as in Figure <xref ref-type="fig" rid="F4">4</xref>.</p></caption>
<graphic xlink:href="fncom-12-00009-g0005.tif"/>
</fig>
<p>We also verified that the synaptic filter does not change qualitatively the emergence of slow fluctuations for strong coupling (i.e., the heterogeneous asynchronous state discussed above). Using &#x003C4;<sub><italic>s</italic></sub> &#x0003D; 10 ms we still see the characteristic strong increase in Fano factor (Figure <xref ref-type="fig" rid="F5">5B</xref>) and a minimum in the correlation time (Figure <xref ref-type="fig" rid="F5">5C</xref>).</p>
</sec>
<sec>
<title>3.2. Networks with different parameters for excitatory and inhibitory neurons</title>
<p>In the following, we return to the limit of instantaneous synapses &#x003C4;<sub><italic>s</italic></sub> &#x02192; 0, i.e., <italic>K</italic>(<italic>t</italic>) &#x0003D; &#x003B4;(<italic>t</italic>), and introduce different parameter values for excitatory neurons (E-cells) and inhibitory neurons (I-cells). First of all, in order to test whether the applicability of the scheme hinges on the exact value of crucial parameters, we choose a small change of the membrane time constant between E and I-cells: &#x003C4;<sub><italic>I</italic></sub> &#x0003D; 19 ms and &#x003C4;<sub><italic>E</italic></sub> &#x0003D; 20 ms. Secondly, we make the relative strength of recurrent inhibition, <italic>g</italic><sub><italic>E</italic></sub> and <italic>g</italic><sub><italic>I</italic></sub>, different for the two populations in order to see whether the generalized iterative scheme with two neurons can cope with this heterogeneous situation.</p>
<p>In Figure <xref ref-type="fig" rid="F6">6</xref> we show power spectra obtained from simulations of the recurrent network and of the iterative scheme for different combinations (<italic>g</italic><sub><italic>E</italic></sub>,<italic>g</italic><sub><italic>I</italic></sub>). In Figure <xref ref-type="fig" rid="F6">6A</xref> the two populations are statistically rather different with an E-cell firing rate of &#x003BD;<sub><italic>E</italic></sub> &#x0003D; 3.2 Hz whereas I-cells fire at &#x003BD;<sub><italic>I</italic></sub> &#x0003D; 9.7 Hz. Both spectra are well reproduced by the iterative scheme and show a &#x0201C;green&#x0201D; shape (in the colored noise lingo, this is white minus red noise). That means, the spectra exhibit a dip at low frequencies, but this is much more pronounced for the I-cells. Even when we increase the difference in recurrent inhibition and the two types of neurons fire at lower frequencies of &#x003BD;<sub><italic>E</italic></sub> &#x0003D; 0.1 Hz and &#x003BD;<sub><italic>I</italic></sub> &#x0003D; 7.4 Hz, the agreement of the spectra from the iterative scheme and from the network simulations is excellent (Figure <xref ref-type="fig" rid="F6">6C</xref>). If we choose the relative recurrent inhibition to be the same, the neural dynamics differ only by the small difference of the membrane time constants, which does neither cause significant differences in the firing rates (&#x003BD;<sub><italic>E</italic></sub> &#x0003D; 128.9 Hz and &#x003BD;<sub><italic>I</italic></sub> &#x0003D; 129.9 Hz) nor in the shape of the power spectra (cf. Figure <xref ref-type="fig" rid="F6">6B</xref>).</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>Example spectra for heterogeneous network of excitatory and inhibitory neurons differing in their parameters. Comparison of power spectra of the recurrent network with two different populations and the self-consistent iterative scheme with two neurons. Parameters are in <bold>(A)</bold> (<italic>g</italic><sub><italic>E</italic></sub>, <italic>g</italic><sub><italic>I</italic></sub>) &#x0003D; (4.2, 4.0), in <bold>(B)</bold> (<italic>g</italic><sub><italic>E</italic></sub>, <italic>g</italic><sub><italic>I</italic></sub>) &#x0003D; (3.7, 3.7), and in <bold>(C)</bold> (<italic>g</italic><sub><italic>E</italic></sub>, <italic>g</italic><sub><italic>I</italic></sub>) &#x0003D; (4.25, 3.6).</p></caption>
<graphic xlink:href="fncom-12-00009-g0006.tif"/>
</fig>
<p>In order to explore the quality of the approximation systematically, we evaluated the discrepancy using the relative integrated error</p>
<disp-formula id="E19"><label>(19)</label><mml:math id="M48"><mml:mrow><mml:mo>&#x00394;</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mstyle displaystyle='true'><mml:mrow><mml:msubsup><mml:mo>&#x0222B;</mml:mo><mml:mn>0</mml:mn><mml:mrow><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mi>c</mml:mi><mml:mi>u</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msubsup><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi><mml:mo>,</mml:mo><mml:mi>s</mml:mi><mml:mi>c</mml:mi><mml:mi>h</mml:mi><mml:mi>e</mml:mi><mml:mi>m</mml:mi><mml:mi>e</mml:mi></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:mrow></mml:mstyle></mml:mrow><mml:mrow><mml:mstyle displaystyle='true'><mml:mrow><mml:msubsup><mml:mo>&#x0222B;</mml:mo><mml:mn>0</mml:mn><mml:mrow><mml:msub><mml:mi>f</mml:mi><mml:mrow><mml:mi>c</mml:mi><mml:mi>u</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msubsup><mml:mrow><mml:mi>d</mml:mi><mml:mi>f</mml:mi><mml:msubsup><mml:mi>S</mml:mi><mml:mrow><mml:mi>x</mml:mi><mml:mi>x</mml:mi><mml:mo>,</mml:mo><mml:mi>n</mml:mi><mml:mi>e</mml:mi><mml:mi>t</mml:mi></mml:mrow><mml:mn>2</mml:mn></mml:msubsup><mml:mo stretchy='false'>(</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:mrow></mml:mstyle></mml:mrow></mml:mfrac><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where <italic>f</italic><sub><italic>cut</italic></sub> &#x0003D; 2&#x003BD;<sub><italic>I</italic></sub> (we use the inhibitory firing rate because it is usually higher).</p>
<p>In our scheme the assumption of weak cross-correlations among neurons in the network is crucial - indeed we assume an infinitely sparse system that is in a perfectly asynchronous state. This is, of course, a somewhat artificial limit and thus it is interesting how, for a fixed number of connections (about 10<sup>3</sup>), the squared deviation as well as important statistics such as the Fano factor depend on the system size. In Figure <xref ref-type="fig" rid="F7">7</xref> this dependence is illustrated for the case where <italic>g</italic><sub><italic>E</italic></sub> &#x0003D; 4.2 and <italic>g</italic><sub><italic>I</italic></sub> &#x0003D; 4.0, the same parameters as in Figure <xref ref-type="fig" rid="F6">6A</xref>. For the chosen connectivity, a minimal number of <italic>N</italic><sub><italic>E</italic></sub> &#x0003D; 20, 000 E-cells seems to be required to reach a good approximation (relative error below 1% for both <italic>E</italic> and <italic>I</italic> cells) with the self-consistent scheme. This plot illustrates that although sparsity is an important assumption for the self-consistent determination of spike-train power spectra, it does not lead to the necessity to consider exorbitantly large networks.</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>Performance of iterative scheme improves with network size. The performance of the iterative scheme depends on the network size. Curves were produced for the case <italic>g</italic><sub><italic>E</italic></sub> &#x0003D; 4.2 and <italic>g</italic><sub><italic>I</italic></sub> &#x0003D; 4.0, same parameters as in Figure <xref ref-type="fig" rid="F6">6A</xref>. <bold>(A)</bold> Relative error dependence of the scheme for a network size <italic>N</italic><sub><italic>E</italic></sub> evaluated with the integrated relative error defined in Equation (19). <bold>(B)</bold> Fano factor dependence where dotted line represents the iterative scheme prediction and solid lines the recurrent network. <bold>(C)</bold> correlation time &#x003C4;<sub><italic>c</italic></sub> dependence.</p></caption>
<graphic xlink:href="fncom-12-00009-g0007.tif"/>
</fig>
</sec>
<sec>
<title>3.3. Networks with three distinct populations and distinct modules</title>
<p>In principle, the proposed iterative scheme is applicable to any number of populations. As long as the resulting activity is sufficiently asynchronous (implying weak cross-correlations) and the synaptic strength is not excessively large (needed for the Gaussian approximation), the iterative scheme should converge to a self-consistent result. Here we demonstrate that the extended scheme also works for networks with more than two populations and study two cases: a network with three distinct populations and a modular network.</p>
<p>An example of three populations is given by a combination of one excitatory and two inhibitory populations (Figure <xref ref-type="fig" rid="F8">8A</xref>), biologically inspired by a cortical network with excitatory regular spiking neurons (RS), inhibitory fast-spiking (FS), and low-threshold spiking (LTS) neurons (see Izhikevich, <xref ref-type="bibr" rid="B34">2003</xref>; Tomov et al., <xref ref-type="bibr" rid="B75">2014</xref> and references therein). Their firing rates are ordered such that &#x003BD;<sub><italic>FS</italic></sub> &#x0003E; &#x003BD;<sub><italic>LTS</italic></sub> &#x0003E; &#x003BD;<sub><italic>RS</italic></sub>. This heterogeneous situation is achieved by changing both membrane time constants, which are chosen to be &#x003C4;<sub><italic>FS</italic></sub> &#x0003D; 21 ms, &#x003C4;<sub><italic>LTS</italic></sub> &#x0003D; 20 ms, and &#x003C4;<sub><italic>RS</italic></sub> &#x0003D; 19 ms, and making one of the synaptic weights in the network (connecting RS neurons to FS neurons) 1.4 times stronger (indicated by the thick arrow in Figure <xref ref-type="fig" rid="F8">8A</xref>, left). This setting illustrates how heterogeneity of connectivity and membrane time constants shape the power spectra statistics.</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p>Heterogeneous networks with more than two populations. Comparison between power spectra of the recurrent network (solid lines) with the iterative scheme (dashed lines). <bold>(A)</bold> Three different populations (<italic>RS</italic>, <italic>LTS</italic>, and <italic>FS</italic>) whereby the inhibitory population is composed of <italic>LTS</italic> (<italic>N</italic><sub><italic>LTS</italic></sub> &#x0003D; 0.25 &#x000D7; <italic>N</italic><sub><italic>E</italic></sub>, <italic>C</italic><sub><italic>LTS</italic></sub> &#x0003D; 0.25 &#x000D7; <italic>C</italic><sub><italic>E</italic></sub>) and of <italic>FS</italic> (<italic>N</italic><sub><italic>FS</italic></sub> &#x0003D; 0.05 &#x000D7; <italic>N</italic><sub><italic>E</italic></sub>, <italic>C</italic><sub><italic>FS</italic></sub> &#x0003D; 0.05 &#x000D7; <italic>C</italic><sub><italic>E</italic></sub>). Parameters are <italic>g</italic> &#x0003D; 4.0, &#x003C4;<sub><italic>RS</italic></sub> &#x0003D; 20 ms, &#x003C4;<sub><italic>LTS</italic></sub> &#x0003D; 19 ms, &#x003C4;<sub><italic>FS</italic></sub> &#x0003D; 21 ms. We multiply the synaptic strength by 1.4 for the excitatory weight to inhibitory neuron from population 2. <bold>(B)</bold> Modular network, modules 1 and 2 communicate through connections represented at the sketch in the left. Each module contains 1.25 &#x000D7; 10<sup>5</sup> cells with E:I ratio 4:1. In both modules &#x003C4; &#x0003D; 20 ms. At module 1 <italic>J</italic> &#x0003D; 0.1 mV and at module 2 <italic>J</italic> &#x0003D; 0.27 mV, for all modules <italic>g</italic> &#x0003D; 4.0. Module 2 exhibits a spectral hump around 80 Hz which comes from the interaction with module 1.</p></caption>
<graphic xlink:href="fncom-12-00009-g0008.tif"/>
</fig>
<p>The resulting spectra are well-captured by the iterative scheme; they all display the effect of neural refractoriness by the dip at low frequencies (Bair et al., <xref ref-type="bibr" rid="B4">1994</xref>; Franklin and Bair, <xref ref-type="bibr" rid="B22">1995</xref>) but to a different degree. The dip is most pronounced for the fast spiking neurons; the regular spiking neurons fire with a statistics that is closest to a Poisson process with a flat power spectrum.</p>
<p>According to a common view, the cortex possesses a modular structure (Boucsein et al., <xref ref-type="bibr" rid="B6">2011</xref>; Tomov et al., <xref ref-type="bibr" rid="B75">2014</xref>, <xref ref-type="bibr" rid="B74">2016</xref>), a feature that we take into account in the next setup. We consider two different modules as shown in Figure <xref ref-type="fig" rid="F8">8B</xref>. The two modules are equal to each other with respect to the population size and each consists of an E-I network with <italic>N</italic><sub><italic>E</italic></sub> &#x0003D; 100, 000 and membrane time constants &#x003C4; &#x0003D; 20 ms, requiring the simulation of two neurons in total in the self-consistent scheme. For module 1 and 2 we choose <italic>J</italic> &#x0003D; 0.1 mV and <italic>J</italic> &#x0003D; 0.27 mV, respectively. With this choice, the two modules operate in different regimes: module 1 in a fast-fluctuation mode with low Fano factor and peaked power spectrum, module 2 in a regime of dominating slow fluctuations (cf. section 3.1). In module 2, we rewired 50% of the connections so that they come from module 1, i.e., it receives 0.5<italic>C</italic><sub><italic>E</italic></sub> excitatory inputs and 0.5<italic>C</italic><sub><italic>I</italic></sub> inhibitory inputs from module 1. This results in a highly heterogeneous situation which is reflected in the power spectrum of module 2: in contrast to the behavior observed in Figure <xref ref-type="fig" rid="F4">4</xref>, the power spectrum of module 2 contains an additional hump around 80 Hz. The power spectra of all different neurons in this setup are well represented by the iterative scheme, cf. Figure <xref ref-type="fig" rid="F8">8B</xref>.</p>
<p>The result in Figure <xref ref-type="fig" rid="F8">8B</xref> demonstrates that the iterative scheme can capture complex situations involving the interaction among different modules. The simulated network contained in total 250,000 neurons and the iterative scheme reproduced the single neuron correlation statistics with high accuracy using only two neurons.</p>
</sec>
<sec>
<title>3.4. Network with randomized number and weight of synaptic inputs</title>
<p>Here we use the iterative scheme to represent network dynamics for distributed connection parameters in a single population. As a first example, we consider a network in which connections are made with a fixed probability (Erdos and R&#x000E9;nyi, <xref ref-type="bibr" rid="B19">1960</xref>) instead of a fixed in-degree (as in all previous examples). This Erd&#x00151;s-R&#x000E9;nyi topology yields a binomially distributed in-degree which is certainly a more realistic scenario than the fixed in-degree. Furthermore, a distributed in-degree leads to a distribution of firing rates, as seen in cortical networks (Griffith and Horn, <xref ref-type="bibr" rid="B27">1966</xref>; Koch and Fuster, <xref ref-type="bibr" rid="B38">1989</xref>; Shafi et al., <xref ref-type="bibr" rid="B66">2007</xref>; Hrom&#x000E1;dka et al., <xref ref-type="bibr" rid="B33">2008</xref>; O&#x00027;Connor et al., <xref ref-type="bibr" rid="B52">2010</xref>; Roxin et al., <xref ref-type="bibr" rid="B61">2011</xref>). In addition to a random number of connections, in cortical networks also the synaptic weights are not fixed but follow a long-tailed distribution (Song et al., <xref ref-type="bibr" rid="B71">2005</xref>; Gilson and Fukai, <xref ref-type="bibr" rid="B24">2011</xref>). This feature can be approximated in the recurrent network model by drawing the weights from an exponential distribution.</p>
<p>In this version of the iterative scheme, we have <italic>M</italic> neurons that represent independent samples of the distributions of excitatory and inhibitory in-degrees and weights. Consequently, the firing rates and power spectra of the <italic>M</italic> neurons will differ and reflect the heterogeneity of these measures in the recurrent network (for further details, see section 2.5).</p>
<p>The first striking feature for a randomized connectivity is a broad distribution of firing rates. The stronger source for the rate variability seems to origin in the random number of connections (the case shown in Figure <xref ref-type="fig" rid="F9">9A</xref>); an exponential distribution of the synaptic strength makes the histograms only somewhat broader (case with additional weight variability, shown in Figure <xref ref-type="fig" rid="F9">9B</xref>). The histograms obtained from our iterative scheme with a modest number of <italic>M</italic> &#x0003D; 50 representative neurons (data are collected over several generations to improve the sampling) agree well with those from the network simulations. Note that analytical expressions for self-consistent distributions of the firing rate have been found previously using the diffusion approximation (Amit and Brunel, <xref ref-type="bibr" rid="B3">1997</xref>; Roxin et al., <xref ref-type="bibr" rid="B61">2011</xref>).</p>
<fig id="F9" position="float">
<label>Figure 9</label>
<caption><p>Iterative scheme reproduces firing rate distributions of Erd&#x00151;s-R&#x000E9;nyi networks. Firing rate histograms of the iterative scheme with <italic>M</italic> &#x0003D; 50 neurons per generation (symbols) and the network simulation (dashed lines) for <bold>(A)</bold> binomially distributed numbers of presynaptic neurons [all excitatory (inhibitory) weights are the same as indicated on the left] and <bold>(B)</bold> additionally randomized synaptic weights (weights are drawn from distributions, sketched on the left). To build the histograms of the scheme, we used all firing rates from the 6th to the 20th generation (after transients have vanished). Parameters are as in Figure <xref ref-type="fig" rid="F10">10</xref>.</p></caption>
<graphic xlink:href="fncom-12-00009-g0009.tif"/>
</fig>
<p>In Figure <xref ref-type="fig" rid="F10">10</xref> we show the mean Figure <xref ref-type="fig" rid="F10">10A</xref> and the standard deviation Figure <xref ref-type="fig" rid="F10">10B</xref> of the firing rate histograms of the iterative scheme as a function of the generation. Because the number <italic>M</italic> of neurons per generation (i.e., the number of samples) is finite we consider the standard error <inline-formula><mml:math id="M49"><mml:msub><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mi>s</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>&#x003C3;</mml:mi><mml:mo>/</mml:mo><mml:msqrt><mml:mrow><mml:mi>M</mml:mi><mml:mo>-</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msqrt></mml:math></inline-formula> represented by the colored areas in Figure <xref ref-type="fig" rid="F10">10A</xref>, where &#x003C3; is the standard deviation of the firing rates measured from the network. The mean firing rate and standard deviation of the iterative scheme fluctuate around the network values within the expected standard error (colored areas), which indicates that the scheme works even for rather limited numbers of neurons <italic>M</italic> &#x0226A; <italic>N</italic>. For the considered parameter sets, we observe fast convergence within five iterations for all used numbers of neurons except in the case of strong recurrent inhibition with <italic>g</italic> &#x0003D; 6 for which we observe convergence only after the 10th generation.</p>
<fig id="F10" position="float">
<label>Figure 10</label>
<caption><p>Iterative scheme captures the heterogeneous statistics due to Erd&#x00151;s-R&#x000E9;nyi topology. Statistics from the iterative scheme and recurrent network for binomially distributed numbers of presynaptic neurons and different recurrent inhibition as indicated; remaining parameters: &#x02329;<italic>C</italic><sub><italic>E</italic></sub>&#x0232A; &#x0003D; 1000, &#x02329;<italic>C</italic><sub><italic>I</italic></sub>&#x0232A; &#x0003D; 250, <italic>J</italic> &#x0003D; 0.1 mV, &#x003C4;<sub><italic>m</italic></sub> &#x0003D; 20 ms, &#x003C4;<sub><italic>D</italic></sub> &#x0003D; 2 ms. For each neuron 100 trials of 10 s were used. From top to bottom: <bold>(A)</bold> mean firing rate for each generation of the scheme and the mean network rate (dashed line); standard error <inline-formula><mml:math id="M50"><mml:msub><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mi>s</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>&#x003C3;</mml:mi><mml:mo>/</mml:mo><mml:msqrt><mml:mrow><mml:mi>M</mml:mi><mml:mo>-</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msqrt></mml:math></inline-formula> (with &#x003C3; being the standard deviation of the network firing rates) for different numbers of neurons <italic>M</italic> in the iterative scheme (colored areas). <bold>(B)</bold> Standard deviation of firing rates in the iterative scheme vs. generation compared to &#x003C3; (dashed line). <bold>(C)</bold> Power spectra averaged over single neuron spectra with firing rates within the indicated intervals in the iterative scheme (lines, data from generations 6 to 20 for <italic>g</italic> &#x0003D; 3.5, 4 and 11&#x02013;20 for <italic>g</italic> &#x0003D; 6) and from neurons in the network (circles). <bold>(D)</bold> Power spectra averaged over all neurons in the scheme (solid lines, data from generations 11 to 20) and network (dashed). For <italic>g</italic> &#x0003D; 6 we used the stabilization procedure from section 2.5.</p></caption>
<graphic xlink:href="fncom-12-00009-g0010.tif"/>
</fig>
<p>Power spectra are different for all neurons in the network and depend most strongly on the mean input that the respective cell receives. In the network we group neurons with similar firing rates (within a 1 Hz interval) and average their spectra within each group. We compare these spectra to those resulting from the self-consistent scheme having firing rates in the same interval (Figure <xref ref-type="fig" rid="F10">10C</xref>); we find a good agreement for a modest number of neurons <italic>M</italic> &#x0003D; 50 used in the scheme. Note that averaged spectra are very different from each other and from the average over all neurons in the network (Figure <xref ref-type="fig" rid="F10">10D</xref>). Even for a low number <italic>M</italic> &#x0003D; 10, the iterative scheme reproduces this average spectrum well.</p>
<p>If we use in addition to the random number of connections also randomly distributed synaptic weights, the overall picture does not change qualitatively (Figure <xref ref-type="fig" rid="F11">11</xref>). Compared to the case of equal weights, the variance in the firing rates goes up by about 50% (Figure <xref ref-type="fig" rid="F11">11B</xref>) whereas the mean firing rate increases only slightly (Figure <xref ref-type="fig" rid="F11">11A</xref>). Power spectra look similar to the previous case and the agreement between scheme and network simulation is again good, except for the case of strong inhibition <italic>g</italic> &#x0003D; 6, for which we find a discrepancy between the averaged power spectra for the scheme and the network (Figure <xref ref-type="fig" rid="F11">11D</xref>) even for a large <italic>M</italic> (similarly for the single neuron spectra in Figure <xref ref-type="fig" rid="F11">11C</xref>). Due to the very low firing rates and some high synaptic weights, the Gaussian approximation becomes inaccurate. We calculated the relative error defined in Equation (19) for the averaged power spectra for <italic>M</italic> &#x0003D; 10 up to <italic>M</italic> &#x0003D; 100, using <italic>f</italic><sub><italic>cut</italic></sub> &#x0003D; 2&#x02329;&#x003BD;&#x0232A;. All observed relative errors were smaller than five percent.</p>
<fig id="F11" position="float">
<label>Figure 11</label>
<caption><p>Iterative scheme captures the heterogeneous statistics due to Erd&#x00151;s-R&#x000E9;nyi topology and randomly distributed synaptic weights. First- and second-order statistics from an iterative scheme for binomial distributed numbers of presynaptic neurons and additionally exponentially distributed synaptic weights. See caption of Figure <xref ref-type="fig" rid="F10">10</xref> for details.</p></caption>
<graphic xlink:href="fncom-12-00009-g0011.tif"/>
</fig>
<p>The results of this section demonstrate how a relatively small number of neurons in the self-consistent scheme can be used to capture the first- and second-order statistics of neurons in a network with a variable number of inputs and synaptic weights.</p>
</sec>
<sec>
<title>3.5. Deviations due to non-gaussianity of current input</title>
<p>The iterative scheme assumes neuronal input that obeys a Gaussian distribution. This assumption is only accurate for a large number of pre-synaptic spikes with small amplitude. A low firing rate or an increase of (some) synaptic weights (as observed for stronger recurrent inhibition, i.e., larger values of <italic>g</italic>) shifts the statistics from approximately Gaussian to a distribution with pronounced non-Gaussian features (skewed and with fat tails). In fact, even the most basic statistics of the output, the firing rate, can systematically deviate from the Gaussian setting if synaptic amplitudes are sufficiently large (Richardson and Swarbrick, <xref ref-type="bibr" rid="B60">2010</xref>). We can thus expect that at large values of <italic>g</italic> the iterative scheme (that assumes Gaussianity) may provide power spectra that deviate from those measured in the network; indeed, this is what we observed above. Here we want to illustrate the relation between the deviations of power spectra in the network and for the isolated neuron on the one side and non-Gaussian features of the network input statistics on the other side.</p>
<p>We simulate the heterogeneous network from section 3.4 with exponentially distributed weights and either <italic>g</italic> &#x0003D; 4 (as in Figure <xref ref-type="fig" rid="F11">11</xref>, middle column) or <italic>g</italic> &#x0003D; 6 (as in Figure <xref ref-type="fig" rid="F11">11</xref>, right column). We pick out 1,000 representative neurons randomly. For each of these neurons we measure the input current spectrum and the output spike-train spectrum. Input currents are integrated over a time bin of 2 ms (10% of the membrane time constant), in which the membrane voltage does not change too drastically but we can expect to collect many input spikes and thus Gaussian statistics. Clearly, for a much smaller time bin of the order of <inline-formula><mml:math id="M51"><mml:msup><mml:mrow><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>E</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>C</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mo>-</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msup><mml:mo>&#x02248;</mml:mo></mml:math></inline-formula> 0.01 ms (where <inline-formula><mml:math id="M52"><mml:mover accent="true"><mml:mrow><mml:mi>&#x003BD;</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:math></inline-formula> is the average firing rate of the presynaptic neurons), one single spike at most would typically fall into one time bin. Thus, on a very fine temporal scale, the input has <italic>always</italic> a highly non-Gaussian statistics. Nevertheless, the Gaussian approximation works well if the temporally integrated input noise has approximately Gaussian statistics for an effective time step, in which the voltage does not change much. As the deterministic drift causes already a change by several mV over a time of 2 ms, our choice of the effective time step is conservative in the sense that non-Gaussian features of the input in this time step will certainly become noticeable in the output statistics of the driven cell.</p>
<p>For each of the 1,000 selected neurons, we first measure the skewness and excess kurtosis of its input current to quantify non-Gaussianity. Then, we generate a Gaussian noise with the same power spectrum as the input current to this specific neuron and use it to drive an isolated LIF neuron. Finally, we calculate the relative error, Equation (19), between the output power spectrum of this isolated neuron and the corresponding neuron from the recurrent network. Note that for this comparison, we do not iterate the self-consistent scheme but rather use a Gaussian version of the (neuron-specific) network input noise for the isolated cell. In this way, we isolate non-Gaussianity of the input noise as one potential source of deviation between network spectra and spectra from the self-consistent scheme.</p>
<p>Plots of the relative error vs. skewness and excess kurtosis are presented in Figures <xref ref-type="fig" rid="F12">12A,B</xref>, respectively. For <italic>g</italic> &#x0003D; 4 (balanced case, moderate inhibitory synaptic amplitudes), the relative error is generally small and skewness and excess kurtosis deviate only little from zero. In contrast, for stronger inhibitory synaptic weigths <italic>g</italic> &#x0003D; 6 (inhibition-dominated recurrent feedback), the input current has a pronounced negative skew and fat tails because of large inhibitory amplitudes, resulting in stronger deviations between the spectra of isolated neurons and the corresponding network neurons. Consequently, we find a correlation between non-Gaussianity and relative error (cf. the Pearson correlation coefficients given atop of the figure). To gauge the relative error, we need a lower limit. To this end, we consider the deviation between two measurements of the same power spectrum for a given neuron of the network. The average of this lower bound over the 1,000 selected neurons is shown in Figure <xref ref-type="fig" rid="F12">12</xref> for comparison. It is close to the mean error for <italic>g</italic> &#x0003D; 4 but is significantly lower than the mean error for <italic>g</italic> &#x0003D; 6, and it barely depends on the skewness and kurtosis, again confirming the relation between non-Gaussianiaty of the input noise and the relative error between isolated neuron and network neuron.</p>
<fig id="F12" position="float">
<label>Figure 12</label>
<caption><p>Deviation between spectra vs. statistical measures of non-Gaussianity of the input current. Relative error, Equation (19), of spike-train spectra from neurons in the network and from neurons driven by corresponding Gaussian noise plotted vs. skewness <bold>(A)</bold> and excess kurtosis <bold>(B)</bold> of the input current. Inset in <bold>(A)</bold> probability distributions for <italic>g</italic> &#x0003D; 4 and <italic>g</italic> &#x0003D; 6 as indicated. Color in <bold>(A,B)</bold> encodes the firing rate of each neuron (cf. scale on the right). We used the heterogeneous network from section 3.4 with exponentially distributed synaptic weights and <italic>g</italic> &#x0003D; 4 (crosses) and <italic>g</italic> &#x0003D; 6 (plusses) and picked 1,000 representative neurons randomly. For these neurons, we determined the skewness and excess kurtosis as well as the power spectrum of the input current. For the former two, we used the input current integrated over an effective time step of 2 ms (see main text for a discussion, how to choose this time step). We computed the relative error for each spike train-power spectrum from the network and its corresponding spike-train spectrum for the isolated neuron driven by the Gaussian version of the input noise (mean values shown by black symbols). The Pearson correlation coefficients are shown atop and indicate that deviations from Gaussian input statistics and deviations between network and single-neuron spectra co-occur. As a lower limit of the relative error, we computed &#x00394; for two independent measurements of the power spectrum of a network neuron; this lower bound for the specific cell was then averaged over all neurons in the network and is shown by green crosses for both networks with <italic>g</italic> &#x0003D; 4 and <italic>g</italic> &#x0003D; 6 (there is no significant dependence of the mean lower bound on <italic>g</italic>).</p></caption>
<graphic xlink:href="fncom-12-00009-g0012.tif"/>
</fig>
<p>For both values of <italic>g</italic> we obtain a high relative error for exceptionally large firing rates (&#x0003E;100Hz) (because the time step of 2 ms becomes too large in comparison to the mean ISI) or exceptionally low firing rate (because spectra are very noisy in this case). If we consider only a range of moderate firing rates (Figure <xref ref-type="fig" rid="F13">13</xref>) then the correlation between the deviation from Gaussianity and the discrepancy between network and isolated becomes even clearer (cf. Pearson correlations coefficients stated atop of the figure).</p>
<fig id="F13" position="float">
<label>Figure 13</label>
<caption><p>Deviation between spectra vs. statistical measures of non-Gaussianity of the input current for an intermediate range of output firing rates. Correlations between the relative error and skewness <bold>(A)</bold> and excess <bold>(B)</bold> are higher than in Figure <xref ref-type="fig" rid="F12">12</xref> if only neurons with firing rates from 20 to 100 Hz are selected. Other parameters as in Figure <xref ref-type="fig" rid="F12">12</xref>.</p></caption>
<graphic xlink:href="fncom-12-00009-g0013.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="conclusions" id="s4">
<title>4. Conclusions</title>
<p>In this work we extended the self-consistent scheme described by Dummer et al. (<xref ref-type="bibr" rid="B16">2014</xref>) to situations with strong inhibition, synaptic filtering, networks with subpopulations of distinct neuron types, and networks with random (instead of constant) number and strength of synaptic connections. In all cases we employed the Gaussian approximation and in the heterogeneous systems considered we used a small number of neurons each representing a certain subclass of similar neurons. Despite these approximations, our comparison of the determined spike-train power spectra with those found by numerical simulations of large and sparse recurrent networks revealed a good quantitative agreement.</p>
<p>Admittedly, with an increasing number of subtypes of neurons, we loose some of the numerical advantages of the scheme compared to a network simulation because in order to get reliable estimates of the power spectrum, we have to simulate the few neurons in each generation many times. If the convergence of the scheme is slow then, adding up all neurons in all generations and all trials, we may have to simulate in the end as many neurons as in the network (however, the typical bottleneck of many simulations, to keep track of all synaptic connections, is still absent in the scheme). It is thus questionable, whether much more complicated situations than discussed here can be studied in depth by our scheme.</p>
<p>Another short-coming of the approach concerns cases in which neural cross-correlations (a very vivid topic of current research, see Doiron et al., <xref ref-type="bibr" rid="B14">2016</xref>) cannot be neglected anymore or in which weak cross-correlations still have a significant impact on the population activity (Schneidman et al., <xref ref-type="bibr" rid="B63">2006</xref>). There are different causes for cross-correlations including common (shared) input, spatially homogeneous external stimuli, and a slight overall synchronization in the network (some of which are reviewed by Helias et al., <xref ref-type="bibr" rid="B31">2014</xref>; Doiron et al., <xref ref-type="bibr" rid="B14">2016</xref>). Not all of these factors can be taken into account by extending the scheme to pairs of neurons that are stimulated by correlated Gaussian noise processes<xref ref-type="fn" rid="fn0002"><sup>2</sup></xref>. We may still learn something from finding situations in which neural cross-correlations can quantitatively be described by extensions of the scheme to pairs of neurons in each generation.</p>
<p>Nevertheless, the results and the approach put forward in our paper are useful in several respects. If the single-neuron statistics is of interest (because this is what is recorded or this is what shows particularly interesting features), our method provides a computationally cheap solution to calculate the spike-train power spectrum and to study its dependence on cellular and network parameters without the need to simulate a network. The scheme is particularly suited for the idealized case of a perfectly asynchronous network that is difficult to study numerically because an almost completely asynchronous state can be reached only in a very sparse, hence, very large network. This case is interesting because it often permits analytical calculations via a density equation for the membrane voltage (Knight, <xref ref-type="bibr" rid="B37">1972</xref>; Abbott and van Vreeswijk, <xref ref-type="bibr" rid="B1">1993</xref>; Amit and Brunel, <xref ref-type="bibr" rid="B3">1997</xref>; Brunel, <xref ref-type="bibr" rid="B7">2000</xref>; Mattia and Giudice, <xref ref-type="bibr" rid="B47">2002</xref>) and thus our scheme might be useful for comparison to simpler theories.</p>
<p>As already mentioned in the introduction, we can regard our results as a confirmation that the approximation of the synaptic input by a correlated Gaussian noise is a reasonable one over a physiological range of parameters for a sparse recurrent network in the asynchronous state. Using Markovian embedding, an arbitrary colored Gaussian noise can be described by a (possibly very high-dimensional) Ornstein-Uhlenbeck process, an idea that has been worked out in the neural context by Schwalger et al. (<xref ref-type="bibr" rid="B65">2015</xref>); for examples from the physics literature, see, for instance, Schimansky-Geier and Z&#x000FC;licke (<xref ref-type="bibr" rid="B62">1990</xref>); H&#x000E4;nggi and Jung (<xref ref-type="bibr" rid="B28">1995</xref>); Siegle et al. (<xref ref-type="bibr" rid="B68">2010</xref>). Hence, a stochastic mean-field theory in terms of the corresponding multidimensional Fokker-Planck equation seems to be in reach, generalizing the successful framework of the diffusion approximation, which was based on the Poissonian (white-noise) approximation and thus led to a one-dimensional Fokker-Planck equation. A theory using the colored-noise Fokker-Planck equation would faithfully reproduce the second-order temporal correlations of the spiking neurons and, possibly, provide novel insights into the bifurcation between asynchronous and synchronous states. This may be particularly relevant for larger synaptic amplitudes (Ostojic, <xref ref-type="bibr" rid="B53">2014</xref>; Wieland et al., <xref ref-type="bibr" rid="B82">2015</xref>), for which the color of the noise becomes more and more important.</p>
</sec>
<sec id="s5">
<title>Author contributions</title>
<p>RP, SV, DB, ACR, and BL: Conceived the work; RP and SV: Developed the codes and performed the computations; RP, SV, DB, and BL: Analyzed the results; RP, SV, DB, ACR, and BL: Wrote the manuscript.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abbott</surname> <given-names>L.</given-names></name> <name><surname>van Vreeswijk</surname> <given-names>C.</given-names></name></person-group> (<year>1993</year>). <article-title>Asynchronous states in networks of pulse-coupled oscillators</article-title>. <source>Phys. Rev. E</source> <volume>48</volume>:<fpage>1483</fpage>. <pub-id pub-id-type="pmid">9960738</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aljadeff</surname> <given-names>J.</given-names></name> <name><surname>Stern</surname> <given-names>M.</given-names></name> <name><surname>Sharpee</surname> <given-names>T.</given-names></name></person-group> (<year>2015</year>). <article-title>Transition to chaos in random networks with cell-type-specific connectivity</article-title>. <source>Phys. Rev. Lett.</source> <volume>114</volume>:<fpage>088101</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.114.088101</pub-id><pub-id pub-id-type="pmid">25768781</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amit</surname> <given-names>D. J.</given-names></name> <name><surname>Brunel</surname> <given-names>N.</given-names></name></person-group> (<year>1997</year>). <article-title>Dynamics of a recurrent network of spiking neurons before and following learning</article-title>. <source>Netw. Comput. Neural Syst.</source> <volume>8</volume>:<fpage>373</fpage>.</citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bair</surname> <given-names>W.</given-names></name> <name><surname>Koch</surname> <given-names>C.</given-names></name> <name><surname>Newsome</surname> <given-names>W.</given-names></name> <name><surname>Britten</surname> <given-names>K.</given-names></name></person-group> (<year>1994</year>). <article-title>Power spectrum analysis of bursting cells in area MT in the behaving monkey</article-title>. <source>J. Neurosci.</source> <volume>14</volume>, <fpage>2870</fpage>&#x02013;<lpage>2892</lpage>. <pub-id pub-id-type="pmid">8182445</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bauermeister</surname> <given-names>C.</given-names></name> <name><surname>Schwalger</surname> <given-names>T.</given-names></name> <name><surname>Russell</surname> <given-names>D.</given-names></name> <name><surname>Neiman</surname> <given-names>A. B.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2013</year>). <article-title>Characteristic effects of stochastic oscillatory forcing on neural firing: analytical theory and comparison to paddlefish electroreceptor data</article-title>. <source>PLoS Comput. Biol.</source> <volume>9</volume>:<fpage>e1003170</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1003170</pub-id><pub-id pub-id-type="pmid">23966844</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boucsein</surname> <given-names>C.</given-names></name> <name><surname>Nawrot</surname> <given-names>M. P.</given-names></name> <name><surname>Schnepel</surname> <given-names>P.</given-names></name> <name><surname>Aertsen</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Beyond the cortical column: abundance and physiology of horizontal connections imply a strong role for inputs from the surround</article-title>. <source>Front. Neurosci.</source> <volume>5</volume>:<fpage>32</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2011.00032</pub-id><pub-id pub-id-type="pmid">21503145</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brunel</surname> <given-names>N.</given-names></name></person-group> (<year>2000</year>). <article-title>Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons</article-title>. <source>J. Comput. Neurosci.</source> <volume>8</volume>, <fpage>183</fpage>&#x02013;<lpage>208</lpage>. <pub-id pub-id-type="doi">10.1023/A:1008925309027</pub-id><pub-id pub-id-type="pmid">10809012</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brunel</surname> <given-names>N.</given-names></name> <name><surname>Hakim</surname> <given-names>V.</given-names></name></person-group> (<year>1999</year>). <article-title>Fast global oscillations in networks of integrate-and-fire neurons with low firing rates</article-title>. <source>Neural Comput.</source> <volume>11</volume>, <fpage>1621</fpage>&#x02013;<lpage>1671</lpage>. <pub-id pub-id-type="pmid">10490941</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brunel</surname> <given-names>N.</given-names></name> <name><surname>Sergi</surname> <given-names>S.</given-names></name></person-group> (<year>1998</year>). <article-title>Firing frequency of leaky integrate-and-fire neurons with synaptic current dynamics</article-title>. <source>J. Theor. Biol.</source> <volume>195</volume>, <fpage>87</fpage>&#x02013;<lpage>95</lpage>.</citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>de la Rocha</surname> <given-names>J.</given-names></name> <name><surname>Doiron</surname> <given-names>B.</given-names></name> <name><surname>Shea-Brown</surname> <given-names>E.</given-names></name> <name><surname>Josic</surname> <given-names>K.</given-names></name> <name><surname>Reyes</surname> <given-names>A.</given-names></name></person-group> (<year>2007</year>). <article-title>Correlation between neural spike trains increases with firing rate</article-title>. <source>Nature</source> <volume>448</volume>, <fpage>802</fpage>&#x02013;<lpage>806</lpage>. <pub-id pub-id-type="doi">10.1038/nature06028</pub-id><pub-id pub-id-type="pmid">17700699</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deger</surname> <given-names>M.</given-names></name> <name><surname>Schwalger</surname> <given-names>T.</given-names></name> <name><surname>Naud</surname> <given-names>R.</given-names></name> <name><surname>Gerstner</surname> <given-names>W.</given-names></name></person-group> (<year>2014</year>). <article-title>Fluctuations and information filtering in coupled populations of spiking neurons with adaptation</article-title>. <source>Phys. Rev. E</source> <volume>90</volume>:<fpage>062704</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.90.062704</pub-id><pub-id pub-id-type="pmid">25615126</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deniz</surname> <given-names>T.</given-names></name> <name><surname>Rotter</surname> <given-names>S.</given-names></name></person-group> (<year>2017</year>). <article-title>Solving the two-dimensional Fokker-Planck equation for strongly correlated neurons</article-title>. <source>Phys. Rev. E</source> <volume>95</volume>:<fpage>012412</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.95.012412</pub-id><pub-id pub-id-type="pmid">28208505</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Doiron</surname> <given-names>B.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name> <name><surname>Longtin</surname> <given-names>A.</given-names></name> <name><surname>Maler</surname> <given-names>L.</given-names></name> <name><surname>Bastian</surname> <given-names>J.</given-names></name></person-group> (<year>2004</year>). <article-title>Oscillatory activity in electrosensory neurons increases with the spatial correlation of the stochastic input stimulus</article-title>. <source>Phys. Rev. Lett.</source> <volume>93</volume>:<fpage>048101</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.93.048101</pub-id><pub-id pub-id-type="pmid">15323795</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Doiron</surname> <given-names>B.</given-names></name> <name><surname>Litwin-Kumar</surname> <given-names>A.</given-names></name> <name><surname>Rosenbaum</surname> <given-names>R.</given-names></name> <name><surname>Ocker</surname> <given-names>G. K.</given-names></name> <name><surname>Josi&#x00107;</surname> <given-names>K.</given-names></name></person-group> (<year>2016</year>). <article-title>The mechanics of state-dependent neural correlations</article-title>. <source>Nat. Neurosci.</source> <volume>19</volume>, <fpage>383</fpage>&#x02013;<lpage>393</lpage>. <pub-id pub-id-type="doi">10.1038/nn.4242</pub-id><pub-id pub-id-type="pmid">26906505</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Droste</surname> <given-names>F.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2017</year>). <article-title>Exact analytical results for integrate-and-fire neurons driven by excitatory shot noise</article-title>. <source>J. Comp. Neurosci.</source> <volume>43</volume>, <fpage>81</fpage>&#x02013;<lpage>91</lpage>. <pub-id pub-id-type="doi">10.1007/s10827-017-0649-5</pub-id><pub-id pub-id-type="pmid">28585050</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dummer</surname> <given-names>B.</given-names></name> <name><surname>Wieland</surname> <given-names>S.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2014</year>). <article-title>Self-consistent determination of the spike-train power spectrum in a neural network with sparse connectivity</article-title>. <source>Front. Comp. Neurosci.</source> <volume>8</volume>:<fpage>104</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2014.00104</pub-id><pub-id pub-id-type="pmid">25278869</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Edwards</surname> <given-names>B. W.</given-names></name> <name><surname>Wakefield</surname> <given-names>G. H.</given-names></name> <name><surname>Powers</surname> <given-names>N. L.</given-names></name></person-group> (<year>1993</year>). <article-title>The spectral shaping of neural discharges by refractory effects</article-title>. <source>J. Acoust. Soc. Am.</source> <volume>93</volume>, <fpage>3353</fpage>&#x02013;<lpage>3364</lpage>. <pub-id pub-id-type="pmid">8326062</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eissfeller</surname> <given-names>H.</given-names></name> <name><surname>Opper</surname> <given-names>M.</given-names></name></person-group> (<year>1992</year>). <article-title>New method for studying the dynamics of disordered spin systems without finite-size effects</article-title>. <source>Phys. Rev. Lett.</source> <volume>68</volume>, <fpage>2094</fpage>&#x02013;<lpage>2097</lpage>. <pub-id pub-id-type="pmid">10045302</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Erdos</surname> <given-names>P.</given-names></name> <name><surname>R&#x000E9;nyi</surname> <given-names>A.</given-names></name></person-group> (<year>1960</year>). <article-title>On the evolution of random graphs</article-title>. <source>Publ. Math. Inst. Hung. Acad. Sci</source> <volume>5</volume>, <fpage>17</fpage>&#x02013;<lpage>60</lpage>.</citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ermentrout</surname> <given-names>B.</given-names></name> <name><surname>Pascal</surname> <given-names>M.</given-names></name> <name><surname>Gutkin</surname> <given-names>B.</given-names></name></person-group> (<year>2001</year>). <article-title>The effects of spike frequency adaptation and negative feedback on the synchronization of neural oscillators</article-title>. <source>Neural Comput.</source> <volume>13</volume>, <fpage>1285</fpage>&#x02013;<lpage>1310</lpage>. <pub-id pub-id-type="doi">10.1162/08997660152002861</pub-id><pub-id pub-id-type="pmid">11387047</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fourcaud-Trocm&#x000E9;</surname> <given-names>N.</given-names></name> <name><surname>Hansel</surname> <given-names>D.</given-names></name> <name><surname>van Vreeswijk</surname> <given-names>C.</given-names></name> <name><surname>Brunel</surname> <given-names>N.</given-names></name></person-group> (<year>2003</year>). <article-title>How spike generation mechanisms determine the neuronal response to fluctuating inputs</article-title>. <source>J. Neurosci.</source> <volume>23</volume>, <fpage>11628</fpage>&#x02013;<lpage>11640</lpage>. <pub-id pub-id-type="doi">10.3410/f.1016851.201577</pub-id><pub-id pub-id-type="pmid">14684865</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Franklin</surname> <given-names>J.</given-names></name> <name><surname>Bair</surname> <given-names>W.</given-names></name></person-group> (<year>1995</year>). <article-title>The effect of a refractory period on the power spectrum of neuronal discharge</article-title>. <source>SIAM J. Appl. Math.</source> <volume>55</volume>, <fpage>1074</fpage>&#x02013;<lpage>1093</lpage>.</citation></ref>
<ref id="B23">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gerstner</surname> <given-names>W.</given-names></name> <name><surname>Kistler</surname> <given-names>W. M.</given-names></name> <name><surname>Naud</surname> <given-names>R.</given-names></name> <name><surname>Paninski</surname> <given-names>L.</given-names></name></person-group> (<year>2014</year>). <source>Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gilson</surname> <given-names>M.</given-names></name> <name><surname>Fukai</surname> <given-names>T.</given-names></name></person-group> (<year>2011</year>). <article-title>Stability versus neuronal specialization for stdp: long-tail weight distributions solve the dilemma</article-title>. <source>PLoS ONE</source> <volume>6</volume>:<fpage>e25339</fpage> <pub-id pub-id-type="doi">10.1371/journal.pone.0025339</pub-id><pub-id pub-id-type="pmid">22003389</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goodman</surname> <given-names>D. F.</given-names></name> <name><surname>Brette</surname> <given-names>R.</given-names></name></person-group> (<year>2009</year>). <article-title>The brian simulator</article-title>. <source>Front. Neurosci.</source> <volume>3</volume>:<fpage>192</fpage>. <pub-id pub-id-type="doi">10.3389/neuro.01.026.2009</pub-id><pub-id pub-id-type="pmid">20011141</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grewe</surname> <given-names>J.</given-names></name> <name><surname>Kruscha</surname> <given-names>A.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name> <name><surname>Benda</surname> <given-names>J.</given-names></name></person-group> (<year>2017</year>). <article-title>Synchronous spikes are necessary but not sufficient for a synchrony code</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>114</volume>, <fpage>E1977</fpage>&#x02013;<lpage>E1985</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1615561114</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Griffith</surname> <given-names>J.</given-names></name> <name><surname>Horn</surname> <given-names>G.</given-names></name></person-group> (<year>1966</year>). <article-title>An analysis of spontaneous impulse activity of units in the striate cortex of unrestrained cats</article-title>. <source>J. Physiol.</source> <volume>186</volume>, <fpage>516</fpage>&#x02013;<lpage>534</lpage>. <pub-id pub-id-type="pmid">5972156</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>H&#x000E4;nggi</surname> <given-names>P.</given-names></name> <name><surname>Jung</surname> <given-names>P.</given-names></name></person-group> (<year>1995</year>). <article-title>Colored noise in dynamical-systems</article-title>. <source>Adv. Chem. Phys.</source> <volume>89</volume>:<fpage>239</fpage>.</citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harris</surname> <given-names>K. D.</given-names></name> <name><surname>Thiele</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Cortical state and attention</article-title>. <source>Nat. Rev. Neurosci.</source> <volume>12</volume>, <fpage>509</fpage>&#x02013;<lpage>523</lpage>. <pub-id pub-id-type="doi">10.1038/nrn3084</pub-id><pub-id pub-id-type="pmid">21829219</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harrison</surname> <given-names>P. M.</given-names></name> <name><surname>Badel</surname> <given-names>L.</given-names></name> <name><surname>Wall</surname> <given-names>M. J.</given-names></name> <name><surname>Richardson</surname> <given-names>M. J. E.</given-names></name></person-group> (<year>2015</year>). <article-title>Experimentally verified parameter sets for modelling heterogeneous neocortical pyramidal-cell populations</article-title>. <source>PLoS Comput. Biol.</source> <volume>11</volume>:<fpage>8</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1004165</pub-id><pub-id pub-id-type="pmid">26291316</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Helias</surname> <given-names>M.</given-names></name> <name><surname>Tetzlaff</surname> <given-names>T.</given-names></name> <name><surname>Diesmann</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <article-title>The correlation structure of local neuronal networks intrinsically results from recurrent dynamics</article-title>. <source>PLoS Comput. Biol.</source> <volume>10</volume>:<fpage>e1003428</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1003428</pub-id><pub-id pub-id-type="pmid">24453955</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hopfield</surname> <given-names>J. J.</given-names></name> <name><surname>Herz</surname> <given-names>A. V. M.</given-names></name></person-group> (<year>1995</year>). <article-title>Rapid local synchronization of action potentials: towards computation with coupled integrate-and-fire neurons</article-title>. <source>Proc. Natl. Acad. U.S.A.</source> <volume>92</volume>, <fpage>6655</fpage>&#x02013;<lpage>6662</lpage>.</citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hrom&#x000E1;dka</surname> <given-names>T.</given-names></name> <name><surname>DeWeese</surname> <given-names>M. R.</given-names></name> <name><surname>Zador</surname> <given-names>A. M.</given-names></name></person-group> (<year>2008</year>). <article-title>Sparse representation of sounds in the unanesthetized auditory cortex</article-title>. <source>PLoS Biol.</source> <volume>6</volume>:<fpage>e16</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pbio.0060016</pub-id><pub-id pub-id-type="pmid">18232737</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Izhikevich</surname> <given-names>E. M.</given-names></name></person-group> (<year>2003</year>). <article-title>Simple model of spiking neurons</article-title>. <source>IEEE Trans. Neural Netw.</source> <volume>14</volume>, <fpage>1569</fpage>&#x02013;<lpage>1572</lpage>. <pub-id pub-id-type="doi">10.1109/TNN.2003.820440</pub-id><pub-id pub-id-type="pmid">18244602</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jarvis</surname> <given-names>M.</given-names></name> <name><surname>Mitra</surname> <given-names>P.</given-names></name></person-group> (<year>2001</year>). <article-title>Sampling properties of the spectrum and coherency of sequences of action potentials</article-title>. <source>Neural Comput.</source> <volume>13</volume>, <fpage>717</fpage>&#x02013;<lpage>749</lpage>. <pub-id pub-id-type="doi">10.1162/089976601300014312</pub-id><pub-id pub-id-type="pmid">11255566</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kadmon</surname> <given-names>J.</given-names></name> <name><surname>Sompolinsky</surname> <given-names>H.</given-names></name></person-group> (<year>2015</year>). <article-title>Transition to chaos in random neuronal networks</article-title>. <source>Phys. Rev. X 5</source> <volume>5</volume>:<fpage>041030</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevX.5.041030</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Knight</surname> <given-names>B. W.</given-names></name></person-group> (<year>1972</year>). <article-title>Relationship between firing rate of a single neuron and level of activity in a population of neurons - experimental evidence for resonant enhancement in population response</article-title>. <source>J. Gen. Physiol.</source> <volume>59</volume>, <fpage>767</fpage>&#x02013;<lpage>778</lpage>. <pub-id pub-id-type="pmid">5025749</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Koch</surname> <given-names>K.</given-names></name> <name><surname>Fuster</surname> <given-names>J.</given-names></name></person-group> (<year>1989</year>). <article-title>Unit activity in monkey parietal cortex related to haptic perception and temporary memory</article-title>. <source>Exp. Brain Res.</source> <volume>76</volume>, <fpage>292</fpage>&#x02013;<lpage>306</lpage>. <pub-id pub-id-type="pmid">2767186</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ladenbauer</surname> <given-names>J.</given-names></name> <name><surname>Augustin</surname> <given-names>M.</given-names></name> <name><surname>Shiau</surname> <given-names>L.</given-names></name> <name><surname>Obermayer</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>Impact of adaptation currents on synchronization of coupled exponential integrate-and-fire neurons</article-title>. <source>PLoS Comput. Biol.</source> <volume>8</volume>:<fpage>e1002478</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002478</pub-id><pub-id pub-id-type="pmid">22511861</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lerchner</surname> <given-names>A.</given-names></name> <name><surname>Sterner</surname> <given-names>G.</given-names></name> <name><surname>Hertz</surname> <given-names>J.</given-names></name> <name><surname>Ahmadi</surname> <given-names>M.</given-names></name></person-group> (<year>2006</year>). <article-title>Mean field theory for a balanced hypercolumn model of orientation selectivity in primary visual cortex</article-title>. <source>Netw. Comput. Neural Syst.</source> <volume>17</volume>, <fpage>131</fpage>&#x02013;<lpage>150</lpage>. <pub-id pub-id-type="doi">10.1080/09548980500444933</pub-id><pub-id pub-id-type="pmid">16818394</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2006</year>). <article-title>Superposition of many independent spike trains is generally not a poisson process</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>73</volume>:<fpage>022901</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.73.022901</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindner</surname> <given-names>B.</given-names></name> <name><surname>Doiron</surname> <given-names>B.</given-names></name> <name><surname>Longtin</surname> <given-names>A.</given-names></name></person-group> (<year>2005</year>). <article-title>Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>72</volume>:<fpage>061919</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.72.061919</pub-id><pub-id pub-id-type="pmid">16485986</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindner</surname> <given-names>B.</given-names></name> <name><surname>Schimansky-Geier</surname> <given-names>L.</given-names></name> <name><surname>Longtin</surname> <given-names>A.</given-names></name></person-group> (<year>2002</year>). <article-title>Maximizing spike train coherence or incoherence in the leaky integrate-and-fire model</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>66</volume>:<fpage>031916</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.66.031916</pub-id><pub-id pub-id-type="pmid">12366161</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Litwin-Kumar</surname> <given-names>A.</given-names></name> <name><surname>Doiron</surname> <given-names>B.</given-names></name></person-group> (<year>2012</year>). <article-title>Slow dynamics and high variability in balanced cortical networks with clustered connections</article-title>. <source>Nat. Neurosci.</source> <volume>15</volume>, <fpage>1498</fpage>&#x02013;<lpage>1505</lpage>. <pub-id pub-id-type="doi">10.1038/nn.3220</pub-id><pub-id pub-id-type="pmid">23001062</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mari</surname> <given-names>C. F.</given-names></name></person-group> (<year>2000</year>). <article-title>Random networks of spiking neurons: instability in the Xenopus tadpole moto-neural pattern</article-title>. <source>Phys. Rev. Lett.</source> <volume>85</volume>, <fpage>210</fpage>&#x02013;<lpage>213</lpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.85.210</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mastrogiuseppe</surname> <given-names>F.</given-names></name> <name><surname>Ostojic</surname> <given-names>S.</given-names></name></person-group> (<year>2017</year>). <article-title>Intrinsically-generated fluctuating activity in excitatory-inhibitory networks</article-title>. <source>PLoS Comput. Biol.</source> <volume>13</volume>:<fpage>e1005498</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1005498</pub-id><pub-id pub-id-type="pmid">28437436</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mattia</surname> <given-names>M.</given-names></name> <name><surname>Giudice</surname> <given-names>P. D.</given-names></name></person-group> (<year>2002</year>). <article-title>Population dynamics of interacting spiking neurons</article-title>. <source>Phys. Rev. E</source> <volume>66</volume>:<fpage>051917</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.66.051917</pub-id><pub-id pub-id-type="pmid">12513533</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meunier</surname> <given-names>D.</given-names></name> <name><surname>Lambiotte</surname> <given-names>R.</given-names></name> <name><surname>Bullmore</surname> <given-names>E. T.</given-names></name></person-group> (<year>2010</year>). <article-title>Modular and hierarchically modular organization of brain networks</article-title>. <source>Front. Neurosci.</source> <volume>4</volume>:<fpage>200</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2010.00200</pub-id><pub-id pub-id-type="pmid">21151783</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Middleton</surname> <given-names>J.</given-names></name> <name><surname>Chacron</surname> <given-names>M.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name> <name><surname>Longtin</surname> <given-names>A.</given-names></name></person-group> (<year>2003</year>). <article-title>Firing statistics of a neuron model driven by long-range correlated noise</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>68</volume>:<fpage>021920</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.68.021920</pub-id><pub-id pub-id-type="pmid">14525019</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Neiman</surname> <given-names>A. B.</given-names></name> <name><surname>Russell</surname> <given-names>D. F.</given-names></name></person-group> (<year>2011</year>). <article-title>Sensory coding in oscillatory electroreceptors of paddlefish</article-title>. <source>Chaos</source> <volume>21</volume>:<fpage>047505</fpage>. <pub-id pub-id-type="doi">10.1063/1.3669494</pub-id><pub-id pub-id-type="pmid">22225379</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Neiman</surname> <given-names>A. B.</given-names></name> <name><surname>Yakusheva</surname> <given-names>T. A.</given-names></name> <name><surname>Russell</surname> <given-names>D. F.</given-names></name></person-group> (<year>2007</year>). <article-title>Noise-induced transition to bursting in responses of paddlefish electroreceptor afferents</article-title>. <source>J. Neurophysiol.</source> <volume>98</volume>, <fpage>2795</fpage>&#x02013;<lpage>2806</lpage>. <pub-id pub-id-type="doi">10.1152/jn.01289.2006</pub-id><pub-id pub-id-type="pmid">17855580</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x00027;Connor</surname> <given-names>D. H.</given-names></name> <name><surname>Peron</surname> <given-names>S. P.</given-names></name> <name><surname>Huber</surname> <given-names>D.</given-names></name> <name><surname>Svoboda</surname> <given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>Neural activity in barrel cortex underlying vibrissa-based object localization in mice</article-title>. <source>Neuron</source> <volume>67</volume>, <fpage>1048</fpage>&#x02013;<lpage>1061</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2010.08.026</pub-id><pub-id pub-id-type="pmid">20869600</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ostojic</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons</article-title>. <source>Nat. Neurosci.</source> <volume>17</volume>, <fpage>594</fpage>&#x02013;<lpage>600</lpage>. <pub-id pub-id-type="doi">10.1038/nn.3658</pub-id><pub-id pub-id-type="pmid">24561997</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ostojic</surname> <given-names>S.</given-names></name> <name><surname>Brunel</surname> <given-names>N.</given-names></name> <name><surname>Hakim</surname> <given-names>V.</given-names></name></person-group> (<year>2009</year>). <article-title>How connectivity, background activity, and synaptic properties shape the cross-correlation between spike trains</article-title>. <source>J. Neurosci.</source> <volume>29</volume>, <fpage>10234</fpage>&#x02013;<lpage>10253</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.1275-09.2009</pub-id><pub-id pub-id-type="pmid">19692598</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pesaran</surname> <given-names>B.</given-names></name> <name><surname>Pezaris</surname> <given-names>J.</given-names></name> <name><surname>Sahani</surname> <given-names>M.</given-names></name> <name><surname>Mitra</surname> <given-names>P.</given-names></name> <name><surname>Andersen</surname> <given-names>R.</given-names></name></person-group> (<year>2002</year>). <article-title>Temporal structure in neuronal activity during working memory in macaque parietal cortex</article-title>. <source>Nat. Neurosci.</source> <volume>5</volume>, <fpage>805</fpage>&#x02013;<lpage>811</lpage>. <pub-id pub-id-type="doi">10.1038/nn890</pub-id><pub-id pub-id-type="pmid">12134152</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Poulet</surname> <given-names>J. F. A.</given-names></name> <name><surname>Petersen</surname> <given-names>C. C. H.</given-names></name></person-group> (<year>2008</year>). <article-title>Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice</article-title>. <source>Nature</source> <volume>454</volume>, <fpage>881</fpage>&#x02013;<lpage>885</lpage>. <pub-id pub-id-type="doi">10.1038/nature07150</pub-id><pub-id pub-id-type="pmid">18633351</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Renart</surname> <given-names>A.</given-names></name> <name><surname>De La Rocha</surname> <given-names>J.</given-names></name> <name><surname>Bartho</surname> <given-names>P.</given-names></name> <name><surname>Hollender</surname> <given-names>L.</given-names></name> <name><surname>Parga</surname> <given-names>N.</given-names></name> <name><surname>Reyes</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>The asynchronous state in cortical circuits</article-title>. <source>Science</source> <volume>327</volume>, <fpage>587</fpage>&#x02013;<lpage>590</lpage>. <pub-id pub-id-type="doi">10.1126/science.1179850</pub-id><pub-id pub-id-type="pmid">20110507</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richardson</surname> <given-names>M. J. E.</given-names></name></person-group> (<year>2008</year>). <article-title>Spike-train spectra and network response functions for non-linear integrate-and-fire neurons</article-title>. <source>Biol. Cybern.</source> <volume>99</volume>, <fpage>381</fpage>&#x02013;<lpage>392</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-008-0244-y</pub-id><pub-id pub-id-type="pmid">19011926</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richardson</surname> <given-names>M. J. E.</given-names></name></person-group> (<year>2009</year>). <article-title>Dynamics of populations and networks of neurons with voltage-activated and calcium-activated currents</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>80</volume>:<fpage>021928</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.80.021928</pub-id><pub-id pub-id-type="pmid">19792172</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richardson</surname> <given-names>M. J. E.</given-names></name> <name><surname>Swarbrick</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). <article-title>Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise</article-title>. <source>Phys. Rev. Lett.</source> <volume>105</volume>:<fpage>178102</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.105.178102</pub-id><pub-id pub-id-type="pmid">21231083</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roxin</surname> <given-names>A.</given-names></name> <name><surname>Brunel</surname> <given-names>N.</given-names></name> <name><surname>Hansel</surname> <given-names>D.</given-names></name> <name><surname>Mongillo</surname> <given-names>G.</given-names></name> <name><surname>van Vreeswijk</surname> <given-names>C.</given-names></name></person-group> (<year>2011</year>). <article-title>On the distribution of firing rates in networks of cortical neurons</article-title>. <source>J. Neurosci.</source> <volume>31</volume>, <fpage>16217</fpage>&#x02013;<lpage>16226</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.1677-11.2011</pub-id><pub-id pub-id-type="pmid">22072673</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schimansky-Geier</surname> <given-names>L.</given-names></name> <name><surname>Z&#x000FC;licke</surname> <given-names>C.</given-names></name></person-group> (<year>1990</year>). <article-title>Harmonic noise: effect on bistable systems</article-title>. <source>Z. Phys. B</source> <volume>79</volume>, <fpage>451</fpage>&#x02013;<lpage>460</lpage>.</citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schneidman</surname> <given-names>E.</given-names></name> <name><surname>Berry</surname> <given-names>M. J.</given-names></name> <name><surname>Segev</surname> <given-names>R.</given-names></name> <name><surname>Bialek</surname> <given-names>W.</given-names></name></person-group> (<year>2006</year>). <article-title>Weak pairwise correlations imply strongly correlated network states in a neural population</article-title>. <source>Nature</source> <volume>440</volume>, <fpage>1007</fpage>&#x02013;<lpage>1012</lpage>. <pub-id pub-id-type="doi">10.1038/nature04701</pub-id><pub-id pub-id-type="pmid">16625187</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schwalger</surname> <given-names>T.</given-names></name> <name><surname>Deger</surname> <given-names>M.</given-names></name> <name><surname>Gerstner</surname> <given-names>W.</given-names></name></person-group> (<year>2017</year>). <article-title>Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size</article-title>. <source>PLoS Comput. Biol.</source> <volume>13</volume>:<fpage>e1005507</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1005507</pub-id><pub-id pub-id-type="pmid">28422957</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schwalger</surname> <given-names>T.</given-names></name> <name><surname>Droste</surname> <given-names>F.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2015</year>). <article-title>Statistical structure of neural spiking under non-poissonian or other non-white stimulation</article-title>. <source>J. Comput. Neurosci.</source> <volume>39</volume>, <fpage>29</fpage>&#x02013;<lpage>51</lpage>. <pub-id pub-id-type="doi">10.1007/s10827-015-0560-x</pub-id><pub-id pub-id-type="pmid">25936628</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shafi</surname> <given-names>M.</given-names></name> <name><surname>Zhou</surname> <given-names>Y.</given-names></name> <name><surname>Quintana</surname> <given-names>J.</given-names></name> <name><surname>Chow</surname> <given-names>C.</given-names></name> <name><surname>Fuster</surname> <given-names>J.</given-names></name> <name><surname>Bodner</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>Variability in neuronal activity in primate cortex during working memory tasks</article-title>. <source>Neuroscience</source> <volume>146</volume>, <fpage>1082</fpage>&#x02013;<lpage>1108</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroscience.2006.12.072</pub-id><pub-id pub-id-type="pmid">17418956</pub-id></citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shea-Brown</surname> <given-names>E.</given-names></name> <name><surname>Josi&#x00107;</surname> <given-names>K.</given-names></name> <name><surname>de la Rocha</surname> <given-names>J.</given-names></name> <name><surname>Doiron</surname> <given-names>B.</given-names></name></person-group> (<year>2008</year>). <article-title>Correlation and synchrony transfer in integrate-and-fire neurons: basic properties and consequences for coding</article-title>. <source>Phys. Rev. Lett.</source> <volume>100</volume>:<fpage>108102</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.100.108102</pub-id><pub-id pub-id-type="pmid">18352234</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Siegle</surname> <given-names>P.</given-names></name> <name><surname>Goychuk</surname> <given-names>I.</given-names></name> <name><surname>P. Talkner</surname> <given-names>P.</given-names></name> <name><surname>H&#x000E4;nggi</surname> <given-names>P.</given-names></name></person-group> (<year>2010</year>). <article-title>Markovian embedding of non-Markovian superdiffusion</article-title>. <source>Phys. Rev. E</source> <volume>81</volume>:<fpage>011136</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.81.011136</pub-id><pub-id pub-id-type="pmid">20365352</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sompolinsky</surname> <given-names>H.</given-names></name> <name><surname>Crisanti</surname> <given-names>A.</given-names></name> <name><surname>Sommers</surname> <given-names>H. J.</given-names></name></person-group> (<year>1988</year>). <article-title>Chaos in random neural networks</article-title>. <source>Phys. Rev. Lett.</source> <volume>61</volume>:<fpage>259</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevLett.61.259</pub-id><pub-id pub-id-type="pmid">10039285</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sompolinsky</surname> <given-names>H.</given-names></name> <name><surname>Zippelius</surname> <given-names>A.</given-names></name></person-group> (<year>1982</year>). <article-title>Relaxational dynamics of the edwards-anderson model and the mean-field theory of spin-glasses</article-title>. <source>Phys. Rev. B</source> <volume>25</volume>:<fpage>6860</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevB.25.6860</pub-id></citation></ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Song</surname> <given-names>S.</given-names></name> <name><surname>Sj&#x000F6;str&#x000F6;m</surname> <given-names>P. J.</given-names></name> <name><surname>Reigl</surname> <given-names>M.</given-names></name> <name><surname>Nelson</surname> <given-names>S.</given-names></name> <name><surname>Chklovskii</surname> <given-names>D. B.</given-names></name></person-group> (<year>2005</year>). <article-title>Highly nonrandom features of synaptic connectivity in local cortical circuits</article-title>. <source>Plos Comput. Biol.</source> <volume>3</volume>:<fpage>e68</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pbio.0030068</pub-id><pub-id pub-id-type="pmid">15737062</pub-id></citation></ref>
<ref id="B72">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Spiridon</surname> <given-names>M.</given-names></name> <name><surname>Gerstner</surname> <given-names>W.</given-names></name></person-group> (<year>1999</year>). <article-title>Noise spectrum and signal transmission through a population of spiking neurons</article-title>. <source>Netw. Comput. Neural Syst.</source> <volume>10</volume>, <fpage>257</fpage>&#x02013;<lpage>272</lpage>. <pub-id pub-id-type="pmid">10496476</pub-id></citation></ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Timme</surname> <given-names>M.</given-names></name> <name><surname>Geisel</surname> <given-names>T.</given-names></name> <name><surname>Wolf</surname> <given-names>F.</given-names></name></person-group> (<year>2006</year>). <article-title>Speed of synchronization in complex networks of neural oscillators: analytic results based on random matrix theory</article-title>. <source>Chaos</source> <volume>16</volume>:<fpage>015108</fpage>. <pub-id pub-id-type="doi">10.1063/1.2150775</pub-id><pub-id pub-id-type="pmid">16599774</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tomov</surname> <given-names>P.</given-names></name> <name><surname>Pena</surname> <given-names>R. F.</given-names></name> <name><surname>Roque</surname> <given-names>A. C.</given-names></name> <name><surname>Zaks</surname> <given-names>M. A.</given-names></name></person-group> (<year>2016</year>). <article-title>Mechanisms of self-sustained oscillatory states in hierarchical modular networks with mixtures of electrophysiological cell types</article-title>. <source>Front. Comput. Neurosc.</source> <volume>10</volume>:<fpage>23</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2016.00023</pub-id><pub-id pub-id-type="pmid">27047367</pub-id></citation></ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tomov</surname> <given-names>P.</given-names></name> <name><surname>Pena</surname> <given-names>R. F.</given-names></name> <name><surname>Zaks</surname> <given-names>M. A.</given-names></name> <name><surname>Roque</surname> <given-names>A. C.</given-names></name></person-group> (<year>2014</year>). <article-title>Sustained oscillations, irregular firing, and chaotic dynamics in hierarchical modular networks with mixtures of electrophysiological cell types</article-title>. <source>Front. Comput. Neurosc.</source> <volume>8</volume>:<fpage>103</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2014.00103</pub-id><pub-id pub-id-type="pmid">25228879</pub-id></citation></ref>
<ref id="B76">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Trousdale</surname> <given-names>J.</given-names></name> <name><surname>Hu</surname> <given-names>Y.</given-names></name> <name><surname>Shea-Brown</surname> <given-names>E.</given-names></name> <name><surname>Josic</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>Impact of network structure and cellular response on spike time correlations</article-title>. <source>PLoS Comput. Biol.</source> <volume>8</volume>:<fpage>e1002408</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002408</pub-id><pub-id pub-id-type="pmid">22457608</pub-id></citation></ref>
<ref id="B77">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tuckwell</surname> <given-names>H. C.</given-names></name></person-group> (<year>1988</year>). <source>Introduction to Theoretical Neurobiology</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>.</citation></ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Vreeswijk</surname> <given-names>C.</given-names></name> <name><surname>Abbott</surname> <given-names>L.</given-names></name> <name><surname>Ermentrout</surname> <given-names>G.</given-names></name></person-group> (<year>1994</year>). <article-title>When inhibition not excitation synchronizes neural firing</article-title>. <source>J. Comput. Neurosci.</source> <volume>1</volume>, <fpage>313</fpage>&#x02013;<lpage>321</lpage>.</citation></ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Vreeswijk</surname> <given-names>C.</given-names></name> <name><surname>Sompolinsky</surname> <given-names>H.</given-names></name></person-group> (<year>1996</year>). <article-title>Chaos in neuronal networks with balanced excitatory and inhibitory activity</article-title>. <source>Science</source> <volume>274</volume>, <fpage>1724</fpage>&#x02013;<lpage>1726</lpage>. <pub-id pub-id-type="pmid">8939866</pub-id></citation></ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vilela</surname> <given-names>R. D.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2009a</year>). <article-title>Are the input parameters of white noise driven integrate and fire neurons uniquely determined by rate and CV?</article-title> <source>J. Theor. Biol.</source> <volume>257</volume>, <fpage>90</fpage>&#x02013;<lpage>99</lpage>. <pub-id pub-id-type="doi">10.1016/j.jtbi.2008.11.004</pub-id><pub-id pub-id-type="pmid">19063904</pub-id></citation></ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vilela</surname> <given-names>R. D.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2009b</year>). <article-title>A comparative study of three different integrate-and-fire neurons: spontaneous activity, dynamical response, and stimulus-induced correlation</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>80</volume>:<fpage>031909</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.80.031909</pub-id></citation></ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wieland</surname> <given-names>S.</given-names></name> <name><surname>Bernardi</surname> <given-names>D.</given-names></name> <name><surname>Schwalger</surname> <given-names>T.</given-names></name> <name><surname>Lindner</surname> <given-names>B.</given-names></name></person-group> (<year>2015</year>). <article-title>Slow fluctuations in recurrent networks of spiking neurons</article-title>. <source>Phys. Rev. E Stat. Nonlin. Soft Matter Phys.</source> <volume>92</volume>:<fpage>040901</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.92.040901</pub-id><pub-id pub-id-type="pmid">26565154</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn0001"><p><sup>1</sup>This is evident for a finite synaptic filter, that leads to a summation of many independent continuous functions. For delta synapses, we add up spike trains and so it becomes questionable, how they can approach a Gaussian statistics. In this latter case we should consider the effect of the summed shot noise on a dynamical system such as the integrate-and-fire neuron: the sum over a small time interval (smaller than the membrane time constant but large enough to collect many independent spikes from the presynaptic neurons) yields a spike count which can be well approximated by a Gaussian variable; this is similar to the common diffusion approximation (Tuckwell, <xref ref-type="bibr" rid="B77">1988</xref>), which, however, additionally involves the assumption of a Poissonian input spike train. In this sense, the Gaussian approximation can be applied to sums of spike trains (see also Figure <xref ref-type="fig" rid="F12">12</xref> and the surrounding discussion, for a test of the Gaussianity of the input current).</p></fn>
<fn id="fn0002"><p><sup>2</sup>For the simpler but still formidable problem of how neuron pairs respond to cross-correlated Gaussian white noise sources, see, for instance, Doiron et al. (<xref ref-type="bibr" rid="B13">2004</xref>); de la Rocha et al. (<xref ref-type="bibr" rid="B10">2007</xref>); Shea-Brown et al. (<xref ref-type="bibr" rid="B67">2008</xref>); Ostojic et al. (<xref ref-type="bibr" rid="B54">2009</xref>); Vilela and Lindner (<xref ref-type="bibr" rid="B81">2009b</xref>); Deniz and Rotter (<xref ref-type="bibr" rid="B12">2017</xref>).</p></fn>
</fn-group>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> This paper was developed within the scope of the IRTG 1740/TRP 2015/50122-0, funded by DFG/FAPESP. RP and ACR are also part of the Research, Innovation and Dissemination Center for Neuromathematics FAPESP grant (2013/07699-0). RP is supported by a FAPESP scholarship (2013/25667-8). ACR is partially supported by a CNPq fellowship (grant 306251/2014-0). DB is supported by the DFG (GRK 1589/2).</p></fn>
</fn-group>
</back>
</article>