<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2018.00210</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Stochastic IMT (Insulator-Metal-Transition) Neurons: An Interplay of Thermal and Threshold Noise at Bifurcation</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Parihar</surname> <given-names>Abhinav</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/471208/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Jerry</surname> <given-names>Matthew</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/513670/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Datta</surname> <given-names>Suman</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/233473/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Raychowdhury</surname> <given-names>Arijit</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c002"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/513572/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Electrical and Computer Engineering, Georgia Institute of Technology</institution>, <addr-line>Atlanta, GA</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Electrical Engineering, University of Notre Dame</institution>, <addr-line>Notre Dame, IN</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Themis Prodromakis, University of Southampton, United Kingdom</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Adnan Mehonic, University College London, United Kingdom; Rune W. Berg, University of Copenhagen, Denmark</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Abhinav Parihar <email>aparihar6&#x00040;gatech.edu</email></corresp>
<corresp id="c002">Arijit Raychowdhury <email>arijit.raychowdhury&#x00040;ece.gatech.edu</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Neuromorphic Engineering, a section of the journal Frontiers in Neuroscience</p></fn></author-notes>
<pub-date pub-type="epub">
<day>04</day>
<month>04</month>
<year>2018</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>12</volume>
<elocation-id>210</elocation-id>
<history>
<date date-type="received">
<day>25</day>
<month>08</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>15</day>
<month>03</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2018 Parihar, Jerry, Datta and Raychowdhury.</copyright-statement>
<copyright-year>2018</copyright-year>
<copyright-holder>Parihar, Jerry, Datta and Raychowdhury</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p>Artificial neural networks can harness stochasticity in multiple ways to enable a vast class of computationally powerful models. Boltzmann machines and other stochastic neural networks have been shown to outperform their deterministic counterparts by allowing dynamical systems to escape local energy minima. Electronic implementation of such stochastic networks is currently limited to addition of algorithmic noise to digital machines which is inherently inefficient; albeit recent efforts to harness physical noise in devices for stochasticity have shown promise. To succeed in fabricating electronic neuromorphic networks we need experimental evidence of devices with measurable and controllable stochasticity which is complemented with the development of reliable statistical models of such observed stochasticity. Current research literature has sparse evidence of the former and a complete lack of the latter. This motivates the current article where we demonstrate a stochastic neuron using an insulator-metal-transition (IMT) device, based on electrically induced phase-transition, in series with a tunable resistance. We show that an IMT neuron has dynamics similar to a piecewise linear FitzHugh-Nagumo (FHN) neuron and incorporates all characteristics of a spiking neuron in the device phenomena. We experimentally demonstrate spontaneous stochastic spiking along with electrically controllable firing probabilities using Vanadium Dioxide (VO<sub>2</sub>) based IMT neurons which show a sigmoid-like transfer function. The stochastic spiking is explained by two noise sources - thermal noise and threshold fluctuations, which act as precursors of bifurcation. As such, the IMT neuron is modeled as an Ornstein-Uhlenbeck (OU) process with a fluctuating boundary resulting in transfer curves that closely match experiments. The moments of interspike intervals are calculated analytically by extending the first-passage-time (FPT) models for Ornstein-Uhlenbeck (OU) process to include a fluctuating boundary. We find that the coefficient of variation of interspike intervals depend on the relative proportion of thermal and threshold noise, where threshold noise is the dominant source in the current experimental demonstrations. As one of the first comprehensive studies of a stochastic neuron hardware and its statistical properties, this article would enable efficient implementation of a large class of neuro-mimetic networks and algorithms.</p></abstract>
<kwd-group>
<kwd>stochastic neuron</kwd>
<kwd>insulator-metal transition</kwd>
<kwd>FitzHugh-Nagumo (FHN) neuron model</kwd>
<kwd>Ornstein-Uhlenbeck process</kwd>
<kwd>threshold noise</kwd>
<kwd>vanadium-dioxide</kwd>
</kwd-group>
<contract-num rid="cn001">1640081</contract-num>
<contract-num rid="cn001">1317560</contract-num>
<contract-num rid="cn001">1317373</contract-num>
<contract-num rid="cn002">2698.001</contract-num>
<contract-num rid="cn002">2698.002</contract-num>
<contract-sponsor id="cn001">National Science Foundation<named-content content-type="fundref-id">10.13039/100000001</named-content></contract-sponsor>
<contract-sponsor id="cn002">Semiconductor Research Corporation<named-content content-type="fundref-id">10.13039/100000028</named-content></contract-sponsor>
<counts>
<fig-count count="7"/>
<table-count count="1"/>
<equation-count count="12"/>
<ref-count count="21"/>
<page-count count="8"/>
<word-count count="4914"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>A growing need for efficient machine-learning in autonomous systems coupled with an interest in solving computationally hard optimization problems has led to active research in stochastic models of computing. Optimization techniques (Haykin, <xref ref-type="bibr" rid="B4">2009</xref>) including Stochastic Sampling Machines (SSM), Simulated Annealing, Stochastic Gradients etc., are examples of such models. All these algorithms are currently implemented using digital hardware which first creates a mathematically accurate platform for computing, and later adds digital noise at the algorithm level. Hence, it is enticing to construct hardware primitives that can harness the already existing physical sources of noise to create a stochastic computing platform. The principal challenge with such efforts is the lack of stable or reproducible distributions, or functions of distributions, of physical noise. One basic stochastic unit which enables a systematic construction of stochastic hardware has long been known&#x02014;the stochastic neuron (Gerstner and Kistler, <xref ref-type="bibr" rid="B3">2002</xref>)&#x02014;which is also believed to be the unit of computation in the human brain. Moreover, recent studies (Buesing et al., <xref ref-type="bibr" rid="B1">2011</xref>) have demonstrated practical applications like sampling using networks of such stochastic spiking neurons. There have been some attempts for building neuron hardware (Indiveri et al., <xref ref-type="bibr" rid="B5">2006</xref>; Pickett et al., <xref ref-type="bibr" rid="B13">2013</xref>; Mehonic and Kenyon, <xref ref-type="bibr" rid="B11">2016</xref>; Sengupta et al., <xref ref-type="bibr" rid="B15">2016</xref>; Tuma et al., <xref ref-type="bibr" rid="B20">2016</xref>), but building a neuron with self-sustained spikes, or oscillations, which are stochastic in nature and where the probability of firing is controllable using a signal has been challenging. Here, we demonstrate and analytically study a true stochastic neuron (Jerry et al., <xref ref-type="bibr" rid="B6">2017a</xref>) which is fabricated using oscillators (Shukla et al., <xref ref-type="bibr" rid="B16">2014a</xref>,<xref ref-type="bibr" rid="B17">b</xref>; Parihar et al., <xref ref-type="bibr" rid="B12">2015</xref>) based on insulator-metal transition (IMT) materials, e.g., Vanadium Dioxide (VO<sub>2</sub>), wherein the inherent physical noise in the dynamics is used to implement stochasticity. The firing probability, and not just the deterministic frequency of oscillations or spikes, is controllable using an electrical signal. We also show that such an IMT neuron has similar dynamics as a piecewise linear FitzHugh-Nagumo (FHN) neuron with thermal noise along with threshold fluctuations as precursors of bifurcation resulting in a sigmoid-like transfer function for the neural firing rates. By analyzing the variance of interspike interval, we determine that for the range of thermal noise present in our experimental demonstrations, threshold fluctuations are responsible for most of the stochasticity compared to thermal noise.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>2. Materials and methods</title>
<sec>
<title>2.1. IMT phase change neuron model</title>
<p>A stochastic IMT neuron is fabricated using relaxation oscillators (Shukla et al., <xref ref-type="bibr" rid="B17">2014b</xref>; Parihar et al., <xref ref-type="bibr" rid="B12">2015</xref>) composed of an IMT phase change device, e.g., Vanadium Dioxide (VO<sub>2</sub>), in series with a tunable resistance, e.g., transistor (Shukla et al., <xref ref-type="bibr" rid="B16">2014a</xref>) (Figure <xref ref-type="fig" rid="F1">1A</xref>). An IMT device is a two terminal device with two resistive states&#x02014;insulating (I) and metallic (M), and the device transitions between the two states based on the applied electric field (which in turn changes the current through the device and the corresponding temperature) across it. The phase transitions are hysteretic in nature, which means that the IMT (insulator-to-metal) transition does not occur at the same voltage as the MIT (metal-to-insulator) transition. For a range of values of the series resistance, the resultant circuit shows spontaneous oscillations due to hysteresis and a lack of stable point (Parihar et al., <xref ref-type="bibr" rid="B12">2015</xref>). Overall, the series resistance acts as a parameter for bifurcation between a spiking (or oscillating) state and a resting state of an IMT neuron.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p><bold>(A)</bold> VO<sub>2</sub> based IMT spiking neuron circuit consisting of a VO<sub>2</sub> device in series with a tunable resistance. <bold>(B)</bold> Equivalent circuit of IMT neuron using a series inductance <italic>L</italic> and a parallel capacitance <italic>C</italic>.</p></caption>
<graphic xlink:href="fnins-12-00210-g0001.tif"/>
</fig>
<p>The equivalent circuit model for an IMT oscillator is shown in Figure <xref ref-type="fig" rid="F1">1B</xref> with the hysteretic switching conductance <italic>g</italic><sub><italic>v</italic>(<italic>m</italic>/<italic>i</italic>)</sub> (<italic>g</italic><sub><italic>vm</italic></sub> in metallic and <italic>g</italic><sub><italic>vi</italic></sub> in insulating state), a series inductance <italic>L</italic>, and a parallel internal capacitance <italic>C</italic>. Let the IMT and MIT thresholds of the device be denoted by <italic>v</italic><sub><italic>h</italic></sub> and <italic>v</italic><sub><italic>l</italic></sub>, respectively, with <italic>v</italic><sub><italic>h</italic></sub> &#x0003E; <italic>v</italic><sub><italic>l</italic></sub>, and the current-voltage relationship of the hysteretic conductance be</p>
<disp-formula id="E1"><mml:math id="M1"><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mi>h</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>i</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:mi>s</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></disp-formula>
<p>where <italic>h</italic> is linear in <italic>i</italic><sub><italic>i</italic></sub> and <italic>s</italic> is the state&#x02014;metallic (M) or insulating (I).</p>
<p>The system dynamics is then given by:</p>
<disp-formula id="E2"><label>(1)</label><mml:math id="M2"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;</mml:mtext><mml:mi>L</mml:mi><mml:mfrac><mml:mrow><mml:mi>d</mml:mi><mml:msub><mml:mi>i</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub><mml:mo>&#x02212;</mml:mo><mml:mi>h</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>i</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>,</mml:mo><mml:mi>s</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>o</mml:mi></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi>C</mml:mi><mml:mfrac><mml:mrow><mml:mi>d</mml:mi><mml:msub><mml:mi>v</mml:mi><mml:mi>o</mml:mi></mml:msub></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:msub><mml:mi>i</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>g</mml:mi><mml:mi>s</mml:mi></mml:msub><mml:msub><mml:mi>v</mml:mi><mml:mi>o</mml:mi></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>with <italic>i</italic><sub><italic>i</italic></sub> and <italic>v</italic><sub><italic>o</italic></sub> as shown in Figure <xref ref-type="fig" rid="F1">1B</xref> and <italic>s</italic> is considered as an independent variable.</p>
</sec>
<sec>
<title>2.2. Mechanism of oscillations and spikes</title>
<p>In VO<sub>2</sub>, IMT, and MIT transitions are orders of magnitude faster than RC time constants for oscillations, as observed in frequency (Kar et al., <xref ref-type="bibr" rid="B9">2013</xref>) and time-domain measurements for voltage driven (Jerry et al., <xref ref-type="bibr" rid="B8">2016</xref>) and photoinduced transitions (Cocker et al., <xref ref-type="bibr" rid="B2">2012</xref>). As such, the change in resistance of the IMT device is assumed to be instantaneous. Figure <xref ref-type="fig" rid="F2">2A</xref> shows the phase space <italic>i</italic><sub><italic>i</italic></sub> &#x000D7; (<italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>v</italic><sub><italic>o</italic></sub>). V-I curves for IMT device in the two states metallic (M) and insulating (I) and the load line for series conductance <italic>v</italic><sub><italic>o</italic></sub> &#x0003D; <italic>i</italic><sub><italic>i</italic></sub>/<italic>g</italic><sub><italic>s</italic></sub> for the steady state are shown along with the fixed points of the system <italic>S</italic><sub>1</sub> and <italic>S</italic><sub>2</sub> in insulating and metallic states respectively. The load line and V-I curves are essentially the nullclines of <italic>v</italic><sub><italic>o</italic></sub> and <italic>i</italic><sub><italic>i</italic></sub>, respectively. The capacitance- inductance pair delays the transitions and slowly pulls the system toward the fixed points S<sub>1</sub> and S<sub>2</sub> even when the IMT device transitions instantaneously. For small <italic>L</italic>/<italic>C</italic> ratio, the eigenvector (of the coefficient matrix) with large negative eigenvalue becomes parallel to the x-axis, whereas the other eigenvector becomes parallel to AB&#x02032; or BA&#x02032; depending on the state (M or I). When the system approaches A from below (or B from above) and IMT device is insulating (or metallic) with fixed point <italic>S</italic><sub>1</sub> (or <italic>S</italic><sub>2</sub>), the IMT device transitions into metallic (or insulating) state changing the fixed point to S<sub>2</sub> (or <italic>S</italic><sub>1</sub>). Two trajectories are shown starting from points A and B each for the system (Equation 1)&#x02014;one for small <italic>L</italic>/<italic>C</italic> value (solid) and the other for large <italic>L</italic>/<italic>C</italic> value (dashed). After a transition, the system moves parallel to <italic>x</italic>-axis almost instantaneously and spends most of the time following the V-I curve toward the fixed point. Before the fixed point is reached the MIT (or IMT) transition threshold is encountered which switches the fixed point, and the cycle continues resulting in sustained oscillations or spike generation.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p><bold>(A)</bold> Trajectories (red) of system (1) in the phase space <italic>i</italic><sub><italic>i</italic></sub> &#x000D7; (<italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>v</italic><sub><italic>o</italic></sub>) for a small <italic>L</italic>/<italic>C</italic> value (solid) and a large <italic>L</italic>/<italic>C</italic> value (dashed). The <italic>i</italic><sub><italic>i</italic></sub>-nullclines of system (1) are shown as solid black lines in the metallic (AB&#x00027;) and insulating (BA&#x00027;) states of the IMT device, and S<sub>1</sub>S<sub>2</sub> is the <italic>v</italic><sub><italic>o</italic></sub>-nullcline. Depending on the state, the phase space is divided into three vertical regions - I, M and N. In the region N the <italic>i</italic><sub><italic>i</italic></sub>-nullclines are dependent on <italic>s</italic> <bold>(B)</bold> Nullclines of the FHN model in the phase space <italic>u</italic> &#x000D7; (1 &#x02212; <italic>w</italic>) where <italic>f</italic>(<italic>u</italic>) is a piecewise linear function. The dynamics of FHN neuron are equivalent to the IMT neuron in the regions M and I. In the region N, for small <italic>L</italic>/<italic>C</italic>, the difference is only in the velocity and not the direction of system trajectories as they are parallel to <italic>x</italic>-axis.</p></caption>
<graphic xlink:href="fnins-12-00210-g0002.tif"/>
</fig>
</sec>
<sec>
<title>2.3. Model approximations and connections with FHN neuron</title>
<sec>
<title>2.3.1. Non-hysteretic approximation</title>
<p>The model of (Equation 1) is very similar to a piecewise linear caricature of FitzHugh-Nagumo (FHN) neuron model (Gerstner and Kistler, <xref ref-type="bibr" rid="B3">2002</xref>), also called the McKean&#x00027;s caricature (McKean, <xref ref-type="bibr" rid="B10">1970</xref>; Tonnelier, <xref ref-type="bibr" rid="B19">2003</xref>). Mathematically, the FHN model is given by:</p>
<disp-formula id="E3"><label>(2)</label><mml:math id="M3"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mi>d</mml:mi><mml:mi>u</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mi>f</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>u</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x02212;</mml:mo><mml:mi>w</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>I</mml:mi><mml:mrow><mml:mi>e</mml:mi><mml:mi>x</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi>&#x003C4;</mml:mi><mml:mfrac><mml:mrow><mml:mi>d</mml:mi><mml:mi>w</mml:mi></mml:mrow><mml:mrow><mml:mi>d</mml:mi><mml:mi>t</mml:mi></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mi>u</mml:mi><mml:mo>&#x02212;</mml:mo><mml:mi>b</mml:mi><mml:mi>w</mml:mi><mml:mo>+</mml:mo><mml:mi>a</mml:mi></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>f</italic>(<italic>u</italic>) is a polynomial of third degree, e.g., <italic>f</italic>(<italic>u</italic>) &#x0003D; <italic>u</italic> &#x02212; <italic>u</italic><sup>3</sup>/3, and <italic>I</italic><sub><italic>ext</italic></sub> is the parameter for bifurcation, as opposed to <italic>g</italic><sub><italic>s</italic></sub> in Equation (1). In the FHN model, one variable (<italic>u</italic>), possessing cubic nonlinearity, allows regenerative self-excitation via a positive feedback, and the second, a recovery variable (<italic>w</italic>), possessing linear dynamics, provides a slower negative feedback. It was reasoned in McKean (<xref ref-type="bibr" rid="B10">1970</xref>) that the essential features of FHN model are retained in a &#x0201C;caricature&#x0201D; where the cubic non-linearity is replaced by a piecewise linear function <italic>f</italic>(<italic>u</italic>). Nullclines of (Equation 2) with a piecewise linear <italic>f</italic>(<italic>u</italic>) are shown in Figure <xref ref-type="fig" rid="F2">2B</xref> in the phase space <italic>u</italic> &#x000D7; (1 &#x02212; <italic>w</italic>). A function <italic>f</italic>(<italic>u</italic>) is trivially possible such that it is equal to <italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>h</italic>(<italic>i</italic><sub><italic>i</italic></sub>, <italic>s</italic>) in the regions M and I, hence making the <italic>u</italic>-nullcline similar to the <italic>i</italic><sub><italic>i</italic></sub>-nullcline in those regions. In the region N, the difference between <italic>f</italic>(<italic>u</italic>) and <italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>h</italic>(<italic>i</italic><sub><italic>i</italic></sub>, <italic>s</italic>) for any state <italic>s</italic> does not result in a difference in the direction of system trajectories but only in their velocity, because for small <italic>L</italic>/<italic>C</italic> the trajectories are almost parallel to <italic>x</italic>-axis. Bifurcation in VO<sub>2</sub> neuron is achieved by tuning the load line using a tunable resistance (<italic>g</italic><sub><italic>s</italic></sub>), or a series transistor (Figure <xref ref-type="fig" rid="F3">3A</xref>). Figure <xref ref-type="fig" rid="F3">3B</xref> shows two load line curves corresponding to different gate voltages (<italic>v</italic><sub><italic>gs</italic></sub>), where one gives rise to spikes while the other results in a resting state.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p><bold>(A)</bold> IMT neuron with series transistor used to achieve bifurcation between a spiking and a resting state. <bold>(B)</bold> Nullclines of the system with series transistor in the phase space <italic>i</italic><sub><italic>i</italic></sub> &#x000D7; <italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>v</italic><sub><italic>o</italic></sub> for two different <italic>v</italic><sub><italic>gs</italic></sub> values for spiking and resting states. Bifurcation occurs when a stable points crosses the boundary of region <italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>v</italic><sub><italic>o</italic></sub> &#x02208; [<italic>v</italic><sub><italic>l</italic></sub>, <italic>v</italic><sub><italic>h</italic></sub>].</p></caption>
<graphic xlink:href="fnins-12-00210-g0003.tif"/>
</fig>
</sec>
<sec>
<title>2.3.2. Single dimensional approximation</title>
<p>Moreover, a single dimensional piecewise approximation of the system can be performed using a dimensionality reduction by replacing the movement along the eigenvector parallel to the x-axis with an instantaneous transition from A to A&#x02032;, or B to B&#x02032;. This leaves a 1-dimensional subsystem in M and I each along the V-I curves AB&#x02032; and BA&#x02032;. Experiments using VO<sub>2</sub> show that the metallic state conductance <italic>g</italic><sub><italic>vm</italic></sub> is very high which causes the charging cycle of <italic>v</italic><sub><italic>o</italic></sub> to be almost instantaneous (Figure <xref ref-type="fig" rid="F4">4</xref>) and resembles a spike of a biological neuron. As such, the spiking statistics can be studied by modeling just the discharge cycle of <italic>v</italic><sub><italic>o</italic></sub>. The inductance being negligible can be effectively removed and only the capacitance is needed for modeling the 1D subsystem of insulating state (<bold>Figure 6A</bold>) making <italic>v</italic><sub><italic>i</italic></sub> &#x0003D; <italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>v</italic><sub><italic>o</italic></sub>.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Experimental waveforms of VO<sub>2</sub> based spiking neuron for various <italic>v</italic><sub><italic>gs</italic></sub> values (1.78, 1.79, and 1.81 V). A VO<sub>2</sub> neuron shows almost instantaneous charging (spike) in metallic state.</p></caption>
<graphic xlink:href="fnins-12-00210-g0004.tif"/>
</fig>
</sec>
</sec>
<sec>
<title>2.4. Noise induced stochastic behavior</title>
<p>The two important noise sources which induce stochasticity in an IMT neuron are (a) V<sub><italic>IMT</italic></sub> (<italic>v</italic><sub><italic>h</italic></sub>) fluctuations (Zhang et al., <xref ref-type="bibr" rid="B21">2016</xref>; Jerry et al., <xref ref-type="bibr" rid="B7">2017b</xref>), and (b) thermal noise. Thermal noise &#x003B7;(<italic>t</italic>) is modeled in the circuit (<bold>Figure 6A</bold>) as a white noise voltage &#x003B7;(<italic>t</italic>)d<italic>t</italic> &#x0003D; &#x003C3;<sub><italic>t</italic></sub>d<italic>w</italic><sub><italic>t</italic></sub> where <italic>w</italic><sub><italic>t</italic></sub> is the standard weiner process and <inline-formula><mml:math id="M4"><mml:msubsup><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> is the infinitesimal thermal noise variance. The threshold <italic>v</italic><sub><italic>h</italic></sub> is assumed constant during a spike, but varies from one spike to another. The distribution of <italic>v</italic><sub><italic>h</italic></sub> from spike to spike is assumed to be Gaussian or subGaussian whose parameters are estimated from experimental observations of oscillations. If the series transistor always remains in saturation and show linear voltage-current relationship, as is the case in our VO<sub>2</sub> based experiments, the discharge phase can be described by an Ornstein-Uhlenbeck (OU) process</p>
<disp-formula id="E4"><label>(3)</label><mml:math id="M5"><mml:mrow><mml:mtext>d</mml:mtext><mml:mi>x</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mi>&#x003B8;</mml:mi></mml:mfrac><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003BC;</mml:mi><mml:mo>&#x02212;</mml:mo><mml:mi>x</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mtext>d</mml:mtext><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mi>&#x003C3;</mml:mi><mml:mtext>d</mml:mtext><mml:msub><mml:mi>w</mml:mi><mml:mi>t</mml:mi></mml:msub></mml:mrow></mml:math></disp-formula>
<p>where &#x003BC;, &#x003B8;, and &#x003C3; are functions of circuit parameters of the series transistor, the IMT device and &#x003C3;<sub><italic>t</italic></sub>. The interspike interval is thus the first-passage-time (FPT) of this OU process, but with a fluctuating boundary.</p>
<sec>
<title>2.4.1. OU process with constant boundary</title>
<p>Analytical expressions for the FPT of OU process (with &#x003BC; &#x0003D; 0) for a constant boundary were derived using the Laplace transform method in Ricciardi and Sato (<xref ref-type="bibr" rid="B14">1988</xref>). Reproducing some of its results, let the first passage time for the system (Equation 3), with &#x003BC; &#x0003D; 0, which starts at <italic>x</italic>(0) &#x0003D; <italic>x</italic><sub>0</sub> and hits a boundary <italic>S</italic>, be denoted by the random variable <bold>t<sub>f</sub></bold>(<italic>S, x</italic><sub>0</sub>), and its <italic>m</italic>th moment by &#x003C4;<sub><italic>m</italic></sub>(<italic>S, x</italic><sub>0</sub>). Also, let <inline-formula><mml:math id="M6"><mml:mrow><mml:mover accent='true'><mml:mrow><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>f</mml:mi></mml:mstyle></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></inline-formula> be the FPT for another OU process with &#x003BC; &#x0003D; 0, &#x003B8; &#x0003D; 1, and &#x003C3; &#x0003D; 2, and <inline-formula><mml:math id="M7"><mml:mover accent="false"><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>x</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula> be its <italic>mth</italic> moment. Then time and space scaling for the OU process imply that</p>
<disp-formula id="E5"><label>(4)</label><mml:math id="M8"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>f</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mover><mml:mo>=</mml:mo><mml:mi>d</mml:mi></mml:mover><mml:mi>&#x003B8;</mml:mi><mml:mover accent='true'><mml:mrow><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>f</mml:mi></mml:mstyle></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mo>&#x02234;</mml:mo><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>m</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:msup><mml:mi>&#x003B8;</mml:mi><mml:mi>m</mml:mi></mml:msup><mml:mover accent='true'><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>m</mml:mi></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M9"><mml:mi>&#x003B1;</mml:mi><mml:mo>=</mml:mo><mml:msqrt><mml:mrow><mml:mfrac><mml:mrow><mml:mn>2</mml:mn></mml:mrow><mml:mrow><mml:mi>&#x003B8;</mml:mi><mml:msup><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:mfrac></mml:mrow></mml:msqrt></mml:math></inline-formula>. The first two moments for the base case OU process <inline-formula><mml:math id="M10"><mml:mover accent="false"><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover></mml:math></inline-formula> and <inline-formula><mml:math id="M11"><mml:mover accent="false"><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003C4;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:mrow><mml:mo>&#x0007E;</mml:mo></mml:mover></mml:math></inline-formula> are given by</p>
<disp-formula id="E6"><label>(5)</label><mml:math id="M12"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mover accent='true'><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mn>1</mml:mn></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mover accent='true'><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mn>2</mml:mn></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mn>2</mml:mn><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:msup><mml:mrow><mml:mo>(</mml:mo><mml:mi>S</mml:mi><mml:mo>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x02212;</mml:mo><mml:mn>2</mml:mn><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>S</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo>+</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where &#x003D5;<sub><italic>k</italic></sub>(<italic>z</italic>) can be written as an infinite sum</p>
<disp-formula id="E7"><label>(6)</label><mml:math id="M13"><mml:mrow><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mi>k</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>z</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mrow><mml:msup><mml:mn>2</mml:mn><mml:mi>k</mml:mi></mml:msup></mml:mrow></mml:mfrac><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>&#x0221E;</mml:mi></mml:munderover><mml:mrow><mml:mfrac><mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:msqrt><mml:mn>2</mml:mn></mml:msqrt><mml:mi>z</mml:mi></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mi>n</mml:mi></mml:msup><mml:mo>&#x00393;</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mfrac><mml:mi>n</mml:mi><mml:mn>2</mml:mn></mml:mfrac></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mi>&#x003C1;</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>n</mml:mi><mml:mo>,</mml:mo><mml:mi>k</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mrow><mml:mi>n</mml:mi><mml:mo>!</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:mrow></mml:math></disp-formula>
<p>with &#x003C1;(<italic>n, k</italic>) being a function of the digamma function (Ricciardi and Sato, <xref ref-type="bibr" rid="B14">1988</xref>).</p>
</sec>
<sec>
<title>2.4.2. OU process with fluctuating boundary</title>
<p>We extend this framework for calculating the FPT statistics with a fluctuating boundary <bold>S</bold> as follows. Let the IMT threshold be represented by the random variable <bold>v<sub>h</sub></bold>. For the VO<sub>2</sub> based IMT neuron, the 1D subsystem in the insulating phase can be converted in the form of Equation(3) with &#x003BC; &#x0003D; 0 by translating the origin to the fixed point. If this transformation is <bold>T</bold> then <italic>x</italic> &#x0003D; <bold>T</bold><italic>v</italic><sub><italic>i</italic></sub> &#x0003D; <bold>T</bold>(<italic>v</italic><sub><italic>dd</italic></sub> &#x02212; <italic>v</italic><sub><italic>o</italic></sub>), <bold>S</bold> &#x0003D; <bold>Tv<sub>h</sub></bold>, and <italic>x</italic><sub><italic>o</italic></sub> &#x0003D; <bold>T</bold><italic>v</italic><sub><italic>l</italic></sub>. The start and end points are B&#x02032; and A, respectively in Figure <xref ref-type="fig" rid="F2">2</xref>. <bold>v<sub>h</sub></bold> is assumed constant during a spike, and across spikes the distribution of <bold>v<sub>h</sub></bold> is <bold>v<sub>h</sub></bold> &#x0007E; <inline-formula><mml:math id="M14"><mml:mrow><mml:mi mathvariant="-tex-caligraphic">D</mml:mi></mml:mrow></mml:math></inline-formula>, where <inline-formula><mml:math id="M15"><mml:mrow><mml:mi mathvariant="-tex-caligraphic">D</mml:mi></mml:mrow></mml:math></inline-formula> is either Gaussian, or subGaussian. For subGaussian distributions we use the Exponential Power family EP[&#x003BA;], &#x003BA; being the shape factor. Let the interspike interval of IMT neuron be denoted by the marginal random variable <inline-formula><mml:math id="M16"><mml:mrow><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi mathvariant='-tex-caligraphic'>D</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></inline-formula>. Then <bold>t<sub>imt</sub></bold> is related to <bold>t<sub>f</sub></bold> in Equation (4), given common parameters &#x003B8; and &#x003C3;, as follows:</p>
<disp-formula id="E8"><mml:math id="M17"><mml:mrow><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi mathvariant='-tex-caligraphic'>D</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo>&#x0007C;</mml:mo><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo>=</mml:mo><mml:mi>v</mml:mi><mml:mo stretchy='false'>)</mml:mo><mml:mover><mml:mo>=</mml:mo><mml:mi>d</mml:mi></mml:mover><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>f</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:mi>v</mml:mi><mml:mo>,</mml:mo><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></disp-formula>
<p>The moments of <bold>t<sub>imt</sub></bold> can be calculated as:</p>
<disp-formula id="E9"><label>(7)</label><mml:math id="M18"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi mathvariant='-tex-caligraphic'>D</mml:mi><mml:mo>,</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mi>m</mml:mi></mml:msup></mml:mrow><mml:mo>]</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi mathvariant='-tex-caligraphic'>D</mml:mi><mml:mo>,</mml:mo><mml:mtext>T</mml:mtext><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mi>m</mml:mi></mml:msup><mml:mo>&#x0007C;</mml:mo><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo>=</mml:mo><mml:mi>v</mml:mi></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>m</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo>,</mml:mo><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mo>=</mml:mo><mml:msup><mml:mi>&#x003B8;</mml:mi><mml:mi>m</mml:mi></mml:msup><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>[</mml:mo><mml:mover accent='true'><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mi>m</mml:mi></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M19"><mml:mi>&#x003B1;</mml:mi><mml:mo>=</mml:mo><mml:msqrt><mml:mrow><mml:mfrac><mml:mrow><mml:mn>2</mml:mn></mml:mrow><mml:mrow><mml:mi>&#x003B8;</mml:mi><mml:msup><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:mfrac></mml:mrow></mml:msqrt></mml:math></inline-formula>. If <inline-formula><mml:math id="M20"><mml:mrow><mml:mi mathvariant="-tex-caligraphic">D</mml:mi></mml:mrow></mml:math></inline-formula> is Gaussian or EP[&#x003BA;] distribution and &#x003B1;<bold>T</bold> is an affine transformation, then &#x003B1;<bold>Tv<sub>h</sub></bold> also has a Gaussian or EP[&#x003BA;] distribution.</p>
</sec>
</sec>
<sec>
<title>2.5. Experiments</title>
<p>IMT devices are fabricated on a 10nm VO<sub>2</sub> thin film grown by reactive oxide molecular beam epitaxy on (001) TiO<sub>2</sub> substrate using a Veeco Gen10 system (Tashman et al., <xref ref-type="bibr" rid="B18">2014</xref>). Planar two terminal structures are formed by patterning contacts using standard electron beam lithography which defines the device length (L<sub><italic>VO</italic>2</sub>). Pd (20 nm)/Au (60 nm) contacts are then deposited by electron beam evaporation and liftoff. The devices are then isolated and the widths (W<sub><italic>VO</italic>2</sub>) are defined using a CF<sub>4</sub> based dry etch.</p>
<p>The IMT neuron is constructed using an externally connected n-channel MOSFET (ALD110802) and the fabricated VO<sub>2</sub> device. A prototypical I-V curve is shown in Figure <xref ref-type="fig" rid="F5">5A</xref>. Within the experimental data, the current is limited to an arbitrarily chosen 200 &#x003BC;A to prevent a thermal runaway and breakdown of the device while in the low resistance metallic state. It should be noted that as the metallic state corresponds to the abrupt charging cycle of <italic>v</italic><sub><italic>o</italic></sub>, limiting the current would not have noticeable effect on spiking statistics of the neuron.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p><bold>(A)</bold> The prototypical DC voltage-current characteristics for a single VO<sub>2</sub> device exhibits abrupt threshold switching at V<sub><italic>IMT</italic></sub> and V<sub><italic>MIT</italic></sub>. The current in the metallic state has been arbitrarily limited to a 200&#x003BC;A compliance current. <bold>(B)</bold> V<sub><italic>IMT</italic></sub> distribution as a function of the peak current during oscillations (value is set by the MOSFET saturation current). V<sub><italic>IMT</italic></sub> is extracted from 300&#x0002B; cycles.</p></caption>
<graphic xlink:href="fnins-12-00210-g0005.tif"/>
</fig>
<p>Threshold voltage fluctuations (cycle to cycle) were observed in all devices which were tested (&#x0003E;10). Threshold voltage distribution was estimated using the varying cycle-to-cycle threshold voltages collected from a single device. Thermal noise is not measured directly, but is estimated approximately by matching the simulation waveforms from the circuit model (Figure <xref ref-type="fig" rid="F6">6A</xref>) with the observed experimental waveforms. It can be verified that thermal noise of the transistor is not the dominant noise source by measuring the threshold variation as a function of the transistor current (Figure <xref ref-type="fig" rid="F5">5B</xref>) and observing that the distribution of switching threshold does not change with varying transistor current. Finally, the firing rate and its variation with <italic>v</italic><sub><italic>gs</italic></sub> (Figure <xref ref-type="fig" rid="F6">6B</xref>) were measured for a single device.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p><bold>(A)</bold> Noise model of IMT neuron where the noise components are the thermal noise voltage source &#x003B7;(<italic>t</italic>) and the IMT threshold fluctuation. <bold>(B)</bold> Firing rate plotted against <italic>v</italic><sub><italic>gs</italic></sub> using the analytical model for different <bold>v<sub>h</sub></bold> distributions (Constant, Gaussian, and EP[3]) and comparison with experimental observations.</p></caption>
<graphic xlink:href="fnins-12-00210-g0006.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3. Results</title>
<sec>
<title>3.1. Spiking statistics</title>
<sec>
<title>3.1.1. First moment and the firing rate</title>
<p>First moment of <bold>t<sub>imt</sub></bold> is calculated using Equations (5) and (7) as</p>
<disp-formula id="E10"><mml:math id="M21"><mml:mrow><mml:mo>&#x1D53C;</mml:mo><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>D</mml:mi></mml:mstyle><mml:mo>,</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:mo>=</mml:mo><mml:mi>&#x003B8;</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:msub><mml:mi>x</mml:mi><mml:mn>0</mml:mn></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>)</mml:mo></mml:mrow></mml:math></disp-formula>
<p>The expansion for &#x003D5;<sub><italic>k</italic></sub>(<italic>z</italic>) in Equation(6) can be used to calculate &#x1D53C;<sub><italic>v</italic><sub><italic>h</italic></sub></sub>[&#x003D5;<sub><italic>k</italic></sub>(&#x003B1;<bold>Tv<sub>h</sub></bold>)] using the moments of &#x003B1;<bold>Tv<sub>h</sub></bold> as follows</p>
<disp-formula id="E11"><mml:math id="M22"><mml:mrow><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mi>k</mml:mi></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:mo>=</mml:mo><mml:mfrac><mml:mn>1</mml:mn><mml:mrow><mml:msup><mml:mn>2</mml:mn><mml:mi>k</mml:mi></mml:msup></mml:mrow></mml:mfrac><mml:mstyle displaystyle='true'><mml:munderover><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>&#x0221E;</mml:mi></mml:munderover><mml:mrow><mml:mfrac><mml:mrow><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:msqrt><mml:mn>2</mml:mn></mml:msqrt><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mi>n</mml:mi></mml:msup><mml:mo>&#x1D53C;</mml:mo><mml:mo stretchy='false'>[</mml:mo><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mi>n</mml:mi></mml:msup><mml:mo stretchy='false'>]</mml:mo><mml:mo>&#x00393;</mml:mo><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mfrac><mml:mi>n</mml:mi><mml:mn>2</mml:mn></mml:mfrac></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mi>&#x003C1;</mml:mi><mml:mo stretchy='false'>(</mml:mo><mml:mi>n</mml:mi><mml:mo>,</mml:mo><mml:mi>k</mml:mi><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mrow><mml:mi>n</mml:mi><mml:mo>!</mml:mo></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:mrow></mml:math></disp-formula>
<p>Figure <xref ref-type="fig" rid="F6">6B</xref> shows firing rate (<inline-formula><mml:math id="M23"><mml:mrow><mml:mn>1</mml:mn><mml:mo>/</mml:mo><mml:mo>&#x1D53C;</mml:mo><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>t</mml:mi></mml:mstyle><mml:mrow><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>i</mml:mi><mml:mi>m</mml:mi><mml:mi>t</mml:mi></mml:mstyle></mml:mrow></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>D</mml:mi></mml:mstyle><mml:mo>,</mml:mo><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo></mml:mrow></mml:math></inline-formula>) as a function of <italic>v</italic><sub><italic>gs</italic></sub> for various &#x003C3;<sub><italic>t</italic></sub> values and for three distributions of threshold fluctuations. The calculations approximate the experimental observations well for all three <italic>v</italic><sub><italic>h</italic></sub> distributions, the closest being EP[3] with &#x003C3;<sub><italic>t</italic></sub> &#x0003D; 4.</p>
</sec>
<sec>
<title>3.1.2. Higher moments</title>
<p>For higher moments, higher order terms are encountered. For example, in case of the second moment, using Equations(5) and (7), we obtain</p>
<disp-formula id="E12"><mml:math id="M24"><mml:mtable columnalign='left'><mml:mtr><mml:mtd><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>[</mml:mo><mml:mover accent='true'><mml:mrow><mml:msub><mml:mi>&#x003C4;</mml:mi><mml:mn>2</mml:mn></mml:msub></mml:mrow><mml:mo stretchy='true'>&#x002DC;</mml:mo></mml:mover><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo>,</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:mo>=</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mn>2</mml:mn><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow><mml:mo>]</mml:mo></mml:mrow><mml:mo>&#x02212;</mml:mo><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mo>&#x02212;</mml:mo><mml:mn>2</mml:mn><mml:msub><mml:mo>&#x1D53C;</mml:mo><mml:mrow><mml:msub><mml:mi>v</mml:mi><mml:mi>h</mml:mi></mml:msub></mml:mrow></mml:msub><mml:mo stretchy='false'>[</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>)</mml:mo><mml:mo stretchy='false'>]</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mtext>&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;&#x000A0;</mml:mtext><mml:mo>+</mml:mo><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>2</mml:mn></mml:msub><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mi>v</mml:mi><mml:mi>l</mml:mi></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>with a higher order term <inline-formula><mml:math id="M25"><mml:mrow><mml:msub><mml:mi>&#x003D5;</mml:mi><mml:mn>1</mml:mn></mml:msub><mml:msup><mml:mrow><mml:mo stretchy='false'>(</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>T</mml:mi></mml:mstyle><mml:msub><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>v</mml:mi></mml:mstyle><mml:mstyle mathvariant='bold' mathsize='normal'><mml:mi>h</mml:mi></mml:mstyle></mml:msub><mml:mo stretchy='false'>)</mml:mo></mml:mrow><mml:mn>2</mml:mn></mml:msup></mml:mrow></mml:math></inline-formula>. In the case of the third moment we obtain &#x003D5;<sub>1</sub>(&#x003B1;<bold>Tv<sub>h</sub></bold>)&#x003D5;<sub>2</sub>(&#x003B1;<bold>Tv<sub>h</sub></bold>). As each &#x003D5;<sub><italic>k</italic></sub> term is an infinite sum, we construct a cauchy product expansion for the higher order term using the infinite sum expansions of the constituent &#x003D5;<sub><italic>k</italic></sub>s and then distribute the expectation over addition. For example, if the &#x003D5;<sub><italic>k</italic></sub> expansions of &#x003D5;<sub>1</sub>(<italic>z</italic>) and &#x003D5;<sub>2</sub>(<italic>z</italic>) are (&#x02211;<italic>a</italic><sub><italic>i</italic></sub>) and (&#x02211;<italic>b</italic><sub><italic>i</italic></sub>), respectively, then the cauchy product expansion of &#x003D5;<sub>1</sub>(<italic>z</italic>)&#x003D5;<sub>2</sub>(<italic>z</italic>) can be calculated as &#x02211;<italic>c</italic><sub><italic>i</italic></sub>, where <italic>c</italic><sub><italic>i</italic></sub> is a function of <italic>a</italic><sub>1&#x02026;<italic>i</italic></sub> and <italic>b</italic><sub>1&#x02026;<italic>i</italic></sub>, and the expectation &#x1D53C;[&#x003D5;<sub>1</sub>(<italic>z</italic>)&#x003D5;<sub>2</sub>(<italic>z</italic>)] &#x0003D; &#x02211;&#x1D53C;[<italic>c</italic><sub><italic>i</italic></sub>]. Since <italic>c</italic><sub><italic>i</italic></sub> is a polynomial in <italic>z</italic>, &#x1D53C;[<italic>c</italic><sub><italic>i</italic></sub>] can be calculated using the moments of <italic>z</italic>.</p>
<p>If &#x003BC;<sub><italic>imt</italic></sub> and &#x003C3;<sub><italic>imt</italic></sub> are the mean and standard deviation of interspike intervals <bold>t<sub>imt</sub></bold>, the coefficient of variation (&#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub>) varies with the relative proportion of the thermal and the threshold induced noise. Figure <xref ref-type="fig" rid="F7">7</xref> shows &#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> (calculated using parameters matched with our VO<sub>2</sub> experiments) plotted against &#x003C3;<sub><italic>t</italic></sub> for various kinds of <bold>v<sub>h</sub></bold> distributions fitted to experimental observations. &#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> as observed in our VO<sub>2</sub> experiments is about an order of magnitude more than what would be calculated with only thermal noise using such a neuron, and hence, threshold noise contributes significant stochasticity to the spiking behavior. As the IMT neuron is setup such that the stable point is close to the IMT transition point (Figure <xref ref-type="fig" rid="F3">3B</xref>), low &#x003C3;<sub><italic>t</italic></sub> results in high and diverging &#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> for any distribution of threshold noise, and &#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> reduces with increasing &#x003C3;<sub><italic>t</italic></sub> for the range shown. For a Normally distributed <italic>v</italic><sub><italic>h</italic></sub> the variance diverges for &#x003C3;<sub><italic>t</italic></sub> &#x02272; 8, but for Exponential Power (EP) distributions with lighter tails, the variance converges for smaller values of &#x003C3;<sub><italic>t</italic></sub>. Statistical measurements on experimental data, as indicated in Figure <xref ref-type="fig" rid="F7">7</xref>, provide measures of &#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> (dotted line) and &#x003C3;<sub><italic>t</italic></sub> (shaded region). We note that EP distributions provide a better approximation of the stochastic nature of experimentally demonstrated VO<sub>2</sub> neurons as the range of &#x003C3;<sub><italic>t</italic></sub> is estimated to be &#x0003C;5.</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>&#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> for the interspike interval plotted against &#x003C3;<sub><italic>t</italic></sub> for <italic>v</italic><sub><italic>gs</italic></sub> &#x0003D; 1.8V with Constant, Gaussian, and Exponential Power (EP[&#x003BA;], where &#x003BA; is the shape factor) distributions of the threshold noise. The experimentally observed &#x003C3;<sub><italic>imt</italic></sub>/&#x003BC;<sub><italic>imt</italic></sub> for a VO<sub>2</sub> neuron is shown with a dotted line. The shaded region shows the experimentally estimated range of &#x003C3;<sub><italic>t</italic></sub> (&#x003C3;<sub><italic>t</italic></sub> &#x0003C; 5).</p></caption>
<graphic xlink:href="fnins-12-00210-g0007.tif"/>
</fig>
</sec>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4. Discussion</title>
<p>In this paper, we demonstrate and analyse an IMT based stochastic neuron hardware which relies on both threshold fluctuations and thermal noise as precursors to bifurcation. The IMT neuron emulates the functionality of theoretical neuron models completely by incorporating all neuron characteristics into device phenomena. Unlike other similar efforts, it does not need peripheral circuits alongside the core device circuit (an IMT device and a transistor) to emulate any sub-component of the spiking neuron model like thresholding, reset etc. Moreover, the neuron construction not only utilizes inherent physical noise sources for stochasticity, but also enables control of firing probability using an analog electrical signal&#x02014;the gate voltage of series transistor. This is different from previous works which control only the deterministic aspect of firing rate like the charging rate. A comparison of spiking neuron hardware characteristics in different works is shown in Table <xref ref-type="table" rid="T1">1</xref>.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Comparison of this work (experimental details from Jerry et al., <xref ref-type="bibr" rid="B6">2017a</xref>) with other spiking neuron hardware works based on different characteristics of spiking neurons.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="left"><bold>Tuma et al., <xref ref-type="bibr" rid="B20">2016</xref></bold></th>
<th valign="top" align="left"><bold>Pickett et al., <xref ref-type="bibr" rid="B13">2013</xref></bold></th>
<th valign="top" align="left"><bold>Sengupta et al., <xref ref-type="bibr" rid="B15">2016</xref></bold></th>
<th valign="top" align="left"><bold>Indiveri et al., <xref ref-type="bibr" rid="B5">2006</xref></bold></th>
<th valign="top" align="left"><bold>This work (VO<sub>2</sub>)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Neuron type</td>
<td valign="top" align="left">Integrate &#x00026; Fire</td>
<td valign="top" align="left">Hodgkin Huxley</td>
<td valign="top" align="left">Integrate &#x00026; Fire</td>
<td valign="top" align="left">Integrate &#x00026; Fire</td>
<td valign="top" align="left">Piecewise Linear FHN</td>
</tr>
<tr>
<td valign="top" align="left">Material/Platform</td>
<td valign="top" align="left">Chalcogenide</td>
<td valign="top" align="left">Mott insulator NbO<sub>2</sub></td>
<td valign="top" align="left">MTJ</td>
<td valign="top" align="left">0.35 &#x003BC;m CMOS</td>
<td valign="top" align="left">Vanadium Dioxide (VO<sub>2</sub>)</td>
</tr>
<tr>
<td valign="top" align="left">Material phenomenon</td>
<td valign="top" align="left">Phase Change</td>
<td valign="top" align="left">IMT</td>
<td valign="top" align="left">Spin transfer torque (STT)</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">IMT</td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left">Spontaneous spiking using only device</td>
<td valign="top" align="left">No</td>
<td valign="top" align="left">Yes</td>
<td valign="top" align="left">No</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Yes</td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left">Peripherals needed for spiking</td>
<td valign="top" align="left">Yes, for spike generation and reset</td>
<td valign="top" align="left">No</td>
<td valign="top" align="left">Yes, for spike generation and reset</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">No</td>
</tr>
<tr>
<td valign="top" align="left">Integration mechanism (I&#x00026;F)</td>
<td valign="top" align="left">Heat accumulation</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Magnetization accumulation</td>
<td valign="top" align="left">Capacitor charging</td>
<td valign="top" align="left">Capacitor charging</td>
</tr>
<tr>
<td valign="top" align="left">Threshold mechanism (I&#x00026;F)</td>
<td valign="top" align="left">External reset by measuring conductance</td>
<td valign="top" align="left">Spontaneous IMT</td>
<td valign="top" align="left">External reset by detecting magnet flip</td>
<td valign="top" align="left">Reset using comparator</td>
<td valign="top" align="left">Spontaneous IMT</td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left">Stochastic</td>
<td valign="top" align="left">Yes</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Yes</td>
<td valign="top" align="left">No</td>
<td valign="top" align="left">Yes</td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left">Kind of stochasticity (I&#x00026;F)</td>
<td valign="top" align="left">Reset potential</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Differential</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Threshold and differential</td>
</tr>
<tr>
<td valign="top" align="left">Source of stochasticity / noise</td>
<td valign="top" align="left">Melt-quench process</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Thermal noise</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">IMT threshold fluctuations &#x00026; Thermal noise</td>
</tr>
<tr>
<td valign="top" align="left">Control of stochastic firing rate</td>
<td valign="top" align="left">Only integration rate</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">Only integration rate</td>
<td valign="top" align="left">Only integration rate</td>
<td valign="top" align="left">Yes</td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left">Status of experiments</td>
<td valign="top" align="left">Constant stochasticity, variable integration rate</td>
<td valign="top" align="left">Deterministic spiking</td>
<td valign="top" align="left">None</td>
<td valign="top" align="left">Deterministic spiking</td>
<td valign="top" align="left">Sigmoidal variation of stochastic firing rates</td>
</tr>
<tr style="border-top: thin solid #000000;">
<td valign="top" align="left">Peak current</td>
<td valign="top" align="left">750&#x02013;800 &#x003BC;A</td>
<td/>
<td valign="top" align="left">&#x02013;</td>
<td/>
<td valign="top" align="left">200 &#x003BC;A</td>
</tr>
<tr>
<td valign="top" align="left">Power or Energy/spike</td>
<td valign="top" align="left">120 &#x003BC;W</td>
<td/>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">900 pJ / spike</td>
<td valign="top" align="left">196 pJ / spike</td>
</tr>
<tr>
<td valign="top" align="left">Voltage</td>
<td valign="top" align="left">5.5 V</td>
<td valign="top" align="left">1.75 V</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">3.3 V</td>
<td valign="top" align="left">0.7 V</td>
</tr>
<tr>
<td valign="top" align="left">Maximum firing rates</td>
<td valign="top" align="left">35&#x02013;40 KHz</td>
<td valign="top" align="left">30 KHz</td>
<td valign="top" align="left">&#x02013;</td>
<td valign="top" align="left">200 Hz</td>
<td valign="top" align="left">30 KHz</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>We also show that the neuron dynamics follow a linear &#x0201C;carricature&#x0201D; of the FitzHugh-Nagumo model with intrinsic stochasticity. The analytical models developed in this paper can also faithfully reproduce the experimentally observed transfer curve which is a stochastic property. Such analytical verification of stochastic neuron experiments is one of the first in this work. It is an important result as it indicates reproducibility of stochastic characteristics and helps in creating the pathway toward perfecting these devices. With a growing concensus that stochasticity will play a key role in solving hard computing tasks, we need efficient ways for controlled amplification and conversion of physical noise into a readable and computable form. In this regard, the IMT based neuron represents a promising solution for a stochastic computational element. Such stochastic neurons have the potential to realize bio-mimetic computational kernels that can be employed to solve a large class of optimization and machine-learning problems.</p>
</sec>
<sec id="s5">
<title>Author contributions</title>
<p>AP worked on the development of theory, simulation frameworks, and mathematical models; MJ worked on the experiments; AR advised AP and participated in the problem formulation; SD advised MJ and also participated in the design of experiments and problem formulations.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack><p>This project was supported by the National Science Foundation under grants 1640081, Expeditions in Computing Award-1317560 and CCF- 1317373, and the Nanoelectronics Research Corporation (NERC), a wholly-owned subsidiary of the Semiconductor Research Corporation (SRC), through Extremely Energy Efficient Collective Electronics (EXCEL), an SRC-NRI Nanoelectronics Research Initiative under Research Task IDs 2698.001 and 2698.002.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buesing</surname> <given-names>L.</given-names></name> <name><surname>Bill</surname> <given-names>J.</given-names></name> <name><surname>Nessler</surname> <given-names>B.</given-names></name> <name><surname>Maass</surname> <given-names>W.</given-names></name></person-group> (<year>2011</year>). <article-title>Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons</article-title>. <source>PLoS Comput. Biol.</source> <volume>7</volume>:<fpage>e1002211</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002211</pub-id><pub-id pub-id-type="pmid">22096452</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cocker</surname> <given-names>T.</given-names></name> <name><surname>Titova</surname> <given-names>L.</given-names></name> <name><surname>Fourmaux</surname> <given-names>S.</given-names></name> <name><surname>Holloway</surname> <given-names>G.</given-names></name> <name><surname>Bandulet</surname> <given-names>H.-C.</given-names></name> <name><surname>Brassard</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Phase diagram of the ultrafast photoinduced insulator-metal transition in vanadium dioxide</article-title>. <source>Phys. Rev. B</source> <volume>85</volume>:<fpage>155120</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevB.85.155120</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gerstner</surname> <given-names>W.</given-names></name> <name><surname>Kistler</surname> <given-names>W. M.</given-names></name></person-group> (<year>2002</year>). <source>Spiking Neuron Models: Single Neurons, Populations, Plasticity</source>. <publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge university press</publisher-name>.</citation></ref>
<ref id="B4">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Haykin</surname> <given-names>S. S.</given-names></name></person-group> (<year>2009</year>). <source>Neural Networks and Learning Machines</source>. <publisher-name>Prentice Hall</publisher-name>.</citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Indiveri</surname> <given-names>G.</given-names></name> <name><surname>Chicca</surname> <given-names>E.</given-names></name> <name><surname>Douglas</surname> <given-names>R.</given-names></name></person-group> (<year>2006</year>). <article-title>A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity</article-title>. <source>IEEE Trans. Neural Netw.</source> <volume>17</volume>, <fpage>211</fpage>&#x02013;<lpage>221</lpage>. <pub-id pub-id-type="doi">10.1109/TNN.2005.860850</pub-id><pub-id pub-id-type="pmid">16526488</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Jerry</surname> <given-names>M.</given-names></name> <name><surname>Parihar</surname> <given-names>A.</given-names></name> <name><surname>Grisafe</surname> <given-names>B.</given-names></name> <name><surname>Raychowdhury</surname> <given-names>A.</given-names></name> <name><surname>Datta</surname> <given-names>S.</given-names></name></person-group> (<year>2017a</year>). <article-title>Ultra-low power probabilistic imt neurons for stochastic sampling machines</article-title>, in <source>Proc. Symp. VLSI Technology</source> (<publisher-loc>Kyoto</publisher-loc>), <fpage>T186</fpage>&#x02013;<lpage>T187</lpage>.</citation></ref>
<ref id="B7">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Jerry</surname> <given-names>M.</given-names></name> <name><surname>Parihar</surname> <given-names>A.</given-names></name> <name><surname>Raychowdhury</surname> <given-names>A.</given-names></name> <name><surname>Datta</surname> <given-names>S.</given-names></name></person-group> (<year>2017b</year>). <article-title>A random number generator based on insulator-to-metal electronic phase transitions</article-title>, in <source>Device Research Conference (DRC), 2017 75th Annual</source> (<publisher-loc>South Bend, IN</publisher-loc>), <fpage>1</fpage>&#x02013;<lpage>2</lpage>.</citation></ref>
<ref id="B8">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Jerry</surname> <given-names>M.</given-names></name> <name><surname>Shukla</surname> <given-names>N.</given-names></name> <name><surname>Paik</surname> <given-names>H.</given-names></name> <name><surname>Schlom</surname> <given-names>D. G.</given-names></name> <name><surname>Datta</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Dynamics of electrically driven sub-nanosecond switching in vanadium dioxide</article-title>, in <source>Silicon Nanoelectronics Workshop (SNW), 2016 IEEE</source> (<publisher-loc>Honolulu, HI</publisher-loc>), <fpage>26</fpage>&#x02013;<lpage>27</lpage>.</citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kar</surname> <given-names>A.</given-names></name> <name><surname>Shukla</surname> <given-names>N.</given-names></name> <name><surname>Freeman</surname> <given-names>E.</given-names></name> <name><surname>Paik</surname> <given-names>H.</given-names></name> <name><surname>Liu</surname> <given-names>H.</given-names></name> <name><surname>Engel-Herbert</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Intrinsic electronic switching time in ultrathin epitaxial vanadium dioxide thin film</article-title>. <source>Appl. Phys. Lett.</source> <volume>102</volume>:<fpage>072106</fpage>. <pub-id pub-id-type="doi">10.1063/1.4793537</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McKean</surname> <given-names>H. P.</given-names></name></person-group> (<year>1970</year>). <article-title>Nagumo&#x00027;s equation</article-title>. <source>Adv. Math.</source> <volume>4</volume>, <fpage>209</fpage>&#x02013;<lpage>223</lpage>.</citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mehonic</surname> <given-names>A.</given-names></name> <name><surname>Kenyon</surname> <given-names>A. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Emulating the electrical activity of the neuron using a silicon oxide rram cell</article-title>. <source>Front. Neurosci.</source> <volume>10</volume>:<fpage>57</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2016.00057</pub-id><pub-id pub-id-type="pmid">26941598</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Parihar</surname> <given-names>A.</given-names></name> <name><surname>Shukla</surname> <given-names>N.</given-names></name> <name><surname>Datta</surname> <given-names>S.</given-names></name> <name><surname>Raychowdhury</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Synchronization of pairwise-coupled, identical, relaxation oscillators based on metal-insulator phase transition devices: a model study</article-title>. <source>J. Appl. Phys.</source> <volume>117</volume>:<fpage>054902</fpage>. <pub-id pub-id-type="doi">10.1063/1.4906783</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pickett</surname> <given-names>M. D.</given-names></name> <name><surname>Medeiros-Ribeiro</surname> <given-names>G.</given-names></name> <name><surname>Williams</surname> <given-names>R. S.</given-names></name></person-group> (<year>2013</year>). <article-title>A scalable neuristor built with mott memristors</article-title>. <source>Nat. Mater.</source> <volume>12</volume>, <fpage>114</fpage>&#x02013;<lpage>117</lpage>. <pub-id pub-id-type="doi">10.1038/nmat3510</pub-id><pub-id pub-id-type="pmid">23241533</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ricciardi</surname> <given-names>L. M.</given-names></name> <name><surname>Sato</surname> <given-names>S.</given-names></name></person-group> (<year>1988</year>). <article-title>First-passage-time density and moments of the ornstein-uhlenbeck process</article-title>. <source>J. Appl. Probab.</source> <volume>25</volume>, <fpage>43</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.2307/3214232</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sengupta</surname> <given-names>A.</given-names></name> <name><surname>Panda</surname> <given-names>P.</given-names></name> <name><surname>Wijesinghe</surname> <given-names>P.</given-names></name> <name><surname>Kim</surname> <given-names>Y.</given-names></name> <name><surname>Roy</surname> <given-names>K.</given-names></name></person-group> (<year>2016</year>). <article-title>Magnetic tunnel junction mimics stochastic cortical spiking neurons</article-title>. <source>Sci. Rep.</source> <volume>6</volume>:<fpage>30039</fpage>. <pub-id pub-id-type="doi">10.1038/srep30039</pub-id><pub-id pub-id-type="pmid">27443913</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Shukla</surname> <given-names>N.</given-names></name> <name><surname>Parihar</surname> <given-names>A.</given-names></name> <name><surname>Cotter</surname> <given-names>M.</given-names></name> <name><surname>Barth</surname> <given-names>M.</given-names></name> <name><surname>Li</surname> <given-names>X.</given-names></name> <name><surname>Chandramoorthy</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2014a</year>). <article-title>Pairwise coupled hybrid vanadium dioxide-MOSFET (HVFET) oscillators for non-boolean associative computing</article-title>, in <source>2014 IEEE International Electron Devices Meeting</source> (<publisher-loc>San Francisco, CA</publisher-loc>), <fpage>28.7.1</fpage>&#x02013;<lpage>28.7.4</lpage>.</citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shukla</surname> <given-names>N.</given-names></name> <name><surname>Parihar</surname> <given-names>A.</given-names></name> <name><surname>Freeman</surname> <given-names>E.</given-names></name> <name><surname>Paik</surname> <given-names>H.</given-names></name> <name><surname>Stone</surname> <given-names>G.</given-names></name> <name><surname>Narayanan</surname> <given-names>V.</given-names></name> <etal/></person-group>. (<year>2014b</year>). <article-title>Synchronized charge oscillations in correlated electron systems</article-title>. <source>Sci. Rep.</source> <volume>4</volume>:<fpage>4964</fpage>. <pub-id pub-id-type="doi">10.1038/srep04964</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tashman</surname> <given-names>J.</given-names></name> <name><surname>Lee</surname> <given-names>J.</given-names></name> <name><surname>Paik</surname> <given-names>H.</given-names></name> <name><surname>Moyer</surname> <given-names>J.</given-names></name> <name><surname>Misra</surname> <given-names>R.</given-names></name> <name><surname>Mundy</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Epitaxial growth of VO_2 by periodic annealing</article-title>. <source>Appl. Phys. Lett.</source> <volume>104</volume>:<fpage>063104</fpage>. <pub-id pub-id-type="doi">10.1063/1.4864404</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tonnelier</surname> <given-names>A.</given-names></name></person-group> (<year>2003</year>). <article-title>The McKean&#x00027;s caricature of the Fitzhugh&#x02013;Nagumo Model I. The space-clamped system</article-title>. <source>SIAM J. Appl. Math.</source> <volume>63</volume>, <fpage>459</fpage>&#x02013;<lpage>484</lpage>. <pub-id pub-id-type="doi">10.1137/S0036139901393500</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tuma</surname> <given-names>T.</given-names></name> <name><surname>Pantazi</surname> <given-names>A.</given-names></name> <name><surname>Le Gallo</surname> <given-names>M.</given-names></name> <name><surname>Sebastian</surname> <given-names>A.</given-names></name> <name><surname>Eleftheriou</surname> <given-names>E.</given-names></name></person-group> (<year>2016</year>). <article-title>Stochastic phase-change neurons</article-title>. <source>Nat. Nanotechnol.</source> <volume>11</volume>, <fpage>693</fpage>&#x02013;<lpage>699</lpage>. <pub-id pub-id-type="doi">10.1038/nnano.2016.70</pub-id><pub-id pub-id-type="pmid">27183057</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>K.</given-names></name> <name><surname>Wang</surname> <given-names>B.</given-names></name> <name><surname>Wang</surname> <given-names>F.</given-names></name> <name><surname>Han</surname> <given-names>Y.</given-names></name> <name><surname>Jian</surname> <given-names>X.</given-names></name> <name><surname>Zhang</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>VO<sub>2</sub>-based selection device for passive resistive random access memory application</article-title>. <source>IEEE Elec. Dev. Lett.</source> <volume>37</volume>, <fpage>978</fpage>&#x02013;<lpage>981</lpage>. <pub-id pub-id-type="doi">10.1109/LED.2016.2582259</pub-id></citation></ref>
</ref-list>
</back>
</article>