<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurorobot.</journal-id>
<journal-title>Frontiers in Neurorobotics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurorobot.</abbrev-journal-title>
<issn pub-type="epub">1662-5218</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnbot.2021.640449</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Neuro4PD: An Initial Neurorobotics Model of Parkinson&#x00027;s Disease</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Pimentel</surname> <given-names>Jhielson M.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1168328/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Moioli</surname> <given-names>Renan C.</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/160358/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>de Araujo</surname> <given-names>Mariana F. P.</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/225384/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ranieri</surname> <given-names>Caetano M.</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1263195/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Romero</surname> <given-names>Roseli A. F.</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/997072/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Broz</surname> <given-names>Frank</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/31118/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Vargas</surname> <given-names>Patricia A.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/154724/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Edinburgh Centre for Robotics, Heriot-Watt University</institution>, <addr-line>Edinburgh</addr-line>, <country>United Kingdom</country></aff>
<aff id="aff2"><sup>2</sup><institution>Bioinformatics Multidisciplinary Environment, Digital Metropolis Institute, Federal University of Rio Grande do Norte</institution>, <addr-line>Natal</addr-line>, <country>Brazil</country></aff>
<aff id="aff3"><sup>3</sup><institution>CCS, Federal University of Esp&#x000ED;rito Santo</institution>, <addr-line>Vit&#x000F3;ria</addr-line>, <country>Brazil</country></aff>
<aff id="aff4"><sup>4</sup><institution>ICMC, University of S&#x000E3;o Paulo</institution>, <addr-line>S&#x000E3;o Paulo</addr-line>, <country>Brazil</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Tomohiro Shibata, Kyushu Institute of Technology, Japan</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Silvia Tolu, Technical University of Denmark, Denmark; Onofrio Gigliotta, University of Naples Federico II, Italy; Fady Alnajjar, United Arab Emirates University, United Arab Emirates</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Patricia A. Vargas <email>p.a.vargas&#x00040;hw.ac.uk</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>07</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>15</volume>
<elocation-id>640449</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>12</month>
<year>2020</year>
</date>
<date date-type="accepted">
<day>31</day>
<month>05</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2021 Pimentel, Moioli, de Araujo, Ranieri, Romero, Broz and Vargas.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Pimentel, Moioli, de Araujo, Ranieri, Romero, Broz and Vargas</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license> </permissions>
<abstract><p>In this work, we present the first steps toward the creation of a new neurorobotics model of Parkinson&#x00027;s Disease (PD) that embeds, for the first time in a real robot, a well-established computational model of PD. PD mostly affects the modulation of movement in humans. The number of people suffering from this neurodegenerative disease is set to double in the next 15 years and there is still no cure. With the new model we were capable to further explore the dynamics of the disease using a humanoid robot. Results show that the embedded model under both conditions, <italic>healthy</italic> and <italic>parkinsonian</italic>, was capable of performing a simple behavioural task with different levels of motor disturbance. We believe that this neurorobotics model is a stepping stone to the development of more sophisticated models that could eventually test and inform new PD therapies and help to reduce and replace animals in research.</p></abstract>
<kwd-group>
<kwd>neurorobotics</kwd>
<kwd>basal ganglia</kwd>
<kwd>motor control</kwd>
<kwd>Parkinson&#x00027;s disease</kwd>
<kwd>motor cortex</kwd>
<kwd>robot controller</kwd>
</kwd-group>
<contract-sponsor id="cn001">Newton Fund<named-content content-type="fundref-id">10.13039/100010897</named-content></contract-sponsor>
<counts>
<fig-count count="15"/>
<table-count count="1"/>
<equation-count count="12"/>
<ref-count count="93"/>
<page-count count="24"/>
<word-count count="16191"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>This paper describes the first steps toward the creation of a novel neurorobotics model of Parkinson&#x00027;s Disease (PD)<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref>. PD is characterised by a disruption of the Basal Ganglia (BG) circuitry, which is composed of a set of nuclei linked to the thalamus and cortex in our brain. PD affects the modulation of movement (Bear et al., <xref ref-type="bibr" rid="B2">1996</xref>; Jankovic, <xref ref-type="bibr" rid="B34">2008</xref>) apart from other symptoms (Girotti et al., <xref ref-type="bibr" rid="B18">1986</xref>; Goodarzi and Ismail, <xref ref-type="bibr" rid="B19">2017</xref>). This neurodegenerative disease affects more than 3% of people over 65 years old, with figures set to double in the next 15 years (Dorsey et al., <xref ref-type="bibr" rid="B10">2007</xref>; Rizek et al., <xref ref-type="bibr" rid="B74">2016</xref>). There is still no cure, and therapies rely heavily on a few incomplete computational models of PD, which were created based on animal models (Humphries et al., <xref ref-type="bibr" rid="B29">2018</xref>).</p>
<p>Computational models developed to date often neglect the behavioural effects of physical bodies interacting with the environment, such as sensorimotor regularities. Apart from that, due to experimental limitations, the data used to tune these models are normally from only a couple of relevant brain regions, collected in different behavioural contexts, possibly from various animal lineages and vivaria. As a consequence, it is largely neglected that animal sensorimotor mechanisms and PD symptoms result from self-organised dynamic processes. The misinterpretation of these processes, which emerge out of the brain-body-environment interactions, might undermine PD computation models&#x00027; fidelity.</p>
<p>In this paper, we embed a biophysically plausible computational model specifically tuned for the 6-hydroxydopamine rat model of PD in a real humanoid robot that is engaged in a simple behavioural task. The computational model represented by the basal ganglia-thalamus-cortex system has been fully tuned and validated with published data (Izhikevich and Edelman, <xref ref-type="bibr" rid="B33">2008</xref>; Van Albada and Robinson, <xref ref-type="bibr" rid="B89">2009</xref>; Robinson and Kim, <xref ref-type="bibr" rid="B75">2012</xref>; Kerr et al., <xref ref-type="bibr" rid="B37">2013</xref>; Kumaravelu et al., <xref ref-type="bibr" rid="B43">2016</xref>). We also created a sensorimotor loop with biologically informed constraints that can modulate human&#x00027;s body inherent oscillatory phenomena (i.e., central oscillators; Burkhard et al., <xref ref-type="bibr" rid="B5">2002</xref>). This is an important step toward advancing our knowledge about PD beyond that obtained from anatomical and physiological studies (Lang and Lozano, <xref ref-type="bibr" rid="B45">1998</xref>; Kalia and Lang, <xref ref-type="bibr" rid="B35">2015</xref>). The main contributions of this paper are: (i) an embedded computational composite model of PD in a real humanoid robot and (ii) the reproduction of abnormal PD motor stimulation based on cortical dynamics via the modulation of central oscillators. We expect new insights into PD by future studies conducted using our proposed model.</p>
<p>This paper is organised as follows: section 2 introduces the Basal Ganglia-Thalamus-Cortex system focusing on its main motor pathways. Section 3 presents the main computational models of PD. Section 4 discusses related works on neurorobotics approaches to neurodegenerative diseases. Section 5 proposes a novel neurorobotics model of PD. Section 6 presents the methods and experimental setup, including the humanoid robot used. Section 6 shows the results and section 7 presents the discussion. Section 8 draws conclusions and proposes future work.</p>
</sec>
<sec id="s2">
<title>2. The Basal Ganglia-Thalamus-Cortex System</title>
<p>The basal ganglia (BG) circuitry is a set of interconnected nuclei including the Striatum (caudade and putamen), Globus Pallidus pars interna and pars externa (GPi and GPe), SubThalamic Nucleus (STN), and Substantia Nigra pars reticulata and pars compacta (SNr and SNc; <xref ref-type="fig" rid="F1">Figure 1</xref>). Together with the thalamus (Haber and Calzavara, <xref ref-type="bibr" rid="B22">2009</xref>) and cerebral cortex, they form the Basal Ganglia-Thalamus-Cortex System (BG-T-C System), a highly organised network formed by parallel sensorimotor, associative, and limbic loops, involved, respectively, with movement control, cognition, and processing of reward and emotions (Obeso et al., <xref ref-type="bibr" rid="B64">2008</xref>; Redgrave et al., <xref ref-type="bibr" rid="B73">2010</xref>; Galvan et al., <xref ref-type="bibr" rid="B16">2015</xref>).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Illustration of the basal ganglia highlighting the location of each nucleus within the human brain.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0001.tif"/>
</fig>
<sec>
<title>2.1. The Sensorimotor Loop</title>
<p>Movements in our body are controlled by a <italic>sensorimotor loop</italic> (SML), which is comprised by somatotopically organised<xref ref-type="fn" rid="fn0002"><sup>2</sup></xref> excitatory projections from cortical motor areas and primary somatosensory cortex to the BG input nuclei (Striatum and STN). Those in turn project to the motor regions of other BG nuclei. The BG output nuclei (GPi and SNr) then project to the Ventroanterior (VA) and Ventrolateral (VL) thalamic nuclei, which then project back to the motor regions of the cortex (Obeso et al., <xref ref-type="bibr" rid="B64">2008</xref>). These connections within the sensorimotor loop are mediated by neurons that establish either excitatory or inhibitory synapses, which are mediated, respectively, by the neurotransmitters glutamate and Gamma-AminoButyric Acid (GABA) (<xref ref-type="fig" rid="F2">Figure 2</xref>).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Major pathways comprising the sensorimotor loop. <bold>(A)</bold> Schematic representation of the direct (left), indirect (centre) and hyperdirect (right) pathways. <bold>(B)</bold> Combined representation of these pathways. STR, striatum; MSNd, medial spiny neurons of the direct pathway; MSNi, medial spiny neurons of the indirect pathway; SNc, substantia nigra pars compacta; GPe, globus pallidus pars externa; GPi, globus pallidus pars interna; STN, subthalamic nucleus; VA/VL, ventroanterior and ventrolateral thalamic nuclei.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0002.tif"/>
</fig>
<p>About 90% of Striatum cells are Medium Spiny Neurons (MSNs), which are GABAergic inhibitory cells that receive excitatory glutamatergic projections from the cortex and thalamus. The MSN projections form 2 distinct circuits, called <italic>direct</italic> and <italic>indirect</italic> pathways (Obeso et al., <xref ref-type="bibr" rid="B64">2008</xref>; Lanciego et al., <xref ref-type="bibr" rid="B44">2012</xref>; <xref ref-type="fig" rid="F2">Figure 2A</xref>).</p>
<p>The MSNs from the <italic>direct</italic> pathway project directly to the BG output nuclei (GPi/SNr), while the MSNs from the <italic>indirect</italic> pathway project to the GPe. GPe is a BG nucleus containing GABAergic inhibitory neurons that project to the GPi/SNr directly and indirectly via the STN. In addition to GABAergic projections arriving from GPe, the STN receives excitatory glutamatergic projections directly from the cerebral cortex. This circuit is often called the <italic>hyperdirect</italic> pathway (Nambu et al., <xref ref-type="bibr" rid="B62">2002</xref>; <xref ref-type="fig" rid="F2">Figure 2A</xref>).</p>
<p>The STN is mainly composed of glutamatergic neurons that send excitatory projections to BG output nuclei (GPi/SNr). Both BG output nuclei (GPi and SNr) contain inhibitory GABAergic neurons that fire tonically (i.e., with a sustained firing frequency), inhibiting the VA/VL thalamic nuclei. The <italic>direct</italic> pathway facilitates movement by inhibiting the tonic activity of GPi/SNr, inducing a pause on their neuronal firing. The <italic>indirect</italic> and <italic>hyperdirect</italic> pathways, on the other hand, inhibit movement by increasing the tonic inhibitory activity of the BG inhibitory outputs.</p>
</sec>
<sec>
<title>2.2. The Parkinsonian Conditions</title>
<p>Dopamine (DA) is another neurotransmitter involved in the sensorimotor loop. DA Projections from SNc to striatum modulate the activity of the <italic>direct</italic> and <italic>indirect</italic> pathways by regulating MSN excitability (<xref ref-type="fig" rid="F2">Figure 2B</xref>). Specifically, dopamine excites MSN neurons in the <italic>direct</italic> pathway and inhibits MSN neurons in the <italic>indirect</italic> pathway. The combined effect of DA on <italic>direct</italic> and <italic>indirect</italic> pathways, therefore, leads to a decrease in GPi/SNr activity, decreasing the inhibition of the thalamocortical projection neurons. Therefore, the main effect of DA release in Striatum is movement facilitation.</p>
<p>In PD, there is a progressive degeneration of SNc DA neurons. The depletion of striatal DA leads to a functional imbalance of BG circuitry, with enhanced activation of the <italic>indirect</italic> pathway and decreased activation of the <italic>direct</italic> pathway, resulting in an increase in GPi/SNr activity that hampers movement execution (Surmeier et al., <xref ref-type="bibr" rid="B86">2014</xref>). In addition to these changes in firing rates, the <italic>parkinsonian</italic> conditions is also characterised by changes in firing patterns within each nucleus and amongst the structures of the BG-T-C system, such as increased synchrony between neighboring neurons, increased bursting activity and enhanced beta oscillatory activity (Galvan et al., <xref ref-type="bibr" rid="B16">2015</xref>).</p>
</sec>
<sec>
<title>2.3. Tremor Symptom</title>
<p>The origin and mechanisms of motor symptoms of Parkinson&#x00027;s Disease (PD) are still under great dispute (McGregor and Nelson, <xref ref-type="bibr" rid="B55">2019</xref>). In particular, there are several hypotheses for the origin of symptoms that are related to motor impairments but there is no consensus so far (Dovzhenok and Rubchinsky, <xref ref-type="bibr" rid="B11">2012</xref>; Helmich et al., <xref ref-type="bibr" rid="B26">2013</xref>). Most likely, a myriad of network interactions lead to motor disruptions that are observed in PD, including structures beyond the basal ganglia networks like the cerebellum. Traditionally, it is assumed that the basal ganglia and cerebellum are anatomically separated but interfaced via cortical networks. Please refer to Mori et al. (<xref ref-type="bibr" rid="B59">2016</xref>) for a more comprehensive discussion on the role of other structures.</p>
<p>Parkinson&#x00027;s tremor symptom is an involuntary motion, in particular on the upper limbs, with frequency of 4&#x02013;6 Hz and high amplitude along a voluntary movement or at rest (Guyton and Hall, <xref ref-type="bibr" rid="B21">2001</xref>; Haeri et al., <xref ref-type="bibr" rid="B23">2005</xref>). A few previous works hypothesize that the dopamine depletion in the BG-T-C system may lead to the occurrence of the tremor symptom (Dovzhenok and Rubchinsky, <xref ref-type="bibr" rid="B11">2012</xref>; Helmich et al., <xref ref-type="bibr" rid="B25">2012</xref>; Cagnan et al., <xref ref-type="bibr" rid="B6">2014</xref>). However, recent evidences from clinical, neuroimaging and postmortem studies link essential tremor to cerebellar dysfunction (Louis et al., <xref ref-type="bibr" rid="B51">2006</xref>; Mirdamadi, <xref ref-type="bibr" rid="B58">2016</xref>; Louis, <xref ref-type="bibr" rid="B49">2018</xref>; Louis and Faust, <xref ref-type="bibr" rid="B50">2020</xref>). The authors hypothesize that the cerebellum influenced by dopamine depletion may also contribute to the enhancement of the tremor. Nonetheless, the origin of the symptom is yet a mystery.</p>
<p>According to Burkhard et al. (<xref ref-type="bibr" rid="B5">2002</xref>), there are central oscillators that are composed of oscillatory components involving neuronal networks capable of generating a naturally occurring neural oscillation. These central oscillators synchronise cerebral function in brains under both conditions (<italic>healthy</italic> and <italic>parkinsonian</italic>). However, it is not very clear which structures of the brain are involved in the generation of these oscillatory patterns. Although the physiological function of those structures are yet unknown, the authors consider them to be directly related to motor control and tremor iythn PD. Based on experiments with healthy subjects executing voluntarily simulated tremor and data from pathological tremors recorded from patients with PD and essential tremor, the authors noticed the influence of the central oscillators on motor tasks.</p>
<p>Based on PD patients with electrode implantation, Du et al. (<xref ref-type="bibr" rid="B12">2018</xref>) observed evidences of oscillatory patterns in different regions of the brain, like STN, GPi, and ventral intermediate thalamus (Vim). They named the cells oscillatory neurons and associated them to the tremor symptom. In a different study, using a helmet-shaped 122-channel whole-head neuromagnetometer (Neuromag<sup><italic>TM</italic></sup>), Pollok et al. (<xref ref-type="bibr" rid="B69">2004</xref>) concluded that the same brain areas are involved in voluntary tremor as in parkinsonian resting tremor. Based on the acquired data, the authors considered that pathological tremors might be based on a physiological pre-existing cerebral oscillatory network. Unfortunately, more details on those oscillatory neurons are yet unknown.</p>
</sec>
</sec>
<sec id="s3">
<title>3. Computational Models of Parkinson&#x00027;s Disease</title>
<p>At present, there are only a few computational models built by different research groups to support distinct investigations on motor and cognitive deficits of PD. In fact, neuroscientists have been using them to improve their understanding of motor symptoms associated to neural disorders like PD and many others (Cohen et al., <xref ref-type="bibr" rid="B8">2002</xref>; O&#x00027;Donnell and Wilt, <xref ref-type="bibr" rid="B65">2006</xref>; Sarbaz et al., <xref ref-type="bibr" rid="B81">2007</xref>; Schroll and Hamker, <xref ref-type="bibr" rid="B82">2013</xref>; Sanger, <xref ref-type="bibr" rid="B80">2018</xref>; Pena et al., <xref ref-type="bibr" rid="B68">2020</xref>). In particular for PD, those models became an ally on a search for new treatments and therapies (Humphries et al., <xref ref-type="bibr" rid="B29">2018</xref>), and also to enhance the efficacy of well-known treatments like Deep Brain Stimulation (DBS) (Rubin and Terman, <xref ref-type="bibr" rid="B78">2004</xref>; Humphries and Gurney, <xref ref-type="bibr" rid="B28">2012</xref>; Lu et al., <xref ref-type="bibr" rid="B52">2020</xref>).</p>
<p>Some of the computational models of PD are built to support hypothesis on the cause of motor impairments. For instance, Pavlides et al. (<xref ref-type="bibr" rid="B67">2015</xref>) explains the proposed mechanisms for an anomalous increase in beta oscillations within the BG nuclei. Other models are built to investigate not the symptoms but the origin of the disease, as presented in Muddapu et al. (<xref ref-type="bibr" rid="B60">2019</xref>). The authors designed a model to explore the progressive and inexorable loss of dopaminergic cells in the SNc. In some cases, computational models of PD are designed inspired by the BG nuclei alone (Gurney et al., <xref ref-type="bibr" rid="B20">2004</xref>; Merrison-Hort et al., <xref ref-type="bibr" rid="B56">2017</xref>) while others build a more complex system incorporating the entire sensorimotor loop (Kumaravelu et al., <xref ref-type="bibr" rid="B43">2016</xref>) (<xref ref-type="fig" rid="F2">Figure 2B</xref>).</p>
<p>Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) is one of the very few models that can incorporate the behavioural effects of physical bodies interacting with the environment. In other words, a model that replicates some of the sensorimotor loop mechanisms discussed in section 2.1, which are observed in animals during behavioural tasks. This computational model of PD focuses on the BG-T-C system of rats (<xref ref-type="fig" rid="F3">Figure 3</xref>). The entire model was tuned using a collection of data from 6-OHDA lesioned rats. Their model also followed an extensive validation, demonstrating that it can replicate a wealth of experimental data.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Schematic of the BG-T-C System computational model adapted from Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>). <bold>(A)</bold> Shows connections within the network. <bold>(B)</bold> Details of synaptic connections within the network model. Each rcortical neuron receives excitatory input from one TH neuron and inhibitory input from four randomly selected icortical neurons. Each icortical neuron receives excitatory input from four randomly selected rcortical neurons. Each dStr neuron receives excitatory input from one rcortical neuron and inhibitory axonal collaterals from three randomly selected dStr neurons. Each idStr neuron receives excitatory input from one rcortical neuron and inhibitory axonal collaterals from four randomly selected idStr neurons. Each STN neuron receives inhibitory input from two GPe neurons and excitatory input from two rcortical neurons. Each GPe neuron receives inhibitory axonal collaterals from any two other GPe neurons and inhibitory input from all idStr neurons. Each GPi neuron receives inhibitory input from two GPe neurons and inhibitory input from all dStr neurons. Some GPe/GPi neurons receive excitatory input from two STN neurons, while others do not. Each TH neuron receives inhibitory input from one GPi neuron.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0003.tif"/>
</fig>
<p>The model is divided into brain regions: CorTeX (CTX), Striatum (Str), SubThalamic Nucleus (STN), Globus Pallidus externa (GPe), Globus Pallidus interna (GPi)<xref ref-type="fn" rid="fn0003"><sup>3</sup></xref>, and THalamus (TH). Each region includes 10 single compartment model neurons (Hodgkin-Huxley or Izhikevich neurons) interconnected with synapses to form a functional network. All model equations can be found in Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>). In <xref ref-type="fig" rid="F3">Figure 3A</xref>, the connections present the excitatory and inhibitory relations between the CTX, BG, and TH. The well-know pathways (<italic>direct, indirect</italic>, and <italic>hyperdirect</italic>) presented in <xref ref-type="fig" rid="F2">Figure 2</xref> can be reproduced by this model. In <xref ref-type="fig" rid="F3">Figure 3B</xref>, a diagram shows the synaptic connections between the CTX, BG, and TH. The pattern exhibited by those synapses was designed based on prior computational models (Rubin and Terman, <xref ref-type="bibr" rid="B78">2004</xref>; So et al., <xref ref-type="bibr" rid="B83">2012</xref>).</p>
<p>The two pathways that process signals through the BG have opposite net effects on thalamic target structures. In Boison and Masino (<xref ref-type="bibr" rid="B3">2016</xref>), the authors explain that the excitation of the <italic>direct</italic> pathway has the net effect of exciting thalamic neurons (which in turn make excitatory connections onto cortical neurons) and excitation of the <italic>indirect</italic> pathway has the net effect of inhibiting thalamic neurons (rendering them unable to excite motor cortical neurons). In other words, the <italic>direct</italic> pathway engages the movement behaviour while the <italic>indirect</italic> pathway inhibits it.</p>
</sec>
<sec id="s4">
<title>4. Neurorobotics and Neural Disorders</title>
<p>Neurorobotics is a field of research that focus on the embodiment of neural systems, like computational models of biological neural networks, in artificial software and machines. In 2005, a robotic salamander was presented as one of the first models designed to explore the interaction between brain, body and environment (Ijspeert et al., <xref ref-type="bibr" rid="B31">2005</xref>, <xref ref-type="bibr" rid="B32">2007</xref>). This interaction brought several discussions of the impact of external information on the dynamics of those neural networks.</p>
<p>For the last few decades, neurorobots have been applied to a wide range of domains (Kaplan, <xref ref-type="bibr" rid="B36">2008</xref>; Krichmar, <xref ref-type="bibr" rid="B41">2018</xref>; Li et al., <xref ref-type="bibr" rid="B47">2019</xref>). For instance, inspired on the action selection mechanisms of the basal ganglia, Prescott et al. (<xref ref-type="bibr" rid="B70">2006</xref>) proposed to embed a neuronal model in a mobile agent to control its action selection during the performance of a robotic task. In a different context, Edvardsen et al. (<xref ref-type="bibr" rid="B14">2020</xref>) incorporated classes of neurons from hippocampus to design a navigation strategy in cluttered environments. Some other works have focused on the development of prosthetics to assist the locomotion of animals (von Zitzewitz et al., <xref ref-type="bibr" rid="B90">2016</xref>) and even on the improvement of human-robot interaction by designing systems that control the levels of awareness in humanoid robots (Lindberg et al., <xref ref-type="bibr" rid="B48">2017</xref>; Balkenius et al., <xref ref-type="bibr" rid="B1">2018</xref>).</p>
<p>Brain-inspired models embedded in robots can be also an important tool for supporting studies on neural disorders. For instance, Yamashita and Tani (<xref ref-type="bibr" rid="B93">2012</xref>) investigated psychiatric disease symptoms, including fictive perception, altered sense of self, and unpredictable behaviour, by embedding a neuronal model containing schizophrenia-like deficits in a humanoid robot engaged in a task that demanded interaction with the environment via object manipulation. Oota et al. (<xref ref-type="bibr" rid="B66">2018</xref>) investigated early onset symptoms of abnormal motor coordination in rats using a soft neurorobotics suit that provides integrated cognitive and physical interventions. For further discussion on neurorobotics models of neurological disorders, please check the mini review by Pronin et al. (<xref ref-type="bibr" rid="B71">2021</xref>).</p>
<p>Most of those works search for a deeper understanding of motor and cognitive symptoms by investigating the dynamics of human and animal brains. However, neural models are yet considerated to be abstraction since they can not replicate the same level of complexity observed in real brains. The most advanced projects modeling the biophysical characteristics of human brain can only perform a reduced number of brain cells (4 million point neurons and 31,000 detailed neurons) on High Performance Computing (HPC) clusters (Chi, <xref ref-type="bibr" rid="B7">2016</xref>; Makin, <xref ref-type="bibr" rid="B53">2019</xref>). Besides, in order to build more realistic neural model, live animals, like monkeys and rats, are used in experiments under specific scenario for data collection. In each experiment with a single subject, the activity of only a few regions of the brain can be collected. To acquire multiple data from different regions, it would demand several invasive surgeries in the same animal which is not ethical. Usually, models of specific regions are built upon data from several animals and, in some cases, even different species. Therefore, neural disorders are usually built upon sophisticated but simplified computational models of specific regions of the brain.</p>
<p>In a PD scope, to the best of our knowledge, sophisticated computational models, such as the one proposed by Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>), have never been embedded in a robot as a mechanism to understand the pathology, for diagnosis, or even to inform new treatments or therapies. Besides, Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) describe brain structures that are important for the formation of sensorimotor loops, like BG, TH, and CTX.</p>
<p>Wang et al. (<xref ref-type="bibr" rid="B91">2010</xref>) designed computational models of Huntington&#x00027;s disease (HD) and PD based on leaky integrate-and-fire neurons, and embedded them in a simple Lego robot (Klassner and Anderson, <xref ref-type="bibr" rid="B39">2003</xref>). By integrating the computational models to the robot&#x00027;s controller, they investigated an action selection mechanism and compared the robot&#x00027;s pattern in changing behaviours. The computational models created are composed of a BG type structure that is updated by sensory information in order to select the robot&#x00027;s behaviour (e.g., wandering, avoiding collision, and dancing; Wang et al., <xref ref-type="bibr" rid="B92">2007</xref>, <xref ref-type="bibr" rid="B91">2010</xref>). In comparison to the Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) model, the model from Wang et al. (<xref ref-type="bibr" rid="B92">2007</xref>, <xref ref-type="bibr" rid="B91">2010</xref>) provides less biophysical details of structures involved in HD and PD, which limits the generalisation of neural and behavioural dynamics reported.</p>
<p>Using a completely different approach, Kulam et al. (<xref ref-type="bibr" rid="B42">2011</xref>) implemented a model inspired only by the BG dynamics to reproduce PD symptoms, like bradykinesia, in a robotic arm. The authors used reinforcement learning to train their model and reproduce the desired symptoms. But, they did not use an artificial neural network with spiking neurons to design the computational model of PD. The model was implemented as a control system in which the dopamine signal is related to the incremental changes in error between the target position and the position of the end-effector of the arm. A biophysical computational model of the BG nuclei was not incorporated and, as a consequence, it may not be the most adequate tool to support neuroscientists in their investigations of PD.</p>
<p>To date and to the best of our knowledge, there are no biologically plausible neurorobotics models capable of reproducing characteristic symptoms of PD, like bradykinesia/akinesia, tremor, and rigidity in real humanoid robots. The majority of those aforementioned works concentrate their investigations in either modeling the circuits of the brain or building robotic devices based on simple neuroscience concepts (Yamashita and Tani, <xref ref-type="bibr" rid="B93">2012</xref>; Idei et al., <xref ref-type="bibr" rid="B30">2017</xref>; Lewis and Ca&#x000F1;amero, <xref ref-type="bibr" rid="B46">2017</xref>). A true intersection between neuroscience and robotics is yet to be unveiled. Our work presents the first steps toward the creation of an embedded realistic computational model of PD in a humanoid robot. This new neurorobotics model has the potential to support researchers from different areas, like biologists, physicists, and neuroscientists, which might help to unravel the mysteries of PD.</p>
</sec>
<sec id="s5">
<title>5. Neuro4PD: Neurorobotics Model of Parkinson&#x00027;s Disease</title>
<p>In this section, we introduce a new neurorobotics model of PD that is comprised by a computational model of the disease, a humanoid robot, and a dedicated sensorimotor loop. Here we explain how the computational model of Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) adapted by Romano et al. (<xref ref-type="bibr" rid="B76">2020</xref>) was embedded in our humanoid robot and how the devised model can be easily adapted to different behavioural tasks and applications.</p>
<sec>
<title>5.1. The Computational Model</title>
<p>The chosen computational model of PD (Romano et al., <xref ref-type="bibr" rid="B76">2020</xref>) is capable of artificially reproducing the biophysical features of the BG-T-C system, thus replicating the biological SML mechanisms discussed in section 3. The model was adapted from Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) to an open-source Python package to facilitate the development, simulation, and analysis of our biological neuronal network using the NEURON simulator. The equations (summarised in <xref ref-type="supplementary-material" rid="SM3">Supplementary Table 1</xref>) describing the dynamics of each type of neuron were replicated without any change. Romano et al. (<xref ref-type="bibr" rid="B76">2020</xref>) modelled the same three conditions representing control (normal), 6-OHDA lesioned (PD), and 6-OHDA lesioned plus STN DBS in rats. In this work, we focused only on the <italic>healthy</italic> and <italic>parkinsonian</italic> conditions. Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) explained how the changes in the synaptic conductance of specific neurons allowed them to replicate the loss of striatal dopamine neurons. In short words, the shift from healthy to PD conditions can be described as follow: decreasing the maximal M-type potassium conductance in direct and indirect MSN neurons (MSN firing dysfunction) from 2.6 to 1.5 <italic>mS</italic>/<italic>cm</italic><sup>2</sup>; decreasing the maximal corticostriatal synaptic conductance (reduced sensitivity of direct MSN to cortical inputs) from 0.07 to 0.026 <italic>mS</italic>/<italic>cm</italic><sup>2</sup>; and increasing the maximal GPe axonal collaterals synaptic conductance from 0.125 to 0.5 <italic>mS</italic>/<italic>cm</italic><sup>2</sup> (increase of GPe neuronal firing). More details of the implementation of each condition can be found in Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>).</p>
<p>To embed the computational model of PD in our humanoid robot, we first had to create the desired robot sensorimotor loop. Following the SML described in section 3, the robot should be able to get inputs from its sensory signals, incorporate them into the embedded computational model, and generate motor commands, which in turn will lead to new sensory inputs, thus closing the loop.</p>
</sec>
<sec>
<title>5.2. The Robot Sensorimotor Loop</title>
<p>It is clear from section 2.1, that the BG-T-C system and its communication pathways allow mammalians to produce motor responses based on sensory information thus giving rise to a sensorimotor loop. Hence, the interplay between those parts allows animals to make decisions based on internal and external stimuli.</p>
<p>One can also observe that the thalamus and the cortex form a closely coupled system (Saalmann and Kastner, <xref ref-type="bibr" rid="B79">2011</xref>), where the thalamus transmits information from the environment to the cortex, and the cortex sends the output from multiple processing stages back to the thalamus. Based on this assumption, we decided to stimulate the thalamus based on visual cues and to read the output neuronal signals from the cortex to create our sensorimotor loop.</p>
<p>Inspired by the existence of central oscillators (section 2.3), the motor commands from cortical neurons are then combined and modulated by this inherent oscillatory phenomena (Burkhard et al., <xref ref-type="bibr" rid="B5">2002</xref>). Similar modulation techniques have been observed in neuronal activity in animals and humans. For instance, Tomassini et al. (<xref ref-type="bibr" rid="B87">2017</xref>) investigated how the rhythm of different neuronal signals may modulate the perceptions of animals; and Ferguson and Cardin (<xref ref-type="bibr" rid="B15">2020</xref>) discussed how multiple input streams of cognitive, sensory or motor origin may modulate cortical gain. In our work, we investigated how the dynamics of the cortical neurons from our BG-T-C system under both <italic>healthy</italic> and <italic>parkinsonian</italic> condition may modulate the oscillatory signals from the central oscillators that might be the cause of the tremor symptom in PD patients. Hence, the final motor command is a result of an emulated signal which is able to simulate motor perturbation in the robot&#x00027;s upper limbs movements in <italic>parkisonian</italic> condition, as further explained on section 6.4.</p>
<p>Our robot sensorimotor loop has four complementary modules (<xref ref-type="fig" rid="F4">Figure 4</xref>): (i) the first module, Encoding Module (EM), is responsible for encoding environmental input into the BG-T-C system; (ii) the second module, Brain Module (BM), processes the input information respecting the dynamics of the embedded computational model of the brain; (iii) the third module, Decoding Module (DM), decodes the brain dynamics into motor stimulation; and (iv) the last module, Behavioural Module (BeM), translates the sensory inputs, the motor stimulation, and the oscillatory signals from the central oscillators into robot commands. Implementation details of each module will be discussed in section 6. The following subsections describe the modules as a generic framework which can be implemented in different ways without compromising the effectiveness of the entire sensorimotor loop.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Full diagram showing the robot sensorimotor loop. The robot adjusts the sensory inputs from the environment through the Encoding Module (EM). The sensory information is then propagated throughout the Brain Module (BM) affecting the dynamics of the cortical neurons which are used to adjust the robot&#x00027;s movements. The dynamics of cortical neurons are decoded to motor stimulation by the Decoding Module (DM), then it is used to modulate the oscillatory signal received from the central oscillators inside the behavioural Module (BeM). The BeM then translates all these signals into motor commands with certain level of disturbance.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0004.tif"/>
</fig>
<sec>
<title>5.2.1. The Encoding Module</title>
<p>The encoding module focuses on the process of extracting information from the environment to stimulate the thalamic neurons in the BM. We designed the EM by transforming visual cues perceived by the robot into thalamic stimulation. For instance, if the robot detects a visual cue, a certain level of electric stimuli is applied directly to thalamic neurons, which in turns changes the dynamics of the entire brain module.</p>
<p>We used visual cues in our work, however, one can use any other type of sensory information, like voice commands and tactile inputs, or even a combination of those.</p>
</sec>
<sec>
<title>5.2.2. The Decoding Module</title>
<p>The Decoding Module (DM) decodes the dynamics of cortical neurons of our embedded computational model into patterns that will be later translated into poses that will form the trajectory of the robot&#x00027;s limbs. Those poses allow the robot to perform pre-defined movements.</p>
<p>In this work, the DM extracts three features from the cortical neurons in order to produce motor signals: the firing rate (FR), the average of interspike intervals (ISIs), and the standard deviation of ISIs. Depending on the purpose of the neurorobotics model, any other set of features can be used. Also, different regions of the brain and different type of neurons could be more suitable.</p>
</sec>
<sec>
<title>5.2.3. The Behavioural Module</title>
<p>This module is responsible for generating motor commands based on sensory inputs, motor stimulation and oscillatory signals created by the central oscillators. As depicted in <xref ref-type="fig" rid="F5">Figure 5</xref>, the intensity or amplitude of the oscillatory pattern will be modulated by the motor stimulation produced by the DM. This gives rise to an &#x0201C;emulated signal,&#x0201D; which will adjust the poses defined by the state machine. During the performance of the motor tasks, each joint of the robot&#x00027;s arm will be able to receive updates of its state that might include some disturbance caused by the modulation of the oscillatory signals, thus closing the sensorimotor loop.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>A diagram illustrating the modulation process between the motor stimulation produced by the DM and the oscillatory signal by the Central Oscillators. The resulting signal is combined to the trajectory, defined by our state machine, to finally produce the movement on the robot&#x00027;s arm.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0005.tif"/>
</fig>
<p>The BeM can reproduce all the robot&#x00027;s expected behaviours under both conditions of the embedded computational model, e.g., <italic>heathy</italic> or <italic>parkinsonian</italic>. We combined pre-defined poses with motor stimulation and an oscillatory pattern but different techniques could be used to produce the robot&#x00027;s trajectories. Also, it is important to highlight, this module can be adapted to a completely different behavioural task.</p>
</sec>
</sec>
</sec>
<sec sec-type="methods" id="s6">
<title>6. Methods</title>
<p>In this section we provide implementation details of our Neurorobotics model by presenting the behavioural task chosen for the SML experiments, the experimental scenarios, the robot architecture, and the software platforms used.</p>
<sec>
<title>6.1. The Robot Architecture</title>
<p>The robot architecture chosen for the experiments was the NAO<sup>T14</sup> &#x0201C;torso only&#x0201D; robot (Gelin, <xref ref-type="bibr" rid="B17">2018</xref>) (<xref ref-type="fig" rid="F6">Figure 6A</xref>). NAO torso has a set of sensor and actuators like cameras, tactile sensors, and motors that allows the robot to move its upper limbs and interact with the environment. It is fully open and programmable and runs on NAOqi OS. Besides that, each arm of the robot has five degrees-of-freedom allowing it to reproduce several movements mimicking those of a human being.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>In <bold>(A)</bold>, technical illustration of NAO<sup>T14</sup> robot indicating the position of sensors and actuators. <bold>(B)</bold> Shows a diagram illustrating the connections between the modules [Encoding Module (EM), Brain Module (BM), Decoding Module (DM), Behavioural Module (BeM)] and NAO robot in the SML. The modules represent different applications that complement each other during the task, and the arrows indicate the data flow. The Central Oscillators generate the oscillatory signals mimicking the inherent oscillatory patterns that are related to motor control and may be linked to <italic>parkinsonian</italic> tremor. ROS was mainly used as a platform to support communication between those elements and to interact with the robot by reading its sensors and sending commands to its actuators.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0006.tif"/>
</fig>
<p>We have implemented the four modules from our Neurorobotics Model (section 5) using Python programming language (Rossum, <xref ref-type="bibr" rid="B77">1995</xref>) plus OpenCV (Bradski, <xref ref-type="bibr" rid="B4">2000</xref>), NetPyNE/NEURON (Hines and Carnevale, <xref ref-type="bibr" rid="B27">2001</xref>; Dura-Bernal et al., <xref ref-type="bibr" rid="B13">2019</xref>), and ROS (Robot Operating System) (Cousins, <xref ref-type="bibr" rid="B9">2010</xref>). The diagram in <xref ref-type="fig" rid="F6">Figure 6B</xref> shows the connections between those modules [Encoding Module (EM), Brain Module (BM), Decoding Module (DM), Behavioural Module (BeM)]<xref ref-type="fn" rid="fn0004"><sup>4</sup></xref> within NAO robot. It is important to mention that any other humanoid robot can be easily adjusted to this work if capable to communicate to our modules through ROS.</p>
</sec>
<sec>
<title>6.2. Behavioural Robot Task</title>
<p>The behavioural task chosen to assess the sensorimotor loop (section 2.1) consists of a simple visual/motor activity. Basically, the robot performs two different behaviours in response to distinct visual cues as illustrated in <xref ref-type="fig" rid="F7">Figure 7A</xref>. If the robot senses an object as a positive stimulus, it extends its right arm and opens its hand to grasp the object. Otherwise, if the robot senses an object as a negative stimulus, it moves its right arm closer to its torso similar to a rejection behaviour.</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>In <bold>(A)</bold>, two different destination poses based on distinct visual stimulus. The first one, the robot senses the object as a positive stimulus. It then extends its right arm and opens its hand to grasp the object. The second one, the robot senses the object as a negative stimulus and moves its right arm closer to its torso similar to a rejection behaviour. <bold>(B)</bold> Shows behavioural responses based on visual information. On the top image, the robot sensed a positive stimulus and activated the curiosity behaviour. On the bottom image, the robot sensed a negative stimulus and initiated the rejection behaviour. In <bold>(C)</bold>, the composed image presents the stage of the task when the robot senses each ball based on its colour: yellow, green, and purple.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0007.tif"/>
</fig>
<p>The task was designed using simple movements that simplify further analyses of the robot&#x00027;s performances in both conditions, <italic>healthy</italic> and <italic>parkinsonian</italic>. Movements are possible by a continuous update of the robot&#x00027;s motor trajectories control with the desired motion. The motion was defined as destination poses, which were pre-defined with specific joints&#x00027; angles. Here, we opted for a discrete set of motor trajectories that result from transitions of a state machine.</p>
</sec>
<sec>
<title>6.3. Experimental Scenarios</title>
<p>The experimental scenarios are composed of one humanoid robot (NAO<sup>T14</sup>), three balls with different colours (yellow, purple and green), and a computer to run ROS and NetPyNE/NEURON applications. We used the colour of the objects to trigger two different behaviours: curiosity and rejection to interact with an object (Nieuwboer et al., <xref ref-type="bibr" rid="B63">2007</xref>) as presented in <xref ref-type="fig" rid="F7">Figure 7B</xref>.</p>
<p>In short words, the behaviour task designed to support this work can be described as a sequence of interactions with the coloured balls by the robot. The main idea was to exploit our sensorimotor loop, which produces behavioural responses based on visual stimuli. In this work, when the task is initialised, the robot checks if there is any object ready to be sensed, as presented on <xref ref-type="fig" rid="F7">Figure 7C</xref>. A small mark in front of the robot indicates the position where the objects are allocated so they can be easily detected. After the recognition of each object, the robot communicates the colour of the ball and, only then, initiates the related behaviour, rejection, or curiosity. A negative stimulus, indicated by the yellow or purple balls, produces the rejection behaviour while a positive one, represented by the green ball, produces the curiosity behaviour. After completing the last iteration, the robot communicates the end of the task and moves to its final pose.</p>
<p>In this work, we ran our experiments using only three iterations by the following order: yellow, green and purple. However, the number of iterations and the sequence of colours of the balls can be adjusted a priori any experiment. During the first 30 s of our experiment, the robot was initiated and none of the objects presented. This period allowed the robot to bring up all the sensors and actuators of the robot, and also to move the arms to their initial position. Then, each ball was allocated in front of the robot respecting the pre-defined sequence, which was the yellow ball at 30 s, followed by a green ball at 55 s, and a purple ball at 75 s after the beginning of the task. The duration of the entire task was 90 s. The time between those events allowed the robot to react to the objects by producing the expected behaviours.</p>
<sec>
<title>6.3.1. Experimental Scenario 01 (Negative Stimulus): Rejection Behaviour</title>
<p>If the robot detects either a purple or yellow ball, it refuses to play and moves the right arm<xref ref-type="fn" rid="fn0005"><sup>5</sup></xref> toward its torso avoiding contact to the ball. In parallel, the robot communicates the decision of not interacting with the ball and asks for a new one. After rejecting the object, the robot moves back to its initial pose where it waits for the next iteration.</p>
</sec>
<sec>
<title>6.3.2. Experimental Scenario 02 (Positive Stimulus): Curiosity Behaviour</title>
<p>The green ball represents a positive stimulus and it triggers the curiosity behaviour which is implemented as requesting the ball. Since the NAO robot (T14) presents some physical limitations that makes object grasping a challenge, it verbally asks someone to put the green ball directly on its hand by moving the right arm forward and opening the hands. Once the ball is grasped, the robot moves the arm toward a small container and drops the green ball in. Then, it moves back to the initial pose and waits for a new ball to be placed on the mark.</p>
</sec>
</sec>
<sec>
<title>6.4. Environment Integration: NEURON, NetPyNE, and ROS</title>
<p>The computational model of PD embedded in the humanoid robot was adapted from Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) by Romano et al. (<xref ref-type="bibr" rid="B76">2020</xref>) to make use of NetPyNE (Networks in Python and NEURON), a tool which provides a simplified interface to implement multiscale network models in the NEURON simulation environment (Hines and Carnevale, <xref ref-type="bibr" rid="B27">2001</xref>). The simulator is a well-known tool that has been extensively used by neuroscientists due to its high reliability in terms of computational neuroscience.</p>
<p>The dynamics of the computational model brings a realism that is fundamental for the purpose of this work. The Hodgkin and Huxley, and Izhikevich neuron models allow the neurorobot to reproduce most of the neurocomputational dynamical features of specific neurons. For instance, the excitatory pattern from cortical neurons also known as regular spiking (RS). In this way, it is possible to generate equivalent patterns observed on real data, collected from animal experimentation, in response to injected pulses of DC current.</p>
<p>We decided to use the Robot Operating System (ROS) to create a bridge between NetPyNE and the robot. ROS is a free and open-source system that has grown out of a novel collaboration between industry and academia (Cousins, <xref ref-type="bibr" rid="B9">2010</xref>). It provides mechanisms to communicate between different applications via topics and services. Thus, the model implemented on NetPyNE could be simulated in NEURON and, in parallel, communicate to other running packages besides the robot. In other to test the entire environment integration, we used Webots simulator (Michel, <xref ref-type="bibr" rid="B57">2004</xref>) to run our experiments. Then, we moved to a real robot.</p>
<p>The neurorobotics model embedded in the robot was designed in subroutines that can be easily replaced without causing a chain of changes. In this way, it is more suitable for updates in the code and even new applications. For example, any module of the SML can be substituted to adapt to a new application. They have separate functionalities as described in section 5.2.</p>
<sec>
<title>6.4.1. Encoding Module</title>
<p>During the task, the robot captures images in high frequency by the camera attached to its head and transmits them to the first module (EM). The position of the object and robot are fixed for simplicity. The section of the images where the object is expected is then selected and its colour identified using the OpenCV library. Basically, we used hue values to group the pixels of the cropped image based on different ranges of colours. Then, the colour of the object is identified by checking the range which contains the highest number of pixels.</p>
<p>This information is used as stimulus to activate thalamic neurons in the BM. We defined two different levels of electrical stimuli based on the robot&#x00027;s behaviours (curiosity and rejection). When the first scenario (section 6.2) is identified, the sensory neural signal is set to its default stimulation, which is 1.2 mA (Kumaravelu et al., <xref ref-type="bibr" rid="B43">2016</xref>). But, when the second scenario is spotted, it is updated to 3.5 mA (over stimulation). The stimulation is maintained until the robot detects a new object.</p>
<p>In this work, since the visual cues identified in this module are also requested later by the BeM, we decided to propagate them instead of the raw sensory inputs as presented in <xref ref-type="fig" rid="F4">Figure 4</xref>. However, in a different and more complex behavioural task, the BeM might need access to the entire sensory inputs instead of only the visual cues. That is why we decided to connect the sensory inputs directly to the BeM in the diagram of the robot sensorimotor loop, as illustrated on <xref ref-type="fig" rid="F4">Figure 4</xref>.</p>
</sec>
<sec>
<title>6.4.2. Brain Module</title>
<p>Inside the BM, the stimuli received by the previous module (EM) are applied directly to thalamic neurons by modifying the stimulation parameters via commands of NetPyNE. These stimuli rapidly propagates the information to the rest of the network affecting the dynamics of the cortical neurons.</p>
<p>In this context, three features are extracted from cortical neurons in order to produce the motor stimulation. The first one is the average of the firing rate (<italic>FR</italic>) every trial (<italic>k</italic>). We calculate it by integrating all the spikes from each cortical neuron (<italic>n</italic><sub><italic>spikes</italic></sub>) in a window of 1 s (<italic>T</italic>) and dividing it by the number of neurons (<italic>n</italic><sub><italic>neurons</italic></sub>).</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>F</mml:mi><mml:msub><mml:mrow><mml:mi>R</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:msub><mml:mrow><mml:mi>n</mml:mi></mml:mrow><mml:mrow><mml:mi>s</mml:mi><mml:mi>p</mml:mi><mml:mi>i</mml:mi><mml:mi>k</mml:mi><mml:mi>e</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>w</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>d</mml:mi><mml:mi>o</mml:mi><mml:mi>w</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>n</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi><mml:mi>e</mml:mi><mml:mi>u</mml:mi><mml:mi>r</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>By using this feature, we can analyse the frequency of spikes produced by cortical neurons instead of focusing on individual spikes. In parallel, we also use the average and standard deviation of the interspike intervals (ISIs) as the second and third features. We calculate the ISIs of one neuron (n) by checking the time (t) between subsequent action potentials or spikes (i).</p>
<disp-formula id="E2"><label>(2)</label><mml:math id="M2"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:msubsup><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msubsup><mml:mo>-</mml:mo><mml:msubsup><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>-</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msubsup></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The average of ISIs of one neuron brings the probable timing of spike, or the interval which a new spike is expected, and the standard deviation of ISIs exploits its temporal coordination or degree of synchrony. For both features, the average value among the cortical neurons are calculated. All those properties are combined as inputs to our DM.</p>
<disp-formula id="E3"><label>(3)</label><mml:math id="M3"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mover accent="true"><mml:mrow><mml:mi>I</mml:mi><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>s</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:mfrac><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:mfrac><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:munderover></mml:mstyle><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:munderover></mml:mstyle><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msubsup></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="E4"><label>(4)</label><mml:math id="M4"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msqrt><mml:mrow><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:mfrac><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:mfrac><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:munderover></mml:mstyle><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mi>I</mml:mi></mml:mrow></mml:munderover></mml:mstyle><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msubsup><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msubsup><mml:mo>-</mml:mo><mml:mover accent="true"><mml:mrow><mml:mi>I</mml:mi><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>s</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:msqrt></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Besides that, we used two different properties to evaluate our model under &#x0201C;<italic>parkinsonian&#x0201D;</italic> conditions. First, it is known that <italic>parkinsonian</italic> brains reveal higher synchronicity among neighbouring neurons than healthy brains. And, this behaviour causes a reduction of spike train variability. In order to evaluate our model using this property, we extracted the spike trains of cortical neurons after 10 simulations for each stationary thalamic stimulation and calculated the Coefficient of Variance (CV). The CV, also known as the neuronal variability, can be estimated by using the normalised ISIs distributions. On other words, the standard deviation of ISIs divided by its mean.</p>
<disp-formula id="E5"><label>(5)</label><mml:math id="M5"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>C</mml:mi><mml:mi>V</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003C3;</mml:mi></mml:mrow><mml:mrow><mml:mi>I</mml:mi><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>I</mml:mi><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>s</mml:mi></mml:mrow><mml:mo>&#x00304;</mml:mo></mml:mover></mml:mrow></mml:mfrac></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Basically, the ISIs distribution reveals if some intervals of time are repeated more often. The repetition of those intervals helped us to calculate the neuron variability and, as a consequence, to evaluate the model. Another important property used in this work was the pathological beta band activity (13&#x02013;30 Hz). In order to consider this property, we calculated the Power Spectrum Density (PSD) of different group of neurons (e.g., cortical neurons) using both conditions of the model. The <italic>parkinsonian</italic> condition should produce an enhanced beta oscillation.</p>
</sec>
<sec>
<title>6.4.3. Decoding Module</title>
<p>The Decoding Module (DM), described in section 5.2, receives signals corresponding to the dynamics of cortical neurons and translates them into motor stimulation. The robot sensorimotor-loop was designed to produce smooth movements on the robot&#x00027;s arm based on sensory information, therefore we built and trained this module using data extracted from our computational model under <italic>healthy</italic> condition only.</p>
<p>Two different parts of this module were implemented. First, we built and trained a Multi-Layer Perceptron (MLP) network to produce the motor stimulation after three different inputs were extracted from cortical neurons (average firing rate, average ISIs, and standard deviation of ISIs). Then, we implemented a simple smooth filter and a linear function to transform the output data from our neural network in values that are suitable for the robot, respecting the operational range in radians of the robot&#x00027;s joints.</p>
<p>Based on that, a MLP neural network was designed and trained as the main component of the DM. Overall, the motor stimulation generated by this module depends only on the dynamics of cortical neurons. Our MLP was trained using the data extracted from the computational model under <italic>healthy</italic> conditions only.</p>
<p>The main idea was to create a MLP that would inhibit the central oscillators and thus simulate smooth (or <italic>healthy</italic>) robot movements. The resultant movements could be seen as our &#x0201C;ground truth,&#x0201D; i.e., the most accurate measurement available of the robot&#x00027;s smooth (or <italic>healthy</italic>) movements (Marvel et al., <xref ref-type="bibr" rid="B54">2012</xref>; Kondermann, <xref ref-type="bibr" rid="B40">2013</xref>). Hence, without retraining our MLP, we wanted to observe the intervention of the central oscillators in the robot&#x00027;s movements after activating the <italic>parkinsonsian</italic> condition. In this way, when comparing <italic>healthy</italic> and <italic>parkinsonian</italic> conditions, we expected that only the BG-T-C dynamics would change.</p>
<p>Burkhard et al. (<xref ref-type="bibr" rid="B5">2002</xref>) state that &#x0201C;oscillatory networks generate a naturally occurring resonance frequency that synchronizes cerebral function, but through an unknown mechanism, they are disinhibited or amplified so as to generate PD or ET tremors.&#x0201D; Therefore, in our initial neurorobotics model, we are assuming that an altered (PD) basal ganglia may interfere with motor programmes (produced, for instance, by the cerebellum) by disinhibiting oscillators that would otherwise not contribute to motor disruption in a <italic>healthy</italic> condition.</p>
<p>In this way, we are not decoding motor commands from our BG-T-C networks, we are instead mimicking the influence of the BG-T-C network on ongoing networks of oscillators that interfere with motor control but that haven&#x00027;t been explicitly modelled. Thus, in our initial model, in the <italic>healthy</italic> condition, regardless of the sensory input, the BG-T-C network should inhibit the influence of such oscillators (modulation values close to 0). Then, in the <italic>parkinsonian</italic> condition, results could be seen as emergent and non intuitive, because the MLP and all other structures, apart from the BG-T-C network, remain exactly the same. This enables us to study the effect of the parkinsonian condition on the inhibition/disinhibition of the central oscillators and its impact on motor behaviour.</p>
<p>In the MLP modelling, we selected the regression mode that could set a predict numeric target instead of creating discrete classes. We used a collection of data obtained after several simulations of our computational model in <italic>healthy</italic> condition to train the entire network. Since we do not want to reproduce any abnormal movement on the robot in <italic>healthy</italic> condition, we trained the network to produce output values equal to zero. This would guarantee that the robot final motor commands translated by the BeM would not be affected by the oscillatory phenomena produced by the central oscillators.</p>
<p>The neural network chosen as our DM is composed of three input neurons, two hidden layers with 9 and 6 neurons, respectively, and one output neuron (<xref ref-type="fig" rid="F8">Figure 8</xref>). All neurons contain log-sigmoid transfer functions</p>
<disp-formula id="E6"><label>(6)</label><mml:math id="M6"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>l</mml:mi><mml:mi>o</mml:mi><mml:mi>g</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>g</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>n</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>/</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn><mml:mo>&#x0002B;</mml:mo><mml:mi>e</mml:mi><mml:mi>x</mml:mi><mml:mi>p</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mo>-</mml:mo><mml:mi>n</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>except by the output neuron which was designed with a hyperbolic tangent sigmoid transfer function</p>
<disp-formula id="E7"><label>(7)</label><mml:math id="M7"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>t</mml:mi><mml:mi>a</mml:mi><mml:mi>n</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>g</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>n</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mn>2</mml:mn><mml:mo>/</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mn>1</mml:mn><mml:mo>&#x0002B;</mml:mo><mml:mi>e</mml:mi><mml:mi>x</mml:mi><mml:mi>p</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mo>-</mml:mo><mml:mn>2</mml:mn><mml:mo>*</mml:mo><mml:mi>n</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>-</mml:mo><mml:mn>1</mml:mn></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>so it could produce positive and negative outputs. Also, three biases were used to adjust the input data <italic>n</italic> to our model. The network was designed and trained using the Shallow Neural Networks from the Deep Learning toolbox of MATLAB. We used the Gradient descent backpropagation approach to train our network with data collected from our BM after a few trials. The weights generated after our training and the entire architecture can be found in our repository within the DM application.</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p>Illustration of the MLP neural network used as part of our DM. The network contains three input neurons which correspond to the properties extracted from cortical neurons; three hidden layers with 3, 9, and 6 neurons, respectively; and one output neuron since we designed the network as a regression model. Log-sigmoid and hyperbolic tangent sigmoid transfer functions were used as presented within the diagrams of the neurons.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0008.tif"/>
</fig>
<p>Two post-processing techniques, smoothing and transformation, were necessary before conveying the motor stimulation to the BeM. Since neural signals are known by their intense oscillation, we decided to apply a mean filter to the output of our MLP network. The designed filter consists of a simple average of five consecutive values (<italic>o</italic><sub><italic>t</italic></sub>, <italic>o</italic><sub><italic>t</italic>&#x02212;1</sub>, &#x022EF;&#x02009;, <italic>o</italic><sub><italic>t</italic>&#x02212;4</sub>).</p>
<disp-formula id="E8"><label>(8)</label><mml:math id="M8"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>o</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>5</mml:mn></mml:mrow></mml:mfrac><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>0</mml:mn></mml:mrow><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:munderover></mml:mstyle><mml:msub><mml:mrow><mml:mi>o</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi><mml:mo>-</mml:mo><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>In this way, only after the fifth output, it is possible to produce the motor stimulation. This was not an issue since the robot spent a few seconds bringing all the packages up and setting itself to its initial pose. Then, a linear mathematical transformation was necessary to adjust those values to a suitable range for the robot&#x00027;s joints in radians.</p>
<disp-formula id="E9"><label>(9)</label><mml:math id="M9"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>m</mml:mi><mml:msub><mml:mrow><mml:mi>s</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mn>15</mml:mn><mml:mo>*</mml:mo><mml:mi>a</mml:mi><mml:mi>b</mml:mi><mml:mi>s</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>o</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>-</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>0015</mml:mn></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The two parameters of this linear function were manually configured before running the experiments on the real robot.</p>
</sec>
<sec>
<title>6.4.4. Behavioural Module</title>
<p>The behavioural module selects the robot&#x00027;s pre-defined <italic>destination poses</italic> after translating sensory inputs, motor stimulation and oscillatory signals to joints trajectories values. Basically, the robot establishes when each movement should be triggered by checking the visual cues from the sensory inputs (positive and negative stimulus) during the task and combining this information to a state machine (SM). Two discrete <italic>destination poses</italic> are established to perform those behaviours. They are used to generate different movements for the robot as presented in <xref ref-type="fig" rid="F7">Figure 7</xref>. Then, the joints angles in radians are adjusted based on the emulated signal (<italic>es</italic>) generated after the modulation of the oscillatory signal (<italic>os</italic>) by the motor stimulation (<italic>ms</italic>).</p>
<disp-formula id="E10"><label>(10)</label><mml:math id="M10"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>o</mml:mi><mml:msub><mml:mrow><mml:mi>s</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003C0;</mml:mi><mml:mi>t</mml:mi><mml:mo>-</mml:mo><mml:mfrac><mml:mrow><mml:mi>&#x003C0;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:mfrac></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="E11"><label>(11)</label><mml:math id="M11"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>e</mml:mi><mml:msub><mml:mrow><mml:mi>s</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mi>m</mml:mi><mml:msub><mml:mrow><mml:mi>s</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>*</mml:mo><mml:mi>o</mml:mi><mml:msub><mml:mrow><mml:mi>s</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Those operations are executed every second (&#x00394;<italic>t</italic> &#x0003D; 1<italic>s</italic>) during the performance of the task. The oscillatory signal generated from our Central Oscillators was implemented as a sinusoidal wave producing alternated peaks (high and low) at each iteration of the motor loop. Since it is not yet very clear which structures of the brain compose this oscillatory pattern we implemented it as an isolated block of the robot sensorimotor loop (<xref ref-type="fig" rid="F6">Figure 6</xref>).</p>
<p>The state machine (<italic>sm</italic>) selects the robot&#x00027;s action taking into account the oscillatory signal from the Central Oscillators and each joint <italic>j</italic><sup><italic>k</italic></sup>, <italic>k</italic> &#x02208; {1, 2, 3, 4}, of the arm is updated closing the sensorimotor loop. All the four joints (RShoulderRoll, RElbowRoll, RElbowYaw, RHand) are updated with the same values from our emulated signal.</p>
<disp-formula id="E12"><label>(12)</label><mml:math id="M12"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msubsup><mml:mrow><mml:mi>j</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mrow><mml:mi>k</mml:mi></mml:mrow></mml:msubsup><mml:mo>=</mml:mo><mml:mi>s</mml:mi><mml:msub><mml:mrow><mml:mi>m</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mi>e</mml:mi><mml:msub><mml:mrow><mml:mi>s</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>In this work, the motor stimulation is responsible to modulate the oscillatory signals by either suppressing or enhancing the oscillatory signal at each time step. Following findings from the literature on motor modulation of oscillatory signals inherent in the human brain (Burkhard et al., <xref ref-type="bibr" rid="B5">2002</xref>), we designed the system to suppress it under healthy conditions. As a consequence, smooth movements can be executed by the robot throughout the entire task. However, we can not anticipate the robot&#x00027;s behaviour under PD conditions. One can expect that once the <italic>parkinsonian</italic> condition is on, the robot will not be able to modulate the inherent oscillatory patterns anymore.</p>
<p>In <xref ref-type="fig" rid="F9">Figure 9</xref>, the state machine designed for our behavioural task is illustrated in a simplified way. There are five different states which correspond to different moments of the behavioural task. In the initial state, the robot moves its body to the initial pose and asks someone to allocate one ball in front of him. Once a ball is detected, the state is updated to state 1. In this state, the robot process the sensory inputs in order to recognize the colour of the ball. If the colour is recognised, the state 2 is activated and the action related to the visual cue is executed. When the action completes, the SM moves to State 3 which checks if the number of repetitions has been completed. If it has not, the state 0 is activated again. Otherwise, the SM moves to state 4, which moves its body to the final pose and concludes the task.</p>
<fig id="F9" position="float">
<label>Figure 9</label>
<caption><p>A diagram illustrating the five states of the state machine developed specifically to perform our behavioural task.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0009.tif"/>
</fig>
</sec>
<sec>
<title>6.4.5. Module Integration</title>
<p>ROS provides integration with OpenCV, Netpyne/NEURON, and many other frameworks, libraries, and packages. It is modular and therefore highly versatile. In this work, it simplified the communication between the modules described above. Each module was considered as a different application or node running in parallel during the entire performance of the task. The messages carrying important data, like the sensory neural signal and the motor stimulation, could be transmitted online via topics and services. Besides that, the sensors and actuators of the robot could be easily accessed in high frequency without compromising the task and the dynamics of the BG-C-T system.</p>
</sec>
</sec>
</sec>
<sec id="s7">
<title>7. Experimental Results</title>
<p>In this section, we present the experimental evaluations used to assess our neurorobot while performing a simple behavioural task in both conditions of the computational model, <italic>healthy</italic> and <italic>parkinsonian</italic>. Analyses of motor perturbations under the influence of the central oscillators were made to compare its intensity throughout the tasks and while the neurorobot was in both conditions.</p>
<sec>
<title>7.1. Robot Behaviour</title>
<p>Each robot behaviour corresponds to a combination of four different joint angles of the right arm. The joints used in our behavioural task are &#x0201C;RShoulderRoll,&#x0201D; &#x0201C;RElbowRoll,&#x0201D; &#x0201C;RElbowYaw,&#x0201D; and &#x0201C;RHand.&#x0201D; <xref ref-type="fig" rid="F10">Figure 10</xref> shows the dynamics of each joint during the performance of the entire task for both conditions of the computational model. As described in section 6.2, there are two different experimental scenarios, the rejection and curiosity behaviours. Those two scenarios produce different movements and are represented by different activities in those joints. As mentioned previously, the robot acts a few seconds after the recognition of the object. Because of that, there is a delay on the change of the angles in all cases. Additionally, the interaction with the robot was manually executed which caused reactions of the robot to the same objects not exactly at the same instance of time but yet close to the experimental scenario presented in section 6.3.</p>
<fig id="F10" position="float">
<label>Figure 10</label>
<caption><p>Dynamics of four different joints of the right arm of the robot during the performance of the task. Both conditions of the computational model were tested, <italic>healthy</italic> and <italic>parkinsonian</italic>. The oscillation under the <italic>parkinsonian</italic> condition indicates the production of the tremor symptom in the robot&#x00027;s arm. A small window was created in between 20 and 30 s of each graphic to zoom in on both signals.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0010.tif"/>
</fig>
<p>In both conditions, one can notice the increase in the intensity of the motor perturbation when the <italic>parkinsonian</italic> condition is activated. The motor perturbation, which could be in a sense analogous to the PD tremor symptom, is reproduced based on subtle oscillations of the joint angles throughout the task. In <xref ref-type="fig" rid="F10">Figure 10</xref>, the dotted line for each joint indicates the tremor pattern that is characteristic in patients diagnosed with PD. However, the frequency and even the amplitude of the movement had to be limited to avoid damaging the joints of the robot. The frequency was adjusted to be the same as the control loop, which is 1 Hz. In this way, every second, the robot could update the joints&#x00027; angles based on the dynamics of the BeM without compromising the motors. Also, the amplitude of the tremor was constrained based on each joint operational range (SoftBank, <xref ref-type="bibr" rid="B84">2006</xref>).</p>
<p>The trajectory of the arm goes through positive and negative adjustments as already illustrated in <xref ref-type="fig" rid="F10">Figure 10</xref>. During the first 30 s of the experiment, the robot did not interact with any objects which allowed the arm to keep the same position or set of angles. In <xref ref-type="table" rid="T1">Table 1</xref>, the values present the fluctuation of the arm during this period of time. Since the same values produced by the modulation process are incorporated to all the joints of the arm, we can see that the standard deviation only differs between the condition of the BM. Those two values highlight the disturbance in the robot&#x00027;s arm under <italic>parkinsonian</italic> conditions. By checking those angles in radians, you could think they may not represent a significant change in the trajectory of the robot&#x00027;s arm. But, as you can see in our experiment (<ext-link ext-link-type="uri" xlink:href="https://youtu.be/KEa_2lG8V5s">https://youtu.be/KEa_2lG8V5s</ext-link>), those extra angles in a joint were enough to create the abnormal movements. Due an increase in the oscillation, the motors needed to move from more distinct positions in the same period of time which caused an increase of velocity and acceleration of the motors.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>The fluctuation of the joints through the first 30 s of the experiment.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Joints</bold></th>
<th valign="top" align="left"><bold>Conditions</bold></th>
<th valign="top" align="left"><bold>Operational range (rad)</bold></th>
<th valign="top" align="center"><bold>Mean angle (rad)</bold></th>
<th valign="top" align="center"><bold>Standard deviation (rad)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">RShoulderRoll</td>
<td valign="top" align="left">H</td>
<td valign="top" align="left">&#x02212;2.0857 to 2.085</td>
<td valign="top" align="center">&#x02212;0.7975</td>
<td valign="top" align="center">0.0145</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">PD</td>
<td valign="top" align="left">&#x02212;2.0857 to 2.085</td>
<td valign="top" align="center">&#x02212;0.7958</td>
<td valign="top" align="center">0.1260</td>
</tr>
<tr>
<td valign="top" align="left">RElbowRoll</td>
<td valign="top" align="left">H</td>
<td valign="top" align="left">0.0349 to 1.5446</td>
<td valign="top" align="center">0.8325</td>
<td valign="top" align="center">0.0145</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">PD</td>
<td valign="top" align="left">0.0349 to 1.5446</td>
<td valign="top" align="center">0.8342</td>
<td valign="top" align="center">0.1260</td>
</tr>
<tr>
<td valign="top" align="left">RElbowYaw</td>
<td valign="top" align="left">H</td>
<td valign="top" align="left">&#x02212;2.0857 to 2.0857</td>
<td valign="top" align="center">0.2525</td>
<td valign="top" align="center">0.0145</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">PD</td>
<td valign="top" align="left">&#x02212;2.0857 to 2.0857</td>
<td valign="top" align="center">0.2542</td>
<td valign="top" align="center">0.1260</td>
</tr>
<tr>
<td valign="top" align="left">RHand</td>
<td valign="top" align="left">H</td>
<td valign="top" align="left">Open and Close</td>
<td valign="top" align="center">0.0025</td>
<td valign="top" align="center">0.0145</td>
</tr>
<tr>
<td/>
<td valign="top" align="left">PD</td>
<td valign="top" align="left">Open and Close</td>
<td valign="top" align="center">0.0042</td>
<td valign="top" align="center">0.1260</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>For each joint, it was calculated the mean and standard deviation of its angle in radians. The operational range is also given as a comparative of the robot&#x00027;s maximum and minimum capacity of motion</italic>.</p>
</table-wrap-foot>
</table-wrap>
<sec>
<title>7.1.1. Experimental Scenario 1: Rejection Behaviour</title>
<p>The scenario 1 was performed two times in this experiment. First, when the yellow ball was presented to the robot. And, then, when the purple ball replaced the green one. During the rejection behaviour, the robot moves the right arm close to its torso for a few seconds and, then, returns it to the initial pose. It is visible the execution of this behaviour by the movements of the first two joints in <xref ref-type="fig" rid="F10">Figure 10</xref> after the first stimulus. They rapidly increase and maintain the angles for a few seconds. The &#x0201C;RElbowYaw&#x0201D; slightly changes its angle and &#x0201C;RHand&#x0201D; keeps in zero which means close hands. When the second negative stimuli (purple ball) is presented, it is possible to see the same behaviour but starting from different states of the joints.</p>
</sec>
<sec>
<title>7.1.2. Experimental Scenario 2: Curiosity Behaviour</title>
<p>The second scenario has a completely different dynamics. The robot moves its arm forward, open the hands and wait a few seconds for someone to put the ball on its hand. Then, it grasps and drops the ball into the small container. The self grasping using NAO robot is an extra challenge out of the scope of this work. The curiosity behaviour can be easily observed in <xref ref-type="fig" rid="F10">Figure 10</xref> after the positive stimulus. The first three joints indicate the movement of the arm forward. The &#x0201C;RHand&#x0201D; opens the hand to hold the object. And, the movement which permit the dropping of the ball can be visualised by the &#x0201C;RElbowYaw&#x0201D; change of angle at 70 s.</p>
</sec>
</sec>
<sec>
<title>7.2. The Abnormal Motor Stimulation and the Tremor Symptom</title>
<p>The computational model in <italic>parkinsonian</italic> condition is characterised by the depletion of striatal DA. As explained in section 3, it leads to a functional imbalance of BG circuitry which hampers movement execution. In our experiments, after embedding the model under those conditions in a humanoid robot engaged in a behavioural task, the intensity of the tremor symptom was enhanced.</p>
<p>In our SML, the DM module produces motor stimulation responsible to modulate the oscillatory signal based only on three different input data (average firing rate, average of ISIs, and standard deviation of ISIs) extracted from cortical neurons. For more details about the DM, please consider reading section 6.4.3. <xref ref-type="fig" rid="F11">Figure 11A</xref> shows those inputs plotted after two experiments, one for each condition of the model. The model under <italic>parkinsonian</italic> conditions produced a higher average firing rate which means more spikes were generated per second (1 Hz). Because of that, there was a reduction in the average of ISIs. In other words, the timing between spikes became shorter. Besides that, the third graphic in <xref ref-type="fig" rid="F11">Figure 11A</xref> shows a slight reduction in synchronicity which means the spikes were generated in a more aleatory manner. During the task, different objects were presented to the robot which produced different levels of excitation in the cortical neurons. For both conditions, the firing rates increased after a positive stimulus which directly produced a certain reduction on the interval between spikes. However, the synchronicity of the neurons seemed to not be affected much.</p>
<fig id="F11" position="float">
<label>Figure 11</label>
<caption><p>In <bold>(A)</bold>, inputs of the MLP network&#x02014;average firing rate (Equation 1), average of ISIs (Equation 3), and standard deviation of ISIs (Equation 4) of cortical neurons) during the performance of the task. Two experiments following the same sequence of balls (yellow, green, and purple) were executed, one for each condition of the model. The variation of those stimulus can be easily observed in those graphics. <bold>(B)</bold> Shows the response of the trained MLP network (<xref ref-type="fig" rid="F8">Figure 8</xref>) to the dynamic of cortical neurons under both conditions of the model. A smoothing filter (Equation 8) is applied to the output of the MLP network in order to reduce the oscillation that is common on neural signals. Then, a linear transformation (Equation 9) adjust the value to proper ranges allowing the disturbance to be visible during the execution of the task without compromising the motors of the robot. In <bold>(C)</bold>, the graphic shows the output of the modulation process which corresponds the emulated signal.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0011.tif"/>
</fig>
<p>The distinguishable cortical dynamics allows our trained network to produce different outputs based on the condition of the model. <xref ref-type="fig" rid="F11">Figure 11B</xref> shows the response of the MLP network under both conditions. As it can be seen, abnormal values emerged during the performance of the task under <italic>parkinsonian</italic> condition. We performed a simple filtering process on both output signals since neural activities are known by their intense oscillation. In this way, the second graphic shows clearly the different patterns that was generated. Under healthy conditions, the signal oscillates around the value zero which represents low motor stimulation. Meanwhile, the <italic>parkinsonian</italic> condition brings slightly higher values. Then, we applied a linear transformation as explained in section 6.4.3 to make the motor stimulation suitable for the robot. The generated output represents the motor stimulation in radians produced by the DM during the performance of the task.</p>
<p>As the final step, the motor stimulation modulate the oscillatory signal, generating the emulated signal (<xref ref-type="fig" rid="F11">Figure 11C</xref>), which then tune the angles of the joints defined by our state machine. Basically, for every iteration of the motor loop, a motor stimulus establish the intensity of the motor noise and the central oscillators its signal before adjusting the trajectory of the robot&#x00027;s arm as observed in <xref ref-type="fig" rid="F10">Figure 10</xref>. The tremor symptom is a response from this modulation process between the motor stimulation and the central oscillators.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s8">
<title>8. Discussion</title>
<p>In this section, we bring some discussions related to the model dynamics, the response of the BG-T-C system to different thalamic stimulation, and other important marks about our SML and PD.</p>
<sec>
<title>8.1. The Model Dynamics</title>
<p>In our experiments, the colour of the object used to interact with the robot triggers different thalamic stimulus which directly affect the dynamics of cortical neurons (<xref ref-type="fig" rid="F12">Figure 12</xref>). When the green ball is sensed by the robot after a negative or non stimulus the cortical neurons intensify the spiking generation, and the opposite happens when a negative stimuli is presented after a positive one.</p>
<fig id="F12" position="float">
<label>Figure 12</label>
<caption><p>The membrane potential of a single cortical neuron after different stimulus being applied to thalamic neurons. In this experiment, we used the same sequence of stimulus in both conditions of the model. The abrupt change of firing spikes can be easily observed in the graphics.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0012.tif"/>
</fig>
<p>By simulating the entire network, we could analyse the dynamics of the robot sensorimotor loop. In <xref ref-type="fig" rid="F13">Figure 13</xref>, the link between the average firing rates of neurons from TH and CTX during the execution of our behavioural task is clear. Every time neurons from TH become more excited, more glutamate is released stimulating even more the motor cortex. And, when TH is inhibited, a reduction of excitation on motor CTX can be also observed. Some other features of the model could be also recognised. For instance, after injecting extra DC current directly to the membrane of the thalamic neurons, there was a significant increase in the number of spikes per second in that region of the brain. In this sense, an external current applied on TH, regardless of the network being on <italic>healthy</italic> or <italic>parkinsonian</italic> condition, contributes to an increase in thalamic firing rate (please refer to section 2.5 from Kumaravelu et al., <xref ref-type="bibr" rid="B43">2016</xref> for the equations). However, we emphasise that the firing rate in each region results from nonlinear effects. Additionally, due to a cortical network composite of inhibitory (Fast-Spiking Interneurons) and excitatory (Regular-Spiking) neurons, the firing rates of the cortical neurons were considerably lower than the ones from TH. Finally, Kumaravelu et al. (<xref ref-type="bibr" rid="B43">2016</xref>) adjusted their model based on data from rats, which shows a higher thalamic firing rate compared to that from CTX. In fact, this is true for primates as well (Van Albada and Robinson, <xref ref-type="bibr" rid="B89">2009</xref>).</p>
<fig id="F13" position="float">
<label>Figure 13</label>
<caption><p>Average firing rate comparison between neurons from CTX and TH during the performance of one entire task. The average firing rate is calculated every second by integrating the spikes from those regions and dividing it by the number of neurons. Three different stimuli were presented to the robot in different moments of the task. The sequence of the colour of the balls in both conditions were yellow (30 s), green (55 s), and purple (75 s). Each graphic shows the exact moment of the transition from a negative to a positive stimuli and vice versa. In those cases, the firing rate rapidly increases and decreases, respectively. The first stimulus maintain the low firing rate since it does not bring any curiosity for the robot. Note that thalamic neurons have a higher firing rate compared to cortical neurons.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0013.tif"/>
</fig>
<p>Since the initial state of the network does not incorporate external stimulus to TH, a low firing rate is characteristic on both conditions of the computational model. After the first stimuli (experimental scenario 1), the CTX under both conditions kept the average firing rate low since the object (yellow ball) was not excitatory to the robot. It is important to mention that the external stimulus are kept until a new object is placed in front of the robot. Consequently, when the first positive stimulus (experimental scenario 2) was presented, an abrupt increase of the firing rate was detected. For a few seconds, the robot interacted with the green ball, maintaining the high rate. Then, the last object reduced the average firing rate to its initial low level since the object (purple ball) was not excitatory to the robot.</p>
</sec>
<sec>
<title>8.2. The Thalamic Stimulation</title>
<p>Since the neurorobot depends on different thalamic stimulation to perform the task, we decided to evaluate the injection of a set of different DC currents on thalamic neurons in order to avoid selecting one that could compromise the biological plausibility of the entire computational model. Hence, we believe it is important to elucidate the effect of different thalamic stimulation over cortical neurons before discussing the results about the emerged <italic>parkinsonian</italic> symptom in the robot.</p>
<p>Steriade et al. (<xref ref-type="bibr" rid="B85">1998</xref>) once investigated the interplay between those neurons in <italic>in vivo</italic> after repetitive stimuli at around 10 Hz. Based on that, it is known that different thalamic stimuli provoke different responses on cortical neurons. A recent work made a similar experiment but in a PD scope. Tucker et al. (<xref ref-type="bibr" rid="B88">2021</xref>) analysed how motor thalamic DBS alters cortical activity by testing different stimulation frequencies, current amplitudes and pulse widths in order to reduce motor symptoms in rats. The authors observed an increase of spike frequencies of cortical neurons after using DBS.</p>
<p>In this work, we tested different thalamic stimuli in our BG-T-C circuitry. <xref ref-type="fig" rid="F14">Figure 14</xref> shows the cortical response to the increase of thalamic stimulation. Since the computational model was designed with excitatory projections from TH to CTX, we expected a proportional increase of the average firing rate in both conditions of the model. However, the model demonstrated a non-linear proportionality within two ranges of thalamic stimulation. For instance, a noticeable peak indicates that the model changes the cortical dynamics after reaching 3.2 mA. Then, it rapidly reduces the average firing rate, reaching zero at 4.6 mA approximately. Besides that, a slight increase of spikes can be observed when the <italic>parkinsonian</italic> condition is activated for several ranges of thalamic stimuli.</p>
<fig id="F14" position="float">
<label>Figure 14</label>
<caption><p>Effect of different thalamic stimulation over cortical neurons. For each thalamic stimulation, we calculated the average firing rate of cortical neurons during an entire experiment and its standard deviation.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0014.tif"/>
</fig>
<p>Based on that, we choose different pairs of DC currents and ran some analyses. We selected values that could respect PD features and generate distinguishable dynamics on cortical neurons. We assessed the model following some PD features like spike train variability of neighbouring neurons and anomalous beta oscillation. Then, we decided to inject 1.2 mA of DC current on thalamic neurons every time the robot sense a negative stimulus and 3.5 mA for the positive stimulus.</p>
<p>In order to evaluate the variability, we built histograms of ISIs of cortical neurons under different thalamic stimulation using both conditions of the model. <xref ref-type="fig" rid="F15">Figure 15A</xref> shows the resulting non-symmetric distributions. The ISI values produced right-skewed distributions that are characterised as having a higher concentration on its left side of the curve and a longer tail on the other side. The intervals with a higher concentration can be visualised around 200 ms for the 1.2 mA scenario and 125 ms for the 3.5 mA scenario. In both cases, under the <italic>parkinsonian</italic> condition, the peaks indicate a clear reduction in variability. On other words, the neurons produce more often spikes with same intervals.</p>
<fig id="F15" position="float">
<label>Figure 15</label>
<caption><p>In <bold>(A)</bold>, histograms of ISIs from simulations under different thalamic stimulation (1.2 and 3.5 mA) in both conditions of the model. The range for each histogram was adapted since a higher thalamic stimulation increases the neuronal activity from CTX, producing even more spikes. A higher concentration of the same intervals between spikes indicate the reduction of variability when the <italic>parkinsonian</italic> condition is activated in both scenarios. <bold>(B)</bold> Shows the coefficient of Variance of cortical neurons after two thalamic stimulation. The variability was tested in both scenarios for both conditions of the model. The box plots show a reduction of variability when the <italic>parkinsonian</italic> condition is activated. It also shows a bigger concentration of ISI values. <bold>(C)</bold> Exhibits Power Spectrum Density (PSD) of cortical neurons under 1.2 and 3.5 mA of thalamic stimulation. Both conditions of the model were tested. The green area indicates the beta band range (13&#x02013;30 Hz). The peaks within the range shows the enhance in beta activity detected after activating the <italic>parkinsonian</italic> condition.</p></caption>
<graphic xlink:href="fnbot-15-640449-g0015.tif"/>
</fig>
<p>Another characteristic that can be observed from both distributions is the increase of the number of ISIs. As exhibited in <xref ref-type="fig" rid="F14">Figure 14</xref>, 3.5 mA of thalamic current generates more spikes on cortical neurons. As a consequence, it reveals more intervals between spikes which obviously increases the number of ISIs. Because of this feature, it can be observed that one peak reach values close to 4,000 ISIs while the other goes over 18,000. Despite this noticeable variation, the graphics maintains the shape of the distributions in both scenarios and conditions.</p>
<p>In order to quantify the variability, the normalised version of the standard deviation of ISIs known as CV was used. <xref ref-type="fig" rid="F15">Figure 15B</xref> makes evident the reduction of variability of cortical neurons after activating the <italic>parkinsonian</italic> condition in both scenarios. This feature relates to an increase of synchronicity between neighbouring neurons.</p>
<p>The other PD feature investigated in this work was the enhance of beta activity in the corticothalamic-basal ganglia network. As it can be seen in <xref ref-type="fig" rid="F15">Figure 15C</xref>, the beta band was enhanced after activating the <italic>parkinsonian</italic> condition of the model in both scenarios (under 1.2 and 3.5 mA of thalamic stimulation). The peaks in both graphics show a significant increase of activity.</p>
</sec>
<sec>
<title>8.3. Final Considerations</title>
<p>The embodiment of autonomous neural systems that are based on the structure of animal brains is yet a young field. However, it has already brought important discussions on neural models and their applications. It permits the conduction of experiments in a repeatable manner without bringing any ethical constraint. As discussed in section 4, only a few works have embedded computational models of neural disorders in robots. We could observe that the majority of the researches in neurorobotics focus on common robotics problems, like navigation and decision-making, instead of building tools to support neuroscientists with their findings on neural disorders.</p>
<p>In this work, we embedded a composite model of the BG-T-C system in a real humanoid robot to perform movements based on sensory information. The realistic biophysical model allowed the robot to replicate the interplay between neurons from different regions of the brain during the performance of the task without demanding a high computational power. With our neurorobot, we could stimulate thalamic neurons and analyse its response over the entire model using different approaches, like mean firing rate, spike train variability, and even beta oscillation activity. Several experiments were executed without compromising our robot and the model. We choose thalamic neurons to be injected with external DC currents since they control the flow of information that are transmitted to cortical neurons. However, some other works have decided to explore other regions of the brain (Kim et al., <xref ref-type="bibr" rid="B38">2017</xref>; Mulcahy et al., <xref ref-type="bibr" rid="B61">2020</xref>). In our experiments, the robot was able to sense the environment, process the information and act respecting the same dynamics observed on data sets from animal&#x00027;s brains.</p>
<p>When activated the &#x0201C;<italic>parkinsonian&#x0201D;</italic> condition, one of the PD symptoms was reproduced during the performance of the task. The combination of different frameworks and libraries made possible to embed the PD model in a robot engaged in a behavioural task. In this way, the sensory information collected from the environment had an important role in our SML which allowed the robot to take its action with incorporated motor noise. Since this work represents the first step toward a realistic neurorobotics model of PD, the main idea was to develop those components in a modulated way, allowing future replacements. Five different modules were created. Simple updates can be made on each module and, even, a complete different implementation. However, the communication between modules must be respected in order to maintain the data flow through our SML. ROS made possible not only the communication between those applications but also the interaction with the robot&#x00027;s hardware.</p>
<p>It is important to highlight that for both conditions, <italic>healthy</italic> and <italic>parkinsonian</italic>, the entire SML used was the same except by the conditions applied to the BM, and the motor stimuli generated was constantly used to modulate the oscillatory signal to incorporate different intensities of motor tremor in the robot motion. However, the <italic>parkinsonian</italic> condition produces values that cause more perturbation to the robot&#x00027;s upper limbs movement, while the <italic>healthy</italic> condition produces minimum-variance trajectory or unnoticeable tremor similar to what happens in healthy animals (Harris and Wolpert, <xref ref-type="bibr" rid="B24">1998</xref>). Hence, the major change between the conditions of our neurorobotics model is the amplitude of the tremor.</p>
<p>This research produced a novel tool that can be used in several contexts, not only PD. The computational model of PD represent the biophysical state of an entire SML. Each module designed within this loop can be modified and adapted to different scenarios and even completely different applications. Neuroscientists could generate new hypotheses relate to other neural disorder that is involved to the BG-T-C system. And, even use the model to understand the dynamics of those neurons respecting the different motor pathways.</p>
<p>Prescott et al. (<xref ref-type="bibr" rid="B70">2006</xref>) once questioned which would be the most suitable interpretation of the inputs and output of computational models of the brain. Authors explain that is common to associate &#x0201C;sensory&#x0201D; signals as input and &#x0201C;motor&#x0201D; signals as output of those models but it might be not the most appropriate representation. We are searching for a more biologically plausible mechanism to coordinate movements in a robot.</p>
<p>In neuroscience, some works investigate the mechanical properties of muscles (Harris and Wolpert, <xref ref-type="bibr" rid="B24">1998</xref>). They bring interesting research questions like how trajectories of arm movements can be performed smoothly and how much control the central nervous system has in this scenario. By using the same theory of control systems, we assume there is an autonomous mechanism responsible for optimising the integration of those movements. For instance, a mechanism capable of generating the correct amount of stimulus for each muscle in small instances of time during the entire trajectory. In this context, we will adapt our SML to new behavioural tasks that will allow us to focus more on the motion of the arm. The BM will be evolved with new components, a novel DM will be designed and implemented allowing the reproduction of the motor pathways between brain and muscles, and a new BeM will allow the execution of more complex tasks.</p>
<p>Another point that is important to discuss is the level of realism of the humanoid robots used in our experiments. Since a more realistic DM will be built, it will be important to move the experiments to a more complex scenario where the robot can reproduce movements that resemble more humans. In this way, we will use the iCub robot instead of keeping using the NAO robot for the upcoming experiments. Movements that are commonly used in therapy sessions with PD patients will be replicated by the iCub robot. And this task will allow us to asses our model by comparing its movements to data collected from real patients under same activities.</p>
<p>Finally, the origin of the PD tremor symptom is yet elusive. Many hypotheses have been created by different research groups but no consensus is in sight. By finding how this neural disorder is triggered and developed, it improves the chances of 1 day finding the cure. Here, we investigated the BG-C-T system and observed the cortical neurons dynamics through different thalamic stimulation and different conditions of the model. The emerged symptom was a result of a combination of different properties extracted from cortical neurons and the oscillatory signal. It might be a naive approach initially. But this is only our first step toward the PD neurorobotics model. We understand the complexity of this problem and we hope that our research outcome might become a new tool for neuroscientists in their further works.</p>
</sec>
</sec>
<sec id="s9">
<title>9. Concluding Remarks and Future Work</title>
<p>In this work, we present an initial neurorobotics model of Parkinson&#x00027;s Disease (Neuro4PD). The proposed model showed that it is possible to reproduce motor movements with different levels of perturbation based mainly on the dynamics of the cortex and the modulation of oscillatory phenomena inherent in the human brain, both in <italic>healthy</italic> and <italic>parkinsonian</italic> conditions.</p>
<p>It was possible to observe that the perturbation on the movement can be in a sense analogous to the tremor symptom, that is characteristic on PD patients. Our behavioural task made it possible for us to focus more on the aspects of PD instead of motor control. However, the robot sensorimotor loop is yet a simple representation of how the nervous system interacts with the upper limbs.</p>
<p>The Neuro4PD is a neurorobotics model that represents a new platform with a strong potential for numerous applications. For instance, it can be used to shed light into PD research and also to support investigation on the BG-C-T circuitry within a sensorimotor loop. Other models could also be incorporated to the circuitry allowing others functionalities to be studied. Moreover, a representation of the cerebellum and amygdala could be linked to the model in order to incorporate the concept of memory. As a consequence, even more complex behavioural tasks could be explored in this context and also other neural disorders.</p>
<p>Future work involves moving to a computational model of the brain that is more closer to the human brain in terms of anatomy and features of PD. In this work, we used a model that was built using data from a rat brain after an unilateral infusion of the neurotoxin 6-hydroxydopamine (6-OHDA). There are some similarities within the sensorimotor loop of rats and humans but better representations can be found on other species. For instance, primates share more genetic similarities to humans. Not only the anatomy of the brain but also the neuropathophysiology of PD. We believe that a more realistic computational model of the brain based on primates will improve the realism of our work and increase the contributions to our community (Ranieri et al., <xref ref-type="bibr" rid="B72">2020</xref>).</p>
<p>Another natural follow-up to our work is to enhance motor control by directly decoding motor commands from cortical activity, possibly including different striatal inputs related to action-selection mechanisms. This improved approach would coexist with our current model, given that they relate to different aspects of motor control.</p>
<p>Overall, by further understanding the interplay between neural dynamics, physical embodiment and environmental factors, we believe that even more complex brain-based robots could be developed unveiling new robot applications based on recent neuroscience findings.</p>
</sec>
<sec sec-type="data-availability-statement" id="s10">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/<xref ref-type="supplementary-material" rid="SM1">Supplementary Material</xref>, further inquiries can be directed to the corresponding author/s.</p>
</sec>
<sec id="s11">
<title>Author Contributions</title>
<p>JP is the main author and contributed to all aspects of this study. PV and RM have contributed to the approach and methodology design, overall text and content. MA have contributed to the overall text and content. CR, RR, and FB provided crucial feedback on manuscript. All authors contributed to the article and approved the submitted version.</p>

</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ack><p>Authors would like to thank Dr. Leonardo Elias and Marcelo Romano from UNICAMP for providing the source code of the computational model.</p>
</ack>
<sec sec-type="supplementary-material" id="s12">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fnbot.2021.640449/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fnbot.2021.640449/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Video_1.AVI" id="SM1" mimetype="video/avi" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Data_Sheet_1.ZIP" id="SM2" mimetype="application/zip" xmlns:xlink="http://www.w3.org/1999/xlink"/>
<supplementary-material xlink:href="Data_Sheet_2.PDF" id="SM3" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Balkenius</surname> <given-names>C.</given-names></name> <name><surname>Tj&#x000F8;stheim</surname> <given-names>T. A.</given-names></name> <name><surname>Johansson</surname> <given-names>B.</given-names></name></person-group> (<year>2018</year>). <article-title>Arousal and awareness in a humanoid robot</article-title>, in <source>CEUR Workshop Proceedings</source>, Vol. 2287 (CEUR Workshop Proceedings).</citation></ref>
<ref id="B2">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Bear</surname> <given-names>M. F.</given-names></name> <name><surname>Connors</surname> <given-names>B. W.</given-names></name> <name><surname>Paradiso</surname> <given-names>M. A.</given-names></name></person-group> (<year>1996</year>). <source>Neuroscience: Exploring the Brain</source>. <publisher-loc>London</publisher-loc>: <publisher-name>Williams &#x00026; Wilkins, Baltimore</publisher-name>.</citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boison</surname> <given-names>D.</given-names></name> <name><surname>Masino</surname> <given-names>S. A.</given-names></name></person-group> (<year>2016</year>). <source>Homeostatic Control of Brain Function</source>. Oxford: Oxford University Press. <pub-id pub-id-type="doi">10.1093/med/9780199322299.001.0001</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Bradski</surname> <given-names>G.</given-names></name></person-group> (<year>2000</year>). <source>The OpenCV library. Dr. Dobb&#x00027;s J. Softw. Tools. 2236121</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://github.com/opencv/opencv/wiki/CiteOpenCV">https://github.com/opencv/opencv/wiki/CiteOpenCV</ext-link></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Burkhard</surname> <given-names>P. R.</given-names></name> <name><surname>Langston</surname> <given-names>J.</given-names></name> <name><surname>Tetrud</surname> <given-names>J. W.</given-names></name></person-group> (<year>2002</year>). <article-title>Voluntarily simulated tremor in normal subjects</article-title>. <source>Clin. Neurophysiol</source>. <volume>32</volume>, <fpage>119</fpage>&#x02013;<lpage>126</lpage>. <pub-id pub-id-type="doi">10.1016/S0987-7053(02)00296-4</pub-id><pub-id pub-id-type="pmid">12035489</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cagnan</surname> <given-names>H.</given-names></name> <name><surname>Little</surname> <given-names>S.</given-names></name> <name><surname>Foltynie</surname> <given-names>T.</given-names></name> <name><surname>Limousin</surname> <given-names>P.</given-names></name> <name><surname>Zrinzo</surname> <given-names>L.</given-names></name> <name><surname>Hariz</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>The nature of tremor circuits in Parkinsonian and essential tremor</article-title>. <source>Brain</source> <volume>137</volume>(<issue>Pt 12</issue>), <fpage>3223</fpage>&#x02013;<lpage>3234</lpage>. <pub-id pub-id-type="doi">10.1093/brain/awu250</pub-id><pub-id pub-id-type="pmid">25200741</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chi</surname> <given-names>K. R.</given-names></name></person-group> (<year>2016</year>). <article-title>Neural modelling: abstractions of the mind</article-title>. <source>Nature</source> <volume>531</volume>, <fpage>S16</fpage>&#x02013;<lpage>S17</lpage>. <pub-id pub-id-type="doi">10.1038/531S16a</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>J. D.</given-names></name> <name><surname>Braver</surname> <given-names>T. S.</given-names></name> <name><surname>Brown</surname> <given-names>J. W.</given-names></name></person-group> (<year>2002</year>). <article-title>Computational perspectives on dopamine function in prefrontal cortex</article-title>. <source>Curr. Opin. Neurobiol</source>. <volume>12</volume>, <fpage>223</fpage>&#x02013;<lpage>229</lpage>. <pub-id pub-id-type="doi">10.1016/S0959-4388(02)00314-8</pub-id><pub-id pub-id-type="pmid">12015241</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cousins</surname> <given-names>S.</given-names></name></person-group> (<year>2010</year>). <article-title>Welcome to ROS topics [ROS topics]</article-title>. <source>IEEE Robot. Autom. Mag</source>. <volume>17</volume>, <fpage>13</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1109/MRA.2010.935808</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dorsey</surname> <given-names>E. R.</given-names></name> <name><surname>Constantinescu</surname> <given-names>R.</given-names></name> <name><surname>Thompson</surname> <given-names>J. P.</given-names></name> <name><surname>Biglan</surname> <given-names>K. M.</given-names></name> <name><surname>Holloway</surname> <given-names>R. G.</given-names></name> <name><surname>Kieburtz</surname> <given-names>K.</given-names></name> <etal/></person-group>. (<year>2007</year>). <article-title>Projected number of people with Parkinson disease in the most populous nations, 2005 through 2030</article-title>. <source>Neurology</source> <volume>68</volume>, <fpage>384</fpage>&#x02013;<lpage>386</lpage>. <pub-id pub-id-type="doi">10.1212/01.wnl.0000247740.47667.03</pub-id><pub-id pub-id-type="pmid">17620562</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dovzhenok</surname> <given-names>A.</given-names></name> <name><surname>Rubchinsky</surname> <given-names>L. L.</given-names></name></person-group> (<year>2012</year>). <article-title>On the origin of tremor in Parkinson&#x00027;s disease</article-title>. <source>PLoS ONE</source> <volume>7</volume>:<fpage>e41598</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0041598</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Du</surname> <given-names>G.</given-names></name> <name><surname>Zhuang</surname> <given-names>P.</given-names></name> <name><surname>Hallett</surname> <given-names>M.</given-names></name> <name><surname>Zhang</surname> <given-names>Y.-Q.</given-names></name> <name><surname>Li</surname> <given-names>J.-Y.</given-names></name> <name><surname>Li</surname> <given-names>Y.-J.</given-names></name></person-group> (<year>2018</year>). <article-title>Properties of oscillatory neuronal activity in the basal ganglia and thalamus in patients with Parkinson&#x00027;s disease</article-title>. <source>Transl. Neurodegener</source>. <volume>7</volume>:<fpage>17</fpage>. <pub-id pub-id-type="doi">10.1186/s40035-018-0123-y</pub-id><pub-id pub-id-type="pmid">30065816</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><collab>Dura-Bernal S. Suter B. A. Gleeson P. Cantarelli M. Quintana A. Rodriguez F. (2019) NetPyNE, a tool for data-driven multiscale modeling of brain circuits</collab></person-group>. elife. 8:e44494. <pub-id pub-id-type="doi">10.7554/eLife.44494.016</pub-id>.</citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Edvardsen</surname> <given-names>V.</given-names></name> <name><surname>Bicanski</surname> <given-names>A.</given-names></name> <name><surname>Burgess</surname> <given-names>N.</given-names></name></person-group> (<year>2020</year>). <article-title>Navigating with grid and place cells in cluttered environments</article-title>. <source>Hippocampus</source> <volume>30</volume>, <fpage>220</fpage>&#x02013;<lpage>232</lpage>. <pub-id pub-id-type="doi">10.1002/hipo.23147</pub-id><pub-id pub-id-type="pmid">31408264</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferguson</surname> <given-names>K. A.</given-names></name> <name><surname>Cardin</surname> <given-names>J. A.</given-names></name></person-group> (<year>2020</year>). <article-title>Mechanisms underlying gain modulation in the cortex</article-title>. <source>Nat. Rev. Neurosci</source>. <volume>21</volume>, <fpage>80</fpage>&#x02013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1038/s41583-019-0253-y</pub-id><pub-id pub-id-type="pmid">31911627</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Galvan</surname> <given-names>A.</given-names></name> <name><surname>Devergnas</surname> <given-names>A.</given-names></name> <name><surname>Wichmann</surname> <given-names>T.</given-names></name></person-group> (<year>2015</year>). <article-title>Alterations in neuronal activity in basal ganglia-thalamocortical circuits in the Parkinsonian state</article-title>. <source>Front. Neuroanat</source>. <volume>9</volume>:<fpage>5</fpage>. <pub-id pub-id-type="doi">10.3389/fnana.2015.00005</pub-id><pub-id pub-id-type="pmid">25698937</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gelin</surname> <given-names>R.</given-names></name></person-group> (<year>2018</year>). <source>NAO</source>. Dordrecht: Springer Netherlands. <pub-id pub-id-type="doi">10.1007/978-94-007-7194-9_14-1</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Girotti</surname> <given-names>F.</given-names></name> <name><surname>Carella</surname> <given-names>F.</given-names></name> <name><surname>Grassi</surname> <given-names>M. P.</given-names></name> <name><surname>Soliveri</surname> <given-names>P.</given-names></name> <name><surname>Marano</surname> <given-names>R.</given-names></name> <name><surname>Caraceni</surname> <given-names>T.</given-names></name></person-group> (<year>1986</year>). <article-title>Motor and cognitive performances of parkinsonian patients in the on and off phases of the disease</article-title>. <source>J. Neurol. Neurosurg. Psychiatry</source> <volume>49</volume>, <fpage>657</fpage>&#x02013;<lpage>660</lpage>. <pub-id pub-id-type="doi">10.1136/jnnp.49.6.657</pub-id><pub-id pub-id-type="pmid">3734822</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goodarzi</surname> <given-names>Z.</given-names></name> <name><surname>Ismail</surname> <given-names>Z.</given-names></name></person-group> (<year>2017</year>). <article-title>A practical approach to detection and treatment of depression in Parkinson disease and dementia</article-title>. <source>Neurology</source> <volume>7</volume>, <fpage>128</fpage>&#x02013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1212/CPJ.0000000000000351</pub-id><pub-id pub-id-type="pmid">30140576</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gurney</surname> <given-names>K.</given-names></name> <name><surname>Prescott</surname> <given-names>T. J.</given-names></name> <name><surname>Wickens</surname> <given-names>J. R.</given-names></name> <name><surname>Redgrave</surname> <given-names>P.</given-names></name></person-group> (<year>2004</year>). <article-title>Computational models of the basal ganglia: from robots to membranes</article-title>. <source>Trends Neurosci</source>. <volume>27</volume>, <fpage>453</fpage>&#x02013;<lpage>459</lpage>. <pub-id pub-id-type="doi">10.1016/j.tins.2004.06.003</pub-id><pub-id pub-id-type="pmid">15271492</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Guyton</surname> <given-names>A. C.</given-names></name> <name><surname>Hall</surname> <given-names>J. E.</given-names></name></person-group> (<year>2001</year>). <source>A Text Book of Medical Physiology, Vol. 10</source>. <publisher-loc>Philadelphia, PA</publisher-loc>: <publisher-name>Elsevier Inc</publisher-name>.</citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><collab>Haber S. and Calzavara, R.</collab></person-group> (<year>2009</year>). <article-title>The cortico-basal ganglia integrative network: the role of the thalamus</article-title>. <source>Brain Res. Bull</source>. <volume>78</volume>, <fpage>69</fpage>&#x02013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1016/j.brainresbull.2008.09.013</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haeri</surname> <given-names>M.</given-names></name> <name><surname>Sarbaz</surname> <given-names>Y.</given-names></name> <name><surname>Gharibzadeh</surname> <given-names>S.</given-names></name></person-group> (<year>2005</year>). <article-title>Modeling the Parkinson&#x00027;s tremor and its treatments</article-title>. <source>J. Theor. Biol</source>. <volume>236</volume>, <fpage>311</fpage>&#x02013;<lpage>322</lpage>. <pub-id pub-id-type="doi">10.1016/j.jtbi.2005.03.014</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harris</surname> <given-names>C.</given-names></name> <name><surname>Wolpert</surname> <given-names>D.</given-names></name></person-group> (<year>1998</year>). <article-title>Signal-dependent noise determines motor planning</article-title>. <source>Nature</source> <volume>394</volume>, <fpage>780</fpage>&#x02013;<lpage>4</lpage>. <pub-id pub-id-type="doi">10.1038/29528</pub-id><pub-id pub-id-type="pmid">9723616</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Helmich</surname> <given-names>R.</given-names></name> <name><surname>Hallett</surname> <given-names>M.</given-names></name> <name><surname>Deuschl</surname> <given-names>G.</given-names></name> <name><surname>Toni</surname> <given-names>I.</given-names></name> <name><surname>Bloem</surname> <given-names>B.</given-names></name></person-group> (<year>2012</year>). <article-title>Cerebral causes and consequences of Parkinsonian resting tremor: a tale of two circuits?</article-title> <source>Brain</source> <volume>135</volume>, <fpage>3206</fpage>&#x02013;<lpage>3226</lpage>. <pub-id pub-id-type="doi">10.1093/brain/aws023</pub-id><pub-id pub-id-type="pmid">22382359</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Helmich</surname> <given-names>R. C.</given-names></name> <name><surname>Toni</surname> <given-names>I.</given-names></name> <name><surname>Deuschl</surname> <given-names>G.</given-names></name> <name><surname>Bloem</surname> <given-names>B. R.</given-names></name></person-group> (<year>2013</year>). <article-title>The pathophysiology of essential tremor and Parkinson&#x00027;s tremor</article-title>. <source>Curr. Neurol. Neurosci. Rep</source>. <volume>13</volume>:<fpage>378</fpage>. <pub-id pub-id-type="doi">10.1007/s11910-013-0378-8</pub-id><pub-id pub-id-type="pmid">23893097</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hines</surname> <given-names>M. L.</given-names></name> <name><surname>Carnevale</surname> <given-names>N. T.</given-names></name></person-group> (<year>2001</year>). <article-title>Neuron: a tool for neuroscientists</article-title>. <source>Neuroscientist</source> <volume>7</volume>, <fpage>123</fpage>&#x02013;<lpage>135</lpage>. <pub-id pub-id-type="doi">10.1177/107385840100700207</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Humphries</surname> <given-names>M.</given-names></name> <name><surname>Gurney</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>Network effects of subthalamic deep brain stimulation drive a unique mixture of responses in basal ganglia output</article-title>. <source>Eur. J. Neurosci</source>. <volume>36</volume>, <fpage>2240</fpage>&#x02013;<lpage>2451</lpage>. <pub-id pub-id-type="doi">10.1111/j.1460-9568.2012.08085.x</pub-id><pub-id pub-id-type="pmid">22805068</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Humphries</surname> <given-names>M. D.</given-names></name> <name><surname>Obeso</surname> <given-names>J. A.</given-names></name> <name><surname>Dreyer</surname> <given-names>J. K.</given-names></name></person-group> (<year>2018</year>). <article-title>Insights into Parkinson&#x00027;s disease from computational models of the basal ganglia</article-title>. <source>J. Neurol. Neurosurg. Psychiatry</source> <volume>89</volume>, <fpage>1181</fpage>&#x02013;<lpage>1188</lpage>. <pub-id pub-id-type="doi">10.1136/jnnp-2017-315922</pub-id><pub-id pub-id-type="pmid">29666208</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Idei</surname> <given-names>H.</given-names></name> <name><surname>Murata</surname> <given-names>S.</given-names></name> <name><surname>Chen</surname> <given-names>Y.</given-names></name> <name><surname>Yamashita</surname> <given-names>Y.</given-names></name> <name><surname>Tani</surname> <given-names>J.</given-names></name> <name><surname>Ogata</surname> <given-names>T.</given-names></name></person-group> (<year>2017</year>). <article-title>Reduced behavioral flexibility by aberrant sensory precision in autism spectrum disorder: a neurorobotics experiment</article-title>, in <source>2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)</source> (<publisher-loc>Lisbon</publisher-loc>), <fpage>271</fpage>&#x02013;<lpage>276</lpage>. <pub-id pub-id-type="doi">10.1109/DEVLRN.2017.8329817</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name> <name><surname>Crespi</surname> <given-names>A.</given-names></name> <name><surname>Cabelguen</surname> <given-names>J.-M.</given-names></name></person-group> (<year>2005</year>). <article-title>Simulation and robotics studies of salamander locomotion</article-title>. <source>Neuroinformatics</source> <volume>3</volume>, <fpage>171</fpage>&#x02013;<lpage>195</lpage>. <pub-id pub-id-type="doi">10.1385/NI:3:3:171</pub-id><pub-id pub-id-type="pmid">16077158</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name> <name><surname>Crespi</surname> <given-names>A.</given-names></name> <name><surname>Ryczko</surname> <given-names>D.</given-names></name> <name><surname>Cabelguen</surname> <given-names>J.-M.</given-names></name></person-group> (<year>2007</year>). <article-title>From swimming to walking with a salamander robot driven by a spinal cord model</article-title>. <source>Science</source> <volume>315</volume>, <fpage>1416</fpage>&#x02013;<lpage>1420</lpage>. <pub-id pub-id-type="doi">10.1126/science.1138353</pub-id><pub-id pub-id-type="pmid">17347441</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Izhikevich</surname> <given-names>E. M.</given-names></name> <name><surname>Edelman</surname> <given-names>G. M.</given-names></name></person-group> (<year>2008</year>). <article-title>Large-scale model of mammalian thalamocortical systems</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A</source>. <volume>105</volume>, <fpage>3593</fpage>&#x02013;<lpage>3598</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.0712231105</pub-id><pub-id pub-id-type="pmid">18292226</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jankovic</surname> <given-names>J.</given-names></name></person-group> (<year>2008</year>). <article-title>Parkinson&#x00027;s disease: clinical features and diagnosis</article-title>. <source>J. Neurol. Neurosurg. Psychiatry</source> <volume>79</volume>, <fpage>368</fpage>&#x02013;<lpage>376</lpage>. <pub-id pub-id-type="doi">10.1136/jnnp.2007.131045</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kalia</surname> <given-names>L. V.</given-names></name> <name><surname>Lang</surname> <given-names>A. E.</given-names></name></person-group> (<year>2015</year>). <article-title>Parkinson&#x00027;s disease</article-title>. <source>Lancet</source> <volume>386</volume>, <fpage>896</fpage>&#x02013;<lpage>912</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(14)61393-3</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaplan</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <article-title>Neurorobotics: an experimental science of embodiment</article-title>. <source>Front. Neurosci</source>. <volume>2</volume>, <fpage>22</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.3389/neuro.01.023.2008</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kerr</surname> <given-names>C.</given-names></name> <name><surname>Van Albada</surname> <given-names>S.</given-names></name> <name><surname>Neymotin</surname> <given-names>S.</given-names></name> <name><surname>Chadderdon</surname> <given-names>G.</given-names></name> <name><surname>Robinson</surname> <given-names>P.</given-names></name> <name><surname>Lytton</surname> <given-names>W.</given-names></name></person-group> (<year>2013</year>). <article-title>Cortical information flow in Parkinson&#x00027;s disease: a composite network/field model</article-title>. <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>39</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00039</pub-id><pub-id pub-id-type="pmid">23630492</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>T.</given-names></name> <name><surname>Hamade</surname> <given-names>K. C.</given-names></name> <name><surname>Todorov</surname> <given-names>D.</given-names></name> <name><surname>Barnett</surname> <given-names>W. H.</given-names></name> <name><surname>Capps</surname> <given-names>R. A.</given-names></name> <name><surname>Latash</surname> <given-names>E. M.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Reward based motor adaptation mediated by basal ganglia</article-title>. <source>Front. Comput. Neurosci</source>. <volume>11</volume>:<fpage>19</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2017.00019</pub-id><pub-id pub-id-type="pmid">28408878</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klassner</surname> <given-names>F.</given-names></name> <name><surname>Anderson</surname> <given-names>S. D.</given-names></name></person-group> (<year>2003</year>). <article-title>Lego mindstorms: not just for k-12 anymore</article-title>. <source>IEEE Robot. Autom. Mag</source>. <volume>10</volume>, <fpage>12</fpage>&#x02013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.1109/MRA.2003.1213611</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kondermann</surname> <given-names>D.</given-names></name></person-group> (<year>2013</year>). <article-title>Ground truth design principles: an overview</article-title>, in <source>Proceedings of the International Workshop on Video and Image Ground Truth in Computer Vision Applications, VIGTA &#x00027;13</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>). <pub-id pub-id-type="doi">10.1145/2501105.2501114</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krichmar</surname> <given-names>J. L.</given-names></name></person-group> (<year>2018</year>). <article-title>Neurorobotics-a thriving community and a promising pathway toward intelligent cognitive robots</article-title>. <source>Front. Neurorobot</source>. <volume>12</volume>:<fpage>42</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2018.00042</pub-id><pub-id pub-id-type="pmid">30061820</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kulam</surname> <given-names>M.</given-names></name> <name><surname>Subramanian</surname> <given-names>D.</given-names></name> <name><surname>Chakravarthy</surname> <given-names>S.</given-names></name> <name><surname>Ravindran</surname> <given-names>B.</given-names></name> <name><surname>Amari</surname> <given-names>S.-I.</given-names></name> <name><surname>Natarajan</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Modeling basal ganglia for understanding parkinsonian reaching movements</article-title>. <source>Neural Comput</source>. <volume>23</volume>, <fpage>477</fpage>&#x02013;<lpage>516</lpage>. <pub-id pub-id-type="doi">10.1162/NECO_a_00073</pub-id><pub-id pub-id-type="pmid">21105828</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kumaravelu</surname> <given-names>K.</given-names></name> <name><surname>Brocker</surname> <given-names>D.</given-names></name> <name><surname>Grill</surname> <given-names>W.</given-names></name></person-group> (<year>2016</year>). <article-title>A biophysical model of the cortex-basal ganglia-thalamus network in the 6-ohda lesioned rat model of Parkinson&#x00027;s disease</article-title>. <source>J. Comput. Neurosci</source>. <volume>40</volume>, <fpage>207</fpage>&#x02013;<lpage>229</lpage>. <pub-id pub-id-type="doi">10.1007/s10827-016-0593-9</pub-id><pub-id pub-id-type="pmid">26867734</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lanciego</surname> <given-names>J.</given-names></name> <name><surname>Luquin</surname> <given-names>N.</given-names></name> <name><surname>Obeso</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Functional neuroanatomy of the basal ganglia</article-title>. <source>Cold Spring Harb. Perspect. Med</source>. <volume>2</volume>:<fpage>a009621</fpage>. <pub-id pub-id-type="doi">10.1101/cshperspect.a009621</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lang</surname> <given-names>A. E.</given-names></name> <name><surname>Lozano</surname> <given-names>A. M.</given-names></name></person-group> (<year>1998</year>). <article-title>Parkinson&#x00027;s disease</article-title>. <source>N. Engl. J. Med</source>. <volume>339</volume>, <fpage>1130</fpage>&#x02013;<lpage>1143</lpage>. <pub-id pub-id-type="doi">10.1056/NEJM199810153391607</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lewis</surname> <given-names>M.</given-names></name> <name><surname>Ca&#x000F1;amero</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>Robot models of mental disorders</article-title>, in <source>2017 Seventh International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)</source> (<publisher-loc>San Antonio, TX</publisher-loc>), <fpage>193</fpage>&#x02013;<lpage>200</lpage>. <pub-id pub-id-type="doi">10.1109/ACIIW.2017.8272613</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>J.</given-names></name> <name><surname>Li</surname> <given-names>Z.</given-names></name> <name><surname>Chen</surname> <given-names>F.</given-names></name> <name><surname>Bicchi</surname> <given-names>A.</given-names></name> <name><surname>Sun</surname> <given-names>Y.</given-names></name> <name><surname>Fukuda</surname> <given-names>T.</given-names></name></person-group> (<year>2019</year>). <article-title>Combined sensing, cognition, learning, and control for developing future neuro-robotics systems: a survey</article-title>. <source>IEEE Trans. Cogn. Dev. Syst</source>. <volume>11</volume>, <fpage>148</fpage>&#x02013;<lpage>161</lpage>. <pub-id pub-id-type="doi">10.1109/TCDS.2019.2897618</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindberg</surname> <given-names>M.</given-names></name> <name><surname>Sandberg</surname> <given-names>H.</given-names></name> <name><surname>Liljenberg</surname> <given-names>M.</given-names></name> <name><surname>Eriksson</surname> <given-names>M.</given-names></name> <name><surname>Johansson</surname> <given-names>B.</given-names></name> <name><surname>Balkenius</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>The expression of mental states in a humanoid robot</article-title>, in <source>Intelligent Virtual Agents</source>, eds J. Beskow, C. Peters, G. Castellano, C. O&#x00027;Sullivan, I. Leite, and S. Kopp (Cham: Springer International Publishing), <fpage>247</fpage>&#x02013;<lpage>250</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-67401-8_32</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Louis</surname> <given-names>E. D.</given-names></name></person-group> (<year>2018</year>). <article-title>Chapter 16 - essential tremor and the cerebellum</article-title>, in <source>The Cerebellum: Disorders and Treatment</source>, Vol. 155, eds M. Manto, and T. A. G. M. Huisman (<publisher-name>Elsevier</publisher-name>), <fpage>245</fpage>&#x02013;<lpage>258</lpage>. <pub-id pub-id-type="doi">10.1016/B978-0-444-64189-2.00016-0</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Louis</surname> <given-names>E. D.</given-names></name> <name><surname>Faust</surname> <given-names>P. L.</given-names></name></person-group> (<year>2020</year>). <article-title>Essential tremor: the most common form of cerebellar degeneration?</article-title> <source>Cerebel. Ataxias</source> <volume>7</volume>:<fpage>12</fpage>. <pub-id pub-id-type="doi">10.1186/s40673-020-00121-1</pub-id><pub-id pub-id-type="pmid">32922824</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Louis</surname> <given-names>E. D.</given-names></name> <name><surname>Vonsattel</surname> <given-names>J. P. G.</given-names></name> <name><surname>Honig</surname> <given-names>L. S.</given-names></name> <name><surname>Lawton</surname> <given-names>A.</given-names></name> <name><surname>Moskowitz</surname> <given-names>C.</given-names></name> <name><surname>Ford</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2006</year>). <article-title>Essential tremor associated with pathologic changes in the cerebellum</article-title>. <source>Arch. Neurol</source>. <volume>63</volume>, <fpage>1189</fpage>&#x02013;<lpage>1193</lpage>. <pub-id pub-id-type="doi">10.1001/archneur.63.8.1189</pub-id><pub-id pub-id-type="pmid">16908751</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lu</surname> <given-names>M.</given-names></name> <name><surname>Wei</surname> <given-names>X.</given-names></name> <name><surname>Che</surname> <given-names>Y.</given-names></name> <name><surname>Wang</surname> <given-names>J.</given-names></name> <name><surname>Loparo</surname> <given-names>K. A.</given-names></name></person-group> (<year>2020</year>). <article-title>Application of reinforcement learning to deep brain stimulation in a computational model of Parkinson&#x00027;s disease</article-title>. <source>IEEE Trans. Neural Syst. Rehabil. Eng</source>. <volume>28</volume>, <fpage>339</fpage>&#x02013;<lpage>349</lpage>. <pub-id pub-id-type="doi">10.1109/TNSRE.2019.2952637</pub-id><pub-id pub-id-type="pmid">32167880</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Makin</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>The four biggest challenges in brain simulation</article-title>. <source>Nature</source> <volume>571</volume>:<fpage>S9</fpage>. <pub-id pub-id-type="doi">10.1038/d41586-019-02209-z</pub-id><pub-id pub-id-type="pmid">31341313</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Marvel</surname> <given-names>J. A.</given-names></name> <name><surname>Falco</surname> <given-names>J.</given-names></name> <name><surname>Hong</surname> <given-names>T.</given-names></name></person-group> (<year>2012</year>). <article-title>Ground truth for evaluating 6 degrees of freedom pose estimation systems</article-title>, in <source>Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS &#x00027;12</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>), <fpage>69</fpage>&#x02013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1145/2393091.2393106</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McGregor</surname> <given-names>M. M.</given-names></name> <name><surname>Nelson</surname> <given-names>A. B.</given-names></name></person-group> (<year>2019</year>). <article-title>Circuit mechanisms of Parkinson&#x00027;s disease</article-title>. <source>Neuron</source> <volume>101</volume>, <fpage>1042</fpage>&#x02013;<lpage>1056</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2019.03.004</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Merrison-Hort</surname> <given-names>R.</given-names></name> <name><surname>Yousif</surname> <given-names>N.</given-names></name> <name><surname>Ferrario</surname> <given-names>A.</given-names></name> <name><surname>Borisyuk</surname> <given-names>R.</given-names></name></person-group> (<year>2017</year>). <source>Oscillatory Neural Models of the Basal Ganglia for Action Selection in Healthy and Parkinsonian Cases</source>. Cham: Springer International <volume>Publishing</volume>, <fpage>149</fpage>&#x02013;<lpage>189</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-49959-8_7</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Michel</surname> <given-names>O.</given-names></name></person-group> (<year>2004</year>). <article-title>Webots: professional mobile robot simulation</article-title>. <source>J. Adv. Robot. Syst</source>. <volume>1</volume>, <fpage>39</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.5772/5618</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mirdamadi</surname> <given-names>J. L.</given-names></name></person-group> (<year>2016</year>). <article-title>Cerebellar role in Parkinson&#x00027;s disease</article-title>. <source>J. Neurophysiol</source>. <volume>116</volume>, <fpage>917</fpage>&#x02013;<lpage>919</lpage>. <pub-id pub-id-type="doi">10.1152/jn.01132.2015</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mori</surname> <given-names>F.</given-names></name> <name><surname>Okada</surname> <given-names>K. I.</given-names></name> <name><surname>Nomura</surname> <given-names>T.</given-names></name> <name><surname>Kobayashi</surname> <given-names>Y.</given-names></name></person-group> (<year>2016</year>). <article-title>The pedunculopontine tegmental nucleus as a motor and cognitive interface between the cerebellum and basal ganglia</article-title>. <source>Front. Neuroanat</source>. <volume>10</volume>:<fpage>109</fpage>. <pub-id pub-id-type="doi">10.3389/fnana.2016.00109</pub-id><pub-id pub-id-type="pmid">27872585</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Muddapu</surname> <given-names>V. R.</given-names></name> <name><surname>Mandali</surname> <given-names>A.</given-names></name> <name><surname>Chakravarthy</surname> <given-names>V. S.</given-names></name> <name><surname>Ramaswamy</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>A computational model of loss of dopaminergic cells in Parkinson&#x00027;s disease due to glutamate-induced excitotoxicity</article-title>. <source>Front. Neural Circuits</source> <volume>13</volume>:<fpage>11</fpage>. <pub-id pub-id-type="doi">10.3389/fncir.2019.00011</pub-id><pub-id pub-id-type="pmid">30858799</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mulcahy</surname> <given-names>G.</given-names></name> <name><surname>Atwood</surname> <given-names>B.</given-names></name> <name><surname>Kuznetsov</surname> <given-names>A.</given-names></name></person-group> (<year>2020</year>). <article-title>Basal ganglia role in learning rewarded actions and executing previously learned choices: healthy and diseased states</article-title>. <source>PLoS ONE</source> <volume>15</volume>:<fpage>e228081</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0228081</pub-id><pub-id pub-id-type="pmid">32040519</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nambu</surname> <given-names>A.</given-names></name> <name><surname>Tokuno</surname> <given-names>H.</given-names></name> <name><surname>Takada</surname> <given-names>M.</given-names></name></person-group> (<year>2002</year>). <article-title>Functional significance of the cortico-subthalamo-pallidal &#x00027;hyperdirect&#x00027; pathway</article-title>. <source>Neurosci. Res</source>. <volume>43</volume>, <fpage>111</fpage>&#x02013;<lpage>117</lpage>. <pub-id pub-id-type="doi">10.1016/S0168-0102(02)00027-5</pub-id><pub-id pub-id-type="pmid">12067746</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nieuwboer</surname> <given-names>A.</given-names></name> <name><surname>Kwakkel</surname> <given-names>G.</given-names></name> <name><surname>Rochester</surname> <given-names>L.</given-names></name> <name><surname>Jones</surname> <given-names>D.</given-names></name> <name><surname>van Wegen</surname> <given-names>E.</given-names></name> <name><surname>Willems</surname> <given-names>A. M.</given-names></name> <etal/></person-group>. (<year>2007</year>). <article-title>Cueing training in the home improves gait-related mobility in Parkinson&#x00027;s disease: the rescue trial</article-title>. <source>J. Neurol. Neurosurg. Psychiatry</source> <volume>78</volume>, <fpage>134</fpage>&#x02013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1136/jnnp.200X.097923</pub-id><pub-id pub-id-type="pmid">17229744</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Obeso</surname> <given-names>J. a.</given-names></name> <name><surname>Rodr&#x000ED;guez-Oroz</surname> <given-names>M. C.</given-names></name> <name><surname>Benitez-Temino</surname> <given-names>B.</given-names></name> <name><surname>Blesa</surname> <given-names>F. J.</given-names></name> <name><surname>Guridi</surname> <given-names>J.</given-names></name> <name><surname>Marin</surname> <given-names>C.</given-names></name> <etal/></person-group>. (<year>2008</year>). <article-title>Functional organization of the basal ganglia: therapeutic implications for Parkinson&#x00027;s disease</article-title>. <source>Mov. Disord</source>. <volume>23</volume>(<supplement>Suppl. 3</supplement>), <fpage>S548</fpage>&#x02013;<lpage>S559</lpage>. <pub-id pub-id-type="doi">10.1002/mds.22062</pub-id><pub-id pub-id-type="pmid">18781672</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x00027;Donnell</surname> <given-names>B. F.</given-names></name> <name><surname>Wilt</surname> <given-names>M. A.</given-names></name></person-group> (<year>2006</year>). <article-title>Mental disorders, computational models of</article-title>, in <source>Encyclopedia of Cognitive Science</source>, ed L. Nadel. <pub-id pub-id-type="doi">10.1002/0470018860.s00498</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Oota</surname> <given-names>S.</given-names></name> <name><surname>Okamura-Oho</surname> <given-names>Y.</given-names></name> <name><surname>Ayusawa</surname> <given-names>K.</given-names></name> <name><surname>Ikegami</surname> <given-names>Y.</given-names></name> <name><surname>Murai</surname> <given-names>A.</given-names></name> <name><surname>Yoshida</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Neurorobotic approach to study huntington disease based on a mouse neuromusculoskeletal model</article-title>, in <source>2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)</source> (<publisher-loc>Madrid</publisher-loc>), <fpage>6720</fpage>&#x02013;<lpage>6727</lpage>. <pub-id pub-id-type="doi">10.1109/IROS.2018.8594491</pub-id></citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pavlides</surname> <given-names>A.</given-names></name> <name><surname>Hogan</surname> <given-names>S. J.</given-names></name> <name><surname>Bogacz</surname> <given-names>R.</given-names></name></person-group> (<year>2015</year>). <article-title>Computational models describing possible mechanisms for generation of excessive beta oscillations in Parkinson&#x00027;s disease</article-title>. <source>PLOS Comput. Biol</source>. <volume>11</volume>:<fpage>e1004609</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1004609</pub-id><pub-id pub-id-type="pmid">26683341</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pena</surname> <given-names>R.</given-names></name> <name><surname>Ceballos</surname> <given-names>C.</given-names></name> <name><surname>de Deus</surname> <given-names>J.</given-names></name> <name><surname>Roque</surname> <given-names>A.</given-names></name> <name><surname>Garcia-Cairasco</surname> <given-names>N.</given-names></name> <name><surname>Leao</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Modeling hippocampal CA1 gabaergic synapses of audiogenic rats</article-title>. <source>Int. J. Neural Syst</source>. <volume>30</volume>:<fpage>2050022</fpage>. <pub-id pub-id-type="doi">10.1142/S0129065720500227</pub-id><pub-id pub-id-type="pmid">32285725</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pollok</surname> <given-names>B.</given-names></name> <name><surname>Gross</surname> <given-names>J.</given-names></name> <name><surname>Dirks</surname> <given-names>M.</given-names></name> <name><surname>Timmermann</surname> <given-names>L.</given-names></name> <name><surname>Schnitzler</surname> <given-names>A.</given-names></name></person-group> (<year>2004</year>). <article-title>The cerebral oscillatory network of voluntary tremor</article-title>. <source>J. Physiol</source>. <volume>554</volume>(<issue>Pt 3</issue>), <fpage>871</fpage>&#x02013;<lpage>878</lpage>. <pub-id pub-id-type="doi">10.1113/jphysiol.2003.051235</pub-id><pub-id pub-id-type="pmid">14645449</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Prescott</surname> <given-names>T.</given-names></name> <name><surname>Gonz&#x000E1;lez</surname> <given-names>F.</given-names></name> <name><surname>Gurney</surname> <given-names>K.</given-names></name> <name><surname>Humphries</surname> <given-names>M.</given-names></name> <name><surname>Redgrave</surname> <given-names>P.</given-names></name></person-group> (<year>2006</year>). <article-title>A robot model of the basal ganglia: behavior and intrinsic processing</article-title>. <source>Neural Netw</source>. <volume>19</volume>, <fpage>31</fpage>&#x02013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1016/j.neunet.2005.06.049</pub-id><pub-id pub-id-type="pmid">16153803</pub-id></citation></ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pronin</surname> <given-names>S.</given-names></name> <name><surname>Wellacott</surname> <given-names>L.</given-names></name> <name><surname>Pimentel</surname> <given-names>J.</given-names></name> <name><surname>Moioli</surname> <given-names>R.</given-names></name> <name><surname>Vargas</surname> <given-names>P.</given-names></name></person-group> (<year>2021</year>). <article-title>Neurorobotic models of neurological disorders: a mini review</article-title>. <source>Front. Neurorobot</source>. <volume>15</volume>:<fpage>26</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2021.634045</pub-id><pub-id pub-id-type="pmid">33828474</pub-id></citation></ref>
<ref id="B72">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ranieri</surname> <given-names>C. M.</given-names></name> <name><surname>Moioli</surname> <given-names>R. C.</given-names></name> <name><surname>Romero</surname> <given-names>R. A. F.</given-names></name> <name><surname>de Ara&#x000FA;jo</surname> <given-names>M. F. P.</given-names></name> <name><surname>De Santana</surname> <given-names>M. B.</given-names></name> <name><surname>Pimentel</surname> <given-names>J. M.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Unveiling Parkinson&#x00027;s disease features from a primate model with deep neural networks</article-title>, in <source>2020 International Joint Conference on Neural Networks (IJCNN)</source> (<publisher-loc>Glasgow</publisher-loc>), <fpage>1</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1109/IJCNN48605.2020.9207180</pub-id></citation></ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Redgrave</surname> <given-names>P.</given-names></name> <name><surname>Rodriguez</surname> <given-names>M.</given-names></name> <name><surname>Smith</surname> <given-names>Y.</given-names></name> <name><surname>Rodriguez-Oroz</surname> <given-names>M. C.</given-names></name> <name><surname>Lehericy</surname> <given-names>S.</given-names></name> <name><surname>Bergman</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>Goal-directed and habitual control in the basal ganglia: implications for Parkinson&#x00027;s disease</article-title>. <source>Nat. Rev. Neurosci</source>. <volume>11</volume>, <fpage>760</fpage>&#x02013;<lpage>772</lpage>. <pub-id pub-id-type="doi">10.1038/nrn2915</pub-id><pub-id pub-id-type="pmid">20944662</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rizek</surname> <given-names>P.</given-names></name> <name><surname>Kumar</surname> <given-names>N.</given-names></name> <name><surname>Jog</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>An update on the diagnosis and treatment of Parkinson disease an update on the diagnosis and treatment of Parkinson disease</article-title>. <source>Can. Med. Assoc. J</source>. <volume>188</volume>, <fpage>1157</fpage>&#x02013;<lpage>1165</lpage>. <pub-id pub-id-type="doi">10.1503/cmaj.151179</pub-id><pub-id pub-id-type="pmid">27221269</pub-id></citation></ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Robinson</surname> <given-names>P.</given-names></name> <name><surname>Kim</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Spike, rate, field, and hybrid methods for treating neuronal dynamics and interactions</article-title>. <source>J. Neurosci. Methods</source> <volume>205</volume>, <fpage>283</fpage>&#x02013;<lpage>294</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2012.01.018</pub-id><pub-id pub-id-type="pmid">22330795</pub-id></citation></ref>
<ref id="B76">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Romano</surname> <given-names>M. R.</given-names></name> <name><surname>Moioli</surname> <given-names>R. C.</given-names></name> <name><surname>Elias</surname> <given-names>L. A.</given-names></name></person-group> (<year>2020</year>). <article-title>Evaluation of frequency-dependent effects of deep brain stimulation in a cortex-basal ganglia-thalamus network model of Parkinson&#x00027;s disease</article-title>. <source>Annu. Int. Conf. IEEE Eng. Med. Biol. Soc</source>. <volume>2020</volume>, <fpage>3638</fpage>&#x02013;<lpage>3641</lpage>. <pub-id pub-id-type="doi">10.1109/EMBC44109.2020.9176570</pub-id><pub-id pub-id-type="pmid">33018790</pub-id></citation></ref>
<ref id="B77">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rossum</surname> <given-names>G.</given-names></name></person-group> (<year>1995</year>). <source>Python Tutorial</source>. Technical report, NLD.</citation></ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rubin</surname> <given-names>J.</given-names></name> <name><surname>Terman</surname> <given-names>D.</given-names></name></person-group> (<year>2004</year>). <article-title>High frequency stimulation of the subthalamic nucleus eliminates pathological thalamic rhythmicity in a computational model</article-title>. <source>J. Computat. Neurosci</source>. <volume>16</volume>, <fpage>211</fpage>&#x02013;<lpage>235</lpage>. <pub-id pub-id-type="doi">10.1023/B:JCNS.0000025686.47117.67</pub-id><pub-id pub-id-type="pmid">15114047</pub-id></citation></ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saalmann</surname> <given-names>Y.</given-names></name> <name><surname>Kastner</surname> <given-names>S.</given-names></name></person-group> (<year>2011</year>). <article-title>Cognitive and perceptual functions of the visual thalamus</article-title>. <source>Neuron</source> <volume>71</volume>, <fpage>209</fpage>&#x02013;<lpage>223</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2011.06.027</pub-id><pub-id pub-id-type="pmid">21791281</pub-id></citation></ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sanger</surname> <given-names>T. D.</given-names></name></person-group> (<year>2018</year>). <article-title>A computational model of deep-brain stimulation for acquired dystonia in children</article-title>. <source>Front. Comput. Neurosci</source>. <volume>12</volume>:<fpage>77</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2018.00077</pub-id><pub-id pub-id-type="pmid">30294268</pub-id></citation></ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sarbaz</surname> <given-names>Y.</given-names></name> <name><surname>Banae</surname> <given-names>M.</given-names></name> <name><surname>Gharibzadeh</surname> <given-names>S.</given-names></name></person-group> (<year>2007</year>). <article-title>A computational model for the Huntington disease</article-title>. <source>Med. Hypoth</source>. <volume>68</volume>, <fpage>1154</fpage>&#x02013;<lpage>1158</lpage>. <pub-id pub-id-type="doi">10.1016/j.mehy.2006.06.039</pub-id></citation></ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schroll</surname> <given-names>H.</given-names></name> <name><surname>Hamker</surname> <given-names>F.</given-names></name></person-group> (<year>2013</year>). <article-title>Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy</article-title>. <source>Front. Syst. Neurosci</source>. <volume>7</volume>:<fpage>122</fpage>. <pub-id pub-id-type="doi">10.3389/fnsys.2013.00122</pub-id><pub-id pub-id-type="pmid">24416002</pub-id></citation></ref>
<ref id="B83">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>So</surname> <given-names>R.</given-names></name> <name><surname>McConnell</surname> <given-names>G.</given-names></name> <name><surname>August</surname> <given-names>A.</given-names></name> <name><surname>Grill</surname> <given-names>W.</given-names></name></person-group> (<year>2012</year>). <article-title>Characterizing effects of subthalamic nucleus deep brain stimulation on methamphetamine-induced circling behavior in hemi-parkinsonian rats</article-title>. <source>IEEE Trans. Neural Syst. Rehabil. Eng</source>. <volume>20</volume>, <fpage>626</fpage>&#x02013;<lpage>635</lpage>. <pub-id pub-id-type="doi">10.1109/TNSRE.2012.2197761</pub-id><pub-id pub-id-type="pmid">22692937</pub-id></citation></ref>
<ref id="B84">
<citation citation-type="journal"><person-group person-group-type="author"><collab>SoftBank</collab></person-group> (<year>2006</year>). <source>Aldebaran Documentation</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://doc.aldebaran.com/2-1/family/nao_t14/index_t14.html">http://doc.aldebaran.com/2-1/family/nao_t14/index_t14.html</ext-link> (accessed March 27, 2021).</citation></ref>
<ref id="B85">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Steriade</surname> <given-names>M.</given-names></name> <name><surname>Timofeev</surname> <given-names>I.</given-names></name> <name><surname>Grenier</surname> <given-names>F.</given-names></name> <name><surname>D&#x000FC;rm&#x000FC;ller</surname> <given-names>N.</given-names></name></person-group> (<year>1998</year>). Role of thalamic and cortical neurons in augmenting responses and self-sustained activity: dual intracellular recordings <italic>in vivo. J. Neurosci</italic>. <volume>18</volume>, <fpage>6425</fpage>&#x02013;<lpage>6443</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.18-16-06425.1998</pub-id></citation></ref>
<ref id="B86">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Surmeier</surname> <given-names>D. J.</given-names></name> <name><surname>Graves</surname> <given-names>S. M.</given-names></name> <name><surname>Shen</surname> <given-names>W.</given-names></name></person-group> (<year>2014</year>). <article-title>Dopaminergic modulation of striatal networks in health and Parkinson&#x00027;s disease</article-title>. <source>Curr. Opin. Neurobiol</source>. <volume>29</volume>, <fpage>109</fpage>&#x02013;<lpage>117</lpage>. <pub-id pub-id-type="doi">10.1016/j.conb.2014.07.008</pub-id><pub-id pub-id-type="pmid">25058111</pub-id></citation></ref>
<ref id="B87">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tomassini</surname> <given-names>A.</given-names></name> <name><surname>Ambrogioni</surname> <given-names>L.</given-names></name> <name><surname>Medendorp</surname> <given-names>W. P.</given-names></name> <name><surname>Maris</surname> <given-names>E.</given-names></name></person-group> (<year>2017</year>). <article-title>Theta oscillations locked to intended actions rhythmically modulate perception</article-title>. <source>eLife</source> <volume>6</volume>:<fpage>e25618</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.25618</pub-id><pub-id pub-id-type="pmid">28686161</pub-id></citation></ref>
<ref id="B88">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tucker</surname> <given-names>H. R.</given-names></name> <name><surname>Mahoney</surname> <given-names>E.</given-names></name> <name><surname>Akhtar</surname> <given-names>K.</given-names></name> <name><surname>Kao</surname> <given-names>T.-J.</given-names></name> <name><surname>Mamone</surname> <given-names>G.</given-names></name> <name><surname>Mikkilineni</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Motor thalamic deep brain stimulation alters cortical activity and shows therapeutic utility for treatment of Parkinson&#x00027;s disease symptoms in a rat model</article-title>. <source>Neuroscience</source> <volume>460</volume>, <fpage>88</fpage>&#x02013;<lpage>106</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroscience.2021.02.019</pub-id><pub-id pub-id-type="pmid">33631218</pub-id></citation></ref>
<ref id="B89">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van Albada</surname> <given-names>S.</given-names></name> <name><surname>Robinson</surname> <given-names>P.</given-names></name></person-group> (<year>2009</year>). <article-title>Mean-field modeling of the basal ganglia-thalamocortical system. I. firing rates in healthy and Parkinsonian states</article-title>. <source>J. Theor. Biol</source>. <volume>257</volume>, <fpage>642</fpage>&#x02013;<lpage>663</lpage>. <pub-id pub-id-type="doi">10.1016/j.jtbi.2008.12.018</pub-id><pub-id pub-id-type="pmid">19168074</pub-id></citation></ref>
<ref id="B90">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>von Zitzewitz</surname> <given-names>J.</given-names></name> <name><surname>Asboth</surname> <given-names>L.</given-names></name> <name><surname>Fumeaux</surname> <given-names>N.</given-names></name> <name><surname>Hasse</surname> <given-names>A.</given-names></name> <name><surname>Baud</surname> <given-names>L.</given-names></name> <name><surname>Vallery</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>A neurorobotic platform for locomotor prosthetic development in rats and mice</article-title>. <source>J. Neural Eng</source>. <volume>13</volume>:<fpage>026007</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/13/2/026007</pub-id><pub-id pub-id-type="pmid">26860920</pub-id></citation></ref>
<ref id="B91">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>Y.</given-names></name> <name><surname>Chen</surname> <given-names>Q.</given-names></name> <name><surname>Hu</surname> <given-names>W.</given-names></name></person-group> (<year>2010</year>). <article-title>Behavior selection mechanism of two typical brain movement disorders: comparative study using robot</article-title>, in <source>2010 International Conference on Digital Manufacturing Automation, Vol. 1</source> (<publisher-loc>Changcha</publisher-loc>), <fpage>319</fpage>&#x02013;<lpage>323</lpage>.</citation></ref>
<ref id="B92">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>Y.</given-names></name> <name><surname>Li</surname> <given-names>S.</given-names></name> <name><surname>Chen</surname> <given-names>Q.</given-names></name> <name><surname>Hu</surname> <given-names>W.</given-names></name></person-group> (<year>2007</year>). <article-title>Biology inspired robot behavior selection mechanism: using genetic algorithm</article-title>, in <source>Bio-Inspired Computational Intelligence and Applications</source>, eds K. Li, M. Fei, G. W. Irwin, and S. Ma (<publisher-loc>Berlin; Heidelberg: Springer Berlin Heidelberg</publisher-loc>), <fpage>777</fpage>&#x02013;<lpage>786</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-540-74769-7_82</pub-id></citation></ref>
<ref id="B93">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yamashita</surname> <given-names>Y.</given-names></name> <name><surname>Tani</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Spontaneous prediction error generation in schizophrenia</article-title>. <source>PLoS ONE</source> <volume>7</volume>:<fpage>e37843</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0037843</pub-id><pub-id pub-id-type="pmid">22666398</pub-id></citation></ref>
</ref-list>
<fn-group>
<fn id="fn0001"><p><sup>1</sup>This work is part of a multidisciplinary project, the Neuro4PD: Neurorobotics Model of Parkinson&#x00027;s Disease. Its main goal is to gain further insights into the mechanisms of PD by combining neuroscience, machine learning and robotics expertise from Brazil and the UK. The project is funded by the Newton Fund and Royal Society in the UK (<ext-link ext-link-type="uri" xlink:href="https://www.macs.hw.ac.uk/neuro4pd/">https://www.macs.hw.ac.uk/neuro4pd/</ext-link>).</p></fn>
<fn id="fn0002"><p><sup>2</sup>Somatotopic organisation means that each part of our body corresponds to a specific location within a structure in the central nervous system.</p></fn>
<fn id="fn0003"><p><sup>3</sup>Or, in the rat, the homologous entopeduncular nucleus, EP.</p></fn>
<fn id="fn0004"><p><sup>4</sup>Each module is available on a github repository (<ext-link ext-link-type="uri" xlink:href="https://github.com/jhielson/Initial_Neurorobotics_Model_of_PD">https://github.com/jhielson/Initial_Neurorobotics_Model_of_PD</ext-link>) with commented material.</p></fn>
<fn id="fn0005"><p><sup>5</sup>In this work, as a proof of concept, we focused on moving only the right arm. The left arm was kept still so it does not compromise the experimental results.</p></fn>
</fn-group>
<fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> This work was part of the Neuro4PD project, granted by Royal Society and Newton Fund (NAF\R2\180773), Edinburgh Centre for Robotics (ECR), grant EP/L016834/1, and S&#x000E3;o Paulo Research Foundation (FAPESP), grants 2017/02377-5 and 2018/25902-0.0.</p>
</fn>
</fn-group>
</back>
</article> 