<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurorobot.</journal-id>
<journal-title>Frontiers in Neurorobotics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurorobot.</abbrev-journal-title>
<issn pub-type="epub">1662-5218</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnbot.2017.00039</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Adaptive Control Strategies for Interlimb Coordination in Legged Robots: A Review</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Aoi</surname> <given-names>Shinya</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<xref ref-type="author-notes" rid="fn003"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/35458/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Manoonpong</surname> <given-names>Poramate</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x0002A;</sup></xref>
<xref ref-type="author-notes" rid="fn003"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/498/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Ambe</surname> <given-names>Yuichi</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/466566/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Matsuno</surname> <given-names>Fumitoshi</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/466524/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>Florentin</given-names></name>
<xref ref-type="aff" rid="aff5"><sup>5</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/315/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Aeronautics and Astronautics, Graduate School of Engineering, Kyoto University</institution> <country>Kyoto, Japan</country></aff>
<aff id="aff2"><sup>2</sup><institution>Embodied AI &#x00026; Neurorobotics Lab, Centre for Biorobotics, M&#x000E6;rsk Mc-Kinney M&#x000F8;ller Institute, University of Southern Denmark</institution> <country>Odense, Denmark</country></aff>
<aff id="aff3"><sup>3</sup><institution>Department of Applied Information Sciences, Graduate School of Information Sciences, Tohoku University</institution> <country>Aoba-ku, Japan</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Mechanical Engineering and Science, Graduate School of Engineering, Kyoto University</institution> <country>Kyoto, Japan</country></aff>
<aff id="aff5"><sup>5</sup><institution>Bernstein Center for Computational Neuroscience, Third Institute of Physics, Georg-August-Universit&#x000E4;t G&#x000F6;ttingen</institution> <country>G&#x000F6;ttingen, Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Tom Ziemke, University of Sk&#x000F6;vde and Link&#x000F6;ping University, Sweden</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Auke Ijspeert, &#x000C9;cole Polytechnique F&#x000E9;d&#x000E9;rale de Lausanne, Switzerland; Holk Cruse, Bielefeld University, Germany</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Shinya Aoi <email>shinya_aoi&#x00040;kuaero.kyoto-u.ac.jp</email></p></fn>
<fn fn-type="corresp" id="fn002"><p>Poramate Manoonpong <email>poma&#x00040;mmmi.sdu.dk</email></p></fn>
<fn fn-type="other" id="fn003"><p>&#x02020;These authors have contributed equally to this work.</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>23</day>
<month>08</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>11</volume>
<elocation-id>39</elocation-id>
<history>
<date date-type="received">
<day>26</day>
<month>11</month>
<year>2016</year>
</date>
<date date-type="accepted">
<day>31</day>
<month>07</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2017 Aoi, Manoonpong, Ambe, Matsuno and W&#x000F6;rg&#x000F6;tter.</copyright-statement>
<copyright-year>2017</copyright-year>
<copyright-holder>Aoi, Manoonpong, Ambe, Matsuno and W&#x000F6;rg&#x000F6;tter</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Walking animals produce adaptive interlimb coordination during locomotion in accordance with their situation. Interlimb coordination is generated through the dynamic interactions of the neural system, the musculoskeletal system, and the environment, although the underlying mechanisms remain unclear. Recently, investigations of the adaptation mechanisms of living beings have attracted attention, and bio-inspired control systems based on neurophysiological findings regarding sensorimotor interactions are being developed for legged robots. In this review, we introduce adaptive interlimb coordination for legged robots induced by various factors (locomotion speed, environmental situation, body properties, and task). In addition, we show characteristic properties of adaptive interlimb coordination, such as gait hysteresis and different time-scale adaptations. We also discuss the underlying mechanisms and control strategies to achieve adaptive interlimb coordination and the design principle for the control system of legged robots.</p>
</abstract>
<kwd-group>
<kwd>legged robot</kwd>
<kwd>interlimb coordination</kwd>
<kwd>adaptation</kwd>
<kwd>sensorimotor interaction</kwd>
<kwd>central pattern generator</kwd>
</kwd-group>
<counts>
<fig-count count="13"/>
<table-count count="1"/>
<equation-count count="0"/>
<ref-count count="163"/>
<page-count count="21"/>
<word-count count="13921"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>Animals produce adaptive motor behaviors by skillfully manipulating their complicated and redundant musculoskeletal systems. Locomotion is an important behavior required in daily life. Gait selection in accordance with the situation, such as speed and environment, is a prominent adaptive motor function. Humans walk bipedally and use walking and running gaits. Quadruped animals use four legs and produce walking, trotting, and galloping gaits. Hexapod insects use six legs and create metachronal (wave), tetrapod, and tripod gaits as well as intermediate stepping patterns forming a continuum. These gaits, including the transitions and the intermediate stepping patterns for hexapods, are generated through the intralimb and interlimb coordination of leg movements. Intralimb coordination is the relationship between segments or joints within one leg, whereas interlimb coordination is the relationship between legs. For example, in the adaptive control of intralimb coordination, peak timings of ankle plantar flexion, knee extension, and hip extension are out of phase during the human walking gait, but they are shifted and almost in phase during the human running gait (Diedrich et al., <xref ref-type="bibr" rid="B52">1998</xref>). In the adaptive control of interlimb coordination, the footfall sequence between legs changes (Muybridge, <xref ref-type="bibr" rid="B121">1957</xref>), and the sequence is mainly explained by the relative phases between leg movements, because the leg movements are periodic with almost the same period for each leg (note that different frequencies between the legs have been sometimes observed in insects due to the flexibility in the stepping patterns, Pearson and Franklin, <xref ref-type="bibr" rid="B129">1984</xref>). In the quadrupedal walking gait, although the left and right legs move in anti-phase, the ipsilateral front and hind legs do not. In contrast, in the quadrupedal trotting gait, the ipsilateral front and hind legs as well as the left and right legs move in anti-phase; that is, the diagonal legs move in phase (Hildebrand, <xref ref-type="bibr" rid="B85">1965</xref>). Measured data analyses performed to clarify the gait mechanisms have suggested that gaits are selected based on metabolic and biomechanical factors (Margaria, <xref ref-type="bibr" rid="B114">1938</xref>; Hoyt and Taylor, <xref ref-type="bibr" rid="B89">1981</xref>; Farley and Taylor, <xref ref-type="bibr" rid="B57">1991</xref>). However, reports on the roles of these factors in determining the gaits (Hreljac, <xref ref-type="bibr" rid="B90">1993</xref>; Minetti et al., <xref ref-type="bibr" rid="B117">1994</xref>; Raynor et al., <xref ref-type="bibr" rid="B133">2002</xref>; Wickler et al., <xref ref-type="bibr" rid="B157">2003</xref>) are conflicting, and so the underlying mechanism remains unclear.</p>
<p>To elucidate adaptive motor functions in animals, neurophysiological and biomechanical studies have been independently conducted. Neurophysiological studies mainly investigate the configurations and activities of the neural system, whereas biomechanical studies generally examine the functional roles of the musculoskeletal system. However, locomotion is generated through dynamic interactions among the neural system, the musculoskeletal system, and the environment. It is thus difficult to fully analyze the locomotion mechanism from a single perspective. In addition, gaits are viewed as self-organized patterns in such complex dynamical systems (Sch&#x000F6;ner et al., <xref ref-type="bibr" rid="B143">1990</xref>; Diedrich et al., <xref ref-type="bibr" rid="B52">1998</xref>; Griffin et al., <xref ref-type="bibr" rid="B80">2004</xref>; Schilling et al., <xref ref-type="bibr" rid="B138">2013a</xref>). The stability structure of gaits has been identified from the response of perturbations, especially by phase oscillators and phase response curves (Couzin-Fuchs et al., <xref ref-type="bibr" rid="B44">2015</xref>; Funato et al., <xref ref-type="bibr" rid="B74">2016</xref>) based on the phase reduction theory (Kuramoto, <xref ref-type="bibr" rid="B104">1984</xref>). However, it is difficult to understand how the stability structure is generated due to the complex nature of interactions between the dynamic factors in locomotion. To fully elucidate the locomotion mechanism, integrated studies of neural and musculoskeletal systems are required to find the processes that create adaptive locomotor behavior.</p>
<p>Recently, to reveal the locomotion mechanism, legged robots have attracted attention. A robot&#x00027;s mechanical system with actuators, such as electric motors and pneumatic and hydraulic actuators, has been used to investigate the dynamic role of the musculoskeletal system in locomotion. The control system of the robot has been developed based on neurophysiological findings and employs various sensors, such as a touch sensor, load cell, acceleration sensor, gyro sensor, laser range scanner, and vision system. This approach allows us to emulate and investigate gait generation through dynamic interactions between the neural system, the musculoskeletal system, and the environment. In particular, central pattern generators (CPGs), which are located in the spinal cord of vertebrates and in the thoracic ganglia of invertebrates, are an important factor for elucidating the locomotion mechanism (Grillner, <xref ref-type="bibr" rid="B81">1975</xref>; Orlovsky et al., <xref ref-type="bibr" rid="B124">1999</xref>; MacKay-Lyons, <xref ref-type="bibr" rid="B109">2002</xref>) and have aided the development of locomotion control systems of legged robots. A CPG is a group of interconnected neurons that can be activated to generate a motor pattern without the requirement of sensory feedback. The evidence that supports this hypothesis was originally shown by Brown (<xref ref-type="bibr" rid="B30">1911</xref>). In addition to the open-loop control function, CPGs receive sensory feedbacks to modulate motor commands. This closed-loop structure of sensory feedbacks is crucial to achieve adaptive behavior depending on the situation. Various CPG models have been proposed by using neural or oscillator networks and implemented in control legged robots [see review by Ijspeert (<xref ref-type="bibr" rid="B92">2008</xref>)]. For example, Taga and Shimizu (<xref ref-type="bibr" rid="B150">1991</xref>) and Taga (<xref ref-type="bibr" rid="B149">1995</xref>) conducted a pioneering study of a CPG model for human bipedal locomotion. They employed an articulated multi-link system for the body mechanical model and neural oscillators developed by Matsuoka (<xref ref-type="bibr" rid="B115">1985</xref>) for the CPG model. This CPG model received sensory signals of local and global information for locomotion. They demonstrated that adaptive locomotion is established through the interaction between body dynamics, oscillator dynamics, and environment; they called this &#x0201C;global entrainment.&#x0201D; Although complex and robust locomotion behavior can be achieved by purely reflexive control mechanisms (Cruse et al., <xref ref-type="bibr" rid="B46">1998</xref>; Manoonpong et al., <xref ref-type="bibr" rid="B110">2007</xref>; Lewinger and Quinn, <xref ref-type="bibr" rid="B106">2011</xref>; Schilling et al., <xref ref-type="bibr" rid="B138">2013a</xref>,<xref ref-type="bibr" rid="B139">b</xref>) and classical machine learning control (Bongard et al., <xref ref-type="bibr" rid="B29">2006</xref>; Cully et al., <xref ref-type="bibr" rid="B47">2015</xref>) instead of using CPG models, the CPG concept and modeling have had a large influence on the studies of legged robots.</p>
<p>In this review, we focus on the adaptive control of interlimb coordination in locomotion. We introduce adaptive interlimb coordination for animals and legged robots induced by various factors (locomotion speed, environmental situation, body properties, and task). In addition, we show characteristic properties of adaptive interlimb coordination in animals and robots, such as gait hysteresis and different time-scale adaptations. Finally, we discuss the underlying mechanisms and control strategies to achieve adaptive interlimb coordination and the design principle for the control system of legged robots.</p>
</sec>
<sec id="s2">
<title>2. Adaptive interlimb coordination in animals and robots</title>
<sec>
<title>2.1. Speed-dependent adaptation</title>
<p>The most general adaptive interlimb coordination appears when varying the locomotion speed in legged animals. This has been observed even in spinal cats on treadmills (Forssberg and Grillner, <xref ref-type="bibr" rid="B59">1973</xref>; Orlovsky et al., <xref ref-type="bibr" rid="B124">1999</xref>), in which the phase relationship between the legs changes and the gait varies among walking, trotting, and galloping. In reported studies, the spinal cords of cats were transected from the brain, but they still received sensory feedback through the contact between their feet and the belt. The sensory signals changed with the belt speed change, which induced their gait transitions. This result highlights the important contribution of sensorimotor interaction to adaptive interlimb coordination. Quadruped robots have achieved adaptive interlimb coordination that depends on locomotion speed by modeling spinal CPGs with local sensory feedback (Maufroy et al., <xref ref-type="bibr" rid="B116">2010</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>; Owaki et al., <xref ref-type="bibr" rid="B126">2013</xref>; Fukuoka et al., <xref ref-type="bibr" rid="B69">2015</xref>; Owaki and Ishiguro, <xref ref-type="bibr" rid="B127">2017</xref>). This can be seen in the following examples. Figure <xref ref-type="fig" rid="F1">1</xref> shows a quadruped robot, the control system, and the experimental results of the walk&#x02013;trot transition in Aoi et al. (<xref ref-type="bibr" rid="B10">2013b</xref>) (this robot showed hysteresis in the gait transition, as discussed in Section 3.1). Figure <xref ref-type="fig" rid="F2">2</xref>, which is from the work by Fukuoka et al. (<xref ref-type="bibr" rid="B69">2015</xref>), presents quadruped gaits transitioned from a walk at slow speeds to a trot at medium speeds, and a transverse gallop at high speeds. Figure <xref ref-type="fig" rid="F3">3</xref>, which is from the work by Owaki and Ishiguro (<xref ref-type="bibr" rid="B127">2017</xref>), also shows spontaneous gait transitions from a lateral-sequence (L-S) walk to a trot and even to a gallop of a quadruped robot with respect to the locomotion speed without neural coupling. These robotics studies used simple neural oscillators or phase oscillators for the CPG model and produced leg motions from the oscillator phases. More specifically, one oscillator created one leg motion and the phase relationship between the oscillators determined the gait. Each oscillator phase was regulated through local sensory information of the leg, such as foot contact and leg loading, occurring only within one leg.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Walk&#x02013;trot transition of a quadruped robot induced by changing the locomotion speed. <bold>(A)</bold> Quadruped robot. <bold>(B)</bold> CPG-based phase oscillator network with local sensory feedback of foot contact information. Left and right leg oscillators are anti-phase and front and hind leg oscillators (&#x00394;: phase difference) are only weakly coupled. <bold>(C)</bold> Footfall sequences during the trot-to-walk and walk-to-trot transitions (white: swing phase, colored: stance phase). These figures were modified from Aoi et al. (<xref ref-type="bibr" rid="B10">2013b</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0001.tif"/>
</fig>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Simulation results of walk, trot, and gallop gaits with different speeds for a quadruped model. <bold>(A)</bold> The quadruped model and its hard-wired neural oscillator network with leg loading feedback for interlimb coordination. <bold>(B)</bold> The CPG outputs for controlling the legs, different emerged gaits from the interlimb coordination, and body movement around the pitch axis. The walking speeds are shown as the top meter bars (dark blue to blue and red to orange) where speed level is denoted as the color meter on the top right gradient bar. The convex curves indicate the flexor half-center outputs for left foreleg (LF, blue), left hindleg (LH, red), right foreleg (RF, green), and right hindleg (RH, purple), which lead to the swing phase. The thick lines indicate the stance phase and the thin dashed lines refer to the swing phase. These figures were modified from Fukuoka et al. (<xref ref-type="bibr" rid="B69">2015</xref>) with permission.</p></caption>
<graphic xlink:href="fnbot-11-00039-g0002.tif"/>
</fig>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Walk-trot-gallop transitions of a quadruped robot achieved by changing its locomotion speed. <bold>(A)</bold> The quadruped robot with interlimb coordination generated by non-wired simple phase oscillators (CPGs) with continuous phase modulation. The oscillator phases are modulated with respect to the magnitude of local load sensing <italic>N</italic><sub><italic>i</italic></sub>. <bold>(B)</bold> Walking speed and gait diagrams of different locomotion modes (walk, trot, canter, and gallop). The pink area shows the change of the treadmill speed with respect to the value of &#x003C9;. The colored areas in the gait diagrams mean the stance phase, during which the sensor value <italic>N</italic><sub><italic>i</italic></sub> becomes greater than a threshold value. These figures were modified from Owaki and Ishiguro (<xref ref-type="bibr" rid="B127">2017</xref>) with permission.</p></caption>
<graphic xlink:href="fnbot-11-00039-g0003.tif"/>
</fig>
<p>As an important control architecture in these robotics studies, the phase relationship between the oscillators was not predefined and the oscillators were only weakly coupled or decoupled. That is, the gait was not determined by the oscillator dynamics using strong coupling (Sch&#x000F6;ner et al., <xref ref-type="bibr" rid="B143">1990</xref>; Canavier et al., <xref ref-type="bibr" rid="B39">1997</xref>; Ito et al., <xref ref-type="bibr" rid="B94">1998</xref>; Golubitsky et al., <xref ref-type="bibr" rid="B76">1999</xref>), but by the interaction between whole-body dynamics and oscillator dynamics through local sensory feedback. The interlimb coordination was generated only in a self-organizing manner among the neural dynamics, the body dynamics, and the environment.</p>
<p>Similar adaptive interlimb coordination in accordance with gait speed also appears in hexapod insects, such as stick insects (Wilson, <xref ref-type="bibr" rid="B158">1966</xref>; Graham, <xref ref-type="bibr" rid="B78">1972</xref>; Cruse, <xref ref-type="bibr" rid="B45">1990</xref>; Grabowska et al., <xref ref-type="bibr" rid="B77">2012</xref>), cockroaches (Hughes, <xref ref-type="bibr" rid="B91">1952</xref>; Delcomyn, <xref ref-type="bibr" rid="B49">1971</xref>; Pearson, <xref ref-type="bibr" rid="B128">1976</xref>; Bender et al., <xref ref-type="bibr" rid="B25">2011</xref>), and flies (Strau&#x000DF; and Heisenberg, <xref ref-type="bibr" rid="B147">1990</xref>; Wosnitza et al., <xref ref-type="bibr" rid="B159">2013</xref>; Berendes et al., <xref ref-type="bibr" rid="B26">2016</xref>). In particular, stick insects and flies smoothly change their interlimb coordination in accordance with gait speed (Wilson, <xref ref-type="bibr" rid="B158">1966</xref>; Graham, <xref ref-type="bibr" rid="B78">1972</xref>; Wosnitza et al., <xref ref-type="bibr" rid="B159">2013</xref>). More specifically, the relative phases between the legs continuously change in a linear fashion for gait speed. This is similar to some mammals, including sheep, but is different from other mammals, including dogs. In mammals such as dogs, the gait transitions have relative leg phases that change suddenly in a sigmoid fashion (Alexander and Jayes, <xref ref-type="bibr" rid="B3">1983</xref>). Although it is suggested that cockroaches achieve interlimb coordination mainly by the CPG itself (Fuchs et al., <xref ref-type="bibr" rid="B65">2011</xref>), the CPG by itself does not produce a coordinated motor pattern for stick insect walking, because sensory feedback is important (B&#x000E4;ssler and Wegner, <xref ref-type="bibr" rid="B24">1983</xref>; B&#x000FC;schges et al., <xref ref-type="bibr" rid="B37">1995</xref>; B&#x000FC;schges et al., <xref ref-type="bibr" rid="B36">2008</xref>). Cruse and his colleagues proposed an artificial neural network, named Walknet, which controls leg movements based on six different rules to regulate interlimb coordination by sensory information (note that the controller of the individual leg operates without CPG). The rules were empirically derived from the behavioral experiments of stick insects [see reviews by Cruse et al. (<xref ref-type="bibr" rid="B46">1998</xref>), D&#x000FC;rr et al. (<xref ref-type="bibr" rid="B54">2004</xref>) and Schilling et al. (<xref ref-type="bibr" rid="B138">2013a</xref>)]. Three of the rules were designed by disturbing leg movements on a slippery surface. The rules changed the cycle duration of a leg based on sensory information of the neighboring legs. As a result of sensorimotor interaction, the insect models controlled by Walknet produced a continuum of locomotion patterns, such as tripod, tetrapod, and wave gaits, and intermediate stepping patterns, as observed in stick insects. In addition, the models were used for various situations, such as walking on uneven surfaces (Kindermann, <xref ref-type="bibr" rid="B100">2002</xref>), leg amputation (Schilling et al., <xref ref-type="bibr" rid="B137">2007</xref>), negotiating curves (Schilling et al., <xref ref-type="bibr" rid="B139">2013b</xref>), and climbing over large gaps (Bl&#x000E4;sing, <xref ref-type="bibr" rid="B28">2006</xref>), and the locomotor behavior was comparable to that of stick insects. T&#x000F3;th and Daun-Gruhn (<xref ref-type="bibr" rid="B153">2016</xref>) developed neural network models based on Hodgkin Huxley dynamics and integrated them with musculoskeletal models to explain the interlimb coordination mechanism of insects. Although their models did not produce intermediate stepping patterns as observed in stick insects (Wilson, <xref ref-type="bibr" rid="B158">1966</xref>; Graham, <xref ref-type="bibr" rid="B78">1972</xref>) and flies (Wosnitza et al., <xref ref-type="bibr" rid="B159">2013</xref>), their results suggest that the connection between the levator-depressor neuromuscular systems of the different legs is necessary to replicate the primary features of tripod and tetrapod gaits. Ambe et al. (<xref ref-type="bibr" rid="B6">2013</xref>, <xref ref-type="bibr" rid="B4">2015</xref>) used simple phase oscillators with local sensory feedback of foot contact information for a hexapod robot, in a manner similar to the quadruped robots mentioned above. They produced a continuum of locomotion patterns, such as metachronal and tripod gaits and intermediate stepping patterns, through embodied sensorimotor interaction, without predefining the patterns in accordance with the locomotion speed. In addition, one important aspect shown was positive velocity feedback during the stance of stick insects (B&#x000E4;ssler, <xref ref-type="bibr" rid="B22">1976</xref>). The positive velocity feedback has been tested on a robot (Schmitz et al., <xref ref-type="bibr" rid="B140">2008</xref>).</p>
<p>Similarly, myriapods, such as centipedes, change their interlimb coordination depending on gait speed. Myriapods have a long and flexible body axis and produce body undulations when the gait speed increases (Manton, <xref ref-type="bibr" rid="B113">1965</xref>). In addition to the amplitude increase of the undulations, the phase relationship between ipsilateral leg movements changes in synchronization with the body segment movements of the undulations. In Aoi et al. (<xref ref-type="bibr" rid="B13">2007</xref>, <xref ref-type="bibr" rid="B8">2013a</xref>), a multilegged robot with six body segments and twelve legs, which use torsional springs for body axis flexibility, was developed. The robot showed body undulations through a supercritical Hopf bifurcation of straight walking by increasing the locomotion speed, and so showed dependence of body undulations on speed, as was similar to the dependence shown by centipedes.</p>
</sec>
<sec>
<title>2.2. Environment-dependent adaptation</title>
<p>The advantage of using legs in mobile motion for animals and machines is to gain high traversability even in complex environments by manipulating the foot contact positions. However, the traversability of legged robots is still far from reaching the level of animals. During locomotion, the leg motion consists of the stance phase, in which the foot is in contact with the ground, and the swing phase, in which the foot is lifted off the ground. In the stance phase, the leg supports the body against gravity and produces propulsive and decelerating forces to move the body through the interaction between the foot and the ground. Geometric properties of the ground vary. These properties include being flat terrain, sloped terrain, or irregular and rough terrain. The physical properties of the ground also change. These properties include hard and slippery ground like stone, soft ground like loose soil, and flowable and penetrable ground like sand. The interaction between the foot and the ground is crucial to create locomotion, and real-time adaptation of motor behavior is required according to the ground situation. Animals actually show adaptive interlimb coordination depending on the environmental situation. To control legged robots, it is crucial to clarify and apply the dynamical principles of animals.</p>
<p>Manoonpong and his colleagues developed a series of modular neural CPG-based locomotion control for legged robots (Manoonpong et al., <xref ref-type="bibr" rid="B112">2008</xref>, <xref ref-type="bibr" rid="B111">2013</xref>; Steingrube et al., <xref ref-type="bibr" rid="B146">2010</xref>; Goldschmidt et al., <xref ref-type="bibr" rid="B75">2014</xref>; Xiong et al., <xref ref-type="bibr" rid="B160">2014</xref>, <xref ref-type="bibr" rid="B161">2015</xref>; Dasgupta et al., <xref ref-type="bibr" rid="B48">2015</xref>; Grinke et al., <xref ref-type="bibr" rid="B82">2015</xref>). They showed that using this control approach leads to adaptive interlimb coordination that allows the robots to deal with complex environments, such as walking over difficult terrain (Steingrube et al., <xref ref-type="bibr" rid="B146">2010</xref>; Manoonpong et al., <xref ref-type="bibr" rid="B111">2013</xref>; Goldschmidt et al., <xref ref-type="bibr" rid="B75">2014</xref>; Xiong et al., <xref ref-type="bibr" rid="B160">2014</xref>, <xref ref-type="bibr" rid="B161">2015</xref>; Dasgupta et al., <xref ref-type="bibr" rid="B48">2015</xref>) and avoiding obstacles in an unknown cluttered area (Manoonpong et al., <xref ref-type="bibr" rid="B112">2008</xref>; Grinke et al., <xref ref-type="bibr" rid="B82">2015</xref>), as observed in insects. For example, they implemented modular neural control with an adaptive chaotic CPG-based network and sensory feedback on a hexapod robot (Figures <xref ref-type="fig" rid="F4">4A,B</xref>; Steingrube et al., <xref ref-type="bibr" rid="B146">2010</xref>). Due to the intrinsically chaotic dynamics of the CPG similar to that observed in certain biological CPGs (Rabinovich and Abarbanel, <xref ref-type="bibr" rid="B132">1998</xref>), the dynamics were exploited to generate various walking patterns depending on the environmental condition. In their setup, the robot showed a tetrapod gait for standard walking, a wave gait for up-slope walking, a mixture gait between wave and tetrapod gaits for down-slope walking, and a tripod gait for fast walking to perform fast phototaxis (Figure <xref ref-type="fig" rid="F4">4C</xref>). However, this implementation of discrete gaits does not necessarily correspond to the situation found in insects. In addition to these multiple gaits, the chaotic dynamics especially contributed to self-untrapping of a leg from a hole in the ground (Figure <xref ref-type="fig" rid="F4">4B</xref>) and thereby enhanced foothold searching behavior. In Dasgupta et al. (<xref ref-type="bibr" rid="B48">2015</xref>), Goldschmidt et al. (<xref ref-type="bibr" rid="B75">2014</xref>), and Manoonpong et al. (<xref ref-type="bibr" rid="B111">2013</xref>) integrating forward models into the modular neural control enabled the robot to effectively predict its walking state in order to extend or elevate its legs during the swing and stance phases while walking on complex terrains. With this setup, the robot walked on uneven terrain by using a tetrapod gait and climbed over high obstacles as well as up a flight of stairs by using a wave gait. Moreover, it successfully crossed a large gap by using a caterpillar gait, where each left and right pair of legs moved simultaneously. In this situation, however, stick insects show more complex behavior than caterpillar coordination, which is adopted only rarely, if at all (Blaesing and Cruse, <xref ref-type="bibr" rid="B27">2004</xref>). In Xiong et al. (<xref ref-type="bibr" rid="B160">2014</xref>), modular neural control was extended by introducing muscle models based on virtual agonist-antagonist mechanisms (VAAM), and neuromechanical control was produced to achieve leg compliance. Combining neuromechanical control with sensorimotor learning results in energy-efficient walking using different gaits with corresponding leg compliances (Xiong et al., <xref ref-type="bibr" rid="B161">2015</xref>). The robot efficiently walked on different surfaces including sponge, gravel, fine gravel, and grass. For adaptation to the avoidance of obstacles in a cluttered environment, an adaptive neural sensory processing network with synaptic plasticity was introduced to the modular neural control (Grinke et al., <xref ref-type="bibr" rid="B82">2015</xref>). The adaptive processing network could drive different turning behaviors with short-term robot memory. As a consequence, the robot walked around and adapted its turning behavior to avoid obstacles in different situations and to avoid sharp corners or deadlocks (Figure <xref ref-type="fig" rid="F4">4D</xref>). In addition to the modular neural control approach, Schneider et al. (<xref ref-type="bibr" rid="B141">2012</xref>) developed bio-inspired control, which combines Walknet (mentioned above) with higher level control and planning (Figures <xref ref-type="fig" rid="F5">5A,B</xref>), for adaptive interlimb coordination of the hexapod robot HECTOR. By using this control technique, versatile behaviors (e.g., gap crossing, obstacle crossing, and global planning to avoid or attack obstacles) can be generated to deal with complex environments (Figure <xref ref-type="fig" rid="F5">5C</xref>). Furthermore, Schilling and Cruse (<xref ref-type="bibr" rid="B136">2017</xref>) expanded Walknet to invent new behaviors and test them by internal simulation before using them in reality. Arena et al. (<xref ref-type="bibr" rid="B18">2017</xref>) proposed multilayered CPG-based locomotion control with insect inspired motor-skill learning. It can adaptively coordinate the limbs of a Drosophila-like hexapod robot for stable walking and obstacle climbing.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Environment-dependent adaptation of a hexapod robot under modular single CPG-based locomotion control. <bold>(A)</bold> Modular neural locomotion control consisting of adaptive chaos control (acting as a CPG), CPG post-processing, and neural motor control. Locomotion control can generate multiple gaits (wave, transition, tetrapod, and tripod gaits) and a chaotic pattern for locomotion on different terrains. A combination of neural control with an adaptive neural sensory processing network can generate adaptive obstacle avoidance for avoiding obstacles in a complex environment. <bold>(B)</bold> Hexapod robot AMOS with a chaotic movement pattern for self-untrapping (i.e., freeing itself when its leg is trapped in a hole). The red light trace recorded from an LED installed at the leg shows the chaos motion of the leg. <bold>(C)</bold> Walking experiment on different terrains (floor, slopes, rough terrain, and holes in the ground) where different gaits were used. The white areas in the gait diagrams indicate the swing phase and the dark blue areas refer to the stance phase. <bold>(D)</bold> Adaptive obstacle avoidance in a simulated complex environment with obstacles, sharp corners, and narrow passages. These figures were modified from Grinke et al. (<xref ref-type="bibr" rid="B82">2015</xref>) and Steingrube et al. (<xref ref-type="bibr" rid="B146">2010</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0004.tif"/>
</fig>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Walknet with higher level control and planning for different locomotion behavior generation of the hexapod robot HECTOR for different environments. <bold>(A)</bold> Bio-inspired control Walknet with interlimb coordination rules [rules 1, 2, and 3; see Schilling et al. (<xref ref-type="bibr" rid="B138">2013a</xref>) and Schneider et al. (<xref ref-type="bibr" rid="B141">2012</xref>) for details]. <bold>(B)</bold> Setup of an individual leg controller with higher-level control and planning. Its outputs drive the leg joints of HECTOR. <bold>(C)</bold> Different desired locomotion behaviors that can be generated by the control approach to deal with complex environments. These figures were modified from Schneider et al. (<xref ref-type="bibr" rid="B141">2012</xref>) with permission.</p></caption>
<graphic xlink:href="fnbot-11-00039-g0005.tif"/>
</fig>
<p>When horses walk up an incline (Wickler et al., <xref ref-type="bibr" rid="B157">2003</xref>) or when they carry weights (Farley and Taylor, <xref ref-type="bibr" rid="B57">1991</xref>), the trot-to-gallop transition speed is reduced. Hexapod insects, such as stick insects, cockroaches, and beetles, change their gait depending on the slope of the ground (Spirito and Mushrush, <xref ref-type="bibr" rid="B145">1979</xref>; Pelletier and Caissie, <xref ref-type="bibr" rid="B130">2001</xref>; Grabowska et al., <xref ref-type="bibr" rid="B77">2012</xref>). Furthermore, while cockroaches use the tripod gait during normal walking, the gait changes to metachronal when they are tethered on a supported ball to decrease loading (Spirito and Mushrush, <xref ref-type="bibr" rid="B145">1979</xref>); uphill slope and loading induce similar effects on their gaits (Tang and Macmillan, <xref ref-type="bibr" rid="B151">1986</xref>). Fujiki et al. (<xref ref-type="bibr" rid="B66">2013a</xref>) extended the control system of a quadruped robot (Figure <xref ref-type="fig" rid="F1">1B</xref>) for a hexapod walker and showed that the gait changed between tripod and metachronal gaits through the sensorimotor interaction depending on the loading and slope angle, as observed in insects.</p>
<p>Fukuoka et al. (<xref ref-type="bibr" rid="B71">2003</xref>), Fukuoka and Kimura (<xref ref-type="bibr" rid="B70">2009</xref>), and Kimura et al. (<xref ref-type="bibr" rid="B97">2007a</xref>,<xref ref-type="bibr" rid="B98">b</xref>) used the neural oscillators developed by Matsuoka (<xref ref-type="bibr" rid="B115">1985</xref>) to control quadruped robots (Tekken series). They incorporated models of various reflexes, such as the flexor reflex, extensor reflex, and vestibulospinal reflex, based on sensory information. In addition, they modeled the tonic labyrinthine response to adjust the rolling motion to synchronize with the pitching motion. The robots produced robust locomotion over irregular terrain, such as steps and slopes, while inducing the gait transition between walking and trotting.</p>
<p>When the ground is flowable like sand, the leg penetrates deeply into the ground during locomotion. Consequently, the interaction with the ground to produce lift, drag, and thrust forces becomes complicated [see review by Aguilar et al. (<xref ref-type="bibr" rid="B1">2016</xref>)]. Li et al. (<xref ref-type="bibr" rid="B107">2009</xref>, <xref ref-type="bibr" rid="B108">2013</xref>) used a tripod gait for a hexapod robot and produced locomotor performance similar to that in hard ground by adjusting the leg shape and leg motion with a force model of the robot moving in granular media.</p>
<p>Along with the adaptation to slopes, rough terrain, cluttered areas, and flowable areas, interlimb adaptation dealing with an asymmetric environmental condition has been investigated. For the asymmetric condition, split-belt treadmills have been used in studies of humans (Dietz et al., <xref ref-type="bibr" rid="B53">1994</xref>; Reisman et al., <xref ref-type="bibr" rid="B131">2005</xref>; Morton and Bastian, <xref ref-type="bibr" rid="B118">2006</xref>), cats (Yanagihara and Kondo, <xref ref-type="bibr" rid="B162">1996</xref>; Frigon et al., <xref ref-type="bibr" rid="B63">2013</xref>), crayfishes (M&#x000FC;ller and Cruse, <xref ref-type="bibr" rid="B119">1991a</xref>,<xref ref-type="bibr" rid="B120">b</xref>), and stick insects (B&#x000E4;ssler and Wegner, <xref ref-type="bibr" rid="B24">1983</xref>; Foth and Graham, <xref ref-type="bibr" rid="B61">1983</xref>). The treadmills have two parallel belts with independently controlled speeds and thus are capable of artificially creating left&#x02013;right symmetric and asymmetric environments for walking (tied configuration: same speed between the belts, split-belt configuration: different speeds between the belts). Although the details are discussed later in Section 3.2, adaptive interlimb coordination has been observed in accordance with the belt speed condition. Such an adaptation appeared even in spinal cats (Forssberg et al., <xref ref-type="bibr" rid="B60">1980</xref>; Frigon et al., <xref ref-type="bibr" rid="B63">2013</xref>). Otoda et al. (<xref ref-type="bibr" rid="B125">2009</xref>) developed a sensory-driven controller without a CPG model for a two-dimensional biped robot and Fujiki et al. (<xref ref-type="bibr" rid="B68">2013b</xref>) used simple phase oscillators for the CPG model of a biped robot with local sensory feedback of the foot contact information, as was similarly done with the abovementioned quadruped and hexapod robots that achieved adaptive interlimb coordination (Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>; Ambe et al., <xref ref-type="bibr" rid="B6">2013</xref>, <xref ref-type="bibr" rid="B4">2015</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>). The biped robots achieved adaptive interlimb coordination on split-belt treadmills.</p>
</sec>
<sec>
<title>2.3. Body-dependent adaptation</title>
<p>Animals show adaptive motor behavior also due to changes in their body properties. As mentioned above, they change walking patterns when carrying weights or reducing their loads (Tang and Macmillan, <xref ref-type="bibr" rid="B151">1986</xref>; Farley and Taylor, <xref ref-type="bibr" rid="B57">1991</xref>). For fast locomotion, such as the galloping gait of cursorial quadrupeds and the undulatory walk of centipedes, the appearance of trunk and body-segment movements suggests that body flexibility is crucial for adaptive locomotion (Alexander, <xref ref-type="bibr" rid="B2">1988</xref>). In Aoi et al. (<xref ref-type="bibr" rid="B17">2011</xref>), a quadruped walker was controlled by simple phase oscillators with local sensory foot contact information (Figure <xref ref-type="fig" rid="F1">1B</xref>) and the change in trunk flexibility induced the walk&#x02013;trot transition, where walking and trotting gaits appeared for a hard trunk and a soft trunk, respectively. In Aoi et al. (<xref ref-type="bibr" rid="B13">2007</xref>, <xref ref-type="bibr" rid="B8">2013a</xref>, <xref ref-type="bibr" rid="B14">2016</xref>), a centipede-like multilegged robot showed the gait transition from straight walking to body undulatory walking through a Hopf bifurcation by changing the body axis flexibility.</p>
<p>One of the advantages to using many legs for mobile motion, as in insects and myriapods, is the avoidance of losing mobility completely by leg damage due to injury and predation. Through adaptive control of interlimb coordination, even complete leg loss does not prevent walking (Grabowska et al., <xref ref-type="bibr" rid="B77">2012</xref>). To clarify how interlimb coordination changes with leg loss, amputations of single legs of stick insects have been performed in order to investigate changes of the relative phases between the legs depending on which leg is amputated (Graham, <xref ref-type="bibr" rid="B79">1977</xref>). Dasgupta et al. (<xref ref-type="bibr" rid="B48">2015</xref>) used neural CPG-based control with distributed adaptive forward models for the hexapod robot, as mentioned above, and demonstrated that the robot successfully kept walking straight with a slightly modified tetrapod gait through adaptation despite the damaged right middle leg. Ren et al. (<xref ref-type="bibr" rid="B134">2015</xref>) extended the chaotic CPG controller introduced above (Steingrube et al., <xref ref-type="bibr" rid="B146">2010</xref>) to a controller of multiple chaotic CPGs depending on the number of legs (Figure <xref ref-type="fig" rid="F6">6A</xref>). They demonstrated that the six-legged robot (AMOSII) could continue walking by changing the interlimb coordination in accordance with the disabled leg(s) (Figures <xref ref-type="fig" rid="F6">6B,C</xref>). Walknet, which identifies the behavior of stick insects, as introduced above, was able to coordinate the movements of the remaining legs so that a six-legged walker could continue walking when some legs were amputated (Kindermann, <xref ref-type="bibr" rid="B100">2002</xref>; Schilling et al., <xref ref-type="bibr" rid="B137">2007</xref>). Besides these bio-inspired control approaches, Cully et al. (<xref ref-type="bibr" rid="B47">2015</xref>) proposed an alternative machine learning based approach consisting of two main parts: an automatically generated, pre-computed, behavior-performance map, and a trial-and-error learning algorithm (Figure <xref ref-type="fig" rid="F7">7</xref>). The behavior-performance map contains a number of interlimb coordination parameters that can generate approximately 13,000 different gaits. The trial-and-error learning algorithm is used to search for successful robot locomotion behaviors from the map with respect to robot body condition. They showed that this approach allows a hexapod robot to walk and rapidly find a walking behavior that can compensate for damage. Although all these approaches predefined interlimb connections, another approach based on the concept of emergent locomotion (i.e., walking patterns appearing as a result of stabilization in a self-organizing manner, Schilling et al., <xref ref-type="bibr" rid="B138">2013a</xref>) from tight interaction between neural systems, musculoskeletal systems, and the environment has been explored for body-dependent adaptation. For example, Barikhan et al. (<xref ref-type="bibr" rid="B21">2014</xref>) proposed multiple decoupled neural CPGs with local sensory feedback (Figure <xref ref-type="fig" rid="F6">6D</xref>). This approach exploited the interaction between neural and body dynamics through foot contact feedback to achieve self-organized locomotion and to allow a hexapod robot to quickly adapt its locomotion to deal with morphological changes [e.g., leg damage (Figure <xref ref-type="fig" rid="F6">6E</xref>) or asymmetric leg lengths between the front and hind legs]. Tsuchiya et al. (<xref ref-type="bibr" rid="B155">2002</xref>) used simple phase oscillators with local sensory foot contact information to control a ten-legged robot to establish adaptive interlimb coordination, as mentioned above for quadruped and hexapod robots. The leg loss induced the change in interlimb coordination, and the change reduced the degradation of locomotion performance, such as gait speed.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>Adaptation to deal with leg malfunction of a hexapod robot under modular multiple CPG-based locomotion control. <bold>(A)</bold> Implementation of multiple chaotic CPGs on a hexapod robot. In the setup, the connections between CPGs are predefined. <bold>(B,C)</bold> Two example scenarios of real robot experiments with disabled legs. In <bold>(B)</bold>, the robot walked with the R1 leg disabled and in <bold>(C)</bold> it walked with the R1 and R3 legs disabled. For each subfigure, the upper panel shows one snapshot of a fail situation (before learning) and three snapshots of a success situation (after learning). The lower panel shows the gait (i.e., suitable leg frequencies) after learning. A black area means that the leg touched the ground, and a white area indicates that the leg was in the air. In this setup, the robot learned to find a proper combination of oscillation frequencies of different legs for malfunction compensation. <bold>(D)</bold> Implementation of multiple CPGs with foot contact feedback on a hexapod robot. This setup does not have predefined coordination between the CPGs. Intralimb coordination emerges from the interactions between the body dynamics and the environment through foot contact feedback of each leg. <bold>(E)</bold> Example of the robot experiment dealing with a temporary handicapped situation. The ground reaction forces during movement of the robot with middle legs temporarily disabled show that the robot quickly adapted to a new gait (i.e., trot gait) and was able to continue walking properly. These figures were modified from Barikhan et al. (<xref ref-type="bibr" rid="B21">2014</xref>) and Ren et al. (<xref ref-type="bibr" rid="B134">2015</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0006.tif"/>
</fig>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>Machine learning approach for locomotion and damage recovery of a hexapod robot. <bold>(A)</bold> Robot setup. <bold>(B)</bold> Example of a behavior-performance map and its post-adaptation for damage recovery. Each colored pixel represents the highest-performing behavior discovered during map creation at that point in six-dimensional behavior space. <bold>(C)</bold> Robot adaptation using the trial-and-error algorithm to recover from leg damage. These figures were modified from Cully et al. (<xref ref-type="bibr" rid="B47">2015</xref>) with permission.</p></caption>
<graphic xlink:href="fnbot-11-00039-g0007.tif"/>
</fig>
</sec>
<sec>
<title>2.4. Task-dependent adaptation</title>
<p>Animals often encounter a situation in which they have to change locomotor behavior. For example, when an obstacle appears in a walking path, they step over the obstacle, or turn to the right or the left to avoid collision with the obstacle (this is also related to environment adaptation). Such a task is mainly generated by modulating the leg movements, and thus adaptive control of intralimb coordination is important. However, also important is adaptive control of interlimb coordination. To step over an obstacle, the leading limb first clears the obstacle and then the trailing limb follows it. The foot of the leading limb must be raised higher than usual to avoid collision with the obstacle, and this motion delays foot contact. Especially for bipedal and quadrupedal animals, the foot of the trailing limb must be raised after foot contact of the leading limb; otherwise, the obstacle avoidance task will fail because the contralateral limb does not support the body at the onset of raising the trailing limb (Aoi et al., <xref ref-type="bibr" rid="B11">2013c</xref>).</p>
<p>Turning behavior to change walking direction is used for various tasks, such as target pursuit (Szczecinski et al., <xref ref-type="bibr" rid="B148">in press</xref>) and obstacle avoidance (Figures <xref ref-type="fig" rid="F4">4D</xref>, <xref ref-type="fig" rid="F5">5C</xref>). Knops et al. (<xref ref-type="bibr" rid="B102">2013</xref>) controlled a mechanical model of a stick insect&#x00027;s middle legs by using a neural network model based on Hodgkin Huxley dynamics and produced turning behavior with two different strategies observed in stick insects walking on a slippery surface: switching the inner middle leg from forward to sideward, or from forward to backward stepping. In Aoi et al. (<xref ref-type="bibr" rid="B14">2016</xref>), the turning maneuverability of a centipede-like multilegged robot was enhanced via straight walk instability induced by the Hopf bifurcation by changing the body axis flexibility. Although arthropods with sprawling legs have a low center of mass and thus cannot effectively lean, mammals with erect legs have a high center of mass and can use body leaning to help turning. The relative phase between legs in human turning shifts from anti-phase due to the left&#x02013;right asymmetry of the turning movement (Courtine and Schieppati, <xref ref-type="bibr" rid="B43">2003</xref>). In Aoi and Tsuchiya (<xref ref-type="bibr" rid="B16">2007</xref>), simple phase oscillators with local sensory feedback about foot contact information were used for turn walking of a biped robot, as was used for walking on a split-belt treadmill. The relative phase between legs shifted depending on the turning radius to compensate for the left&#x02013;right asymmetry induced by body leaning; this shift allowed the robot to achieve high turning performance.</p>
<p>The transition from quadrupedal gait to upright and bipedal gait is a challenging task for legged robots, because it requires drastic changes in locomotor movements (Asa et al., <xref ref-type="bibr" rid="B20">2009</xref>; Aoi et al., <xref ref-type="bibr" rid="B7">2012</xref>; Kobayashi et al., <xref ref-type="bibr" rid="B103">2015</xref>). In particular, because the robot has to raise its trunk so that the arms leave the ground, an adequate relationship between the supporting limb locations and the center of mass location is important. That is, adequate interlimb and trunk coordination is crucial; otherwise, the robot easily falls over. In Aoi et al. (<xref ref-type="bibr" rid="B7">2012</xref>), simple phase oscillators with sensory regulation by ground contact information of the arms and legs were used for a biped robot (Figures <xref ref-type="fig" rid="F8">8A,B</xref>). The controller was extended based on the concept of kinematic synergy (Freitas et al., <xref ref-type="bibr" rid="B62">2006</xref>; Ivanenko et al., <xref ref-type="bibr" rid="B95">2007</xref>; Latash, <xref ref-type="bibr" rid="B105">2008</xref>; Funato et al., <xref ref-type="bibr" rid="B73">2010</xref>) to change the robot movements for gait transition and allowed the robot to successfully change the gait from quadrupedal to upright and bipedal (Figure <xref ref-type="fig" rid="F8">8C</xref>).</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p>Gait transition of a biped robot from quadrupedal to upright and bipedal gait. <bold>(A)</bold> Biped robot. <bold>(B)</bold> Phase oscillator network with local sensory foot contact information for the biped robot. <bold>(C)</bold> Gait transition experiment. These figures were modified from Aoi et al. (<xref ref-type="bibr" rid="B7">2012</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0008.tif"/>
</fig>
<p>Legged robots are useful for search and rescue missions. In this case, the ground is not only irregular but also fragile, like an area with scattered debris and collapsed buildings, on which surfaces may collapse when put under external forces, such as the pressure from a robot&#x00027;s leg. It is important to check the ground condition in such situations by using haptic information of the legs to secure stable walking. In Ambe and Matsuno (<xref ref-type="bibr" rid="B5">2016</xref>), a control mechanism with haptic sensory feedback for terrain determination was proposed. With the control mechanism, a quadruped robot can sense whether the foothold is stable through its force sensor when it puts its leg on the ground. In addition, this mechanism produces adequate interlimb coordination so that the robot never stumbles, even if the foothold collapses in the probe motion. As a result, the robot can effectively walk on unstable terrain and avoid stumbling and causing a large collapse of the surrounding area (Figure <xref ref-type="fig" rid="F9">9</xref>). Other methods have also been proposed to estimate fragile and slippery footholds based on haptic feedbacks and image information (Tokuda et al., <xref ref-type="bibr" rid="B152">2003</xref>; Hoepflinger et al., <xref ref-type="bibr" rid="B87">2010</xref>, <xref ref-type="bibr" rid="B86">2013</xref>).</p>
<fig id="F9" position="float">
<label>Figure 9</label>
<caption><p>Walking on fragile irregular terrain. <bold>(A)</bold> Quadruped robot with load sensors on feet. <bold>(B)</bold> Process to find footfold condition for fore right leg. The robot moves the center of mass by standing on all four legs, then swings a leg, and probes the foothold by applying force gradually. The robot repeats this process for each of the four legs. <bold>(C)</bold> Time response of normal reaction force of the leg in experiments. The robot applies force over a reference value <italic>R</italic><sub>ref</sub> in the grope phase to ensure that the ground is solid enough for walking, but the robot never applies force over <italic>R</italic><sub>ref</sub> in the other phases. These figures were modified from Ambe and Matsuno (<xref ref-type="bibr" rid="B5">2016</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0009.tif"/>
</fig>
</sec>
</sec>
<sec id="s3">
<title>3. Characteristic properties of adaptive interlimb coordination</title>
<sec>
<title>3.1. Hysteresis in gait transition</title>
<p>As discussed in Section 2.1, animals change their walking patterns depending on their locomotion speed. In general, locomotion speed has a large sudden change at gait transition in overground walking. However, using treadmills, which can control gait speed, we can investigate the speed-dependent gait transition mechanism by smoothly and continuously changing the belt speed of the treadmills. It has been reported in humans and some quadruped animals that the gait changes at different speeds depending on whether the speed is increasing or decreasing, and that a speed range exists in which different gaits are used. In other words, gait transitions may exhibit hysteresis (Diedrich et al., <xref ref-type="bibr" rid="B52">1998</xref>; Heglund and Taylor, <xref ref-type="bibr" rid="B84">1998</xref>; Raynor et al., <xref ref-type="bibr" rid="B133">2002</xref>; Griffin et al., <xref ref-type="bibr" rid="B80">2004</xref>). Figure <xref ref-type="fig" rid="F10">10A</xref> shows the relative phase between the right front and hind legs of a dog walking on a treadmill for walk-to-trot and trot-to-walk transitions induced by changing the belt speed (Aoi et al., <xref ref-type="bibr" rid="B10">2013b</xref>). This figure shows hysteresis in the walk&#x02013;trot transition. Such a phenomenon is difficult to explain by triggering the gait transition based on metabolic and biomechanical factors. The dynamical system approach might provide useful insights into such a gait transition mechanism (Diedrich et al., <xref ref-type="bibr" rid="B52">1998</xref>).</p>
<fig id="F10" position="float">
<label>Figure 10</label>
<caption><p>Hysteresis in the walk&#x02013;trot transition. <bold>(A)</bold> Relative phases of ipsilateral legs of a dog for walk-to-trot and trot-to-walk transitions induced by changing the belt speed. <bold>(B)</bold> Relative phases of a quadruped robot for walk-to-trot and trot-to-walk transitions induced by changing the locomotion speed. The three speeds indicated by vertical dotted lines are used in <bold>(C)</bold>. <bold>(C)</bold> Stability analyses using return maps for the relative phases at three speeds. The bold lines are approximated polynomial functions of the return maps. <bold>(D)</bold> Estimated stable and unstable relative phases from the stability analyses showing two saddle-node bifurcations. <bold>(E)</bold> Possible potential function that shows hysteresis. These figures were modified from Aoi et al. (<xref ref-type="bibr" rid="B10">2013b</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0010.tif"/>
</fig>
<p>Quadruped robots controlled by simple phase oscillators with local sensory foot contact information, as introduced in Section 2.1, showed hysteresis in the walk&#x02013;trot transition induced by changing the locomotion speed (Figure <xref ref-type="fig" rid="F10">10B</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>). Because walking and trotting gaits are mainly distinguished by the relative phases of the ipsilateral legs, a stability analysis using the return maps of the relative phases clarified the stability structure of the gaits. Figure <xref ref-type="fig" rid="F10">10C</xref> shows the return maps obtained at three different speeds. While only one stable relative phase exists in the left and right figures, two stable and one unstable relative phases exist in the middle figure. The stable and unstable relative phases explain that hysteresis is generated through two saddle-node bifurcations induced by changing the locomotion speed (Figure <xref ref-type="fig" rid="F10">10D</xref>). From this result, a potential function is derived, as shown in Figure <xref ref-type="fig" rid="F10">10E</xref>. It suggests that gait transition is explained by switching the stability of self-organized patterns in the complex dynamical system.</p>
<p>Gait transition hysteresis also appears in other legged robots controlled by CPG models with sensory feedback, e.g., in the walk&#x02013;run transition of a biped model (Taga and Shimizu, <xref ref-type="bibr" rid="B150">1991</xref>) and the metachronal&#x02013;tripod gait transition of hexapod robots (Kimura et al., <xref ref-type="bibr" rid="B99">1993</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>; note that insects do not clearly show abrupt transitions, but a continuum of locomotion patterns).</p>
</sec>
<sec>
<title>3.2. Two different time-scale adaptations</title>
<p>When the environment suddenly changes, locomotor behavior is rapidly modulated to adapt to the environmental variation and successively shows gradual regulation for gaining a new locomotor pattern. This behavior suggests that motor learning occurs. This has been observed in interlimb coordination during locomotion. In particular, the split-belt treadmill walking mentioned above is a good example.</p>
<p>The regulation of motor behavior in split-belt treadmill walking appears in various locomotor factors. However, the factors related to interlimb coordination, such as the relative phase between the legs, step length, and center of pressure profile, and those related to intralimb coordination, such as the duty factor and stride length, show different trends (Figure <xref ref-type="fig" rid="F11">11</xref>). A sudden environmental variation rapidly changes the factors; this is called &#x0201C;early adaptation&#x0201D;. Although the intralimb coordination factors do not show further change, the interlimb coordination factors tend to gradually return to their original state after early adaptation; this is called &#x0201C;late adaptation&#x0201D;. This means that interlimb coordination has two types of adaptations with different time scales. Furthermore, when the environment is returned its original state, the interlimb coordination factors move in the opposite direction to the early adaptation, which shows the after-effects.</p>
<fig id="F11" position="float">
<label>Figure 11</label>
<caption><p>Changes in locomotor factors during human split-belt treadmill walking, where the belt speed condition changes from the tied to the split-belt configuration (adaptation period) and returns to the tied configuration (post-adaptation period). <bold>(A)</bold> Relative phase between legs as one of the interlimb coordination factors. This shows both early and late adaptations when the environmental change occurs. When the environment is returned, after-effects appear. <bold>(B)</bold> Duty factor of the legs as one of the intralimb coordination factors. This shows only early adaptation when the environment changes. These figures were modified from Fujiki et al. (<xref ref-type="bibr" rid="B67">2015</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0011.tif"/>
</fig>
<p>Rapid changes in the locomotor factors have been observed during split-belt treadmill walking of spinal cats (Forssberg et al., <xref ref-type="bibr" rid="B60">1980</xref>; Frigon et al., <xref ref-type="bibr" rid="B63">2013</xref>). These rapid changes suggest that early adaptation is induced by sensorimotor interaction in the spinal cord. On the other hand, humans with cerebellar damage do not show late adaptation or after-effects during split-belt treadmill walking, and it appears that the cerebellum contributes to late adaptation and the after-effects (Morton and Bastian, <xref ref-type="bibr" rid="B118">2006</xref>; although split-belt experiments have been performed for arthropods (B&#x000E4;ssler and Wegner, <xref ref-type="bibr" rid="B24">1983</xref>; Foth and Graham, <xref ref-type="bibr" rid="B61">1983</xref>; M&#x000FC;ller and Cruse, <xref ref-type="bibr" rid="B119">1991a</xref>,<xref ref-type="bibr" rid="B120">b</xref>), the results showed that they do not necessarily need learning, which may underestimate their adaptation ability). Otoda et al. (<xref ref-type="bibr" rid="B125">2009</xref>) modeled the stepping reflex to modulate the touchdown angle of the swing leg and introduced the adjustment of proportional control gain at the hip joint of the stance leg as the cerebellar function producing split-belt treadmill walking of a two-dimensional biped robot, although they did not use a CPG model with adaptation. In contrast, Fujiki et al. (<xref ref-type="bibr" rid="B67">2015</xref>) incorporated a cerebellar learning model into the spinal CPG model (Figure <xref ref-type="fig" rid="F12">12B</xref>). The CPG model was composed of simple phase oscillators with sensory reflex by local foot contact information and was used in Fujiki et al. (<xref ref-type="bibr" rid="B68">2013b</xref>) as mentioned above. The learning model modulated the foot contact timing of each leg through the evaluation of prediction error by using the local sensory foot contact information of each leg. Biped robot experiments on a split-belt treadmill (Figure <xref ref-type="fig" rid="F12">12A</xref>) showed adaptive intralimb and interlimb coordination (Figures <xref ref-type="fig" rid="F12">12C,D</xref>). In particular, despite the lack of direct interlimb coordination control, early and late adaptations and after-effects were observed in interlimb coordination, and showed strong similarities to those observed in humans.</p>
<fig id="F12" position="float">
<label>Figure 12</label>
<caption><p>Split-belt treadmill walking experiment of a biped robot. <bold>(A)</bold> Biped robot and split-belt treadmill. <bold>(B)</bold> Spinal CPG and cerebellar learning models using simple phase oscillators with sensory reflex by local foot contact information and modulation of foot contact timing through the evaluation of prediction error. <bold>(C)</bold> Relative phase between legs of the biped robot. <bold>(D)</bold> Duty factor of legs of the biped robot. These figures were modified from Fujiki et al. (<xref ref-type="bibr" rid="B67">2015</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0012.tif"/>
</fig>
<p>Rapid modulation by the sensory reflex model and gradual modulation by the learning model changed the pitching moment depending on the belt speed condition through the body dynamics of the robot (Figure <xref ref-type="fig" rid="F13">13</xref>). The pitching moment change induced spatiotemporal modification of the robot movements and altered various locomotor factors. The sensory reflex model secured the ability to continue walking against the environmental change, and the cerebellar learning model modulated the robot movements under those conditions to make walking smoother and more efficient through optimization (minimization of prediction error of foot contact timing). For simple human behaviors, such as arm reaching movements, learning models that aim to minimize jerk or torque-change have been proposed (Flash and Hogan, <xref ref-type="bibr" rid="B58">1985</xref>; Uno et al., <xref ref-type="bibr" rid="B156">1989</xref>). However, for human locomotion, it remains unclear what factors are predicted and how to facilitate the learning. This is partly because locomotion is a whole-body movement through limb movement and posture controls, and is governed by complicated dynamics including foot contact and lift off, which change the physical constraints. Robot experiments with neurophysiologically inspired control models are useful for examining potential control models through the comparison of results obtained from human measured data and clarification of dynamical mechanisms.</p>
<fig id="F13" position="float">
<label>Figure 13</label>
<caption><p>Pitching moment change due to belt-speed change <bold>(A&#x02013;E)</bold> through sensory reflex and learning regarding foot contact timing. These figures were modified from Fujiki et al. (<xref ref-type="bibr" rid="B67">2015</xref>).</p></caption>
<graphic xlink:href="fnbot-11-00039-g0013.tif"/>
</fig>
</sec>
</sec>
<sec id="s4">
<title>4. Key factors and mechanisms for adaptive interlimb coordination</title>
<p>In the previous sections, we presented adaptive interlimb coordination of animals and legged robots to deal with different locomotion speeds, environmental situations, body properties, and tasks. Here, we discuss key factors and mechanisms underlying the adaptive control of interlimb coordination.</p>
<p>One of the key mechanisms is the CPGs, which are located in the spinal cord of vertebrates and in the thoracic ganglia of invertebrates. Except for the anti-phase activity of antagonistic excitatory motoneurones, no feature of the pilocarpine-induced rhythm appears to correspond to any motor output observed in stick insects (B&#x000FC;schges et al., <xref ref-type="bibr" rid="B37">1995</xref>). However, neurophysiological studies have revealed that CPGs are important for locomotion (Grillner, <xref ref-type="bibr" rid="B81">1975</xref>; Orlovsky et al., <xref ref-type="bibr" rid="B124">1999</xref>; MacKay-Lyons, <xref ref-type="bibr" rid="B109">2002</xref>). A CPG is a group of interconnected neurons that can be activated to generate a motor pattern without the requirement of sensory feedback. As described in Ijspeert (<xref ref-type="bibr" rid="B92">2008</xref>), various CPG models with different levels of complexity have been proposed, from detailed biophysical models using Hodgkin-Huxley neurons (Traven et al., <xref ref-type="bibr" rid="B154">1993</xref>; Cataldo et al., <xref ref-type="bibr" rid="B40">2006</xref>; Holmes et al., <xref ref-type="bibr" rid="B88">2006</xref>; Bungay and Campbell, <xref ref-type="bibr" rid="B34">2009</xref>) and connectionist models using leaky-integrator neurons or integrate-and-fire neurons (Buchanan, <xref ref-type="bibr" rid="B31">1992</xref>; Arena, <xref ref-type="bibr" rid="B19">2000</xref>) to abstract models using coupled oscillators (Ijspeert et al., <xref ref-type="bibr" rid="B93">2007</xref>; Chung and Slotine, <xref ref-type="bibr" rid="B41">2010</xref>; Yu et al., <xref ref-type="bibr" rid="B163">2014</xref>). Although some robot studies have shown that complex insect behavior, such as continuous gait transition, walking over irregular ground including a large gap, and curve walking with an irregular step pattern, can be replicated without CPG models (Cruse et al., <xref ref-type="bibr" rid="B46">1998</xref>; Lewinger and Quinn, <xref ref-type="bibr" rid="B106">2011</xref>; Schilling et al., <xref ref-type="bibr" rid="B138">2013a</xref>,<xref ref-type="bibr" rid="B139">b</xref>), these CPG models have improved locomotion control of legged robots, such as the control of speed (Ijspeert, <xref ref-type="bibr" rid="B92">2008</xref>) and robustness against sensory noise as well as sensory failure (Di Canio et al., <xref ref-type="bibr" rid="B51">2016</xref>). In particular, key issues for controlling legged robots are design of feedforward and feedback controllers and integration of these controllers. The CPG models give us useful ideas for the design and integration so that the integrated controller works in a biologically plausible fashion (comparison between the controllers with and without CPG models would be useful to find the contribution of the CPG models).</p>
<p>Most research has employed abstract CPG models with hardwired connections to motor units for generating different basic locomotor behaviors, such as walking and swimming. Switching between different gaits or locomotion modes can be done by using simple external input signals (Kirchner et al., <xref ref-type="bibr" rid="B101">2002</xref>; Ijspeert et al., <xref ref-type="bibr" rid="B93">2007</xref>; Manoonpong et al., <xref ref-type="bibr" rid="B112">2008</xref>). Though CPGs acting as open-loop control are the key for production of basic rhythmic locomotion, sensory feedback is a very important factor needed for adaptations to different speeds, environments, bodies, and tasks, as described in previous sections for adaptive interlimb coordination. Combining CPGs with sensory feedback results in closed-loop control with adaptability. For robotic implementation, different sensory feedback affecting CPG activities includes proprioceptive feedback (e.g., joint/leg movement and force) and exteroceptive feedback (e.g., foot contact and vision). Such feedback can modulate the frequency, phase, and magnitude of CPG activities [see review by Buschmann et al. (<xref ref-type="bibr" rid="B38">2015</xref>)].</p>
<p>Frequency modulation (also known as entrainment, Buchli et al., <xref ref-type="bibr" rid="B33">2006</xref>) uses feedback information to adapt the frequency of the CPG so that the frequencies of the feedback and the CPG are synchronized (Nachstedt et al., <xref ref-type="bibr" rid="B122">2017</xref>). Usually, joint angle feedback is used for this process in robotics studies (Endo et al., <xref ref-type="bibr" rid="B56">2004</xref>; Buchli and Ijspeert, <xref ref-type="bibr" rid="B32">2008</xref>; Di Canio et al., <xref ref-type="bibr" rid="B50">2016</xref>) and frequency modulation has been mainly employed for adaptations of locomotion speed (Harischandra et al., <xref ref-type="bibr" rid="B83">2011</xref>; Di Canio et al., <xref ref-type="bibr" rid="B51">2016</xref>) and body change (Ren et al., <xref ref-type="bibr" rid="B134">2015</xref>). In contrast, phase modulation typically uses foot contact and foot loading feedbacks to adjust the phase of CPGs to regulate the swing and stance phase durations, depending on the situation. In particular, the phase resetting mechanism, which has often been used for phase modulation in legged robots, was developed from the phase shift and rhythm resetting behaviors by the tactile sensor feedback in cats (Conway et al., <xref ref-type="bibr" rid="B42">1987</xref>; Duysens, <xref ref-type="bibr" rid="B55">1997</xref>; Schomburg et al., <xref ref-type="bibr" rid="B142">1998</xref>; Rybak et al., <xref ref-type="bibr" rid="B135">2006</xref>; Frigon et al., <xref ref-type="bibr" rid="B64">2010</xref>) and stick insects (B&#x000FC;schges, <xref ref-type="bibr" rid="B35">1995</xref>; B&#x000E4;ssler and B&#x000FC;schges, <xref ref-type="bibr" rid="B23">1998</xref>). The functional role of phase resetting has been investigated by the integration with musculoskeletal models and muscle synergy hypothesis (Aoi et al., <xref ref-type="bibr" rid="B12">2010</xref>, <xref ref-type="bibr" rid="B11">2013c</xref>; Aoi and Funato, <xref ref-type="bibr" rid="B9">2016</xref>), and the control strategy was implemented in legged robots and helped to improved the robustness of their walking (Tsuchiya et al., <xref ref-type="bibr" rid="B155">2002</xref>; Aoi and Tsuchiya, <xref ref-type="bibr" rid="B15">2005</xref>, <xref ref-type="bibr" rid="B16">2007</xref>; Nomura et al., <xref ref-type="bibr" rid="B123">2009</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B7">2012</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>; Ambe et al., <xref ref-type="bibr" rid="B6">2013</xref>, <xref ref-type="bibr" rid="B4">2015</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>,<xref ref-type="bibr" rid="B68">b</xref>, <xref ref-type="bibr" rid="B67">2015</xref>). Phase modulation has also been widely used for different adaptations including locomotion speed (Tsuchiya et al., <xref ref-type="bibr" rid="B155">2002</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>; Ambe et al., <xref ref-type="bibr" rid="B6">2013</xref>, <xref ref-type="bibr" rid="B4">2015</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>; Owaki et al., <xref ref-type="bibr" rid="B126">2013</xref>; Fukuoka et al., <xref ref-type="bibr" rid="B69">2015</xref>; Owaki and Ishiguro, <xref ref-type="bibr" rid="B127">2017</xref>), environmental condition (Aoi and Tsuchiya, <xref ref-type="bibr" rid="B15">2005</xref>; Aoi et al., <xref ref-type="bibr" rid="B12">2010</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>,<xref ref-type="bibr" rid="B68">b</xref>, <xref ref-type="bibr" rid="B67">2015</xref>), body properties (Tsuchiya et al., <xref ref-type="bibr" rid="B155">2002</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>; Owaki et al., <xref ref-type="bibr" rid="B126">2013</xref>; Barikhan et al., <xref ref-type="bibr" rid="B21">2014</xref>), and task (Aoi and Tsuchiya, <xref ref-type="bibr" rid="B16">2007</xref>; Aoi et al., <xref ref-type="bibr" rid="B7">2012</xref>, <xref ref-type="bibr" rid="B11">2013c</xref>). Magnitude modulation uses different types of feedback, such as force and vision, to regulate the magnitude of the CPG. This regulation is indirectly achieved through premotor neuron networks (Buschmann et al., <xref ref-type="bibr" rid="B38">2015</xref>). Goldschmidt et al. (<xref ref-type="bibr" rid="B75">2014</xref>) and Grinke et al. (<xref ref-type="bibr" rid="B82">2015</xref>) employed this strategy by using visual feedback for environment-dependent adaptation, such as hexapod robots climbing over an obstacle or turning away from it.</p>
<p>One can also achieve adaptive interlimb coordination by integrating these CPG modulation techniques with other bio-inspired approaches, such as adaptive muscle stiffness control (Xiong et al., <xref ref-type="bibr" rid="B161">2015</xref>). Manoonpong et al. (<xref ref-type="bibr" rid="B111">2013</xref>) showed that bio-inspired forward models that translate motor commands or efference copies into expected sensory feedback are important components for environment-dependent adaptation, i.e., walking on different terrains. By using a split-belt treadmill, Fujiki et al. (<xref ref-type="bibr" rid="B67">2015</xref>) showed that cerebellar learning models to regulate motor commands while minimizing the prediction error are also important for environment-dependent adaptation. Table <xref ref-type="table" rid="T1">1</xref> roughly categorizes the key mechanisms that have been used for different adaptations.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Key mechanisms used for different adaptations.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Adaptation</bold></th>
<th valign="top" align="left"><bold>Key mechanism</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Speed-dependent</td>
<td valign="top" align="left">CF, CP, PF</td>
</tr>
<tr>
<td valign="top" align="left">Environment-dependent</td>
<td valign="top" align="left">CF, CP, PF, CP&#x0002B;LM, CPG&#x0002B;FM, CPG&#x0002B;FM&#x0002B;MS</td>
</tr>
<tr>
<td valign="top" align="left">Body-dependent</td>
<td valign="top" align="left">CF, CP, PF, ML</td>
</tr>
<tr>
<td valign="top" align="left">Task-dependent</td>
<td valign="top" align="left">CP, CM, PF</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>CPG, Central pattern generator; CF, CPG frequency modulation; CP, CPG phase modulation; CM, CPG magnitude modulation; PF, Pure feedback; FM, Forward model; LM, Learning model; MS, Muscle stiffness adaptation; ML, Other machine learning approaches</italic>.</p>
</table-wrap-foot>
</table-wrap>
<p>In addition to these bio-inspired key factors (CPGs, sensory feedbacks, forward model, learning model, and muscle stiffness), which are usually applied to independent control of individual legs or joints, most of the studies explicitly design complete interlimb connections to obtain the desired locomotor behaviors. This results in limitations of adaptive and flexible interlimb coordination (e.g., Kirchner et al., <xref ref-type="bibr" rid="B101">2002</xref>; Ijspeert et al., <xref ref-type="bibr" rid="B93">2007</xref>; Harischandra et al., <xref ref-type="bibr" rid="B83">2011</xref>; Manoonpong et al., <xref ref-type="bibr" rid="B111">2013</xref>; Ren et al., <xref ref-type="bibr" rid="B134">2015</xref>). To overcome these limitations, a proposed alternative paradigm achieves interlimb coordination by local sensing, body-environment interactions, and weakly-coupled or decoupled CPGs (Tsuchiya et al., <xref ref-type="bibr" rid="B155">2002</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>; Shim and Husbands, <xref ref-type="bibr" rid="B144">2012</xref>; Ambe et al., <xref ref-type="bibr" rid="B6">2013</xref>, <xref ref-type="bibr" rid="B4">2015</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>; Owaki et al., <xref ref-type="bibr" rid="B126">2013</xref>; Barikhan et al., <xref ref-type="bibr" rid="B21">2014</xref>; Owaki and Ishiguro, <xref ref-type="bibr" rid="B127">2017</xref>), rather than by predefined interlimb connections. Although the proposed paradigm leads to high flexibility and adaptability in interlimb coordination, it sometimes encounters unstable locomotion. Phase resetting, which modulates the CPG phase based on the sensory reflex, as mentioned above, is one of the solutions to obtain flexible and adaptive interlimb coordination while keeping stability in locomotion (Tsuchiya et al., <xref ref-type="bibr" rid="B155">2002</xref>; Aoi and Tsuchiya, <xref ref-type="bibr" rid="B16">2007</xref>; Aoi et al., <xref ref-type="bibr" rid="B17">2011</xref>, <xref ref-type="bibr" rid="B7">2012</xref>, <xref ref-type="bibr" rid="B10">2013b</xref>,<xref ref-type="bibr" rid="B11">c</xref>; Ambe et al., <xref ref-type="bibr" rid="B6">2013</xref>, <xref ref-type="bibr" rid="B4">2015</xref>; Fujiki et al., <xref ref-type="bibr" rid="B66">2013a</xref>,<xref ref-type="bibr" rid="B68">b</xref>, <xref ref-type="bibr" rid="B67">2015</xref>). However, this uses only phase modulation and has limitations. Thus, one future research study in this direction is to find a method that can autonomously form the plastic connections for stable but still flexible and adaptive locomotion. Furthermore, the interactions of CPGs, sensory feedback, body dynamics, forward model, learning model, and muscle stiffness for highly adaptive, robust, and energy-efficient locomotion remain to be explored.</p>
</sec>
<sec sec-type="conclusions" id="s5">
<title>5. Conclusion</title>
<p>Although walking animals create adaptive locomotor behavior by skillfully manipulating their complicated and redundant musculoskeletal systems, the underlying mechanisms are still unclear. Designing the control architecture for legged robots to autonomously achieve such adaptability is still a challenge. Although some legged robots produced adaptive locomotor behaviors by purely engineering approaches without inspiration from biological systems, neurophysiological findings such as CPG organizations and sensorimotor interactions are useful for designing the control system of legged robots. Robot experiments with CPG models and sensory feedbacks are insightful from a dynamic viewpoint for understanding gait generation and adaptation in a self-organizing manner among neural dynamics, body dynamics, and environment. In this review, we showed adaptive interlimb coordination in the locomotion of animals and legged robots induced by various factors, such as locomotion speed, environmental situation, body properties, and tasks. We also showed characteristic properties of adaptive interlimb coordination, such as gait hysteresis and different time-scale adaptations. Legged robots are becoming a valuable tool for understanding the locomotion mechanism including interlimb coordination. In the future, together with the improvement of robotics systems, such as actuators and sensors, it will be important to enhance biological plausibility and feasibility by the integration with sophisticated models of neural and musculoskeletal systems, such as the Hodgkin-Huxley model and the muscle-tendon unit model, and to extract dynamical features by integration with simple models, such as the template model (Full and Koditschek, <xref ref-type="bibr" rid="B72">1999</xref>; Holmes et al., <xref ref-type="bibr" rid="B88">2006</xref>). Furthermore, it will also be important to further improve and develop analytical methods, such as phase reduction theory (Kuramoto, <xref ref-type="bibr" rid="B104">1984</xref>) and synergy analysis (Ivanenko et al., <xref ref-type="bibr" rid="B96">2004</xref>; Latash, <xref ref-type="bibr" rid="B105">2008</xref>), to clarify essential factors from multiple and redundant data.</p>
</sec>
<sec id="s6">
<title>Author contributions</title>
<p>SA and PM contributed to the conception and design of the paper. SA, PM, and YA reviewed the relevant literature and wrote the paper. FM and FW revised the paper critically for important intellectual content. All authors approved the paper for publication.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back>
<ack><p>This paper is supported in part by Grant-in-Aid for Young Scientists (A) 17H04914 from the Ministry of Education, Culture, Sports, Science, and Technology (MEXT) of Japan, by the Inamori Foundation, Japan, by the Kyoto Technoscience Center, Japan, and by the Centre for BioRobotics (CBR) at the University of Southern Denmark (SDU, Denmark).</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aguilar</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>T.</given-names></name> <name><surname>Qian</surname> <given-names>F.</given-names></name> <name><surname>Kingsbury</surname> <given-names>M.</given-names></name> <name><surname>McInroe</surname> <given-names>B.</given-names></name> <name><surname>Mazouchova</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>A review on locomotion robophysics: the study of movement at the intersection of robotics, soft matter and dynamical systems</article-title>. <source>Rep. Prog. Phys.</source> <volume>79</volume>:<fpage>110001</fpage>. <pub-id pub-id-type="doi">10.1088/0034-4885/79/11/110001</pub-id><pub-id pub-id-type="pmid">27652614</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alexander</surname> <given-names>R. M. C. N.</given-names></name></person-group> (<year>1988</year>). <article-title>Why mammals gallop</article-title>. <source>Am. Zool.</source> <volume>28</volume>, <fpage>237</fpage>&#x02013;<lpage>245</lpage>. <pub-id pub-id-type="doi">10.1093/icb/28.1.237</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alexander</surname> <given-names>R. M. C. N.</given-names></name> <name><surname>Jayes</surname> <given-names>A. S.</given-names></name></person-group> (<year>1983</year>). <article-title>A dynamic similarity hypothesis for the gaits of quadrupedal mammals</article-title>. <source>J. Zool. Lond.</source> <volume>201</volume>, <fpage>135</fpage>&#x02013;<lpage>152</lpage>. <pub-id pub-id-type="doi">10.1111/j.1469-7998.1983.tb04266.x</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ambe</surname> <given-names>Y.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Nachstedt</surname> <given-names>T.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Matsuno</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>Embodied sensorimotor interaction for hexapod locomotion</article-title>, in <source>Proceedings of International Symposium on Swarm Behavior Bio-Inspired Robotics</source> (<publisher-loc>Kyoto</publisher-loc>), <fpage>340</fpage>&#x02013;<lpage>343</lpage>.</citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ambe</surname> <given-names>Y.</given-names></name> <name><surname>Matsuno</surname> <given-names>F.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Leg-grope walk&#x0201D;: strategy for walking on fragile irregular slopes as a quadruped robot by force distribution</article-title>. <source>Robomech. J.</source> <volume>3</volume>:<fpage>7</fpage>. <pub-id pub-id-type="doi">10.1186/s40648-016-0046-2</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Ambe</surname> <given-names>Y.</given-names></name> <name><surname>Nachstedt</surname> <given-names>T.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Matsuno</surname> <given-names>F.</given-names></name></person-group> (<year>2013</year>). <article-title>Stability analysis of a hexapod robot driven by distributed nonlinear oscillators with a phase modulation mechanism</article-title>, in <source>Proceedings of IEEE/RSJ International Conference on Intelligent Robots System</source> (<publisher-loc>Tokyo</publisher-loc>), <fpage>5087</fpage>&#x02013;<lpage>5092</lpage>.</citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Egi</surname> <given-names>Y.</given-names></name> <name><surname>Sugimoto</surname> <given-names>R.</given-names></name> <name><surname>Yamashita</surname> <given-names>T.</given-names></name> <name><surname>Fujiki</surname> <given-names>S.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2012</year>). <article-title>Functional roles of phase resetting in the gait transition of a biped robot from quadrupedal to bipedal locomotion</article-title>. <source>IEEE Trans. Robot.</source> <volume>28</volume>, <fpage>1244</fpage>&#x02013;<lpage>1259</lpage>. <pub-id pub-id-type="doi">10.1109/TRO.2012.2205489</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Egi</surname> <given-names>Y.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2013a</year>). <article-title>Instability-based mechanism for body undulations in centipede locomotion</article-title>. <source>Phys. Rev. E</source> <volume>87</volume>:<fpage>012717</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.87.012717</pub-id><pub-id pub-id-type="pmid">23410369</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). <article-title>Neuromusculoskeletal models based on the muscle synergy hypothesis for the investigation of adaptive motor control in locomotion via sensory-motor coordination</article-title>. <source>Neurosci. Res.</source> <volume>104</volume>, <fpage>88</fpage>&#x02013;<lpage>95</lpage>. <pub-id pub-id-type="doi">10.1016/j.neures.2015.11.005</pub-id><pub-id pub-id-type="pmid">26616311</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Katayama</surname> <given-names>D.</given-names></name> <name><surname>Fujiki</surname> <given-names>S.</given-names></name> <name><surname>Tomita</surname> <given-names>N.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Yamashita</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2013b</year>). <article-title>A stability-based mechanism for hysteresis in the walk&#x02013;trot transition in quadruped locomotion</article-title>. <source>J. R. Soc. Interface</source> <volume>10</volume>:<fpage>20120908</fpage>. <pub-id pub-id-type="doi">10.1098/rsif.2012.0908</pub-id><pub-id pub-id-type="pmid">23389894</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Kondo</surname> <given-names>T.</given-names></name> <name><surname>Hayashi</surname> <given-names>N.</given-names></name> <name><surname>Yanagihara</surname> <given-names>D.</given-names></name> <name><surname>Aoki</surname> <given-names>S.</given-names></name> <name><surname>Yamaura</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2013c</year>). <article-title>Contributions of phase resetting and interlimb coordination to the adaptive control of hindlimb obstacle avoidance during locomotion in rats: a simulation study</article-title>. <source>Biol. Cybern.</source> <volume>107</volume>, <fpage>201</fpage>&#x02013;<lpage>216</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-013-0546-6</pub-id><pub-id pub-id-type="pmid">23430278</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Ogihara</surname> <given-names>N.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Sugimoto</surname> <given-names>Y.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>Evaluating functional roles of phase resetting in generation of adaptive human bipedal walking with a physiologically based model of the spinal pattern generator</article-title>. <source>Biol. Cybern.</source> <volume>102</volume>, <fpage>373</fpage>&#x02013;<lpage>387</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-010-0373-y</pub-id><pub-id pub-id-type="pmid">20217427</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Sasaki</surname> <given-names>H.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2007</year>). <article-title>A multilegged modular robot that meanders: investigation of turning maneuvers using its inherent dynamic characteristics <italic>SIAM J</italic></article-title>. <source>Appl. Dyn. Syst.</source> <volume>6</volume>, <fpage>348</fpage>&#x02013;<lpage>377</lpage>. <pub-id pub-id-type="doi">10.1137/060664756</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Tanaka</surname> <given-names>T.</given-names></name> <name><surname>Fujiki</surname> <given-names>S.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Senda</surname> <given-names>K.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2016</year>). <article-title>Advantage of straight walk instability in turning maneuver of multilegged locomotion: a robotics approach</article-title>. <source>Sci. Rep.</source> <volume>6</volume>:<fpage>30199</fpage>. <pub-id pub-id-type="doi">10.1038/srep30199</pub-id><pub-id pub-id-type="pmid">27444746</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2005</year>). <article-title>Locomotion control of a biped robot using nonlinear oscillators</article-title>. <source>Auton. Robots</source> <volume>19</volume>, <fpage>219</fpage>&#x02013;<lpage>232</lpage>. <pub-id pub-id-type="doi">10.1007/s10514-005-4051-1</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2007</year>). <article-title>Adaptive behavior in turning of an oscillator-driven biped robot</article-title>. <source>Auton. Robots</source> <volume>23</volume>, <fpage>37</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1007/s10514-007-9029-8</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Yamashita</surname> <given-names>T.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2011</year>). <article-title>Hysteresis in the gait transition of a quadruped investigated using simple body mechanical and oscillator network models</article-title>. <source>Phys. Rev. E</source> <volume>83</volume>:<fpage>061909</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.83.061909</pub-id><pub-id pub-id-type="pmid">21797405</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arena</surname> <given-names>E.</given-names></name> <name><surname>Arena</surname> <given-names>P.</given-names></name> <name><surname>Strauss</surname> <given-names>R.</given-names></name> <name><surname>Patan&#x000E9;</surname> <given-names>L.</given-names></name></person-group> (<year>2017</year>). <article-title>Motor-skill learning in an insect inspired neuro-computational control system</article-title>. <source>Front. Neurorobot.</source> <volume>11</volume>:<fpage>12</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2017.00012</pub-id><pub-id pub-id-type="pmid">28337138</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arena</surname> <given-names>P.</given-names></name></person-group> (<year>2000</year>). <article-title>The Central Pattern Generator: a paradigm for artificial locomotion</article-title>. <source>Soft Comput.</source> <volume>4</volume>, <fpage>251</fpage>&#x02013;<lpage>266</lpage>. <pub-id pub-id-type="doi">10.1007/s005000000051</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Asa</surname> <given-names>K.</given-names></name> <name><surname>Ishimura</surname> <given-names>K.</given-names></name> <name><surname>Wada</surname> <given-names>M.</given-names></name></person-group> (<year>2009</year>). <article-title>Behavior transition between biped and quadrupedwalking by using bifurcation</article-title>. <source>Robot. Auton. Syst.</source> <volume>57</volume>, <fpage>155</fpage>&#x02013;<lpage>160</lpage>. <pub-id pub-id-type="doi">10.1016/j.robot.2008.04.005</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Barikhan</surname> <given-names>S. S.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). <article-title>Multiple decoupled CPGs with local sensory feedback for adaptive locomotion behaviors of bio-inspired walking robots</article-title>, in <source>From Animals to Animats 13, Lecture Notes in Computer Science</source>, eds <person-group person-group-type="editor"><name><surname>del Pobil</surname> <given-names>A. P.</given-names></name> <name><surname>Chinellato</surname> <given-names>E.</given-names></name> <name><surname>Martinez-Martin</surname> <given-names>E.</given-names></name> <name><surname>Hallam</surname> <given-names>J.</given-names></name> <name><surname>Cervera</surname> <given-names>E.</given-names></name> <name><surname>Morales</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>65</fpage>&#x02013;<lpage>75</lpage>.</citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000E4;ssler</surname> <given-names>U.</given-names></name></person-group> (<year>1976</year>). <article-title>Reversal of a reflex to a single motoneuron in the stick insect Carausius morosus</article-title>. <source>Biol. Cybern.</source> <volume>24</volume>, <fpage>47</fpage>&#x02013;<lpage>49</lpage>. <pub-id pub-id-type="doi">10.1007/BF00365594</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000E4;ssler</surname> <given-names>U.</given-names></name> <name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name></person-group> (<year>1998</year>). <article-title>Pattern generation for stick insect walking movements&#x02013;multisensory control of a locomotor program</article-title>. <source>Brain Res. Rev.</source> <volume>27</volume>, <fpage>65</fpage>&#x02013;<lpage>88</lpage>. <pub-id pub-id-type="doi">10.1016/S0165-0173(98)00006-X</pub-id><pub-id pub-id-type="pmid">9639677</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000E4;ssler</surname> <given-names>U.</given-names></name> <name><surname>Wegner</surname> <given-names>U.</given-names></name></person-group> (<year>1983</year>). <article-title>Motor output of the denervated thoracic ventral nerve cord in the stick insect Carausius morosus</article-title>. <source>J. Exp. Biol.</source> <volume>105</volume>, <fpage>127</fpage>&#x02013;<lpage>145</lpage>.</citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bender</surname> <given-names>J. A.</given-names></name> <name><surname>Simpson</surname> <given-names>E. M.</given-names></name> <name><surname>Tietz</surname> <given-names>B. R.</given-names></name> <name><surname>Daltorio</surname> <given-names>K. A.</given-names></name> <name><surname>Quinn</surname> <given-names>R. D.</given-names></name> <name><surname>Ritzmann</surname> <given-names>R. E.</given-names></name></person-group> (<year>2011</year>). <article-title>Kinematic and behavioral evidence for a distinction between trotting and ambling gaits in the cockroach Blaberus discoidalis</article-title>. <source>J. Exp. Biol.</source> <volume>214</volume>, <fpage>2057</fpage>&#x02013;<lpage>2064</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.056481</pub-id><pub-id pub-id-type="pmid">21613522</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berendes</surname> <given-names>V.</given-names></name> <name><surname>Zill</surname> <given-names>S. N.</given-names></name> <name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name> <name><surname>Bockem&#x000FC;hl</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). <article-title>Speed-dependent interplay between local pattern-generating activity and sensory signals during walking in Drosophila</article-title>. <source>J. Exp. Biol.</source> <volume>219</volume>, <fpage>3781</fpage>&#x02013;<lpage>3793</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.146720</pub-id><pub-id pub-id-type="pmid">27688052</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blaesing</surname> <given-names>B.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>2004</year>). <article-title>Stick insect locomotion in a complex environment: climbing over large gaps</article-title>. <source>J. Exp. Biol.</source> <volume>207</volume>, <fpage>1273</fpage>&#x02013;<lpage>1286</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.00888</pub-id><pub-id pub-id-type="pmid">15010478</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bl&#x000E4;sing</surname> <given-names>B.</given-names></name></person-group> (<year>2006</year>). <article-title>Crossing large gaps: a simulation study of stick insect behavior</article-title>. <source>Adapt. Behav.</source> <volume>14</volume>, <fpage>265</fpage>&#x02013;<lpage>285</lpage>. <pub-id pub-id-type="doi">10.1177/105971230601400307</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bongard</surname> <given-names>J.</given-names></name> <name><surname>Zykov</surname> <given-names>V.</given-names></name> <name><surname>Lipson</surname> <given-names>H.</given-names></name></person-group> (<year>2006</year>). <article-title>Resilient machines through continuous self-modeling</article-title>. <source>Science</source> <volume>314</volume>, <fpage>1118</fpage>&#x02013;<lpage>1121</lpage>. <pub-id pub-id-type="doi">10.1126/science.1133687</pub-id><pub-id pub-id-type="pmid">17110570</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brown</surname> <given-names>T. G.</given-names></name></person-group> (<year>1911</year>). <article-title>The intrinsic factors in the act of progression in the mammal</article-title>. <source>Proc. R. Soc. Lond. B</source> <volume>84</volume>, <fpage>308</fpage>&#x02013;<lpage>319</lpage>. <pub-id pub-id-type="doi">10.1098/rspb.1911.0077</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buchanan</surname> <given-names>J. T.</given-names></name></person-group> (<year>1992</year>). <article-title>Neural network simulations of coupled locomotor oscillators in the lamprey spinal cord</article-title>. <source>Biol. Cybern.</source> <volume>66</volume>, <fpage>367</fpage>&#x02013;<lpage>374</lpage>. <pub-id pub-id-type="doi">10.1007/BF00203673</pub-id><pub-id pub-id-type="pmid">1550884</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buchli</surname> <given-names>J.</given-names></name> <name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name></person-group> (<year>2008</year>). <article-title>Self-organized adaptive legged locomotion in a compliant quadruped robot</article-title>. <source>Auton. Robots</source> <volume>25</volume>, <fpage>331</fpage>&#x02013;<lpage>347</lpage>. <pub-id pub-id-type="doi">10.1007/s10514-008-9099-2</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buchli</surname> <given-names>J.</given-names></name> <name><surname>Righetti</surname> <given-names>L.</given-names></name> <name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name></person-group> (<year>2006</year>). <article-title>Engineering entrainment and adaptation in limit cycle systems&#x02013;From biological inspiration to applications in robotics</article-title>. <source>Biol. Cybern.</source> <volume>95</volume>, <fpage>645</fpage>&#x02013;<lpage>664</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-006-0128-y</pub-id><pub-id pub-id-type="pmid">17146662</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bungay</surname> <given-names>S. D.</given-names></name> <name><surname>Campbell</surname> <given-names>S. A.</given-names></name></person-group> (<year>2009</year>). <article-title>Modelling a respiratory central pattern generator neuron in Lymnaea stagnalis</article-title>. <source>Can. Appl. Math. Quart.</source> <volume>17</volume>, <fpage>283</fpage>&#x02013;<lpage>291</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.math.ualberta.ca/ami/CAMQ/table_of_content/vol_17/17_2a.htm">http://www.math.ualberta.ca/ami/CAMQ/table_of_content/vol_17/17_2a.htm</ext-link></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name></person-group> (<year>1995</year>). <article-title>Role of local nonspiking interneurons in the generation of rhythmic motor activity in the stick insect</article-title>. <source>J. Neurobiol.</source> <volume>27</volume>, <fpage>488</fpage>&#x02013;<lpage>512</lpage>. <pub-id pub-id-type="doi">10.1002/neu.480270405</pub-id><pub-id pub-id-type="pmid">7561829</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name> <name><surname>Akay</surname> <given-names>T.</given-names></name> <name><surname>Gabriel</surname> <given-names>J. P.</given-names></name> <name><surname>Schmidt</surname> <given-names>J.</given-names></name></person-group> (<year>2008</year>). <article-title>Organizing network action for locomotion: insights from studying insect walking</article-title>. <source>Brain Res. Rev.</source> <volume>57</volume>, <fpage>162</fpage>&#x02013;<lpage>171</lpage>. <pub-id pub-id-type="doi">10.1016/j.brainresrev.2007.06.028</pub-id><pub-id pub-id-type="pmid">17888515</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name> <name><surname>Schmitz</surname> <given-names>J.</given-names></name> <name><surname>B&#x000E4;ssler</surname> <given-names>U.</given-names></name></person-group> (<year>1995</year>). <article-title>Rhythmic patterns in the thoracic nerve cord of the stick insect induced by pilocarpine</article-title>. <source>J. Exp. Biol.</source> <volume>198</volume>, <fpage>435</fpage>&#x02013;<lpage>456</lpage>. <pub-id pub-id-type="pmid">9318078</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buschmann</surname> <given-names>T.</given-names></name> <name><surname>Ewald</surname> <given-names>A.</given-names></name> <name><surname>von Twickel</surname> <given-names>A.</given-names></name> <name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name></person-group> (<year>2015</year>). <article-title>Controlling legs for locomotion&#x02013;insights from robotics and neurobiology</article-title>. <source>Bioinspir. Biomim.</source> <volume>10</volume>:<fpage>041001</fpage>. <pub-id pub-id-type="doi">10.1088/1748-3190/10/4/041001</pub-id><pub-id pub-id-type="pmid">26119450</pub-id></citation></ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Canavier</surname> <given-names>C. C.</given-names></name> <name><surname>Butera</surname> <given-names>R. J.</given-names></name> <name><surname>Dror</surname> <given-names>R. O.</given-names></name> <name><surname>Baxter</surname> <given-names>D. A.</given-names></name> <name><surname>Clark</surname> <given-names>J. W.</given-names></name> <name><surname>Byrne</surname> <given-names>J. H.</given-names></name></person-group> (<year>1997</year>). <article-title>Phase response characteristics of model neurons determine which patterns are expressed in a ring circuit model of gait generation</article-title>. <source>Biol. Cybern.</source> <volume>77</volume>, <fpage>367</fpage>&#x02013;<lpage>380</lpage>. <pub-id pub-id-type="doi">10.1007/s004220050397</pub-id><pub-id pub-id-type="pmid">9433752</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Cataldo</surname> <given-names>E.</given-names></name> <name><surname>Byrne</surname> <given-names>J. H.</given-names></name> <name><surname>Baxter</surname> <given-names>D. A.</given-names></name></person-group> (<year>2006</year>). <article-title>Computational model of a central pattern generator</article-title>, in <source>Computational Methods in Systems Biology, Lecture Notes in Computer Science</source>, ed <person-group person-group-type="editor"><name><surname>Priami</surname> <given-names>C.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>242</fpage>&#x02013;<lpage>256</lpage>.</citation></ref>
<ref id="B41">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Chung</surname> <given-names>S. J.</given-names></name> <name><surname>Slotine</surname> <given-names>J. J.</given-names></name></person-group> (<year>2010</year>). <article-title>On synchronization of coupled Hopf-Kuramoto oscillators with phase delays</article-title>, in <source>Proceedings of IEEE International Conference on Decision Control</source> (<publisher-loc>Atlanta, GA</publisher-loc>), <fpage>3181</fpage>&#x02013;<lpage>3187</lpage>.</citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Conway</surname> <given-names>B. A.</given-names></name> <name><surname>Hultborn</surname> <given-names>H.</given-names></name> <name><surname>Kiehn</surname> <given-names>O.</given-names></name></person-group> (<year>1987</year>). <article-title>Proprioceptive input resets central locomotor rhythm in the spinal cat</article-title>. <source>Exp. Brain Res.</source> <volume>68</volume>, <fpage>643</fpage>&#x02013;<lpage>656</lpage>. <pub-id pub-id-type="doi">10.1007/BF00249807</pub-id><pub-id pub-id-type="pmid">3691733</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Courtine</surname> <given-names>G.</given-names></name> <name><surname>Schieppati</surname> <given-names>M.</given-names></name></person-group> (<year>2003</year>). <article-title>Human walking along a curved path. II. Gait features and EMG patterns</article-title>. <source>Eur. J. Neurosci.</source> <volume>18</volume>, <fpage>191</fpage>&#x02013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.1046/j.1460-9568.2003.02737.x</pub-id><pub-id pub-id-type="pmid">12859352</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Couzin-Fuchs</surname> <given-names>E.</given-names></name> <name><surname>Kiemel</surname> <given-names>T.</given-names></name> <name><surname>Gal</surname> <given-names>O.</given-names></name> <name><surname>Ayali</surname> <given-names>A.</given-names></name> <name><surname>Holmes</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>Intersegmental coupling and recovery from perturbations in freely running cockroaches</article-title>. <source>J. Exp. Biol.</source> <volume>218</volume>, <fpage>285</fpage>&#x02013;<lpage>297</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.112805</pub-id><pub-id pub-id-type="pmid">25609786</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>1990</year>). <article-title>What mechanisms coordinate leg movement in walking arthropods?</article-title> <source>Trends Neurosci.</source> <volume>13</volume>, <fpage>15</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1016/0166-2236(90)90057-H</pub-id><pub-id pub-id-type="pmid">1688670</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cruse</surname> <given-names>H.</given-names></name> <name><surname>Kindermann</surname> <given-names>T.</given-names></name> <name><surname>Schumm</surname> <given-names>M.</given-names></name> <name><surname>Dean</surname> <given-names>J.</given-names></name> <name><surname>Schmitz</surname> <given-names>J.</given-names></name></person-group> (<year>1998</year>). <article-title>Walknet&#x02014;a biologically inspired network to control six-legged walking</article-title>. <source>Neural Netw.</source> <volume>11</volume>, <fpage>1435</fpage>&#x02013;<lpage>1447</lpage>. <pub-id pub-id-type="doi">10.1016/S0893-6080(98)00067-7</pub-id><pub-id pub-id-type="pmid">12662760</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cully</surname> <given-names>A.</given-names></name> <name><surname>Clune</surname> <given-names>J.</given-names></name> <name><surname>Tarapore</surname> <given-names>D.</given-names></name> <name><surname>Mouret</surname> <given-names>J.-B.</given-names></name></person-group> (<year>2015</year>). <article-title>Robots that can adapt like animals</article-title>. <source>Nature</source> <volume>521</volume>, <fpage>503</fpage>&#x02013;<lpage>507</lpage>. <pub-id pub-id-type="doi">10.1038/nature14422</pub-id><pub-id pub-id-type="pmid">26017452</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dasgupta</surname> <given-names>S.</given-names></name> <name><surname>Goldschmidt</surname> <given-names>D.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>Distributed recurrent neural forward models with synaptic adaptation and CPG-based control for complex behaviors of walking robots</article-title>. <source>Front. Neurorobot.</source> <volume>9</volume>:<fpage>10</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2015.00010</pub-id><pub-id pub-id-type="pmid">26441629</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Delcomyn</surname> <given-names>F.</given-names></name></person-group> (<year>1971</year>). <article-title>The locomotion of the cockroach <italic>Periplaneta americana</italic></article-title>. <source>J. Exp. Biol.</source> <volume>54</volume>, <fpage>443</fpage>&#x02013;<lpage>452</lpage>.</citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Di Canio</surname> <given-names>G.</given-names></name> <name><surname>Stoyanov</surname> <given-names>S.</given-names></name> <name><surname>Larsen</surname> <given-names>J.C.</given-names></name> <name><surname>Hallam</surname> <given-names>J.</given-names></name> <name><surname>Kovalev</surname> <given-names>A.</given-names></name> <name><surname>Kleinteich</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>A robot leg with compliant tarsus and its neural control for efficient and adaptive locomotion on complex terrains</article-title>. <source>Artif. Life Robot.</source> <volume>21</volume>, <fpage>274</fpage>&#x02013;<lpage>281</lpage>. <pub-id pub-id-type="doi">10.1007/s10015-016-0296-3</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Di Canio</surname> <given-names>G.</given-names></name> <name><surname>Stoyanov</surname> <given-names>S.</given-names></name> <name><surname>Balmori</surname> <given-names>I. T.</given-names></name> <name><surname>Larsen</surname> <given-names>J. C.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2016</year>). <article-title>Adaptive combinatorial neural control for robust locomotion of a biped robot</article-title>, in <source>From Animals to Animats 14, Lecture Notes in Computer Science</source>, eds <person-group person-group-type="editor"><name><surname>Tuci</surname> <given-names>E.</given-names></name> <name><surname>Giagkos</surname> <given-names>A.</given-names></name> <name><surname>Wilson</surname> <given-names>M.</given-names></name> <name><surname>Hallam</surname> <given-names>J.</given-names></name></person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>317</fpage>&#x02013;<lpage>328</lpage>.</citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Diedrich</surname> <given-names>F. J.</given-names></name> <name><surname>Warren</surname> <given-names>W. H.</given-names> <suffix>Jr.</suffix></name></person-group> (<year>1998</year>). <article-title>Why change gaits? Dynamics of the walk-run transition</article-title>. <source>J. Exp. Psychol. Hum. Percept. Perform.</source> <volume>21</volume>, <fpage>183</fpage>&#x02013;<lpage>202</lpage>. <pub-id pub-id-type="doi">10.1037/0096-1523.21.1.183</pub-id><pub-id pub-id-type="pmid">7707029</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dietz</surname> <given-names>Z.</given-names></name> <name><surname>Zijlstra</surname> <given-names>W.</given-names></name> <name><surname>Duysens</surname> <given-names>J.</given-names></name></person-group> (<year>1994</year>). <article-title>Human neuronal interlimb coordination during split-belt locomotion</article-title>. <source>Exp. Brain Res.</source> <volume>101</volume>, <fpage>513</fpage>&#x02013;<lpage>520</lpage>. <pub-id pub-id-type="doi">10.1007/BF00227344</pub-id><pub-id pub-id-type="pmid">7851518</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>D&#x000FC;rr</surname> <given-names>V.</given-names></name> <name><surname>Schmitz</surname> <given-names>J.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>2004</year>). <article-title>Behaviour-based modelling of hexapod locomotion: linking biology and technical application</article-title>. <source>Arth. Struct. Develop.</source> <volume>33</volume>, <fpage>237</fpage>&#x02013;<lpage>250</lpage>. <pub-id pub-id-type="doi">10.1016/j.asd.2004.05.004</pub-id><pub-id pub-id-type="pmid">18089037</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Duysens</surname> <given-names>J.</given-names></name></person-group> (<year>1997</year>). <article-title>Fluctuations in sensitivity to rhythm resetting effects during the cat&#x00027;s step cycle</article-title>. <source>Brain Res.</source> <volume>133</volume>, <fpage>190</fpage>&#x02013;<lpage>195</lpage>. <pub-id pub-id-type="doi">10.1016/0006-8993(77)90063-4</pub-id><pub-id pub-id-type="pmid">902087</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Endo</surname> <given-names>G.</given-names></name> <name><surname>Morimoto</surname> <given-names>J.</given-names></name> <name><surname>Nakanishi</surname> <given-names>J.</given-names></name> <name><surname>Cheng</surname> <given-names>G.</given-names></name></person-group> (<year>2004</year>). <article-title>An empirical exploration of a neural oscillator for biped locomotion control</article-title>, in <source>Proceedings of IEEE International Conference on Robotics and Automation</source> (<publisher-loc>New Orleans, LA</publisher-loc>), <fpage>3036</fpage>&#x02013;<lpage>3042</lpage>.</citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farley</surname> <given-names>C. T.</given-names></name> <name><surname>Taylor</surname> <given-names>C. R.</given-names></name></person-group> (<year>1991</year>). <article-title>A mechanical trigger for the trot-gallop transition in horses</article-title>. <source>Science</source> <volume>253</volume>, <fpage>306</fpage>&#x02013;<lpage>308</lpage>. <pub-id pub-id-type="doi">10.1126/science.1857965</pub-id><pub-id pub-id-type="pmid">1857965</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flash</surname> <given-names>T.</given-names></name> <name><surname>Hogan</surname> <given-names>N.</given-names></name></person-group> (<year>1985</year>). <article-title>The coordination of arm movements: an experimentally confirmed mathematical model</article-title>. <source>J. Neurosci.</source> <volume>5</volume>, <fpage>1688</fpage>&#x02013;<lpage>1703</lpage>. <pub-id pub-id-type="pmid">4020415</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Forssberg</surname> <given-names>H.</given-names></name> <name><surname>Grillner</surname> <given-names>S.</given-names></name></person-group> (<year>1973</year>). <article-title>The locomotion of the acute spinal cat injected with clonidine i.v</article-title>. <source>Brain Res.</source> <volume>50</volume>, <fpage>184</fpage>&#x02013;<lpage>186</lpage>. <pub-id pub-id-type="doi">10.1016/0006-8993(73)90606-9</pub-id><pub-id pub-id-type="pmid">4690545</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Forssberg</surname> <given-names>H.</given-names></name> <name><surname>Grillner</surname> <given-names>S.</given-names></name> <name><surname>Halbertsma</surname> <given-names>J.</given-names></name> <name><surname>Rossignol</surname> <given-names>S.</given-names></name></person-group> (<year>1980</year>). <article-title>The locomotion of the low spinal cat. II. Interlimb coordination</article-title>. <source>Acta. Physiol. Scand.</source> <volume>108</volume>, <fpage>283</fpage>&#x02013;<lpage>295</lpage>. <pub-id pub-id-type="doi">10.1111/j.1748-1716.1980.tb06534.x</pub-id><pub-id pub-id-type="pmid">7376923</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Foth</surname> <given-names>E.</given-names></name> <name><surname>Graham</surname> <given-names>D.</given-names></name></person-group> (<year>1983</year>). <article-title>Influence of loading parallel to the body axis on the walking coordination of an insect. II. Contralateral effects</article-title>. <source>Biol. Cybern.</source> <volume>48</volume>, <fpage>149</fpage>&#x02013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1007/BF00318082</pub-id></citation></ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Freitas</surname> <given-names>S. M. S. F.</given-names></name> <name><surname>Duarte</surname> <given-names>M.</given-names></name> <name><surname>Latash</surname> <given-names>M. L.</given-names></name></person-group> (<year>2006</year>). <article-title>Two kinematic synergies in voluntary whole-body movements during standing</article-title>. <source>J. Neurophysiol.</source> <volume>95</volume>, <fpage>636</fpage>&#x02013;<lpage>645</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00482.2005</pub-id><pub-id pub-id-type="pmid">16267118</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frigon</surname> <given-names>A.</given-names></name> <name><surname>Hurteau</surname> <given-names>M.-F.</given-names></name> <name><surname>Thibaudier</surname> <given-names>Y.</given-names></name> <name><surname>Leblond</surname> <given-names>H.</given-names></name> <name><surname>Telonio</surname> <given-names>A.</given-names></name> <name><surname>D&#x00027;Angelo</surname> <given-names>G.</given-names></name></person-group> (<year>2013</year>). <article-title>Split-belt walking alters the relationship between locomotor phases and cycle duration across speeds in intact and chronic spinalized adult cats</article-title>. <source>J. Neurosci.</source> <volume>33</volume>, <fpage>8559</fpage>&#x02013;<lpage>8566</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.3931-12.2013</pub-id><pub-id pub-id-type="pmid">23658193</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frigon</surname> <given-names>A.</given-names></name> <name><surname>Sirois</surname> <given-names>J.</given-names></name> <name><surname>Gossard</surname> <given-names>J.-P.</given-names></name></person-group> (<year>2010</year>). <article-title>Effects of ankle and hip muscle afferent inputs on rhythm generation during fictive locomotion</article-title>. <source>J. Neurophysiol.</source> <volume>103</volume>, <fpage>1591</fpage>&#x02013;<lpage>1605</lpage>. <pub-id pub-id-type="doi">10.1152/jn.01028.2009</pub-id><pub-id pub-id-type="pmid">20089809</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fuchs</surname> <given-names>E.</given-names></name> <name><surname>Holmes</surname> <given-names>P.</given-names></name> <name><surname>Kiemel</surname> <given-names>T.</given-names></name> <name><surname>Ayali</surname> <given-names>A.</given-names></name></person-group> (<year>2011</year>). <article-title>Intersegmental coordination of cockroach locomotion: adaptive control of centrally coupled pattern generator circuits</article-title>. <source>Front. Neural Circuits</source> <volume>4</volume>:<fpage>125</fpage>. <pub-id pub-id-type="doi">10.3389/fncir.2010.00125</pub-id><pub-id pub-id-type="pmid">21369365</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fujiki</surname> <given-names>S.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Tomita</surname> <given-names>N.</given-names></name> <name><surname>Senda</surname> <given-names>K.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2013a</year>). <article-title>Hysteresis in the metachronal-tripod gait transition of insects: a modeling study</article-title>. <source>Phys. Rev. E</source> <volume>88</volume>:<fpage>012717</fpage>. <pub-id pub-id-type="doi">10.1103/PhysRevE.88.012717</pub-id><pub-id pub-id-type="pmid">23944500</pub-id></citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fujiki</surname> <given-names>S.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Tomita</surname> <given-names>N.</given-names></name> <name><surname>Senda</surname> <given-names>K.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2015</year>). <article-title>Adaptation mechanism of interlimb coordination in human split-belt treadmill walking through learning of foot contact timing: a robotics study</article-title>. <source>J. R. Soc. Interface</source> <volume>12</volume>:<fpage>20150542</fpage>. <pub-id pub-id-type="doi">10.1098/rsif.2015.0542</pub-id><pub-id pub-id-type="pmid">26289658</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fujiki</surname> <given-names>S.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Yamashita</surname> <given-names>T.</given-names></name> <name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Tomita</surname> <given-names>N.</given-names></name> <name><surname>Senda</surname> <given-names>K.</given-names></name> <etal/></person-group>. (<year>2013b</year>). <article-title>Adaptive splitbelt treadmill walking of a biped robot using nonlinear oscillators with phase resetting</article-title>. <source>Auton. Robots</source> <volume>35</volume>, <fpage>15</fpage>&#x02013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1007/s10514-013-9331-6</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fukuoka</surname> <given-names>Y.</given-names></name> <name><surname>Habu</surname> <given-names>Y.</given-names></name> <name><surname>Fukui</surname> <given-names>T.</given-names></name></person-group> (<year>2015</year>). <article-title>A simple rule for quadrupedal gait generation determined by leg loading feedback: a modeling study</article-title>. <source>Sci. Rep.</source> <volume>5</volume>:<fpage>8169</fpage>. <pub-id pub-id-type="doi">10.1038/srep08169</pub-id><pub-id pub-id-type="pmid">25639661</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fukuoka</surname> <given-names>Y.</given-names></name> <name><surname>Kimura</surname> <given-names>H.</given-names></name></person-group> (<year>2009</year>). <article-title>Dynamic locomotion of a biomorphic quadruped Tekken robot using various gaits: walk, trot, free-gait and bound</article-title>. <source>Appl. Bionics Biomech.</source> <volume>6</volume>, <fpage>63</fpage>&#x02013;<lpage>71</lpage>. <pub-id pub-id-type="doi">10.1155/2009/743713</pub-id></citation></ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fukuoka</surname> <given-names>Y.</given-names></name> <name><surname>Kimura</surname> <given-names>H.</given-names></name> <name><surname>Cohen</surname> <given-names>A.</given-names></name></person-group> (<year>2003</year>). <article-title>Adaptive dynamic walking of a quadruped robot on irregular terrain based on biological concepts</article-title>. <source>Int. J. Robot. Res.</source> <volume>22</volume>, <fpage>187</fpage>&#x02013;<lpage>202</lpage>. <pub-id pub-id-type="doi">10.1177/0278364903022003004</pub-id></citation></ref>
<ref id="B72">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Full</surname> <given-names>R. J.</given-names></name> <name><surname>Koditschek</surname> <given-names>D. E.</given-names></name></person-group> (<year>1999</year>). <article-title>Templates and anchors: Neuromechanical hypotheses of legged locomotion on land</article-title>. <source>J. Exp. Biol.</source> <volume>202</volume>, <fpage>3325</fpage>&#x02013;<lpage>3332</lpage>. <pub-id pub-id-type="pmid">10562515</pub-id></citation></ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Oshima</surname> <given-names>H.</given-names></name> <name><surname>Tsuchiya</surname> <given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>Variant and invariant patterns embedded in human locomotion through whole body kinematic coordination</article-title>. <source>Exp. Brain Res.</source> <volume>205</volume>, <fpage>497</fpage>&#x02013;<lpage>511</lpage>. <pub-id pub-id-type="doi">10.1007/s00221-010-2385-1</pub-id><pub-id pub-id-type="pmid">20700732</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Funato</surname> <given-names>T.</given-names></name> <name><surname>Yamamoto</surname> <given-names>Y.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Imai</surname> <given-names>T.</given-names></name> <name><surname>Aoyagi</surname> <given-names>T.</given-names></name> <name><surname>Tomita</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Evaluation of the phase-dependent rhythm control of human walking using phase response curves</article-title>. <source>PLoS Comput. Biol.</source> <volume>12</volume>:<fpage>e1004950</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1004950</pub-id><pub-id pub-id-type="pmid">27203839</pub-id></citation></ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goldschmidt</surname> <given-names>D.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). <article-title>Biologically-inspired adaptive obstacle negotiation behavior of hexapod robots</article-title>. <source>Front. Neurorobot.</source> <volume>8</volume>:<fpage>3</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2014.00003</pub-id><pub-id pub-id-type="pmid">24523694</pub-id></citation></ref>
<ref id="B76">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Golubitsky</surname> <given-names>M.</given-names></name> <name><surname>Stewart</surname> <given-names>I.</given-names></name> <name><surname>Buono</surname> <given-names>P. L.</given-names></name> <name><surname>Collins</surname> <given-names>J. J.</given-names></name></person-group> (<year>1999</year>). <article-title>Symmetry in locomotor central pattern generators and animal gaits</article-title>. <source>Nature</source> <volume>401</volume>, <fpage>693</fpage>&#x02013;<lpage>695</lpage>. <pub-id pub-id-type="doi">10.1038/44416</pub-id><pub-id pub-id-type="pmid">10537106</pub-id></citation></ref>
<ref id="B77">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grabowska</surname> <given-names>M.</given-names></name> <name><surname>Godlewska</surname> <given-names>E.</given-names></name> <name><surname>Schmidt</surname> <given-names>J.</given-names></name> <name><surname>Daun-Gruhn</surname> <given-names>S.</given-names></name></person-group> (<year>2012</year>). <article-title>Quadrupedal gaits in hexapod animals - inter-leg coordination in free-walking adult stick insects</article-title>. <source>J. Exp. Biol.</source> <volume>215</volume>, <fpage>4255</fpage>&#x02013;<lpage>4266</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.073643</pub-id><pub-id pub-id-type="pmid">22972892</pub-id></citation></ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Graham</surname> <given-names>D.</given-names></name></person-group> (<year>1972</year>). <article-title>A behavioural analysis of the temporal organisation of walking movements in the 1st instar and adult stick insect (Carausius morosus)</article-title>. <source>J. Comp. Physiol.</source> <volume>81</volume>, <fpage>23</fpage>&#x02013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.1007/BF00693548</pub-id></citation></ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Graham</surname> <given-names>D.</given-names></name></person-group> (<year>1977</year>). <article-title>The effect of amputation and leg restraint on the free walking coordination of the stick insect Carausius morosus</article-title>. <source>J. Comp. Physiol. A</source> <volume>116</volume>, <fpage>91</fpage>&#x02013;<lpage>116</lpage>. <pub-id pub-id-type="doi">10.1007/BF00605519</pub-id></citation></ref>
<ref id="B80">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Griffin</surname> <given-names>T. M.</given-names></name> <name><surname>Kram</surname> <given-names>R.</given-names></name> <name><surname>Wickler</surname> <given-names>S. J.</given-names></name> <name><surname>Hoyt</surname> <given-names>D. F.</given-names></name></person-group> (<year>2004</year>). <article-title>Biomechanical and energetic determinants of the walk-trot transition in horses</article-title>. <source>J. Exp. Biol.</source> <volume>207</volume>, <fpage>4215</fpage>&#x02013;<lpage>4223</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.01277</pub-id><pub-id pub-id-type="pmid">15531642</pub-id></citation></ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grillner</surname> <given-names>S.</given-names></name></person-group> (<year>1975</year>). <article-title>Locomotion in vertebrates: central mechanisms and reflex interaction</article-title>. <source>Physiol. Rev.</source> <volume>55</volume>, <fpage>247</fpage>&#x02013;<lpage>304</lpage>. <pub-id pub-id-type="pmid">1144530</pub-id></citation></ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grinke</surname> <given-names>E.</given-names></name> <name><surname>Tetzlaff</surname> <given-names>C.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot</article-title>. <source>Front. Neurorobot.</source> <volume>9</volume>:<fpage>11</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2015.00011</pub-id><pub-id pub-id-type="pmid">26528176</pub-id></citation></ref>
<ref id="B83">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harischandra</surname> <given-names>N.</given-names></name> <name><surname>Kn&#x000FC;sel</surname> <given-names>J.</given-names></name> <name><surname>Kozlov</surname> <given-names>A.</given-names></name> <name><surname>Bicanski</surname> <given-names>A.</given-names></name> <name><surname>Cabelguen</surname> <given-names>J.-M.</given-names></name> <name><surname>Ijspeert</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Sensory feedback plays a significant role in generating walking gait and in gait transition in salamanders: a simulation study</article-title>. <source>Front. Neurorobot.</source> <volume>5</volume>:<fpage>3</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2011.00003</pub-id><pub-id pub-id-type="pmid">22069388</pub-id></citation></ref>
<ref id="B84">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Heglund</surname> <given-names>N. C.</given-names></name> <name><surname>Taylor</surname> <given-names>C. R.</given-names></name></person-group> (<year>1998</year>). <article-title>Speed, stride frequency and energy cost per stride: how do they change with body size and gait?</article-title> <source>J. Exp. Biol.</source> <volume>138</volume>, <fpage>301</fpage>&#x02013;<lpage>318</lpage>. <pub-id pub-id-type="pmid">3193059</pub-id></citation></ref>
<ref id="B85">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hildebrand</surname> <given-names>M.</given-names></name></person-group> (<year>1965</year>). <article-title>Symmetrical gaits of horses</article-title>. <source>Science</source> <volume>150</volume>, <fpage>701</fpage>&#x02013;<lpage>708</lpage>. <pub-id pub-id-type="pmid">5844074</pub-id></citation></ref>
<ref id="B86">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hoepflinger</surname> <given-names>M. A.</given-names></name> <name><surname>Hutter</surname> <given-names>M.</given-names></name> <name><surname>Gehring</surname> <given-names>C.</given-names></name> <name><surname>Bloesch</surname> <given-names>M.</given-names></name> <name><surname>Siegwart</surname> <given-names>R.</given-names></name></person-group> (<year>2013</year>). <article-title>Unsupervised identification and prediction of foothold robustness</article-title>, in <source>Proceeding of IEEE International Conference on Robotica Automation</source> (<publisher-loc>Karlsruhe</publisher-loc>), <fpage>3293</fpage>&#x02013;<lpage>3298</lpage>.</citation></ref>
<ref id="B87">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hoepflinger</surname> <given-names>M. A.</given-names></name> <name><surname>Remy</surname> <given-names>C. D.</given-names></name> <name><surname>Hutter</surname> <given-names>M.</given-names></name> <name><surname>Spinello</surname> <given-names>L.</given-names></name> <name><surname>Siegwart</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). <article-title>Haptic terrain classification for legged robots</article-title>, in <source>Proceedings of IEEE International Conference on Robotics Automation</source> (<publisher-loc>Anchorage, AK</publisher-loc>), <fpage>2828</fpage>&#x02013;<lpage>2833</lpage>.</citation></ref>
<ref id="B88">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holmes</surname> <given-names>P.</given-names></name> <name><surname>Full</surname> <given-names>R. J.</given-names></name> <name><surname>Koditschek</surname> <given-names>D.</given-names></name> <name><surname>Guckenheimer</surname> <given-names>J.</given-names></name></person-group> (<year>2006</year>). <article-title>The dynamics of legged locomotion: Models, analyses, and challenges</article-title> <source>SIAM Rev.</source> <volume>48</volume>, <fpage>207</fpage>&#x02013;<lpage>304</lpage>. <pub-id pub-id-type="doi">10.1137/S0036144504445133</pub-id></citation></ref>
<ref id="B89">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hoyt</surname> <given-names>D. F.</given-names></name> <name><surname>Taylor</surname> <given-names>C. R.</given-names></name></person-group> (<year>1981</year>). <article-title>Gait and the energetics of locomotion in horses</article-title>. <source>Nature</source> <volume>292</volume>, <fpage>239</fpage>&#x02013;<lpage>240</lpage>. <pub-id pub-id-type="doi">10.1038/292239a0</pub-id></citation></ref>
<ref id="B90">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hreljac</surname> <given-names>A.</given-names></name></person-group> (<year>1993</year>). <article-title>Preferred and energetically optimal gait transition speeds in human locomotion</article-title>. <source>Med. Sci. Sports Exerc.</source> <volume>25</volume>, <fpage>1158</fpage>&#x02013;<lpage>1162</lpage>. <pub-id pub-id-type="doi">10.1249/00005768-199310000-00012</pub-id><pub-id pub-id-type="pmid">8231761</pub-id></citation></ref>
<ref id="B91">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hughes</surname> <given-names>G. M.</given-names></name></person-group> (<year>1952</year>). <article-title>The co-ordination of insect movements. I. The walking movements of insects</article-title>. <source>J. Exp. Biol.</source> <volume>29</volume>, <fpage>267</fpage>&#x02013;<lpage>285</lpage>.</citation></ref>
<ref id="B92">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name></person-group> (<year>2008</year>). <article-title>Central pattern generators for locomotion control in animals and robots: a review</article-title>. <source>Neural Netw.</source> <volume>21</volume>, <fpage>642</fpage>&#x02013;<lpage>653</lpage>. <pub-id pub-id-type="doi">10.1016/j.neunet.2008.03.014</pub-id><pub-id pub-id-type="pmid">18555958</pub-id></citation></ref>
<ref id="B93">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ijspeert</surname> <given-names>A. J.</given-names></name> <name><surname>Crespi</surname> <given-names>A.</given-names></name> <name><surname>Ryczko</surname> <given-names>D.</given-names></name> <name><surname>Cabelguen</surname> <given-names>J. M.</given-names></name></person-group> (<year>2007</year>). <article-title>From swimming to walking with a salamander robot driven by a spinal cord model</article-title>. <source>Science</source> <volume>315</volume>, <fpage>1416</fpage>&#x02013;<lpage>1420</lpage>. <pub-id pub-id-type="doi">10.1126/science.1138353</pub-id><pub-id pub-id-type="pmid">17347441</pub-id></citation></ref>
<ref id="B94">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ito</surname> <given-names>S.</given-names></name> <name><surname>Yuasa</surname> <given-names>H.</given-names></name> <name><surname>Luo</surname> <given-names>Z.</given-names></name> <name><surname>Ito</surname> <given-names>M.</given-names></name> <name><surname>Yanagihara</surname> <given-names>D.</given-names></name></person-group> (<year>1998</year>). <article-title>A mathematical model of adaptive behavior in quadruped locomotion</article-title>. <source>Biol. Cybern.</source> <volume>78</volume>, <fpage>337</fpage>&#x02013;<lpage>347</lpage>. <pub-id pub-id-type="doi">10.1007/s004220050438</pub-id><pub-id pub-id-type="pmid">9691263</pub-id></citation></ref>
<ref id="B95">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ivanenko</surname> <given-names>Y. P.</given-names></name> <name><surname>Cappellini</surname> <given-names>G.</given-names></name> <name><surname>Dominici</surname> <given-names>N.</given-names></name> <name><surname>Poppele</surname> <given-names>R. E.</given-names></name> <name><surname>Lacquaniti</surname> <given-names>F.</given-names></name></person-group> (<year>2007</year>). <article-title>Modular control of limb movements during human locomotion</article-title>. <source>J. Neurosci.</source> <volume>27</volume>, <fpage>11149</fpage>&#x02013;<lpage>11161</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2644-07.2007</pub-id><pub-id pub-id-type="pmid">17928457</pub-id></citation></ref>
<ref id="B96">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ivanenko</surname> <given-names>Y. P.</given-names></name> <name><surname>Poppele</surname> <given-names>R. E.</given-names></name> <name><surname>Lacquaniti</surname> <given-names>F.</given-names></name></person-group> (<year>2004</year>). <article-title>Five basic muscle activation patterns account for muscle activity during human locomotion</article-title>. <source>J. Physiol.</source> <volume>556</volume>, <fpage>267</fpage>&#x02013;<lpage>282</lpage>. <pub-id pub-id-type="doi">10.1113/jphysiol.2003.057174</pub-id><pub-id pub-id-type="pmid">14724214</pub-id></citation></ref>
<ref id="B97">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kimura</surname> <given-names>H.</given-names></name> <name><surname>Fukuoka</surname> <given-names>Y.</given-names></name> <name><surname>Cohen</surname> <given-names>A. H.</given-names></name></person-group> (<year>2007a</year>). <article-title>Adaptive dynamic walking of a quadruped robot on natural ground based on biological concepts</article-title>. <source>Int. J. Robot. Res.</source> <volume>26</volume>, <fpage>475</fpage>&#x02013;<lpage>490</lpage>. <pub-id pub-id-type="doi">10.1177/0278364907078089</pub-id></citation></ref>
<ref id="B98">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kimura</surname> <given-names>H.</given-names></name> <name><surname>Fukuoka</surname> <given-names>Y.</given-names></name> <name><surname>Cohen</surname> <given-names>A. H.</given-names></name></person-group> (<year>2007b</year>). <article-title>Biologically inspired adaptive walking of a quadruped robot</article-title>. <source>Phil. Trans. R. Soc. A</source> <volume>365</volume>, <fpage>153</fpage>&#x02013;<lpage>170</lpage>. <pub-id pub-id-type="doi">10.1098/rsta.2006.1919</pub-id><pub-id pub-id-type="pmid">17148054</pub-id></citation></ref>
<ref id="B99">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kimura</surname> <given-names>S.</given-names></name> <name><surname>Yano</surname> <given-names>M.</given-names></name> <name><surname>Shimizu</surname> <given-names>H.</given-names></name></person-group> (<year>1993</year>). <article-title>A self-organizing model of walking patterns of insects</article-title>. <source>Biol. Cybern.</source> <volume>69</volume>, <fpage>183</fpage>&#x02013;<lpage>193</lpage>. <pub-id pub-id-type="doi">10.1007/BF00198958</pub-id></citation></ref>
<ref id="B100">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kindermann</surname> <given-names>T.</given-names></name></person-group> (<year>2002</year>). <article-title>Behavior and adaptability of a six-legged walking system with highly distributed control</article-title>. <source>Adapt. Behav.</source> <volume>9</volume>, <fpage>16</fpage>&#x02013;<lpage>41</lpage>. <pub-id pub-id-type="doi">10.1177/105971230200900103</pub-id></citation></ref>
<ref id="B101">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kirchner</surname> <given-names>F.</given-names></name> <name><surname>Spenneberg</surname> <given-names>D.</given-names></name> <name><surname>Linnemann</surname> <given-names>R.</given-names></name></person-group> (<year>2002</year>). <article-title>A biologically inspired approach toward robust real-world locomotion in legged robots</article-title>, in <source>Neurotechnology for Biomimetic Robots</source>, eds <person-group person-group-type="editor"><name><surname>Ayers</surname> <given-names>J.</given-names></name> <name><surname>Davis</surname> <given-names>J.</given-names></name> <name><surname>Rudolph</surname> <given-names>A.</given-names></name></person-group> (<publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>MIT Press</publisher-name>), <fpage>419</fpage>&#x02013;<lpage>447</lpage>.</citation></ref>
<ref id="B102">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Knops</surname> <given-names>S.</given-names></name> <name><surname>T&#x000F3;th</surname> <given-names>T. I.</given-names></name> <name><surname>Guschlbauer</surname> <given-names>C.</given-names></name> <name><surname>Gruhn</surname> <given-names>M.</given-names></name> <name><surname>Daun-Gruhn</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>A neuromechanical model for the neuronal basis of curve walking in the stick insect</article-title>. <source>J. Neurophysiol.</source> <volume>109</volume>, <fpage>679</fpage>&#x02013;<lpage>691</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00648.2012</pub-id><pub-id pub-id-type="pmid">23136343</pub-id></citation></ref>
<ref id="B103">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kobayashi</surname> <given-names>T.</given-names></name> <name><surname>Aoyama</surname> <given-names>T.</given-names></name> <name><surname>Sekiyama</surname> <given-names>K.</given-names></name> <name><surname>Fukuda</surname> <given-names>T.</given-names></name></person-group> (<year>2015</year>). <article-title>Selection algorithm for locomotion based on the evaluation of falling risk</article-title>. <source>IEEE Trans. Robot.</source> <volume>31</volume>, <fpage>750</fpage>&#x02013;<lpage>765</lpage>. <pub-id pub-id-type="doi">10.1109/TRO.2015.2426451</pub-id></citation></ref>
<ref id="B104">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kuramoto</surname> <given-names>Y.</given-names></name></person-group> (<year>1984</year>). <source>Chemical Oscillations, Waves, and Turbulences</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer-Verlag</publisher-name>.</citation></ref>
<ref id="B105">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Latash</surname> <given-names>M. L.</given-names></name></person-group> (<year>2008</year>). <source>Synergy.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="B106">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lewinger</surname> <given-names>W. A.</given-names></name> <name><surname>Quinn</surname> <given-names>R. D.</given-names></name></person-group> (<year>2011</year>). <article-title>Neurobiologically]based control system for an adaptively walking hexapod</article-title>. <source>Indust. Robot. Int. J.</source> <volume>38</volume>, <fpage>258</fpage>&#x02013;<lpage>263</lpage>. <pub-id pub-id-type="doi">10.1108/01439911111122752</pub-id></citation></ref>
<ref id="B107">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>C.</given-names></name> <name><surname>Umbanhowar</surname> <given-names>P. B.</given-names></name> <name><surname>Komsuoglu</surname> <given-names>H.</given-names></name> <name><surname>Koditschek</surname> <given-names>D. E.</given-names></name> <name><surname>Goldman</surname> <given-names>D. I.</given-names></name></person-group> (<year>2009</year>). <article-title>Sensitive dependence of the motion of a legged robot on granular media</article-title>. <source>Proc. Natl. Acad. Sci. U.S.A.</source> <volume>106</volume>, <fpage>3029</fpage>&#x02013;<lpage>3034</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.0809095106</pub-id><pub-id pub-id-type="pmid">19204285</pub-id></citation></ref>
<ref id="B108">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>C.</given-names></name> <name><surname>Zhang</surname> <given-names>T.</given-names></name> <name><surname>Goldman</surname> <given-names>D. I.</given-names></name></person-group> (<year>2013</year>). <article-title>A terradynamics of legged locomotion on granular media</article-title>. <source>Science</source> <volume>339</volume>, <fpage>1408</fpage>&#x02013;<lpage>1411</lpage>. <pub-id pub-id-type="doi">10.1126/science.1229163</pub-id><pub-id pub-id-type="pmid">23520106</pub-id></citation></ref>
<ref id="B109">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>MacKay-Lyons</surname> <given-names>M.</given-names></name></person-group> (<year>2002</year>). <article-title>Central pattern generation of locomotion: a review of the evidence</article-title>. <source>Phys. Ther.</source> <volume>82</volume>, <fpage>69</fpage>&#x02013;<lpage>83</lpage>. <pub-id pub-id-type="doi">10.1093/ptj/82.1.69</pub-id><pub-id pub-id-type="pmid">11784280</pub-id></citation></ref>
<ref id="B110">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manoonpong</surname> <given-names>P.</given-names></name> <name><surname>Geng</surname> <given-names>T.</given-names></name> <name><surname>Kulvicius</surname> <given-names>T.</given-names></name> <name><surname>Porr</surname> <given-names>B.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name></person-group> (<year>2007</year>). <article-title>Adaptive, fast walking in a biped robot under neuronal control and learning</article-title>. <source>PLoS Comput. Biol.</source> <volume>3</volume>:<fpage>e134</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.0030134</pub-id><pub-id pub-id-type="pmid">17630828</pub-id></citation></ref>
<ref id="B111">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manoonpong</surname> <given-names>P.</given-names></name> <name><surname>Parlitz</surname> <given-names>U.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name></person-group> (<year>2013</year>). <article-title>Neural control and adaptive neural forward models for insect-like, energy-efficient, and adaptable locomotion of walking machines</article-title>. <source>Front. Neural Circuits</source> <volume>7</volume>:<fpage>12</fpage>. <pub-id pub-id-type="doi">10.3389/fncir.2013.00012</pub-id><pub-id pub-id-type="pmid">23408775</pub-id></citation></ref>
<ref id="B112">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manoonpong</surname> <given-names>P.</given-names></name> <name><surname>Pasemann</surname> <given-names>F.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name></person-group> (<year>2008</year>). <article-title>Sensor-driven neural control for omnidirectional locomotion and versatile reactive behaviors of walking machines</article-title>. <source>Robot. Auton. Syst.</source> <volume>56</volume>, <fpage>265</fpage>&#x02013;<lpage>288</lpage>. <pub-id pub-id-type="doi">10.1016/j.robot.2007.07.004</pub-id></citation></ref>
<ref id="B113">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Manton</surname> <given-names>S. M.</given-names></name></person-group> (<year>1965</year>). <article-title>The evolution of arthropodan locomotory mechanisms. Part 8. Functional requirements and body design in Chilopoda, together with a comparative account of their skeleto-muscular systems and an Appendix on A comparison between burrowing forces of annelids and chilopods and its bearing upon the evolution of the arthropodan haemocoel</article-title>. <source>J. Linn. Soc. Zool.</source> <volume>46</volume>, <fpage>251</fpage>&#x02013;<lpage>484</lpage>. <pub-id pub-id-type="doi">10.1111/j.1096-3642.1965.tb00500.x</pub-id></citation></ref>
<ref id="B114">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Margaria</surname> <given-names>R.</given-names></name></person-group> (<year>1938</year>). <article-title>Sulla fisiologia e specialmente sul consumo energetico della marcia e della corsa a varie velocita ed inclinazioni del terreno</article-title>. <source>Atti Acc. Naz. Lincei.</source> <volume>7</volume>, <fpage>299</fpage>&#x02013;<lpage>368</lpage>.</citation></ref>
<ref id="B115">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Matsuoka</surname> <given-names>K.</given-names></name></person-group> (<year>1985</year>). <article-title>Sustained oscillations generated by mutually inhibiting neurons with adaptation</article-title>. <source>Biol. Cybern.</source> <volume>52</volume>, <fpage>367</fpage>&#x02013;<lpage>376</lpage>. <pub-id pub-id-type="doi">10.1007/BF00449593</pub-id><pub-id pub-id-type="pmid">2996634</pub-id></citation></ref>
<ref id="B116">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maufroy</surname> <given-names>C.</given-names></name> <name><surname>Kimura</surname> <given-names>H.</given-names></name> <name><surname>Takase</surname> <given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>Integration of posture and rhythmic motion controls in quadrupedal dynamic walking using phase modulations based on leg loading/unloading</article-title>. <source>Auton. Robots</source> <volume>28</volume>, <fpage>331</fpage>&#x02013;<lpage>353</lpage>. <pub-id pub-id-type="doi">10.1007/s10514-009-9172-5</pub-id></citation></ref>
<ref id="B117">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Minetti</surname> <given-names>A. E.</given-names></name> <name><surname>Ardigo</surname> <given-names>L. P.</given-names></name> <name><surname>Saibene</surname> <given-names>F.</given-names></name></person-group> (<year>1994</year>). <article-title>Mechanical determinants of the minimum energy cost of gradient running in humans</article-title>. <source>J. Exp. Biol.</source> <volume>195</volume>, <fpage>211</fpage>&#x02013;<lpage>225</lpage>. <pub-id pub-id-type="pmid">7964412</pub-id></citation></ref>
<ref id="B118">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morton</surname> <given-names>S. M.</given-names></name> <name><surname>Bastian</surname> <given-names>A. J.</given-names></name></person-group> (<year>2006</year>). <article-title>Cerebellar contributions to locomotor adaptations during splitbelt treadmill walking</article-title>. <source>J. Neurosci.</source> <volume>26</volume>, <fpage>9107</fpage>&#x02013;<lpage>9116</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2622-06.2006</pub-id><pub-id pub-id-type="pmid">16957067</pub-id></citation></ref>
<ref id="B119">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x000FC;ller</surname> <given-names>U.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>1991a</year>). <article-title>The contralateral coordination of walking legs in the crayfish <italic>Astacus leptodactylus</italic>. I. Experimental results</article-title>. <source>Biol. Cybern.</source> <volume>64</volume>, <fpage>429</fpage>&#x02013;<lpage>436</lpage>. <pub-id pub-id-type="doi">10.1007/BF00224710</pub-id></citation></ref>
<ref id="B120">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x000FC;ller</surname> <given-names>U.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>1991b</year>). <article-title>The contralateral coordination of walking in the crayfish <italic>Astacus leptodactylus</italic>. II. Model calculations</article-title>. <source>Biol. Cybern</source>. <volume>64</volume>, <fpage>437</fpage>&#x02013;<lpage>446</lpage>. <pub-id pub-id-type="doi">10.1007/BF00224711</pub-id></citation></ref>
<ref id="B121">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Muybridge</surname> <given-names>E.</given-names></name></person-group> (<year>1957</year>). <source>Animals in Motion</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Dover Publications</publisher-name>.</citation></ref>
<ref id="B122">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nachstedt</surname> <given-names>T.</given-names></name> <name><surname>Tetzlaff</surname> <given-names>C.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2017</year>). <article-title>Fast dynamical coupling enhances frequency adaptation of oscillators for robotic locomotion control</article-title>. <source>Front. Neurorobot.</source> <volume>11</volume>:<fpage>14</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2017.00014</pub-id><pub-id pub-id-type="pmid">28377710</pub-id></citation></ref>
<ref id="B123">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nomura</surname> <given-names>T.</given-names></name> <name><surname>Kawa</surname> <given-names>K.</given-names></name> <name><surname>Suzuki</surname> <given-names>Y.</given-names></name> <name><surname>Nakanishi</surname> <given-names>M.</given-names></name> <name><surname>Yamasaki</surname> <given-names>T.</given-names></name></person-group> (<year>2009</year>). <article-title>Dynamic stability and phase resetting during biped gait</article-title>. <source>Chaos</source> <volume>19</volume>:<fpage>026103</fpage>. <pub-id pub-id-type="doi">10.1063/1.3138725</pub-id><pub-id pub-id-type="pmid">19566263</pub-id></citation></ref>
<ref id="B124">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Orlovsky</surname> <given-names>G. N.</given-names></name> <name><surname>Deliagina</surname> <given-names>T.</given-names></name> <name><surname>Grillner</surname> <given-names>S.</given-names></name></person-group> (<year>1999</year>). <source>Neuronal Control of Locomotion: from Mollusc to Man</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation></ref>
<ref id="B125">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Otoda</surname> <given-names>Y.</given-names></name> <name><surname>Kimura</surname> <given-names>H.</given-names></name> <name><surname>Takase</surname> <given-names>K.</given-names></name></person-group> (<year>2009</year>). <article-title>Construction of a gait adaptation model in human split-belt treadmill walking using a two-dimensional biped robot</article-title>. <source>Adv. Robot.</source> <volume>23</volume>, <fpage>535</fpage>&#x02013;<lpage>561</lpage>. <pub-id pub-id-type="doi">10.1163/156855309X420057</pub-id></citation></ref>
<ref id="B126">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Owaki</surname> <given-names>D.</given-names></name> <name><surname>Kano</surname> <given-names>T.</given-names></name> <name><surname>Nagasawa</surname> <given-names>K.</given-names></name> <name><surname>Tero</surname> <given-names>A.</given-names></name> <name><surname>Ishiguro</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Simple robot suggests physical interlimb communication is essential for quadruped walking</article-title>. <source>J. R. Soc. Interface</source> <volume>10</volume>:<fpage>20120669</fpage>. <pub-id pub-id-type="doi">10.1098/rsif.2012.0669</pub-id><pub-id pub-id-type="pmid">23097501</pub-id></citation></ref>
<ref id="B127">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Owaki</surname> <given-names>D.</given-names></name> <name><surname>Ishiguro</surname> <given-names>A.</given-names></name></person-group> (<year>2017</year>). <article-title>A quadruped robot exhibiting spontaneous gait transitions from walking to trotting to galloping</article-title>. <source>Sci. Rep.</source> <volume>7</volume>:<fpage>277</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-017-00348-9</pub-id><pub-id pub-id-type="pmid">28325917</pub-id></citation></ref>
<ref id="B128">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pearson</surname> <given-names>K.</given-names></name></person-group> (<year>1976</year>). <article-title>The control of walking</article-title>. <source>Sci. Am.</source> <volume>235</volume>, <fpage>72</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1038/scientificamerican1276-72</pub-id><pub-id pub-id-type="pmid">1006306</pub-id></citation></ref>
<ref id="B129">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pearson</surname> <given-names>K. G.</given-names></name> <name><surname>Franklin</surname> <given-names>R.</given-names></name></person-group> (<year>1984</year>). <article-title>Characteristics of leg movement and patterns of coordination in locusts walking on rough terrain</article-title>. <source>Int. J. Robot. Res.</source> <volume>3</volume>, <fpage>101</fpage>&#x02013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.1177/027836498400300209</pub-id></citation></ref>
<ref id="B130">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pelletier</surname> <given-names>Y.</given-names></name> <name><surname>Caissie</surname> <given-names>R.</given-names></name></person-group> (<year>2001</year>). <article-title>Behavioural and physical reactions of the Colorado potato beetle, <italic>Leptinotarsa decemlineata</italic> (Say) (Coleoptera: Chrysomelidae) walking on a slanted surface</article-title>. <source>Biol. Cybern.</source> <volume>84</volume>, <fpage>269</fpage>&#x02013;<lpage>277</lpage>. <pub-id pub-id-type="doi">10.1007/s004220000214</pub-id><pub-id pub-id-type="pmid">11324338</pub-id></citation></ref>
<ref id="B131">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reisman</surname> <given-names>D. S.</given-names></name> <name><surname>Block</surname> <given-names>H. J.</given-names></name> <name><surname>Bastian</surname> <given-names>A. J.</given-names></name></person-group> (<year>2005</year>). <article-title>Interlimb coordination during locomotion: What can be adapted and stored?</article-title> <source>J. Neurophysiol.</source> <volume>94</volume>, <fpage>2403</fpage>&#x02013;<lpage>2415</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00089.2005</pub-id><pub-id pub-id-type="pmid">15958603</pub-id></citation></ref>
<ref id="B132">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rabinovich</surname> <given-names>M. I.</given-names></name> <name><surname>Abarbanel</surname> <given-names>H. D. I.</given-names></name></person-group> (<year>1998</year>). <article-title>The role of chaos in neural systems</article-title>. <source>Neuroscience</source> <volume>87</volume>, <fpage>5</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1016/S0306-4522(98)00091-8</pub-id><pub-id pub-id-type="pmid">9722138</pub-id></citation></ref>
<ref id="B133">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Raynor</surname> <given-names>A. J.</given-names></name> <name><surname>Yi</surname> <given-names>C. J.</given-names></name> <name><surname>Abernethy</surname> <given-names>B.</given-names></name> <name><surname>Jong</surname> <given-names>Q. J.</given-names></name></person-group> (<year>2002</year>). <article-title>Are transitions in human gait determined by mechanical, kinetic or energetic factors?</article-title> <source>Hum. Mov. Sci.</source> <volume>21</volume>, <fpage>785</fpage>&#x02013;<lpage>805</lpage>. <pub-id pub-id-type="doi">10.1016/S0167-9457(02)00180-X</pub-id><pub-id pub-id-type="pmid">12620720</pub-id></citation></ref>
<ref id="B134">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ren</surname> <given-names>G.</given-names></name> <name><surname>Chen</surname> <given-names>W.</given-names></name> <name><surname>Dasgupta</surname> <given-names>S.</given-names></name> <name><surname>Kolodziejski</surname> <given-names>C. W&#x000F6;rg&#x000F6;tter, F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>Multiple chaotic central pattern generators with learning for legged locomotion and malfunction compensation</article-title>. <source>Inform. Sci.</source> <volume>294</volume>, <fpage>666</fpage>&#x02013;<lpage>682</lpage>. <pub-id pub-id-type="doi">10.1016/j.ins.2014.05.001</pub-id></citation></ref>
<ref id="B135">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rybak</surname> <given-names>I. A.</given-names></name> <name><surname>Shevtsova</surname> <given-names>N. A.</given-names></name> <name><surname>Lafreniere-Roula</surname> <given-names>M.</given-names></name> <name><surname>McCrea</surname> <given-names>D. A.</given-names></name></person-group> (<year>2006</year>). <article-title>Modelling spinal circuitry involved in locomotor pattern generation: insights from deletions during fictive locomotion</article-title>. <source>J. Physiol.</source> <volume>577</volume>, <fpage>617</fpage>&#x02013;<lpage>639</lpage>. <pub-id pub-id-type="doi">10.1113/jphysiol.2006.118703</pub-id><pub-id pub-id-type="pmid">17008376</pub-id></citation></ref>
<ref id="B136">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schilling</surname> <given-names>M.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>2017</year>). <article-title>ReaCog, a minimal cognitive controller based on recruitment of reactive systems</article-title>. <source>Front. Neurorobot.</source> <volume>11</volume>:<fpage>3</fpage>. <pub-id pub-id-type="doi">10.3389/fnbot.2017.00003</pub-id><pub-id pub-id-type="pmid">28194106</pub-id></citation></ref>
<ref id="B137">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schilling</surname> <given-names>M.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name> <name><surname>Arena</surname> <given-names>P.</given-names></name></person-group> (<year>2007</year>). <article-title>Hexapod Walking: an expansion to Walknet dealing with leg amputations and force oscillations</article-title>. <source>Biol. Cybern.</source> <volume>96</volume>, <fpage>323</fpage>&#x02013;<lpage>340</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-006-0117-1</pub-id><pub-id pub-id-type="pmid">17106698</pub-id></citation></ref>
<ref id="B138">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schilling</surname> <given-names>M.</given-names></name> <name><surname>Hoinville</surname> <given-names>T.</given-names></name> <name><surname>Schmitz</surname> <given-names>J.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>2013a</year>). <article-title>Walknet, a bio-inspired controller for hexapod walking</article-title>. <source>Biol. Cybern.</source> <volume>107</volume>, <fpage>397</fpage>&#x02013;<lpage>419</lpage>. <pub-id pub-id-type="doi">10.1007/s00422-013-0563-5</pub-id><pub-id pub-id-type="pmid">23824506</pub-id></citation></ref>
<ref id="B139">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schilling</surname> <given-names>M.</given-names></name> <name><surname>Paskarbeit</surname> <given-names>J.</given-names></name> <name><surname>Hoinville</surname> <given-names>T.</given-names></name> <name><surname>H&#x000FC;ffmeier</surname> <given-names>A.</given-names></name> <name><surname>Schneider</surname> <given-names>A.</given-names></name> <name><surname>Schmitz</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2013b</year>). <article-title>A hexapod walker using a heterarchical architecture for action selection</article-title>. <source>Front. Comput. Neurosci.</source> <volume>7</volume>:<fpage>126</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00126</pub-id><pub-id pub-id-type="pmid">24062682</pub-id></citation></ref>
<ref id="B140">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schmitz</surname> <given-names>J.</given-names></name> <name><surname>Schneider</surname> <given-names>A.</given-names></name> <name><surname>Schilling</surname> <given-names>M.</given-names></name> <name><surname>Cruse</surname> <given-names>H.</given-names></name></person-group> (<year>2008</year>). <article-title>No need for a body model: positive velocity feedback for the control of an 18-DOF robot walker</article-title>. <source>Appl. Bionics Biomech.</source> <volume>5</volume>, <fpage>135</fpage>&#x02013;<lpage>147</lpage>. <pub-id pub-id-type="doi">10.1155/2008/737239</pub-id></citation></ref>
<ref id="B141">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Schneider</surname> <given-names>A.</given-names></name> <name><surname>Paskarbeit</surname> <given-names>J.</given-names></name> <name><surname>Schaeffersmann</surname> <given-names>M.</given-names></name> <name><surname>Schmitz</surname> <given-names>J.</given-names></name></person-group> (<year>2012</year>). <article-title>Hector, a new hexapod robot platform with increased mobility-control approach, design and communication</article-title>, in <source>Advances in Autonomous Mini Robots</source>, eds <person-group person-group-type="editor"><name><surname>R&#x000FC;ckert</surname> <given-names>U.</given-names></name> <name><surname>Joaquin</surname> <given-names>S.</given-names></name> <name><surname>Felix</surname> <given-names>W.</given-names></name></person-group> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>249</fpage>&#x02013;<lpage>264</lpage>.</citation></ref>
<ref id="B142">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schomburg</surname> <given-names>E. D.</given-names></name> <name><surname>Petersen</surname> <given-names>N.</given-names></name> <name><surname>Barajon</surname> <given-names>I.</given-names></name> <name><surname>Hultborn</surname> <given-names>H.</given-names></name></person-group> (<year>1998</year>). <article-title>Flexor reflex afferents reset the step cycle during fictive locomotion in the cat</article-title>. <source>Exp. Brain Res.</source> <volume>122</volume>, <fpage>339</fpage>&#x02013;<lpage>350</lpage>. <pub-id pub-id-type="doi">10.1007/s002210050522</pub-id><pub-id pub-id-type="pmid">9808307</pub-id></citation></ref>
<ref id="B143">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sch&#x000F6;ner</surname> <given-names>G.</given-names></name> <name><surname>Jiang</surname> <given-names>W. Y.</given-names></name> <name><surname>Kelso</surname> <given-names>J. A. S.</given-names></name></person-group> (<year>1990</year>). <article-title>A synergetic theory of quadrupedal gaits and gait transitions</article-title>. <source>J. Theor. Biol.</source> <volume>142</volume>, <fpage>359</fpage>&#x02013;<lpage>391</lpage>. <pub-id pub-id-type="doi">10.1016/S0022-5193(05)80558-2</pub-id><pub-id pub-id-type="pmid">2338828</pub-id></citation></ref>
<ref id="B144">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shim</surname> <given-names>Y.</given-names></name> <name><surname>Husbands</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <article-title>Chaotic exploration and learning of locomotion behaviors</article-title>. <source>Neural Comput.</source> <volume>24</volume>, <fpage>2185</fpage>&#x02013;<lpage>222</lpage>. <pub-id pub-id-type="doi">10.1162/NECO_a_00313</pub-id><pub-id pub-id-type="pmid">22509965</pub-id></citation></ref>
<ref id="B145">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Spirito</surname> <given-names>C. P.</given-names></name> <name><surname>Mushrush</surname> <given-names>D. L.</given-names></name></person-group> (<year>1979</year>). <article-title>Interlimb coordination during slow walking in the cockroach I. effects of substrate alterations</article-title>. <source>J. Exp. Biol.</source> <volume>78</volume>, <fpage>233</fpage>&#x02013;<lpage>243</lpage>.</citation></ref>
<ref id="B146">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Steingrube</surname> <given-names>S.</given-names></name> <name><surname>Timme</surname> <given-names>M.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2010</year>). <article-title>Self-organized adaptation of a simple neural circuit enables complex robot behaviour</article-title>. <source>Nat. Phys.</source> <volume>6</volume>, <fpage>224</fpage>&#x02013;<lpage>230</lpage>. <pub-id pub-id-type="doi">10.1038/nphys1508</pub-id></citation></ref>
<ref id="B147">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Strau&#x000DF;</surname> <given-names>R.</given-names></name> <name><surname>Heisenberg</surname> <given-names>M.</given-names></name></person-group> (<year>1990</year>). <article-title>Coordination of legs during straight walking and turning in <italic>Drosophila melanogaster</italic></article-title>. <source>J. Comp. Physiol. A</source> <volume>167</volume>, <fpage>403</fpage>&#x02013;<lpage>412</lpage>. <pub-id pub-id-type="doi">10.1007/BF00192575</pub-id><pub-id pub-id-type="pmid">2121965</pub-id></citation></ref>
<ref id="B148">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Szczecinski</surname> <given-names>N. S.</given-names></name> <name><surname>Getsy</surname> <given-names>A. P.</given-names></name> <name><surname>Martin</surname> <given-names>J. P.</given-names></name> <name><surname>Ritzmann</surname> <given-names>R. E.</given-names></name> <name><surname>Quinn</surname> <given-names>R. D.</given-names></name></person-group> (<year>in press</year>). <article-title>Mantisbot is a robotic model of visually guided motion in the praying mantis</article-title>. <source>Arthropod. Struct. Dev</source>. <pub-id pub-id-type="doi">10.1016/j.asd.2017.03.001</pub-id><pub-id pub-id-type="pmid">28302586</pub-id></citation></ref>
<ref id="B149">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taga</surname> <given-names>G.</given-names></name></person-group> (<year>1995</year>). <article-title>A model of the neuro-musculo-skeletal system for human locomotion I. Emergence of basic gait</article-title>. <source>Biol. Cybern.</source> <volume>73</volume>, <fpage>97</fpage>&#x02013;<lpage>111</lpage>. <pub-id pub-id-type="doi">10.1007/BF00204048</pub-id><pub-id pub-id-type="pmid">7662771</pub-id></citation></ref>
<ref id="B150">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Taga</surname> <given-names>G.</given-names></name> <name><surname>Yamaguchi</surname> <given-names>Y.</given-names></name> <name><surname>Shimizu</surname> <given-names>H.</given-names></name></person-group> (<year>1991</year>). <article-title>Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment</article-title>. <source>Biol. Cybern.</source> <volume>65</volume>, <fpage>147</fpage>&#x02013;<lpage>159</lpage>. <pub-id pub-id-type="doi">10.1007/BF00198086</pub-id><pub-id pub-id-type="pmid">1912008</pub-id></citation></ref>
<ref id="B151">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tang</surname> <given-names>T. P.</given-names></name> <name><surname>Macmillan</surname> <given-names>D. L.</given-names></name></person-group> (<year>1986</year>). <article-title>The effects of sensory manipulation upon interlimb coordination during fast walking in the cockroach</article-title>. <source>J. Exp. Biol.</source> <volume>125</volume>, <fpage>107</fpage>&#x02013;<lpage>117</lpage>.</citation></ref>
<ref id="B152">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tokuda</surname> <given-names>K.</given-names></name> <name><surname>Toda</surname> <given-names>T.</given-names></name> <name><surname>Koji</surname> <given-names>Y.</given-names></name> <name><surname>Konyo</surname> <given-names>M.</given-names></name> <name><surname>Tadokoro</surname> <given-names>S.</given-names></name> <name><surname>Alain</surname> <given-names>P.</given-names></name></person-group> (<year>2003</year>). <article-title>Estimation of fragile ground by foot pressure sensor of legged robot</article-title>, in <source>Proceedings of IEEE/ASME International Conference on Advanced Intelligent Mechatronics</source> (<publisher-loc>Kobe</publisher-loc>), <fpage>447</fpage>&#x02013;<lpage>453</lpage>.</citation></ref>
<ref id="B153">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>T&#x000F3;th</surname> <given-names>T. I.</given-names></name> <name><surname>Daun-Gruhn</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>A three-leg model producing tetrapod and tripod coordination patterns of ipsilateral legs in the stick insect</article-title>. <source>J. Neurophysiol.</source> <volume>115</volume>, <fpage>887</fpage>&#x02013;<lpage>906</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00693.2015</pub-id><pub-id pub-id-type="pmid">26581871</pub-id></citation></ref>
<ref id="B154">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Traven</surname> <given-names>H. G.</given-names></name> <name><surname>Brodin</surname> <given-names>L.</given-names></name> <name><surname>Lansner</surname> <given-names>A.</given-names></name> <name><surname>Ekeberg</surname> <given-names>O.</given-names></name> <name><surname>Wallen</surname> <given-names>P.</given-names></name> <name><surname>Grillner</surname> <given-names>S.</given-names></name></person-group> (<year>1993</year>). <article-title>Computer simulations of NMDA and non-NMDA receptor-mediated synaptic drive: sensory and supraspinal modulation of neurons and small networks</article-title>. <source>J. Neurophysiol.</source> <volume>70</volume>, <fpage>695</fpage>&#x02013;<lpage>709</lpage>. <pub-id pub-id-type="pmid">8105036</pub-id></citation></ref>
<ref id="B155">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tsuchiya</surname> <given-names>K.</given-names></name> <name><surname>Aoi</surname> <given-names>S.</given-names></name> <name><surname>Tsujita</surname> <given-names>K.</given-names></name></person-group> (<year>2002</year>). <article-title>Locomotion control of a multi-legged locomotion robot using oscillators</article-title>, in <source>Proceedings of IEEE International Conference on Systems, Man Cybernetics</source> (<publisher-loc>Hammamet</publisher-loc>).</citation></ref>
<ref id="B156">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Uno</surname> <given-names>Y.</given-names></name> <name><surname>Kawato</surname> <given-names>M.</given-names></name> <name><surname>Suzuki</surname> <given-names>R.</given-names></name></person-group> (<year>1989</year>). <article-title>Formation and control of optical trajectory in human multi-joint arm movement - minimum torque-change model</article-title>. <source>Biol. Cybern.</source> <volume>61</volume>, <fpage>89</fpage>&#x02013;<lpage>101</lpage>. <pub-id pub-id-type="doi">10.1007/BF00204593</pub-id><pub-id pub-id-type="pmid">2742921</pub-id></citation></ref>
<ref id="B157">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wickler</surname> <given-names>S. J.</given-names></name> <name><surname>Hoyt</surname> <given-names>D. F.</given-names></name> <name><surname>Cogger</surname> <given-names>E. A.</given-names></name> <name><surname>Myers</surname> <given-names>G.</given-names></name></person-group> (<year>2003</year>). <article-title>The energetics of the trot-gallop transition</article-title>. <source>J. Exp. Biol.</source> <volume>206</volume>, <fpage>1557</fpage>&#x02013;<lpage>1564</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.00276</pub-id><pub-id pub-id-type="pmid">12654894</pub-id></citation></ref>
<ref id="B158">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wilson</surname> <given-names>D. M.</given-names></name></person-group> (<year>1966</year>). <article-title>Insect walking</article-title>. <source>Annu. Rev. Entomol.</source> <volume>11</volume>, <fpage>103</fpage>&#x02013;<lpage>122</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.en.11.010166.000535</pub-id><pub-id pub-id-type="pmid">5321575</pub-id></citation></ref>
<ref id="B159">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wosnitza</surname> <given-names>A.</given-names></name> <name><surname>Bockem&#x000FC;hl</surname> <given-names>T.</given-names></name> <name><surname>D&#x000FC;bbert</surname> <given-names>M.</given-names></name> <name><surname>Scholz</surname> <given-names>H.</given-names></name> <name><surname>B&#x000FC;schges</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Inter-leg coordination in the control of walking speed in <italic>Drosophila</italic></article-title>. <source>J. Exp. Biol.</source> <volume>216</volume>, <fpage>480</fpage>&#x02013;<lpage>491</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.078139</pub-id><pub-id pub-id-type="pmid">23038731</pub-id></citation></ref>
<ref id="B160">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xiong</surname> <given-names>X.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2014</year>). <article-title>Neuromechanical control for hexapedal robot walking on challenging surfaces and surface classification</article-title>. <source>Robot. Auton. Syst.</source> <volume>62</volume>, <fpage>1777</fpage>&#x02013;<lpage>1789</lpage>. <pub-id pub-id-type="doi">10.1016/j.robot.2014.07.008</pub-id></citation></ref>
<ref id="B161">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xiong</surname> <given-names>X.</given-names></name> <name><surname>W&#x000F6;rg&#x000F6;tter</surname> <given-names>F.</given-names></name> <name><surname>Manoonpong</surname> <given-names>P.</given-names></name></person-group> (<year>2015</year>). <article-title>Adaptive and energy efficient walking in a hexapod robot under neuromechanical control and sensorimotor learning</article-title>. <source>IEEE Trans. Cybern.</source> <volume>46</volume>, <fpage>2521</fpage>&#x02013;<lpage>2534</lpage>. <pub-id pub-id-type="doi">10.1109/TCYB.2015.2479237</pub-id><pub-id pub-id-type="pmid">26441437</pub-id></citation></ref>
<ref id="B162">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yanagihara</surname> <given-names>D.</given-names></name> <name><surname>Kondo</surname> <given-names>I.</given-names></name></person-group> (<year>1996</year>). <article-title>Nitric oxide plays a key role in adaptive control of locomotion in cat</article-title>. <source>Proc. Nat. Acad. Sci. U.S.A.</source> <volume>93</volume>, <fpage>13292</fpage>&#x02013;<lpage>13297</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.93.23.13292</pub-id><pub-id pub-id-type="pmid">8917584</pub-id></citation></ref>
<ref id="B163">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yu</surname> <given-names>J.</given-names></name> <name><surname>Tan</surname> <given-names>M.</given-names></name> <name><surname>Chen</surname> <given-names>J.</given-names></name> <name><surname>Zhang</surname> <given-names>J.</given-names></name></person-group> (<year>2014</year>). <article-title>A survey on CPG-inspired control models and system implementation</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst.</source> <volume>25</volume>, <fpage>441</fpage>&#x02013;<lpage>456</lpage>. <pub-id pub-id-type="doi">10.1109/TNNLS.2013.2280596</pub-id><pub-id pub-id-type="pmid">24807442</pub-id></citation></ref>
</ref-list>
</back>
</article>