<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Comput. Neurosci.</journal-id>
<journal-title>Frontiers in Computational Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Comput. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5188</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fncom.2024.1355855</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Synergy quality assessment of muscle modules for determining learning performance using a realistic musculoskeletal model</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Fukunishi</surname> <given-names>Akito</given-names></name>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2206932/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Kutsuzawa</surname> <given-names>Kyo</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/1181476/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Owaki</surname> <given-names>Dai</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/234417/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Hayashibe</surname> <given-names>Mitsuhiro</given-names></name>
<uri xlink:href="http://loop.frontiersin.org/people/84197/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
</contrib-group>
<aff><institution>Department of Robotics, Graduate School of Engineering, Tohoku University</institution>, <addr-line>Sendai</addr-line>, <country>Japan</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Alireza Alemi, University of California, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Jessica L. Allen, University of Florida, United States</p>
<p>Charlotte Le Mouel, Max Planck Institute for Intelligent Systems, Germany</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Akito Fukunishi <email>akito.fukunishi.r4&#x00040;dc.tohoku.ac.jp</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>30</day>
<month>05</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>18</volume>
<elocation-id>1355855</elocation-id>
<history>
<date date-type="received">
<day>14</day>
<month>12</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>13</day>
<month>05</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2024 Fukunishi, Kutsuzawa, Owaki and Hayashibe.</copyright-statement>
<copyright-year>2024</copyright-year>
<copyright-holder>Fukunishi, Kutsuzawa, Owaki and Hayashibe</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>How our central nervous system efficiently controls our complex musculoskeletal system is still debated. The muscle synergy hypothesis is proposed to simplify this complex system by assuming the existence of functional neural modules that coordinate several muscles. Modularity based on muscle synergies can facilitate motor learning without compromising task performance. However, the effectiveness of modularity in motor control remains debated. This ambiguity can, in part, stem from overlooking that the performance of modularity depends on the mechanical aspects of modules of interest, such as the torque the modules exert. To address this issue, this study introduces two criteria to evaluate the quality of module sets based on commonly used performance metrics in motor learning studies: the accuracy of torque production and learning speed. One evaluates the regularity in the direction of mechanical torque the modules exert, while the other evaluates the evenness of its magnitude. For verification of our criteria, we simulated motor learning of torque production tasks in a realistic musculoskeletal system of the upper arm using feed-forward neural networks while changing the control conditions. We found that the proposed criteria successfully explain the tendency of learning performance in various control conditions. These result suggest that regularity in the direction of and evenness in magnitude of mechanical torque of utilized modules are significant factor for determining learning performance. Although the criteria were originally conceived for an error-based learning scheme, the approach to pursue which set of modules is better for motor control can have significant implications in other studies of modularity in general.</p></abstract>
<kwd-group>
<kwd>muscle synergy</kwd>
<kwd>redundancy</kwd>
<kwd>neural network</kwd>
<kwd>optimization</kwd>
<kwd>motor control</kwd>
</kwd-group>
<counts>
<fig-count count="13"/>
<table-count count="2"/>
<equation-count count="15"/>
<ref-count count="70"/>
<page-count count="19"/>
<word-count count="13091"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1 Introduction</title>
<p>Modularity is believed to simplify control by assuming functionally coordinated modules in the control architecture instead of controlling all control units (d&#x00027;Avella et al., <xref ref-type="bibr" rid="B17">2015</xref>) and is considered to serve to control redundant motor systems effectively. Among the various forms of modularity that have been proposed (R&#x000FC;ckert and d&#x00027;Avella, <xref ref-type="bibr" rid="B51">2013</xref>; Sartori et al., <xref ref-type="bibr" rid="B52">2013</xref>; Sternad et al., <xref ref-type="bibr" rid="B60">2013</xref>; Alessandro et al., <xref ref-type="bibr" rid="B2">2014</xref>; Hayashibe and Shimoda, <xref ref-type="bibr" rid="B26">2014</xref>), muscle synergy hypothesis is characterized by a particularly small number of combinations of muscle coordination patterns. The muscle synergy hypothesis is gaining phenomenological support based on previous studies (d&#x00027;Avella and Bizzi, <xref ref-type="bibr" rid="B16">2005</xref>; Overduin et al., <xref ref-type="bibr" rid="B43">2008</xref>; Roh et al., <xref ref-type="bibr" rid="B49">2012</xref>; Hilt et al., <xref ref-type="bibr" rid="B29">2018</xref>) and its neural implementation is being identified (Giszter et al., <xref ref-type="bibr" rid="B24">1993</xref>; Kargo et al., <xref ref-type="bibr" rid="B35">2010</xref>; Roh et al., <xref ref-type="bibr" rid="B48">2011</xref>; Takei et al., <xref ref-type="bibr" rid="B63">2017</xref>). Following the rudimentary but successful demonstration of the muscle synergy hypothesis, modularity is gaining popularity not only in neuroscience but also in various fields such as robotics and rehabilitation (d&#x00027;Avella et al., <xref ref-type="bibr" rid="B17">2015</xref>; Ting et al., <xref ref-type="bibr" rid="B65">2015</xref>; Brock and Valero-Cuevas, <xref ref-type="bibr" rid="B11">2016</xref>).</p>
<p>In line with this, researchers started to study what effects the central nervous system (CNS) would have in adopting modularity in motor control rather than full-rank control. The typical aspects regarded as advantages of modularity are its facilitating effects of motor learning or planning (R&#x000FC;ckert and d&#x00027;Avella, <xref ref-type="bibr" rid="B51">2013</xref>; Diamond and Holland, <xref ref-type="bibr" rid="B20">2014</xref>; Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>; Al Borno et al., <xref ref-type="bibr" rid="B1">2020</xref>; Chen and Qiao, <xref ref-type="bibr" rid="B12">2020</xref>; Berg et al., <xref ref-type="bibr" rid="B8">2023</xref>) and partial generalization capability (R&#x000FC;ckert and d&#x00027;Avella, <xref ref-type="bibr" rid="B51">2013</xref>; Ta&#x000EF;x et al., <xref ref-type="bibr" rid="B62">2013</xref>; Al Borno et al., <xref ref-type="bibr" rid="B1">2020</xref>; Chen and Qiao, <xref ref-type="bibr" rid="B12">2020</xref>; Kutsuzawa and Hayashibe, <xref ref-type="bibr" rid="B36">2022</xref>; Berg et al., <xref ref-type="bibr" rid="B8">2023</xref>). These aspects will provide evolutionary benefits to organisms because combining a limited number of learned repertoires for realizing a new motor skill is more efficient than an exhaustive search in full-rank motor space for an optimal solution if the generated motor skill is enough (Loeb, <xref ref-type="bibr" rid="B39">2021</xref>).</p>
<p>On the other hand, the effectiveness of modularity in motor control is still controversial. The controversial point is whether a synergistic controller performs practically enough compared with an optimal control or optimization. Due to a potential performance limitation of modularity deriving from its low dimensionality, researchers had pushed modularity off to an extreme position relative to the optimal control or optimization (Hirashima and Oya, <xref ref-type="bibr" rid="B31">2016</xref>; Berret et al., <xref ref-type="bibr" rid="B10">2019</xref>). To fill the gap between these two positions, researchers have tested the performance of modularity compared with the optimized one (Berniker et al., <xref ref-type="bibr" rid="B9">2009</xref>; McKay and Ting, <xref ref-type="bibr" rid="B41">2012</xref>; de Rugy et al., <xref ref-type="bibr" rid="B18">2013</xref>; Inouye and Valero-Cuevas, <xref ref-type="bibr" rid="B33">2016</xref>; Al Borno et al., <xref ref-type="bibr" rid="B1">2020</xref>). However, the studies have reported conflicting results; Some researchers suggested that the degradation in performance is negligible (Berniker et al., <xref ref-type="bibr" rid="B9">2009</xref>; Al Borno et al., <xref ref-type="bibr" rid="B1">2020</xref>), while others suggested that degradation matters significantly (McKay and Ting, <xref ref-type="bibr" rid="B41">2012</xref>; de Rugy et al., <xref ref-type="bibr" rid="B18">2013</xref>; Inouye and Valero-Cuevas, <xref ref-type="bibr" rid="B33">2016</xref>). It is necessary to locate what makes the disputes over modularity and optimality complicated.</p>
<p>We speculate that one of the causes of these complexities in modularity comes from the confusion of the performance of the specific modules of interest with the overall discussion of the performance of modularity. There is no doubt that the effectiveness of modularity can be affected by module extraction algorithms, complexities of a musculoskeletal system, control policy, and even tasks. For instance, Hagio <italic>et al</italic>. observed that the control performance and effect of learning facilitation of modularity depends on the mechanical properties of modules (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>). Similarly, Borno <italic>et al</italic>. pointed out that the complexities in the musculoskeletal model could affect the effectiveness of modularity (Al Borno et al., <xref ref-type="bibr" rid="B1">2020</xref>). They found that the degradation of learning performance of modularity compared with individual muscle control is slight when a realistic musculoskeletal model is used. Furthermore, they also reported that control performance variance depends on the module extraction algorithms. As for generalization, Kutsuzawa <italic>et al</italic>. found that the successful generalization capability of modularity is provided by modules extracted by multiple tasks, whereas modularity with modules extracted by a single task fails to generalize (Kutsuzawa and Hayashibe, <xref ref-type="bibr" rid="B36">2022</xref>). Their results support that the mechanical repertoire of modules, rather than the number of modules, is significant for motor generalization. However, except for these studies, most previous research has not paid much attention to such module-dependent variation in the performance of modularity, which can be considered the cause of controversial arguments concerning modularity. Therefore, it is necessary to quantitatively clarify what are the essential factors of modules that determine the performances and provide a better understanding of modularity.</p>
<p>This study aims to provide refined insights into modularity by quantitatively associating the relationship between the performance/effect of modularity and utilized modules. To this end, we quantify the modules with their mechanical properties inspired by the previous studies (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>). Then, we verified the relationship between them and the popular measure of modularity: task accuracy and learning speed in error-based learning. In concrete, we proposed two criteria (<xref ref-type="fig" rid="F1">Figure 1</xref>), Direction Bias (DB) and Power Bias (PB), to quantify the modules. DB quantifies the unevenness of the directions of the torque vectors exerted by individual modules, whereas PB quantifies the unevenness of the amplitude of the torque vectors. These metrics were developed by adding heuristics to theoretical predictions regarding the convergence speed and accuracy of learning in gradient-based learning of linear neural networks to make them applicable to more realistic situations. Specifically, we designed DB and PB to predict the learning speed and accuracy of isometric control of a realistic musculoskeletal system of a non-linear neural network with non-negative constraints for muscle actuation. Our metrics could reveal the relationship between the realistic musculoskeletal learning system and the mechanical function of muscles or muscle synergies, advancing our understanding of motor control and muscle synergies. To validate the criteria, we did two separate experiments: (1) Similar to the conventional studies, we compared the task accuracy and learning speed of the independent muscle controller and the muscle synergy controller; and (2) We verified the explanation capabilities of criteria for task accuracy and learning speed by providing various sets of possible modules, changing the number of modules, or scaling the passive force elements. Our analysis demonstrates that muscle synergies should be formed in a way that could effectively compensate for the musculoskeletal complexities to improve the performance of the modularity. Our approach to quantitative module assessment can have significant implications in other studies of modularity.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Criteria proposed by this study. The yellow and blue arrows represent the torque exerted by the utilized modules, while the dotted circle signifies the normalized amplitude of the torque. Power Bias quantifies the unevenness of torque amplitude (<bold>top</bold>), and Direction Bias quantifies the irregularity in torque direction (<bold>bottom</bold>) of the modules in task space, respectively. These criteria assess modules with lower bias as superior, indicating better motor performance. Conversely, modules with higher bias are predicted to result in inferior motor performance.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0001.tif"/>
</fig>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>2 Materials and methods</title>
<sec>
<title>2.1 Musculoskeletal plant</title>
<p>In this study, in contrast with the simplified musculoskeletal plants (Hirashima and Nozaki, <xref ref-type="bibr" rid="B30">2012</xref>; Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>; Song et al., <xref ref-type="bibr" rid="B58">2022</xref>), we implemented a more realistic musculoskeletal plant for an isometric force production task by approximating the musculoskeletal dynamics calculation of OpenSim (Delp et al., <xref ref-type="bibr" rid="B19">2007</xref>) so as not to miss the significant properties of musculotendon dynamics such as the passive force element and the force-length relationships of the muscles. In this study, we choose a realistic upper limb musculoskeletal model that we approximate and implement as an affine function of muscle activation (Saul et al., <xref ref-type="bibr" rid="B53">2015</xref>).</p>
<p>The <italic>n</italic>-th muscle&#x00027;s force, <italic>F</italic><sub><italic>n</italic></sub>, is given by multiplication of its maximum isometric force, <italic>F</italic><sub><italic>iso</italic><sub><italic>n</italic></sub></sub>, normalized force function, <italic>f</italic><sub><italic>n</italic></sub>(<italic>a, l</italic><sub><italic>n</italic></sub>), and cosine of pennation angle, &#x003C8;<sub><italic>n</italic></sub>(<italic>l</italic><sub><italic>n</italic></sub>) (<xref ref-type="disp-formula" rid="E1">Equation 1</xref>). Additionally, we can give the normalized force coefficient, <italic>f</italic><sub><italic>n</italic></sub>(<italic>a, l</italic><sub><italic>n</italic></sub>), as a summation of the active force element, <italic>f</italic><sub><italic>AL</italic><sub><italic>n</italic></sub></sub>(<italic>l</italic><sub><italic>n</italic></sub>), that is scaled by muscle activation, <italic>a</italic><sub><italic>n</italic></sub>, and the passive force element, <italic>f</italic><sub><italic>PL</italic><sub><italic>n</italic></sub></sub>(&#x003B8;) (<xref ref-type="disp-formula" rid="E2">Equation 2</xref>). This is uniquely determined by the length of the muscle fiber, <italic>l</italic><sub><italic>n</italic></sub>, when enough time for muscle activation and muscle fiber speed convergence has passed.</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:msub><mml:mrow><mml:mi>o</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>s</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003C8;</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="E2"><label>(2)</label><mml:math id="M2"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>A</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>f</mml:mi></mml:mrow><mml:mrow><mml:mi>P</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>In the musculoskeletal computation framework of OpenSim, the fiber length, <italic>l</italic><sub><italic>n</italic></sub>, is searched so that the tendon force and the fiber force, <italic>F</italic><sub><italic>iso</italic><sub><italic>n</italic></sub></sub><italic>f</italic><sub><italic>n</italic></sub>(<italic>a</italic><sub><italic>n</italic></sub>, <italic>l</italic><sub><italic>n</italic></sub>)<italic>cos</italic>(&#x003B1;<sub><italic>n</italic></sub>), are in equilibrium under a constraint that the total length of them is identical to the muscle-tendon length calculated from the musculoskeletal geometry, i.e., the posture of the model, &#x003B8;. In this study, the posture is given as 2D vectors (&#x003B8; &#x02208; &#x0211D;<sup>2</sup>), with components representing the normalized values of shoulder horizontal flexion/extension angles and elbow flexion/extension angles. We normalized the posture value so that it falls within the interval of (0, 1). Furthermore, because the fiber force depends on muscle activation <italic>a</italic><sub><italic>n</italic></sub>(<xref ref-type="disp-formula" rid="E2">Equation 2</xref>), the fiber length, <italic>l</italic><sub><italic>n</italic></sub>, is affected by muscle activation. Therefore, the fiber length is determined by the model&#x00027;s posture and the activation at convergence, <italic>l</italic><sub><italic>n</italic></sub> : &#x0003D; <italic>l</italic><sub><italic>n</italic></sub>(&#x003B8;, <italic>a</italic><sub><italic>n</italic></sub>), indicating that the muscle force is a function of the musculoskeletal posture and the activation of the muscle. However, it is difficult to find the analytical solution of fiber length directly, and active/passive force&#x02013;length relationship computation requires large computation costs. Hence, we approximate the muscle force as a first-order form of the muscle activation determined by the model&#x00027;s posture (<xref ref-type="disp-formula" rid="E3">Equation 3</xref>).</p>
<disp-formula id="E3"><label>(3)</label><mml:math id="M3"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:mo>&#x02248;</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:msub><mml:mrow><mml:mi>o</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>a</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>A</mml:mi><mml:msub><mml:mrow><mml:mi>L</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mi>P</mml:mi><mml:msub><mml:mrow><mml:mi>L</mml:mi></mml:mrow><mml:mrow><mml:mi>n</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Where <italic>F</italic><sub><italic>iso</italic><sub><italic>n</italic></sub></sub> denotes the maximum isometric force of <italic>n</italic> th muscle. We found the active force coefficient, <italic>k</italic><sub><italic>AL</italic><sub><italic>n</italic></sub></sub>(&#x003B8;), and the passive force coefficient, <italic>k</italic><sub><italic>PL</italic><sub><italic>n</italic></sub></sub>(&#x003B8;), by applying a least-square matching to the relation map of the muscle activation and the muscle force. We extracted 20 samples of the muscle force by intervals of &#x00394;<italic>a</italic><sub><italic>n</italic></sub> &#x0003D; 0.05 while fixing the posture of the musculoskeletal model. In this research, we approximated the mechanics of the musculoskeletal model at three postures that we refer to as &#x0201C;Base Posture,&#x0201D; &#x0201C;Fully Extended,&#x0201D; and &#x0201C;Mildly Extended&#x0201D; (see below and Section 2.4.1), and we conducted this sampling for each posture.</p>
<p>We choose a two-joint torque production system for the task: shoulder horizontal flexion/extension and elbow flexion/extension, denoted as &#x0201C;elv angle&#x0201D; and &#x0201C;elbow flexion&#x0201D;, respectively, in the model. In this research. we decide the task posture &#x003B8;<sub><italic>task</italic></sub> of the musculoskeletal model, which we refer to as &#x0201C;Base Posture&#x0201D; by horizontally and vertically flexing the shoulder by 30 degrees and 90 degrees, respectively, and flexing the elbow by 90 degrees (<xref ref-type="fig" rid="F2">Figure 2</xref>). Similarly to the previous study (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>), the target torque combination was randomly chosen from the 12 ideal torque targets. The 12 torque targets are evenly distributed along the circumference of the circle with a radius of 1[Nm] in the torque space (<xref ref-type="fig" rid="F3">Figure 3A</xref>). The resultant torque, <italic><bold>T</bold></italic>, was calculated by multiplication of the moment arm matrix of <italic>N</italic><sub><italic>mus</italic></sub> simulated muscles, <inline-formula><mml:math id="M4"><mml:mstyle mathvariant="bold-italic"><mml:mi>M</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>&#x02208;</mml:mo><mml:msup><mml:mrow><mml:mi>&#x0211D;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn><mml:mo>&#x000D7;</mml:mo><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula>, and muscle force vectors, <inline-formula><mml:math id="M5"><mml:mstyle mathvariant="bold-italic"><mml:mi>F</mml:mi></mml:mstyle><mml:mo>=</mml:mo><mml:msup><mml:mrow><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:mo>,</mml:mo><mml:mo>.</mml:mo><mml:mo>.</mml:mo><mml:mo>.</mml:mo><mml:mo>,</mml:mo><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mo>&#x022A4;</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula> (<xref ref-type="disp-formula" rid="E4">Equation 4</xref>).</p>
<disp-formula id="E4"><label>(4)</label><mml:math id="M6"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mstyle mathvariant="bold-italic"><mml:mi>T</mml:mi></mml:mstyle><mml:mo>=</mml:mo><mml:mstyle mathvariant="bold-italic"><mml:mi>M</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>F</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:mi>o</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>K</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:mi>A</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>a</mml:mi></mml:mstyle><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>K</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:mi>P</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="E5"><label>(5)</label><mml:math id="M7"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>A</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>P</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Where <italic><bold>K</bold></italic><sup><italic>AL</italic></sup> and <italic><bold>F</bold></italic><sub><italic>iso</italic></sub> denote diagonal matrices whose diagonal components are the active force coefficients and the maximum isometric force, respectively, and <italic><bold>K</bold></italic><sup><italic>PL</italic></sup> denotes a <inline-formula><mml:math id="M8"><mml:msup><mml:mrow><mml:mi>&#x0211D;</mml:mi></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula> vector of the passive force. <inline-formula><mml:math id="M9"><mml:mstyle mathvariant="bold-italic"><mml:mi>a</mml:mi></mml:mstyle><mml:mo>&#x02208;</mml:mo><mml:msup><mml:mrow><mml:mi>&#x0211D;</mml:mi></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula> denotes the vector of the muscle activation. The mechanical function of the muscles or modules, which is defined as a mechanical pulling vector, is calculated as an active force component of <xref ref-type="disp-formula" rid="E4">Equation (4)</xref>, <italic><bold>M</bold></italic>(&#x003B8;)<italic><bold>F</bold></italic><sub><italic>iso</italic></sub><italic><bold>K</bold></italic><sub><italic>AL</italic></sub><italic><bold>a</bold></italic>. These torque calculation procedures are summarized as orange-colored flows in <xref ref-type="fig" rid="F3">Figure 3E</xref>.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Postures of interest. In the posture of the musculoskeletal model, which we refer to as &#x0201C;Base Posture&#x0201D;, the shoulder is horizontally flexed at a 30-degree, and the elbow is flexed at a 90-degree (<bold>left</bold>). In the other two postures, which we refer to as &#x0201C;Fully Extended&#x0201D; (<bold>left</bold>) and &#x0201C;Mildly Extended&#x0201D; (<bold>right</bold>), respectively, the elbow is fully or mildly extended from Base Posture.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0002.tif"/>
</fig>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Non-synergy and synergy model for isometric shoulder and elbow torque production task. <bold>(A)</bold> Twelve torque targets are uniformly distributed on a circumference with a radius of 1[Nm] at 30-degree intervals in the torque space. <bold>(B, C)</bold> Neural network models without modules [<bold>(B)</bold> &#x0201C;Non-synergy model&#x0201D;] and with modules [<bold>(C)</bold> &#x0201C;Synergy model&#x0201D;]. Two neurons at the first layer surrounded by a blue rectangle receive a desired torque target, and adjacent neurons receive task-irrelevant bias neurons. The yellow-colored neurons in the third layer in the synergy model represent muscle synergy. The gray-colored neuron in the final layer represents muscle activation neurons. <bold>(D)</bold> Variance Accounted For (VAF) for determining the number of muscle synergies. The dashed line represents VAF = 0.95. <bold>(E)</bold> Flowchart of the network output and update.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0003.tif"/>
</fig>
<p>In this research, we extracted 22 task-relevant muscles (<italic>N</italic><sub><italic>mus</italic></sub> &#x0003D; 22, deltoid anterior [DeltAnt], deltoid middle [DeltMid], deltoid posterior [DeltPst], supraspinatus, infraspinatus, subscapularis, teres minor [TerMin], teres major [TerMaj], pectoralis major clavicular [PecMajClv], pectoralis major sternal [PecMajStr], pectoralis major ribs [PectMajRib], latissmus dorsi thoracic [LatDorTho], latissmus dorsi lumbar [LatDorLum], latissmus dorsi iliac [LatDorIil], coracobrachialis, triceps long [TRILong], triceps lateral [TRILat], triceps medial [TRIMed], biceps long [BICLong], biceps short [BICShort], brachialis, and brachioradialis), which are agonists or antagonists of the joints movement.</p>
</sec>
<sec>
<title>2.2 Neural network models</title>
<p>We are primarily focused on examining how the mechanical properties of a set of modules influence the performance of modularity in error-based learning. To this end, similarly to the related works, we modeled the motor learning system as a descending feed-forward neural network. Although a feed-forward neural network is a largely simplified motor control system which ignores some important complexities of actual neural networks, such as sensory feedback loop and recurrent connection, it provides powerful description capabilities against data of experimentally observed neural behavior (Rokni et al., <xref ref-type="bibr" rid="B50">2007</xref>; Hirashima and Nozaki, <xref ref-type="bibr" rid="B30">2012</xref>; Takiyama and Okada, <xref ref-type="bibr" rid="B64">2012</xref>; Song et al., <xref ref-type="bibr" rid="B58">2022</xref>). In this research, we modeled two types of neural network (<xref ref-type="fig" rid="F3">Figures 3B</xref>, <xref ref-type="fig" rid="F3">C</xref>): one is a non-synergy model that the CNS directly and individually control muscles, and the other is synergy model that the CNS indirectly controls muscles via a small number of modules. The performance of the network is defined as the learning error at the final learning trials and its learning speed. The function of the network and how it learns are summarized as blue-colored and green-colored flows in <xref ref-type="fig" rid="F3">Figure 3E</xref>.</p>
<sec>
<title>2.2.1 Non-synergy model</title>
<p>Our network&#x00027;s structure is the same as the one used in previous studies (Hirashima and Nozaki, <xref ref-type="bibr" rid="B30">2012</xref>; Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>; Song et al., <xref ref-type="bibr" rid="B58">2022</xref>), with the exception of the addition of two bias neurons at the input layer (<xref ref-type="fig" rid="F3">Figure 3B</xref>). Bias neurons, <italic><bold>b</bold></italic>, are non-zero constant vectors that have no correlation with the task. This simplified bias neuron addition can be partially justified because the neurons of the primary motor cortex are active for various motor parameters (Scott, <xref ref-type="bibr" rid="B54">2008</xref>; Shenoy et al., <xref ref-type="bibr" rid="B56">2013</xref>; Gallego et al., <xref ref-type="bibr" rid="B23">2018</xref>) rather than specialized for specific parameters such as gain of the task, and there should be neurons which shows almost no correlation with the task. In our musculoskeletal model, we added the passive force component that makes an input&#x02013;output relationship of the plant affine transformed one (<xref ref-type="disp-formula" rid="E3">Equation 3</xref>) to reproduce the OpenSim musculoskeletal dynamics, and added bias neurons serve to compensate for this disturbance. The input layer contains two torque-active neurons that receive ideal torque, <italic><bold>&#x003C4;</bold></italic> randomly from the 12 torque production targets (<xref ref-type="fig" rid="F3">Figure 3A</xref>). The other part of the network, e.g., the first intermediate layer (M1 layer), which models the primary motor cortex and consists of 1000 neurons, computes and learns required motor commands in accordance with the input weight matrix, <italic><bold>W</bold></italic><bold><sub><italic>inp</italic></sub></bold>. The innervation matrix, <italic><bold>Z</bold></italic>, which models the spinal cord, computes the resulting muscle activation vector, <italic><bold>a</bold></italic>;</p>
<disp-formula id="E6"><label>(6)</label><mml:math id="M10"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>a</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>&#x0230A;</mml:mo><mml:mrow><mml:mi>Z</mml:mi><mml:msub><mml:mrow><mml:mi>W</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mi>x</mml:mi></mml:mrow><mml:mo>&#x0230B;</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Where <italic><bold>x</bold></italic> denotes an input vector, which is a concatenated vector of desired torque and bias (<xref ref-type="disp-formula" rid="E7">Equation 7</xref>).</p>
<disp-formula id="E7"><label>(7)</label><mml:math id="M11"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>x</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mtable style="text-align:axis;" equalrows="false" columnlines="none none none none none none none none none" equalcolumns="false" class="array"><mml:mtr><mml:mtd><mml:mi>&#x003C4;</mml:mi></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mi>b</mml:mi></mml:mtd></mml:mtr></mml:mtable></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>In a non-linear network, the muscle activation, <italic><bold>a</bold></italic>, is given by filtering the output of the network <italic><bold>ZW</bold></italic><bold><sub><italic>inp</italic></sub><italic>x</italic></bold> with non-negative constraints &#x0230A;&#x000B7;&#x0230B;. We initialized the innervation matrix and input weight matrix in the same way as the previous studies (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>): The input matrix, <italic><bold>W</bold></italic><sub><italic>inp</italic></sub>, is initialized as white noise matrix and the innervation matrix, <italic><bold>Z</bold></italic>, is initialized so that columns of the matrix uniformly distribute on the <inline-formula><mml:math id="M12"><mml:msup><mml:mrow><mml:mi>&#x0211D;</mml:mi></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula> hypersphere.</p>
</sec>
<sec>
<title>2.2.2 Synergy Model</title>
<p>The synergy model shares the same structure with the non-synergy model for input and the first intermediate layer. The difference is an additional layer (synergy layer) inserted just after the M1 layer, which mimics the spinal interneurons (<xref ref-type="fig" rid="F3">Figure 3C</xref>, yellow-colored neurons). The cortical input matrix to the synergy layer, <italic><bold>Z</bold></italic><bold><sub><italic>syn</italic></sub></bold>, was defined similarly to the non-synergy model but normalized such that the average force amplitude of M1 neurons is identical to that of non-synergy model (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>). This <italic><bold>Z</bold></italic><bold><sub><italic>syn</italic></sub></bold> normalization is necessary for a fair comparison of the non-synergy model and the synergy model. Furthermore, it allows us to exclude the average scale of torque, <inline-formula><mml:math id="M13"><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover></mml:math></inline-formula> (<xref ref-type="disp-formula" rid="E8">Equation 8</xref>), exerted by each synergies of interest, <italic>T</italic><sub><italic>mod</italic><sub><italic>i</italic></sub></sub> (<xref ref-type="disp-formula" rid="E9">Equation 9</xref>)</p>
<disp-formula id="E8"><label>(8)</label><mml:math id="M14"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:msubsup><mml:mrow><mml:mo>&#x003A3;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msubsup><mml:mo>|</mml:mo><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>T</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mo>|</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<disp-formula id="E9"><label>(9)</label><mml:math id="M15"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>T</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mstyle mathvariant="bold-italic"><mml:mi>M</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>&#x003B8;</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:msub><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:mi>o</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>K</mml:mi></mml:mrow><mml:mrow><mml:mi>A</mml:mi><mml:mi>L</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>W</mml:mi></mml:mrow><mml:mrow><mml:mi>s</mml:mi><mml:mi>y</mml:mi><mml:msub><mml:mrow><mml:mi>n</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub></mml:mstyle></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>from consideration. Muscle synergies, <italic><bold>W</bold></italic><bold><sub><italic>syn</italic></sub></bold>, are provided by either non-negative matrix factorization (NMF) or a random combination of feasible muscle activation. We refer to muscle synergies extracted by NMF as &#x0201C;NMF-derived synergies&#x0201D;. On the other hand, muscle synergies comprise randomly selected feasible muscle activation as &#x0201C;feasible synergies&#x0201D; in this study (see Experiment 2). Similar to the non-synergy model, the network output is transformed into muscle activation with non-negative constraints in a non-linear network.</p>
<disp-formula id="E10"><label>(10)</label><mml:math id="M16"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>a</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>&#x0230A;</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>W</mml:mi></mml:mrow><mml:mrow><mml:mi>s</mml:mi><mml:mi>y</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>Z</mml:mi></mml:mrow><mml:mrow><mml:mi>s</mml:mi><mml:mi>y</mml:mi><mml:mi>n</mml:mi></mml:mrow></mml:msub><mml:msub><mml:mrow><mml:mi>W</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mi>x</mml:mi></mml:mrow><mml:mo>&#x0230B;</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>The NMF-derived synergies were extracted from the optimized non-synergy model. The non-synergy model was optimized by training 25,000 trials, and the last 100 trials for muscle activation data were used to extract muscle synergies (Hirashima and Oya, <xref ref-type="bibr" rid="B31">2016</xref>; Song et al., <xref ref-type="bibr" rid="B58">2022</xref>). We set the number of NMF-derived synergies and feasible synergies at four where the averaged variance accounted for (VAF), which is calculated as VAF = 1 - SSE/SST, exceeds 0.95 (Rodriguez et al., <xref ref-type="bibr" rid="B47">2013</xref>; Sy et al., <xref ref-type="bibr" rid="B61">2016</xref>) (<xref ref-type="fig" rid="F3">Figure 3D</xref>). SSE denotes the sum of the squares of residual errors, and SST is the sum of the square differences between each data point and the overall mean. In this study, we adopted the more strict heuristic threshold, which is less frequently used, because a lenient threshold could overlook important components for task achievement (Barradas et al., <xref ref-type="bibr" rid="B5">2020</xref>). In our model, lenient threshold such as <italic>VAF</italic> &#x0003D; 0.90 provides only three muscle synergies that are insufficient to achieve the two-dimensional motor task (<xref ref-type="fig" rid="F3">Figure 3D</xref>).</p>
</sec>
<sec>
<title>2.2.3 Training procedure</title>
<p>The neural network is trained for 25,000 trials, and the input weight matrix at <italic>t</italic>-th learning trial, <italic><bold>W</bold></italic><sub><italic>inp</italic></sub>(<italic>t</italic>), is updated using the error feedback-with-decay algorithm.</p>
<disp-formula id="E11"><label>(11)</label><mml:math id="M17"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>W</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mo>-</mml:mo><mml:mi>&#x003B1;</mml:mi><mml:mfrac><mml:mrow><mml:mi>&#x02202;</mml:mi><mml:msub><mml:mrow><mml:mi>J</mml:mi></mml:mrow><mml:mrow><mml:mi>e</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mrow><mml:mi>&#x02202;</mml:mi><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>W</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:mfrac><mml:mo>-</mml:mo><mml:mi>&#x003B2;</mml:mi><mml:msub><mml:mrow><mml:mstyle mathvariant="bold-italic"><mml:mi>W</mml:mi></mml:mstyle></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mi>n</mml:mi><mml:mi>p</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Where &#x003B1; denotes learning rate and &#x003B2; denotes decay rate. <italic>J</italic><sub><italic>e</italic></sub> denotes the error cost that is calculated by the error vector at <italic>t</italic>-th trial, <italic><bold>e</bold></italic>(<italic>t</italic>) &#x0003D; <bold>&#x003C4;</bold>(<italic>t</italic>) &#x02212; <italic><bold>T</bold></italic>(<italic>t</italic>), between output torque and input torque, <inline-formula><mml:math id="M18"><mml:msub><mml:mrow><mml:mi>J</mml:mi></mml:mrow><mml:mrow><mml:mi>e</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo>/</mml:mo><mml:mn>2</mml:mn><mml:mstyle mathvariant="bold-italic"><mml:mi>e</mml:mi></mml:mstyle><mml:msup><mml:mrow><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mo>&#x022A4;</mml:mo></mml:mrow></mml:msup><mml:mstyle mathvariant="bold-italic"><mml:mi>e</mml:mi></mml:mstyle><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>t</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:math></inline-formula>. The input matrix is updated in accordance with the gradient of the error cost (The first term of <xref ref-type="disp-formula" rid="E11">Equation 11</xref>).</p>
<p>The second term is a weight decay term that minimizes motor effort (Hirashima and Nozaki, <xref ref-type="bibr" rid="B30">2012</xref>). Learning rate and decay rate were set to &#x003B1; &#x0003D; 20 and &#x003B2; &#x0003D; 1.0 &#x000D7; 10<sup>&#x02212;4</sup>, respectively.</p>
<p>This research defines motor error as the norm of the error vector. The learning speed of the network, <italic>v</italic>, is determined by calculating the exponential coefficient of an approximation function that represents the change in learning error across trials, |<italic>e</italic><sub><italic>t</italic></sub>| (<xref ref-type="disp-formula" rid="E12">Equation 12</xref>) (Takiyama and Okada, <xref ref-type="bibr" rid="B64">2012</xref>).</p>
<disp-formula id="E12"><label>(12)</label><mml:math id="M19"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mo>|</mml:mo><mml:msub><mml:mrow><mml:mi>e</mml:mi></mml:mrow><mml:mrow><mml:mi>t</mml:mi></mml:mrow></mml:msub><mml:mo>|</mml:mo><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mi>e</mml:mi><mml:mi>x</mml:mi><mml:mi>p</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mo>-</mml:mo><mml:mi>v</mml:mi><mml:mi>t</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>&#x003B3;</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
</sec>
</sec>
<sec>
<title>2.3 Direction bias and power bias</title>
<p>To assess how the mechanical properties of the modules affect the performance of the network, we proposed two criteria that quantify the mechanical properties of the modules in the task space.</p>
<sec>
<title>2.3.1 Direction bias</title>
<p>The previous research (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>) used a non-linear network and partially demonstrated that a more effective set of modules for motor learning is associated with the angular regularity of forces of a set of modules in the task space. These findings are true for a simplified musculoskeletal model and partially true even for our musculoskeletal model. Inspired from their work and considering the mathematics of error-based learning of a linear neural network, we first conceived one novel criteria named &#x0201C;Direction Bias (DB)&#x0201D;. The basic concept of DB is illustrated in <xref ref-type="fig" rid="F1">Figure 1</xref> at the bottom. DB quantifies how the set of module torques in use is irregular in direction in the task space. If the forces of the modules are sparsely distributed in the task space (<xref ref-type="fig" rid="F1">Figure 1</xref>, left one at the bottom), DB evaluates the given module set as the better one, while the biased one (<xref ref-type="fig" rid="F1">Figure 1</xref>, right one at the bottom) is considered worse. However, we heuristically found the complexities of the realistic musculoskeletal system, i.e., the contribution of passive force (<xref ref-type="disp-formula" rid="E2">Equation 2</xref>), affect how the forces of modules should be distributed in the task space because of the non-negative constraint of the muscle activation (<xref ref-type="disp-formula" rid="E6">Equations 6</xref>, <xref ref-type="disp-formula" rid="E10">10</xref>). Qualitatively, this non-negative constraint rectify the muscle control signals, and it forces the network to compensate for the passive force. For example, if the desired torque targets, &#x003C4;, distribute on a circle&#x00027;s circumference like <xref ref-type="fig" rid="F3">Figure 3A</xref>, the network has to generate <bold>&#x003C4;&#x02212;<italic>T</italic><sub><italic>PL</italic></sub></bold> to realize the desired torque. In the end, the torques produced by the network will be placed on another circle&#x00027;s circumference such that the task circle is shifted toward <bold>&#x003C4;&#x02212;<italic>T</italic><sub><italic>PL</italic></sub></bold> (<xref ref-type="fig" rid="F3">Figure 3A</xref>, blue-dotted circle). Therefore, we hypothesized that the set of synergies whose torque vectors regularly cover this shifted circle will be efficient for achieving the task. Direction bias (DB) formulates this idea, and it evaluates how the torques of modules, <italic><bold>T</bold></italic><sub><italic>mod</italic></sub>, <italic>do not</italic> regularly distribute on the torque circle where output torque of the network eventually need to be placed for producing the desired torques on the circumrefence. The calculation of DB is done as follows: First, we calculate the intersection points of torque vector of modules, <italic><bold>T</bold></italic><sub><italic>mod</italic></sub>, and the shifted circle, |&#x003C4;&#x02212;<italic><bold>T</bold></italic><sub><italic>PL</italic></sub>| &#x0003D; 1[<italic>Nm</italic>] (<xref ref-type="fig" rid="F4">Figure 4A</xref> left). Next, we calculate the angles of neighboring intersection points, &#x003C9;<sub><italic>i</italic></sub>, on the circle&#x00027;s circumference (<xref ref-type="fig" rid="F4">Figure 4A</xref> middle). Finally, we calculate DB as the standard deviation of the angles of neighboring points on the circle&#x00027;s circumference (<xref ref-type="fig" rid="F4">Figure 4A</xref> right) (<xref ref-type="disp-formula" rid="E13">Equation 13</xref>). Note that it provides an identical indication to the bias in mechanical direction of modules (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>) when the passive force is zero:</p>
<disp-formula id="E13"><label>(13)</label><mml:math id="M20"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>D</mml:mi><mml:mi>B</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:msqrt><mml:mrow><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:munderover></mml:mstyle><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:msub><mml:mrow><mml:mi>&#x003C9;</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:mi>&#x003C9;</mml:mi></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:msqrt></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <inline-formula><mml:math id="M21"><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:mi>&#x003C9;</mml:mi></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover></mml:math></inline-formula> denotes mean of &#x003C9;.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Visual description of direction bias and power bias. <bold>(A, B)</bold> Description of direction bias. The yellow dotted circle represents the circle of the torque production target with a radius of 1[Nm] (<xref ref-type="fig" rid="F3">Figure 3A</xref>), and the yellow arrows represent the torque direction of modules, <italic><bold>T</bold></italic><sub><italic>mod</italic></sub>. The blue dotted circle represents a circle of torque that the network actually generates to compensate for the passive force (red dotted arrow, <italic><bold>T</bold></italic><sub><italic>PL</italic></sub>) and to realize the desired torque targets. Orange dots represent intersections of the blue dotted circle and the vectors of modules, <italic><bold>T</bold></italic><sub><italic>mod</italic></sub>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0004.tif"/>
</fig>
</sec>
<sec>
<title>2.3.2 Power bias</title>
<p>DB does not take care of the scale of the module forces. However, from the linear neural network theory, the scale of the module torque also determines the characteristics of the network (e.g., eigenvalues of the system matrix) in the same way as the direction of the forces, which DB assesses. Therefore, we extended the idea of mechanical regularity of the modules from the angular perspective to the gain perspective. The concept is illustrated in <xref ref-type="fig" rid="F1">Figure 1</xref>. In general, if the gain of the modules is not even (<xref ref-type="fig" rid="F1">Figure 1</xref> right), the gains are possibly worse for the task. To investigate how the unevenness of the forces of the modules affect motor performance, we proposed Power Bias (PB) to evaluate how the gains of the forces of the modules &#x0201C;are not&#x0201D; regular. PB is computed as the standard deviation of the gains of the modules (<xref ref-type="fig" rid="F4">Figure 4</xref>) (<xref ref-type="disp-formula" rid="E14">Equation 14</xref>):</p>
<disp-formula id="E14"><label>(14)</label><mml:math id="M22"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>P</mml:mi><mml:mi>B</mml:mi><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:msqrt><mml:mrow><mml:mstyle displaystyle="true"><mml:munderover accentunder="false" accent="false"><mml:mrow><mml:mo>&#x02211;</mml:mo></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:munderover></mml:mstyle><mml:mo>|</mml:mo><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:msub><mml:mrow><mml:mi>d</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover><mml:msup><mml:mrow><mml:mo>|</mml:mo></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:msqrt></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Where <italic>T</italic><sub><italic>mod</italic><sub><italic>i</italic></sub></sub> denotes the torque of the <italic>i</italic>-th modules and <inline-formula><mml:math id="M23"><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover></mml:math></inline-formula> denotes the average torque of the modules.</p>
</sec>
</sec>
<sec>
<title>2.4 Experimental procedure</title>
<sec>
<title>2.4.1 Experiment 1: synergy model vs. non-synergy model</title>
<p>To investigate the performance of the modularity in our musculoskeletal system, we conducted a standard comparative experiment. The non-synergy model was trained first (i.e., Section 2.2.3) at the Base Posture (BP). Next, we extracted NMF-derived synergies from this non-synergy model. We prepared one synergy model, which learns how to control muscle synergies optimized for BP, and we provided it with extracted synergies. This model is referred to as &#x0201C;BP mods&#x0201D; in this study. Regarding the measurement of DB and PB of non-synergy model, we calculated PB and DB of the synergy model whose <italic><bold>W</bold></italic><sub><italic>syn</italic></sub> is <italic>N</italic><sub><italic>mus</italic></sub> dimensional identity matrix, <inline-formula><mml:math id="M25"><mml:mstyle mathvariant="bold-italic"><mml:mi>I</mml:mi></mml:mstyle><mml:mo>&#x02208;</mml:mo><mml:msup><mml:mrow><mml:mi>&#x0211D;</mml:mi></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub><mml:mo>&#x000D7;</mml:mo><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>u</mml:mi><mml:mi>s</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:msup></mml:math></inline-formula> instead.</p>
<p>Furthermore, to discuss why muscle synergies extracted from specific biomechanical contexts sometimes fail to perform well in other contexts from the mechanical viewpoint, we prepared two additional synergy models and two sets of NMF-derived synergies for the models. These additional sets of synergies are extracted from two non-synergy models optimized for two postures different from BP. We provided synergy model with these two module sets to the motor learning task at the BP. At one of the postures, we refer to as &#x0201C;Fully Extended (FE, <xref ref-type="fig" rid="F2">Figure 2</xref> middle)&#x0201D;,&#x003B8;<sub><italic>FE</italic></sub>, the elbow is horizontally extended 90 degrees from the BP. At the other posture, we refer to &#x0201C;Mildly Extended (ME, <xref ref-type="fig" rid="F2">Figure 2</xref> right)&#x0201D;,&#x003B8;<sub><italic>ME</italic></sub>, the elbow was extended 45 degrees from the BP. These models are referred to as &#x0201C;FE mods&#x0201D; and &#x0201C;ME mods&#x0201D;, respectively, in this study. The three synergy models, which respectively control muscle synergies extracted from a non-synergy model optimized for FE, ME, or BP, were trained at the BP and iterated 30 times. We compared the learning performance across these three synergy models and the non-synergy model, and we also measured PB and DB of the utilized synergies of the models and the non-synergy model for analysis. Note that the synergy model learns only how to control the provided muscle synergies through the optimization of <italic><bold>W</bold></italic><sub><italic>inp</italic></sub>, and the synergies are not updated during the learning. Therefore, the difference in learning performance across the synergy models depends on their synergies. Comparison of the learning performance of across models were conducted with analysis of variance (ANOVA) and post hoc test. On the other hand, the performance of the synergy network and the non-synergy network was analyzed with the Wilcoxon signed rank test.</p>
</sec>
<sec>
<title>2.4.2 Experiment 2: correlation of performance of modularity with PB and DB</title>
<p>To demonstrate to what extent PB and DB explain the performance of non-linear networks in a realistic musculoskeletal system, we prepared multiple sets of feasible synergies and conducted learning simulations of the synergy model.</p>
<p>The feasible synergies can be categorized into two groups: One is the synergies, which we refer to as &#x0201C;FSforDB&#x0201D;, and it is used for verification of DB. It consists of <italic>N</italic><sub><italic>mod</italic></sub> synergies whose amplitude of exerting torques remain consistent while their directions vary. In other words, among the different FSforDB, PB are preserved and only DB vary.</p>
<p>Generation of this type of synergies (FSforDB) is as follows. First, we generated a dataset of muscle activity patterns necessary to exert force in any direction. Specifically, torque targets were placed at intervals of 3&#x000B0; along the circumference of a torque circle with a radius of 1 [Nm] (<xref ref-type="fig" rid="F5">Figure 5A</xref>, upper left). By training a non-synergy model to produce each target torque, we made the dataset of 120 muscle activity patterns required to exert force in each direction. After that, we randomly selected <italic>N</italic><sub><italic>mod</italic></sub> muscle activation patterns from the dataset. The example of FSforDB is illustrated in <xref ref-type="fig" rid="F5">Figure 5B</xref>. If the synergy model sufficiently learn the task of <xref ref-type="fig" rid="F3">Figure 3A</xref> using the set of selected muscle activation patterns, we admitted it as the valid set of FSforDB for verification of DB. In this research, we determined the sufficiency of the learning performance of the synergy network by using a threshold, which we refer to as the &#x0201C;feasibility cut-off.&#x0201D; In other words, if the synergy network, utilizing a set of selected muscle activation patterns, fails to learn the task so that the average torque error remains below the value for feasibility cutoff, the selected muscle activation patterns are excluded from the dataset of the feasible synergies. We established the feasibility cutoff value as 0.1 [Nm] and applied it to the generation of FSforDB. This sorting is necessary for analysis because an ineffective synergy set can cause learning of the synergy network to easily drop into bad local optima, where the learning was not sufficiently progressed.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Making of the feasible synergy set. <bold>(A)</bold> Making muscle activation pattern dataset. The red dot, arrow, and bars are example of making one activation-torque data. Each corresponds to motor target the non-synergy network receives, the torque produced by the network, and the muscle activation for producing the motor target, respectively. This procedure is iterated for all the motor targets (upper left), and the non-synergy model trained to produce the given torque computes necessary motor activation pattern (upper right). <bold>(B)</bold> Example of a set of four feasible synergies used for verification of DB. <italic>N</italic><sub><italic>mod</italic></sub> muscle activation patterns are randomly selected from the normalized muscle activation data is so that the amplitude of torque of each synergy is 1 [Nm]; <italic><bold>T</bold></italic><sub><italic>mod</italic><sub><italic>i</italic></sub></sub> &#x0003D; 1. <bold>(C)</bold> Example of four feasible synergies used for verification of PB. The muscle activation patterns are selected to satisfy <italic>DB</italic> &#x0003D; 0 and scaled randomly so that mean amplitude of torque is 1 [Nm]; <inline-formula><mml:math id="M24"><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0005.tif"/>
</fig>
<p>The other type of feasible synergies set, which we refer to as &#x0201C;FSforPB&#x0201D;, is used for verification of PB. It consists of <italic>N</italic><sub><italic>mod</italic></sub> synergies whose amplitude of exerting torques vary while their directions remain consistent. In other words, among the different FSforPB, DB are preserved and only PB vary, in contrast with FSforDB. Generation of this type of synergies (FSforPB) is as follows. We first selected <italic>N</italic><sub><italic>mod</italic></sub> activation patterns from the dataset of 120 muscle activation patterns, which we made for generation of FSforDB, so that <italic>DB</italic> &#x0003D; 0. Next, we randomly scaled their gains within the interval of [0.5, 1.5] so that the average torque gain of the synergies, <inline-formula><mml:math id="M26"><mml:mover accent="false" class="mml-overline"><mml:mrow><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>m</mml:mi><mml:mi>o</mml:mi><mml:mi>d</mml:mi></mml:mrow></mml:msub></mml:mrow><mml:mo accent="true">&#x000AF;</mml:mo></mml:mover><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:math></inline-formula>, becomes 1 [Nm]. The example of FSforPB is illustrated in <xref ref-type="fig" rid="F5">Figure 5C</xref>. Finally, similar to generation FSforDB, if the synergy network can sufficiently learn the task of <xref ref-type="fig" rid="F3">Figure 3A</xref> using the generated synergies set, we admitted it as the valid set of FSforPB for verification of PB. As for the feasibility cutoff for FSforPB, in common with FSforDB, we set the threshold value as 0.1 [Nm].</p>
<p>To verify our criteria, we trained the synergy model 30 times for each set of synergies of either sets of FSforPB or sets of FSforDB. In this reserach, We generated 30 sets of FSforPB and we generated 90 sets of FSforDB. The learning performance of each synergy model is represented as the median of 30 times training. We analyzed the correlation of our criteria with the learning performance of the synergy models. The statistical analysis is performed using multiple regression analysis with F-test.</p>
</sec>
<sec>
<title>2.4.3 Experiment 3: effect of dimensionality of modules on PB and DB</title>
<p>To investigate whether the explanation capability of PB and DB are robust to the number of modules, we conducted motor learning simulations while changing the number of modules, DB and PB. We iterated each simulation 30 times and analyzed the data with multivariate analysis. We investigated the correlation when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, 15, 22. Note that the synergy model that controls the same number of synergies with the muscles, <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22, is not equivalent to the non-synergy model unless the synergy matrix, <italic><bold>W</bold></italic><sub><italic>syn</italic></sub>, is the identity matrix. The number of samples is the same as in experiment 2 (30 samples for PB and 90 samples for DB). We calculate the <italic>p</italic>-value with <italic>F</italic>-test and <italic>R</italic><sup>2</sup> for each number of modules.</p>
<p>In addition, to test whether the dimensionality of the synergy network affects the accuracy and learning speed of the synergy model, we compared the performance of the synergy network when both PB and DB were zero at each number of modules. In other words, we compared the performance of the synergy network when both PB and DB were zero at each number of modules. We analyzed the data with analysis of variance (ANOVA) and post hoc test.</p>
</sec>
<sec>
<title>2.4.4 Experiment 4: independence test of DB and PB</title>
<p>To investigate whether PB and DB independently affect the learning performance, we trained the synergy network with module sets that provide various values of PB and DB. We conducted this investigation for the case of <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, 8, 15, and 22. To generate new feasible synergy sets whose DB and PB vary across each synergy set, we randomly sampled 60 FSforDB without replacement and changing PB of them within the interval of (0.5 1.5). The feasibility cutoff value for this new synergy was set as 0.15 [Nm]. We conducted the learning simulation of the synergy model 30 times, and we analyzed the median data with multiple regression analysis. The data of the error or the learning speed, here we denote <italic><bold>X</bold></italic>, is regressed by a linear function of PB and DB:</p>
<disp-formula id="E15"><label>(15)</label><mml:math id="M27"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mstyle mathvariant="bold-italic"><mml:mi>X</mml:mi></mml:mstyle><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mstyle mathvariant="bold-italic"><mml:mi>P</mml:mi><mml:mi>B</mml:mi></mml:mstyle><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub><mml:mstyle mathvariant="bold-italic"><mml:mi>D</mml:mi><mml:mi>B</mml:mi></mml:mstyle><mml:mo>&#x0002B;</mml:mo><mml:msub><mml:mrow><mml:mi>k</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>Where <italic>k</italic><sub><italic>i</italic></sub> denotes regression coefficients. We used the F-test to calculate the p-value of the regression. Furthermore, we also calculated the Variance Inflation Factor (VIF) of PB and DB to test the multicollinearity.</p>
</sec>
<sec>
<title>2.4.5 Experiment 5: effect of the scale of the passive force element on PB and DB</title>
<p>To demonstrate the effect of the scale of the passive force on the explanation capability, we changed the scale of the passive force element so that the passive force derived torque, <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.3 and 0.7 [Nm] (<xref ref-type="disp-formula" rid="E5">Equation 5</xref>). The number of modules, <italic>N</italic><sub><italic>mod</italic></sub>, is determined as four. We provide the synergy model with the same modules as the set used in section 2.4.2: 90 samples for DB and 30 modules for PB, and examined how the correlations in learning performance and the criteria changes with the scale of <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold>.</p>
</sec>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>3 Results</title>
<sec>
<title>3.1 Musculoskeletal model with passive force well reproduces isometric mechanics of OpenSim</title>
<p>To demonstrate the reproduction capability of our plant for the musculoskeletal model, the mean error and mean absolute deviation (MAD) of each muscle force at the base posture were calculated. Furthermore, <italic>R</italic><sup>2</sup> value and <italic>p</italic>-value of linear hypothesis test based on F-test (<xref ref-type="table" rid="T1">Table 1</xref>). All the muscles are well reproduced by linear regression with high reliability (<italic>R</italic><sup>2</sup> &#x0003E; 0.99, <italic>p</italic> &#x0003C; 0.05). Although most of the large approximation errors of the normalized muscle force concentrate around <italic>u</italic> &#x0003D; 0, 0.5, 1.0, its approximation error keeps within 2.5 &#x000D7; 10<sup>&#x02212;3</sup> (<xref ref-type="fig" rid="F6">Figure 6B</xref>), and mean error of normalized muscle forces keep within 5% and MADs keeps within 6%. These results indicate that our musculoskeletal model reproduces characteristics of the musculoskeletal model, including a significant property, i.e., the passive force (<xref ref-type="fig" rid="F6">Figure 6A</xref>) in the isometric force production.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Approximation accuracy of the musculoskeletal model.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:#919498;color:#ffffff">
<th valign="top" align="left"><bold>Muscle name</bold></th>
<th valign="top" align="center"><bold>Mean error [<italic>%</italic>]</bold></th>
<th valign="top" align="center"><bold>MAD [<italic>%</italic>]</bold></th>
<th valign="top" align="center"><bold><italic>R</italic><sup>2</sup></bold></th>
<th valign="top" align="center"><bold><italic>p</italic>-value</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">DeltAnt</td>
<td valign="top" align="center">0.4083</td>
<td valign="top" align="center">0.5289</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">4.3059 &#x000D7; 10<sup>&#x02212;51</sup></td>
</tr> <tr>
<td valign="top" align="left">DeltMid</td>
<td valign="top" align="center">4.0300</td>
<td valign="top" align="center">5.4351</td>
<td valign="top" align="center">0.9994</td>
<td valign="top" align="center">4.0909 &#x000D7; 10<sup>&#x02212;32</sup></td>
</tr> <tr>
<td valign="top" align="left">DeltPst</td>
<td valign="top" align="center">0.1557</td>
<td valign="top" align="center">0.2032</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">2.9574 &#x000D7; 10<sup>&#x02212;59</sup></td>
</tr> <tr>
<td valign="top" align="left">supraspinatus</td>
<td valign="top" align="center">2.1961</td>
<td valign="top" align="center">2.8877</td>
<td valign="top" align="center">0.9998</td>
<td valign="top" align="center">4.3559 &#x000D7; 10<sup>&#x02212;37</sup></td>
</tr> <tr>
<td valign="top" align="left">infraspinatus</td>
<td valign="top" align="center">0.2593</td>
<td valign="top" align="center">0.3389</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">4.7510 &#x000D7; 10<sup>&#x02212;55</sup></td>
</tr> <tr>
<td valign="top" align="left">Subscapularis</td>
<td valign="top" align="center">0.2108</td>
<td valign="top" align="center">0.2759</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">9.2134 &#x000D7; 10<sup>&#x02212;57</sup></td>
</tr> <tr>
<td valign="top" align="left">TerMin</td>
<td valign="top" align="center">0.6371</td>
<td valign="top" align="center">0.8315</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">1.5181 &#x000D7; 10<sup>&#x02212;47</sup></td>
</tr> <tr>
<td valign="top" align="left">TerMaj</td>
<td valign="top" align="center">0.0158</td>
<td valign="top" align="center">0.020</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">4.4394 &#x000D7; 10<sup>&#x02212;78</sup></td>
</tr> <tr>
<td valign="top" align="left">PecMajClv</td>
<td valign="top" align="center">0.0121</td>
<td valign="top" align="center">0.0158</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">2.1650 &#x000D7; 10<sup>&#x02212;80</sup></td>
</tr> <tr>
<td valign="top" align="left">PecMajStr</td>
<td valign="top" align="center">0.4289</td>
<td valign="top" align="center">0.5603</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">7.6528 &#x000D7; 10<sup>&#x02212;51</sup></td>
</tr> <tr>
<td valign="top" align="left">PecMajRib</td>
<td valign="top" align="center">0.5998</td>
<td valign="top" align="center">0.7855</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">4.6422 &#x000D7; 10<sup>&#x02212;48</sup></td>
</tr> <tr>
<td valign="top" align="left">LatDorsiTho</td>
<td valign="top" align="center">0.4225</td>
<td valign="top" align="center">0.5537</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">5.9591 &#x000D7; 10<sup>&#x02212;51</sup></td>
</tr> <tr>
<td valign="top" align="left">LatDorsiLum</td>
<td valign="top" align="center">0.8733</td>
<td valign="top" align="center">1.1382</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">7.8627 &#x000D7; 10<sup>&#x02212;45</sup></td>
</tr> <tr>
<td valign="top" align="left">LatDorsiIli</td>
<td valign="top" align="center">0.3257</td>
<td valign="top" align="center">0.4263</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">3.5705 &#x000D7; 10<sup>&#x02212;53</sup></td>
</tr> <tr>
<td valign="top" align="left">Corabrachialis</td>
<td valign="top" align="center">0.2042</td>
<td valign="top" align="center">0.2786</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">7.3990 &#x000D7; 10<sup>&#x02212;58</sup></td>
</tr> <tr>
<td valign="top" align="left">TRILong</td>
<td valign="top" align="center">0.1418</td>
<td valign="top" align="center">0.0692</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">2.8085 &#x000D7; 10<sup>&#x02212;36</sup></td>
</tr> <tr>
<td valign="top" align="left">TRILat</td>
<td valign="top" align="center">0.4837</td>
<td valign="top" align="center">0.6313</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">6.8502 &#x000D7; 10<sup>&#x02212;50</sup></td>
</tr> <tr>
<td valign="top" align="left">TRIMed</td>
<td valign="top" align="center">0.3710</td>
<td valign="top" align="center">0.4867</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">3.5051 &#x000D7; 10<sup>&#x02212;52</sup></td>
</tr> <tr>
<td valign="top" align="left">BICLong</td>
<td valign="top" align="center">0.9971</td>
<td valign="top" align="center">1.2906</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">1.4896 &#x000D7; 10<sup>&#x02212;43</sup></td>
</tr> <tr>
<td valign="top" align="left">BICShort</td>
<td valign="top" align="center">2.5013</td>
<td valign="top" align="center">3.3371</td>
<td valign="top" align="center">0.9998</td>
<td valign="top" align="center">7.1196 &#x000D7; 10<sup>&#x02212;37</sup></td>
</tr> <tr>
<td valign="top" align="left">Brachialis</td>
<td valign="top" align="center">0.3893</td>
<td valign="top" align="center">0.5053</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">6.4226 &#x000D7; 10<sup>&#x02212;43</sup></td>
</tr> <tr>
<td valign="top" align="left">Brachioradialis</td>
<td valign="top" align="center">1.0909</td>
<td valign="top" align="center">1.4146</td>
<td valign="top" align="center">1.0000</td>
<td valign="top" align="center">6.4226 &#x000D7; 10<sup>&#x02212;43</sup></td>
</tr></tbody>
</table>
</table-wrap>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>Approximated muscle mechanics and regression accuracy. <bold>(A, B)</bold> Four examples of approximated muscle mechanics and its absolute error of normalized fiber force. Solid line represents DeltAnt, long dashed line for TerMin, dotted line for TRIlong, and chain line for LatDorsiLum.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0006.tif"/>
</fig>
</sec>
<sec>
<title>3.2 Performance of modularity depends on mechanical properties of muscle synergies&#x02014;Experiment 1</title>
<p>The overall performance of the non-synergy model and synergy models with three NMF-derived synergies are shown in <xref ref-type="fig" rid="F7">Figure 7</xref>, and the mechanical properties of each module and the performances were summarized in <xref ref-type="fig" rid="F7">Figure 7D</xref> and DB and PB of those sets of modules and individual muscles are summarized in <xref ref-type="table" rid="T2">Table 2</xref>. Across the three synergy models, significant differences in performance in motor achievement and learning speed are found (<xref ref-type="fig" rid="F7">Figure 7B</xref>; for motor achievement, <italic>p</italic> &#x0003D; 1.70 &#x000D7; 10<sup>&#x02212;80</sup>, for learning speed <italic>p</italic> &#x0003D; 4.39 &#x000D7; 10<sup>&#x02212;68</sup>, ANOVA). The synergy model with NMF-derived synergies at the base posture (BP mods) significantly degrades motor achievement compared with the non-synergy model (<italic>p</italic> &#x0003D; 3.02 &#x000D7; 10<sup>&#x02212;11</sup>, Wilcoxon). The synergy model with NMF-derived synergies of the elbow fully extended posture (FE mods) showed the worst motor achievement across the three module sets. Similarly, although the synergy model with the NMF-derived synergy of elbow mildly extended posture (ME mods) provides the best across the three modules, it significantly degraded the motor accuracy from the non-synergy model (<italic>p</italic> &#x0003D; 3.39 &#x000D7; 10<sup>&#x02212;6</sup>, Wilcoxon).</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>Performance comparison of non-synergy network and synergy network with different module sets in motor learning simulation with non-linear neural networks. <bold>(A</bold>) Visualization of torque of module sets. Red arrows represent the vector of the passive torque, <italic><bold>T</bold></italic><sub><italic>PL</italic></sub>, at BP. Black arrows represent the vectors of the torque which synergies of the models, i.e., BP mods, FE mods, and ME mods, exert, <italic><bold>T</bold></italic><sub><italic>mod</italic></sub>. Dashed gray circle represents the circle where desired torque targets, <bold>&#x003C4;</bold>, are placed along whose radius is 1 [Nm]. <bold>(B)</bold> Plot of trial-dependent change of error. The blue solid line represents a mean trial-dependent loss of the non-synergy network, the orange solid line for the synergy network with base posture modules (BP mods), the yellow solid line for the synergy network with fully extended modules (FE mods), and the green solid line for the synergy network with mildly extended modules (ME mods). Shade regions represent the standard deviation of the trial-dependent loss change. <bold>(C, D)</bold> Comparison of non-synergy network and the synergy networks with different modules in final error and learning speed, respectively.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0007.tif"/>
</fig>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Power bias and direction bias of modules and non-synergy model.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:#919498;color:#ffffff">
<th valign="top" align="left"><bold>Network type</bold></th>
<th valign="top" align="center"><bold>Direction bias</bold></th>
<th valign="top" align="center"><bold>Power bias</bold></th>
<th valign="top" align="center"><bold>Mean error [Nm]</bold></th>
<th valign="top" align="center"><bold>Learning speed</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Non-synergy</td>
<td valign="top" align="center">16.3636</td>
<td valign="top" align="center">0.9904</td>
<td valign="top" align="center">0.0465</td>
<td valign="top" align="center">0.0037</td>
</tr> <tr>
<td valign="top" align="left">BP mods</td>
<td valign="top" align="center">6.0308</td>
<td valign="top" align="center">0.3387</td>
<td valign="top" align="center">0.0653</td>
<td valign="top" align="center">0.0055</td>
</tr> <tr>
<td valign="top" align="left">ME mods</td>
<td valign="top" align="center">26.6063</td>
<td valign="top" align="center">0.4386</td>
<td valign="top" align="center">0.0600</td>
<td valign="top" align="center">0.0049</td>
</tr> <tr>
<td valign="top" align="left">FE mods</td>
<td valign="top" align="center">42.1959</td>
<td valign="top" align="center">0.4901</td>
<td valign="top" align="center">0.0894</td>
<td valign="top" align="center">0.0015</td>
</tr></tbody>
</table>
</table-wrap>
<p>On the other hand, the BP mods significantly promoted the learning speed compared with the non-synergy model (<italic>p</italic> &#x0003D; 4.98 &#x000D7; 10<sup>&#x02212;11</sup>, Wilcoxon). The synergy model with MD modules also promoted the motor learning (<italic>p</italic> &#x0003D; 5.07 &#x000D7; 10<sup>&#x02212;10</sup>, Wilcoxon). However, the synergy model with FE modules significantly slowed down the motor learning compared with individual control (<italic>p</italic> &#x0003D; 3.02 &#x000D7; 10<sup>&#x02212;11</sup>, Wilcoxon). The results indicate that modularity may degrade motor achievement, and its learning promotion depends on the synergies used in a complex musculoskeletal model. Furthermore, the performance of modularity largely depends on the mechanical properties of the muscle synergies.</p>
</sec>
<sec>
<title>3.3 Performance of modularity correlates with DB and PB&#x02014;Experiment2</title>
<p>To qualitatively demonstrate how the performance of modularity correlates with DB and PB, we conducted extensive simulations of modularity with four modules at the base posture while changing their DB or PB. The scatter plot of the median of the learning performance of modularity and the criteria, i.e., DB and PB, was summarized in <xref ref-type="fig" rid="F8">Figure 8</xref>. While DB showed a strong negative correlation with learning speed (<xref ref-type="fig" rid="F8">Figure 8C</xref>; <italic>R</italic><sup>2</sup> &#x0003D; 0.845, <italic>p</italic> &#x0003D; 6.97 &#x000D7; 10<sup>&#x02212;40</sup>, <italic>N</italic> = 90, F test), it shows an almost no correlation with motor achievement (<xref ref-type="fig" rid="F8">Figure 8A</xref> <italic>R</italic><sup>2</sup> &#x0003D; 0.0635, <italic>p</italic> &#x0003D; 1.13 &#x000D7; 10<sup>2</sup>, <italic>N</italic> = 90, F test). In contrast, PB consistently and strongly correlated with both motor achievement and learning speed (for motor achievement <italic>R</italic><sup>2</sup> &#x0003D; 0.7608, <italic>p</italic> &#x0003D; 4.32 &#x000D7; 10<sup>&#x02212;3</sup> and for learning speed <italic>R</italic><sup>2</sup> &#x0003D; 0.7471, <italic>p</italic> &#x0003D; 1.05 &#x000D7; 10<sup>&#x02212;7</sup>, <italic>N</italic> = 30, F test). These results indicate that PB and DB are effective criteria for evaluating the modules and predicting the performance of modularity with four modules at the base posture. Specifically, while motor achievement mainly depends only on PB, learning speed depends on both PB and DB.</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p>Scatter plot of performance in learning simulation of synergy network when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4. <bold>(A, B)</bold> Correlation of final error or learning speed and direction bias. <bold>(C, D)</bold> Correlation of final error or learning speed and power bias. The dashed line and shade interpolated in each figure represent first-order regression and 95% confidence intervals of the scatter plot. <bold>(E)</bold> Amplitude and direction of the synergies of interest. The black dotted arrow represents the passive torque, <italic><bold>T</bold></italic><sub><italic>PL</italic></sub>. The orange, cyan, yellow, and green arrows represent synergies dotted in <bold>A&#x02013;D</bold>, respectively.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0008.tif"/>
</fig>
</sec>
<sec>
<title>3.4 Impacts of dimensionality on the performance, DB and PB are consistent&#x02014;Experiment 3</title>
<p>We verified the robustness of the explanation capabilities of the criteria to the number of modules. The results are summarized in the <xref ref-type="fig" rid="F9">Figure 9</xref>. <xref ref-type="fig" rid="F9">Figures 9A</xref>&#x02013;<xref ref-type="fig" rid="F9">D</xref> illustrates the correlation between the performance of the modularity and PB or DB when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22. Similar to the case of <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, learning speed strongly correlates with both DB and PB (<xref ref-type="fig" rid="F9">Figures 9C</xref>, <xref ref-type="fig" rid="F9">D</xref>; for DB <italic>R</italic><sup>2</sup> &#x0003D; 0.5647, <italic>p</italic> &#x0003D; 9.98 &#x000D7; 10<sup>&#x02212;19</sup> and for PB <italic>R</italic><sup>2</sup> &#x0003D; 0.5133, <italic>p</italic> &#x0003D; 8.46 &#x000D7; 10<sup>&#x02212;6</sup>, F test), and we also found strong correlation of PB and motor achievement (<xref ref-type="fig" rid="F9">Figure 9A</xref>). However, in contrast, DB correlates with motor achievement (<xref ref-type="fig" rid="F9">Figure 9A</xref>). In other cases with different modules (<italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8 and 15), we also found similar tendencies (<xref ref-type="fig" rid="F9">Figures 9E</xref>, <xref ref-type="fig" rid="F9">H</xref>) except for the correlation of DB and motor achievement <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4 (<xref ref-type="fig" rid="F9">Figure 9E</xref>).</p>
<fig id="F9" position="float">
<label>Figure 9</label>
<caption><p>Correlation of learning performances and DB or PB with different numbers of modules. <bold>(A&#x02013;D)</bold> Correlation of final error or learning speed and criteria when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22. <bold>(E&#x02013;H)</bold> Bar plot of <italic>R</italic><sup>2</sup> error or learning speed with different scale of the passive force (blue; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, orange; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, yellow; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15 and green; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0009.tif"/>
</fig>
<p>Furthermore, we tested the performance of modularity with different numbers of modules with zero PB and DB. The result is summarized in <xref ref-type="fig" rid="F10">Figure 10</xref>. As for motor achievement, we found significant difference of motor achievement performance across groups (<italic>p</italic> &#x0003D; 4.66 &#x000D7; 10<sup>&#x02212;</sup>18, ANOVA), and varies across the case of <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, 8 and 15 (<xref ref-type="fig" rid="F10">Figure 10A</xref>; comparison of <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4 and <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, <italic>p</italic> &#x0003D; 3.39 &#x000D7; 10 &#x02212; 6, and comparison of <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8 and <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15, <italic>p</italic> &#x0003D; 4.94 &#x000D7; 10 &#x02212; 4, Wilcoxon). Motor achievement performance of <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15 and <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22 did not show significant difference (<italic>p</italic> &#x0003D; 5.61 &#x000D7; 10<sup>&#x02212;1</sup>, Wilcoxon). On the other hand, as for learning speed, there is no significant difference across the groups (<italic>p</italic> &#x0003D; 4.45 &#x000D7; 10<sup>&#x02212;1</sup>, ANOVA). These results suggest that maximum learning speed does not depend on the number of modules, while motor achievement does.</p>
<fig id="F10" position="float">
<label>Figure 10</label>
<caption><p>Comparison of performance of synergy network with different number of DB-PB minimizing modules. <bold>(A, B)</bold> Bar plot of final error and learning speed of synergy network using different number of DB and PB minimizing module sets, respectively (blue; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, orange; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, yellow; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15 and green; <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22). For comparison, we added the performance of non-synergy model to the graph as the purple bar plot.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0010.tif"/>
</fig>
</sec>
<sec>
<title>3.5 Independent impact of DB and PB on performance of modularity&#x02014;Experiment 4</title>
<p>In all cases, PB and DB are independent and there is no multicollinearity (VIF = 1.0008 for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, 1.0005 for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, 1.0677 for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15 and 1.0436 for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22). <xref ref-type="fig" rid="F11">Figure 11</xref> illustrates example of the spatial distribution of the performance of modularity in the PB-DB space and comparison of explanation power among the different number of modules. The planes in each figure represent the approximated 3D planes of predicted performances of modularity against PB and DB that assume PB and DB independently affect the performance of modularity. While the independent description of motor achievement by PB and DB was not so successful (<xref ref-type="fig" rid="F11">Figure 11B</xref>; <italic>R</italic><sup>2</sup> &#x0003D; 0.15699, <italic>p</italic> &#x0003D; 7.7 &#x000D7; 10<sup>&#x02212;3</sup>. F test, <italic>N</italic> = 60), it successfully explained the major variance of learning speed (<xref ref-type="fig" rid="F11">Figure 11A</xref>; <italic>R</italic><sup>2</sup> &#x0003D; 0.7220, <italic>p</italic> &#x0003D; 1.43 &#x000D7; 10<sup>&#x02212;16</sup>, F test, <italic>N</italic> = 60). On the other hand, the explanation power of criteria decreased when the synergy model controls more modules (<xref ref-type="fig" rid="F11">Figures 11C</xref>, <xref ref-type="fig" rid="F11">F</xref>). The independent model of PB and DB exhibit a limited explanation power for a limited part of the variance of both learning speed (<italic>R</italic><sup>2</sup> &#x0003D; 0.254, <italic>p</italic> &#x0003D; 2.37 &#x000D7; 10<sup>&#x02212;4</sup> for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, <italic>R</italic><sup>2</sup> &#x0003D; 0.217, <italic>p</italic> &#x0003D; 9.44 &#x000D7; 10<sup>&#x02212;4</sup> for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15, and <italic>R</italic><sup>2</sup> &#x0003D; 0.280, <italic>p</italic> &#x0003D; 8.60 &#x000D7; 10<sup>&#x02212;5</sup> for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22) and learning error (<italic>R</italic><sup>2</sup> &#x0003D; 0.1803, <italic>p</italic> &#x0003D; 3.46 &#x000D7; 10<sup>&#x02212;3</sup> for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 8, <italic>R</italic><sup>2</sup> &#x0003D; 0.2169, <italic>p</italic> &#x0003D; 9.41 &#x000D7; 10<sup>&#x02212;4</sup> for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 15, and <italic>R</italic><sup>2</sup> &#x0003D; 0.294, <italic>p</italic> &#x0003D; 4.93 &#x000D7; 10<sup>&#x02212;5</sup> for <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 22).</p>
<fig id="F11" position="float">
<label>Figure 11</label>
<caption><p>Estimated performance of synergy network with module sets of various PB and DB when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, 8, 15, and 22. <bold>(A, B)</bold> Three-dimensional scatter of learning speed of synergy network when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4 and 8, respectively. The colored surface represents a two-dimensional plane estimating the performances of the networks.<bold>(D, E)</bold> Three-dimensional scatter of learning error of synergy network when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4 and 8, respectively. The colored surface represents a two-dimensional plane estimating the performances of the networks. <bold>(C, F)</bold> Comparison of explanatory power of the model among the synergy model with different number of modules.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0011.tif"/>
</fig>
</sec>
<sec>
<title>3.6 Scale of the passive force affects the effectiveness of the criteria&#x02014;Experiment 5</title>
<p>We verified the robustness of the criteria to the scale of the passive force. <xref ref-type="fig" rid="F12">Figure 12</xref> illustrates how the explanation capabilities of the criteria change with the scale of the passive force. DB successfully explained the major variance of the learning speed data (<xref ref-type="fig" rid="F12">Figure 12A</xref>; <italic>R</italic><sup>2</sup> &#x0003D; 0.6931 for <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.3[<italic>Nm</italic>], <italic>R</italic><sup>2</sup> &#x0003D; 0.6768 for <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.7[<italic>Nm</italic>]). However, it failed to explain the data on motor achievement except for <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub> &#x0003D; 0.7</bold> [Nm] (<xref ref-type="fig" rid="F12">Figure 12B</xref>; <italic>R</italic><sup>2</sup> &#x0003D; 0.0392 for <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.3[<italic>Nm</italic>], <italic>R</italic><sup>2</sup> &#x0003D; 0.5557 for <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.7[<italic>Nm</italic>]). On the other hand, PB relatively succeeded in explaining the variance of the data. For motor achievement, PB explained a large part of the data when <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.3[<italic>Nm</italic>] (<xref ref-type="fig" rid="F12">Figure 12C</xref>; <italic>R</italic><sup>2</sup> &#x0003D; 0.7252), while it only explained some parts of the data when <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.7[<italic>Nm</italic>] (<italic>R</italic><sup>2</sup> &#x0003D; 0.2411). For learning speed (<xref ref-type="fig" rid="F12">Figure 12D</xref>), similar to motor achievement, the explanation capability of the criteria is strong when <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.3[<italic>Nm</italic>] (<italic>R</italic><sup>2</sup> &#x0003D; 0.9330), while it gets weak when <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.7[<italic>Nm</italic>] (<italic>R</italic><sup>2</sup> &#x0003D; 0.4254).</p>
<fig id="F12" position="float">
<label>Figure 12</label>
<caption><p>Correlation of learning performances and DB or PB with different scale of the passive force when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4. <bold>(A&#x02013;D)</bold> Bar plot of <italic>R</italic><sup>2</sup> value of error or learning speed with different number of modules (blue; <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.3[<italic>Nm</italic>], orange; <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub> &#x0003D; 0.5[<italic>Nm</italic>]</bold>, and yellow; <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub></bold> &#x0003D; 0.7[<italic>Nm</italic>]). Note that <italic><bold>T</bold></italic><bold><sub><italic>PL</italic></sub> &#x0003D; 0.5[<italic>Nm</italic>]</bold> is the data identical to <xref ref-type="fig" rid="F8">Figure 8</xref>.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0012.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4 Discussion</title>
<sec>
<title>4.1 Passive force element of the muscle influences the selection of the module</title>
<p>One of the key contributions of our research is the consideration of the passive force element in muscle mechanics within the criteria and our musculoskeletal model. This element is a significant component of typical Hill-type musculoskeletal mechanics, although it has been underappreciated and neglected in some previous literature (Rokni et al., <xref ref-type="bibr" rid="B50">2007</xref>; Hirashima and Nozaki, <xref ref-type="bibr" rid="B30">2012</xref>; Hirashima and Oya, <xref ref-type="bibr" rid="B31">2016</xref>; Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>; Song et al., <xref ref-type="bibr" rid="B58">2022</xref>). In a static condition, specifically isometric torque production, the upper limb musculoskeletal mechanics (Saul et al., <xref ref-type="bibr" rid="B53">2015</xref>) is simplified into an affine-like system for muscle activation. Despite this simplification, its reproducibility is high (<xref ref-type="table" rid="T1">Table 1</xref>) due to the negligible second-order or higher-order behavior in this context. As shown in <xref ref-type="fig" rid="F6">Figure 6</xref>, some muscles produce non-zero force even when no control signals are provided (<italic><bold>a</bold></italic> &#x0003D; 0), and these forces act as constant passive joint torque based on their joint moment arms depending on the posture of the musculoskeletal model.</p>
<p>The passive characteristics of muscles play a crucial role in controlling musculoskeletal mechanics by influencing impedance modification in musculoskeletal systems (Winters et al., <xref ref-type="bibr" rid="B68">1988</xref>) or storing elastic energy (Roberts, <xref ref-type="bibr" rid="B46">2016</xref>). Although it has recently gained renewed attention for its significant role in modeling musculoskeletal mechanics (Herbert and Gandevia, <xref ref-type="bibr" rid="B27">2019</xref>; Herzog, <xref ref-type="bibr" rid="B28">2019</xref>) and is gradually being considered in the context of computational control of realistic musculoskeletal models (Al Borno et al., <xref ref-type="bibr" rid="B1">2020</xref>; Fischer et al., <xref ref-type="bibr" rid="B22">2021</xref>), how it interacts with musculoskeletal control has not been well elucidated.</p>
<p>However, except for a weak correlation case found in lower-dimensional modularity (i.e., <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4; <xref ref-type="fig" rid="F8">Figures 8A</xref>, <xref ref-type="fig" rid="F9">9A</xref>), certain correlations between DB and learning error or the speed of the network directly demonstrate the necessity of efficiently occupying task space considering elastic components by utilized modules for higher control performance. This tendency is preserved across different scales of passive-derived torque for learning speed (<xref ref-type="fig" rid="F12">Figure 12B</xref>), while it fails to explain the data variance for learning accuracy (<xref ref-type="fig" rid="F12">Figure 12A</xref>). This failure may stem from the limitation of the network&#x00027;s dimensionality because the explanatory capability of DB for learning error is extremely low only when <italic>N</italic><sub><italic>mod</italic></sub> &#x0003D; 4, compared with higher-dimensional modularity (<xref ref-type="fig" rid="F9">Figure 9A</xref>). It is considered that this limitation does not cast doubt on the effectiveness of DB.</p>
<p>The other criterion we proposed, i.e., PB, which quantifies the evenness in torque amplitude of the utilized modules, generally succeeds in explaining the data tendencies of learning performances. In contrast to DB, its validity is relatively preserved across the number of network dimensionalities (<xref ref-type="fig" rid="F9">Figures 9C</xref>, <xref ref-type="fig" rid="F9">D</xref>). However, it tends to decline as the amplitude of the passive force increases (<xref ref-type="fig" rid="F12">Figures 12C</xref>, <xref ref-type="fig" rid="F12">D</xref>). This is possible because the definition of PB disregards the passive force element of the muscles, as the results show. Overall, the passive element of muscle significantly affects the selection of the direction of the module torque for the improvement of learning performance, whereas it does not strongly affect the selection of the amplitude of the module torque, at least in the region where the action of passive force is weak. It seems that the direction regularity and power evenness of the torque of the modules serve as a good guideline for modularity in the given task setting.</p>
</sec>
<sec>
<title>4.2 Qualitative description of DB and PB</title>
<p>The previous study (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>) suggested that the more sparsely the modules exert the forces in the task space, the more accurate and faster motor learning the network obtains. This is the basis of the concept of DB, and it derives from learning characteristics of a neural network. For instance, in a shallow linear neural network, the forces of the modules, <italic><bold>F</bold></italic><bold><sub><italic>iso</italic></sub><italic>K</italic><sub><italic>AL</italic></sub><italic>W</italic><sub><italic>syn</italic></sub></bold>, largely affect the eigenvalues of the system matrix of the network, <italic><bold>M</bold></italic><bold>(&#x003B8;)<italic>F</italic><sub><italic>iso</italic></sub><italic>K</italic><sub><italic>AL</italic></sub></bold><italic>W</italic><sub><italic>syn</italic></sub><italic>Z</italic><sub><italic>syn</italic></sub><italic>W</italic><sub><italic>inp</italic></sub>, which dominantly determines the learning speed and largely affects the accuracy of the network. If the forces of the modules are biased in a specific direction, the motor targets in the module-concentrated direction should be achieved more accurately and faster than the other quadrants because the eigenvalue of the system matrix corresponding to the module-concentrated gets high while the other gets low under the <italic><bold>Z</bold></italic><bold><sub><italic>syn</italic></sub></bold> normalization.</p>
<p>This description is illustrated in <xref ref-type="fig" rid="F13">Figure 13</xref>. In this case, the module set is biased toward the direction of a normal basis (<xref ref-type="fig" rid="F13">Figure 13A</xref>, left). This module set provides a large eigenvalue in the direction while it provides a small eigenvalue in the vertical direction. These biased eigenvalues provide the learning path with fast learning in the force-concentrated direction and slow learning in the vertical direction (<xref ref-type="fig" rid="F13">Figures 13B</xref>, <xref ref-type="fig" rid="F13">C</xref>, green arrows), requiring many steps for overall convergence. On the other hand, the module set unbiased in a specific direction (<xref ref-type="fig" rid="F13">Figure 13A</xref>, right) provides even eigenvalues in the whole direction in the task space. These even eigenvalues provide the learning path with fast convergence for all directions, requiring fewer steps for overall convergence (<xref ref-type="fig" rid="F13">Figures 13B</xref>, <xref ref-type="fig" rid="F13">C</xref>, blue arrows). Importantly, the more learning proceeds, the less update the network has, resulting in a learning equilibrium that derives from forgetting and learning (<xref ref-type="fig" rid="F13">Figures 13B</xref>, <xref ref-type="fig" rid="F13">C</xref>, shaded circle). Weight update of the biased modules soon gets equilibrium with the forgetting compared with unbiased modules because its effective update is smaller. Therefore, biased modules provide less accurate motor achievement and slower learning speed. Such a learning speed-motor achievement relationship is preserved even in a non-linear neural network where the passive force contribution is zero or weak enough (<xref ref-type="fig" rid="F13">Figure 13D</xref>), also seen in the previous study (Hagio and Kouzaki, <xref ref-type="bibr" rid="B25">2018</xref>). In the same context, PB also affects the eigenvalue distribution of the system matrix of the network. Even if the torque of the modules regularly distribute on the task space in direction, unless their gains are not even, the eigenvalues are biased and affect the performance of the modularity. This system characteristic description for learning performance is very similar to and experimentally supported by a very recent work (Barradas et al., <xref ref-type="bibr" rid="B4">2024</xref>). Therefore, DB and PB can be said to have the same mathematical origin as parameters affecting eigenvalues of the system matrix.</p>
<fig id="F13" position="float">
<label>Figure 13</label>
<caption><p>Description of learning dynamics unique to modules. <bold>(A)</bold> Sample of the module sets. The green-colored set of modules has high PB and DB, while the blue-colored set of modules has relatively lower PB and DB. <bold>(B, C)</bold> Illustration of path-dependent learning performances in 3D-shapes <bold>(B)</bold> and 2D-shapes <bold>(C)</bold>. The green path represents the learning path of the network that is provided with the biased modules [<bold>(A)</bold>, green arrows], and the blue path represents the learning path of the network that is provided with not-biased modules [<bold>(A)</bold>, blue arrows]. <bold>(D)</bold> The error and the learning speed relationship in the non-linear neural network that is not strongly affected by the passive force of the plant.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fncom-18-1355855-g0013.tif"/>
</fig>
<p>However, we should note that the above learning speed-motor achievement description is true only to linear networks or non-linear neural networks where the passive force is zero, negligible, or compensated. If the plant is non-linear, and the passive force is significant, its plausibility can be limited due to the contributions of biomechanical complexities such as changes in moment arm, passive force, and active force coefficient or the non-linearity of the muscles. These components function computationally as an affine transformation (Bebis et al., <xref ref-type="bibr" rid="B7">1999</xref>) and typical rectifying units, such as ReLU layers (Dittmer et al., <xref ref-type="bibr" rid="B21">2019</xref>). These characteristics would interact to affect the learning path of the network and make it difficult to predict what kind of system property is necessary for a better control performance.</p>
<p>To address this question, this study extend the idea of the eigenvalues of the system matrix to the non-linear neural network by dividing the property of the system matrix into two factors; regularity in direction of torque of modules and their power evenness. Through the experiment, as discussed above, although in some cases, they failed to explain the major variance of the data possibly due to the data contamination caused by feasibility cutoff in generating feasible synergies (=0.1[Nm]), the proposed criteria actually clarified the necessary property for improving the performance. Moreover, in terms of the learning behavior of an actual network, the interaction between DB and PB is not collinear; it seems they act almost independently (<xref ref-type="fig" rid="F11">Figure 11</xref>; VIF = 1.0008). Therefore, while originally inspired by linear theory and heuristics, both PB and DB can be considered as independent explanatory variables that demonstrate a certain efficacy in explaining the behavior of non-linear networks and systems. Then, can we further apply the criteria to other situation such as leaning a task that is more dynamic and have multiple optimality such as walking or more dynamic reaching task? We speculate that even in the situation of more dynamic movements, it may be possible to partly expand the discussion of PB and DB when the movement optimization is done by an gradient-based learning algorithm. For example, with a proper expansion, our metrics may be applicable in a gradient-based learning of feedforward arm reaching where an ideal trajectory is already given, and they may inform us what kind of synergies are better regarding converging the error-term. However, even in this simple case, it is still unclear whether expanded metrics are easily measurable or not, and we should investigate the point in future study. In addition, while metrics are relevant only with an error-term, it will not directly explain the other optimality such as energy consumption or cost of transport, which is often used in locomotion studies. Therefore, direct use and expansion of our metrics may have a potential limitation or technological difficulties in application to such complex optimization process. Moreover, for a physiological evidence, it is necessary to see whether the criteria actually correlates with the learning curve data of primate isometric force reaching task in future.</p>
</sec>
<sec>
<title>4.3 Muscle synergies contribute to motor learning?</title>
<p>In Experiment 1, we compared the synergy network models and non-synergy models for addressing why muscle synergies extracted from a specific biomechanical contexts sometimes fail to perform well in other contexts. Overall, the synergy model, which utilizes synergies from the non-synergy model optimized for the Base Posture, i.e., BP mods, expedited the learning at the expense of motor accuracy. On the other hand, FE and ME mods showed high DB and PB (<xref ref-type="table" rid="T2">Table 2</xref>, <xref ref-type="fig" rid="F7">Figure 7</xref>), and their performance significantly degraded despite the postural changes in the experiment are relatively small. It suggests that minor difference in biomechanical contexts can easily make modularity using context-specific synergies less effective. Consistent with the results of the previous study (Kutsuzawa and Hayashibe, <xref ref-type="bibr" rid="B36">2022</xref>), the modularity performance largely depends on the biomechanical context from which the synergies are extracted.</p>
<p>However, it is important to acknowledge the limitations in our experimental protocols that may have influenced the results. We used NMF to extract each set of synergies from the non-synergy model optimized for each BP, FE, or ME. It is worth noting that NMF does not guarantee solution uniqueness or convexity of the objective function, i.e., square error of data reproduction, and determining the number of synergies is somewhat arbitrary (Barradas et al., <xref ref-type="bibr" rid="B5">2020</xref>). Therefore, the extraction of synergies using NMF can miss significant components for control, and variability of synergy organization in each extraction can provide synergies with different PB and DB. These experimental limitations may have influenced the performance of each synergy model.</p>
<p>Furthermore, synergies extracted from the non-synergy model are features of the control and implicitly encode prior knowledge of a particular biomechanical context in which they are extracted. This means that the performance of each synergy model can partly depend on the similarity of musculoskeletal mechanics in a position of interest. This qualitative premise on simulated muscle synergies, i.e., assuming only context-specific synergies, can be distinct from the essential purpose or function of actual muscle synergies. In any case, the limitations of experimental procedures and synergy dependency in control performance obscure the contribution of muscle synergies in control. Then, what is the plausible role of muscle synergies in motor learning?</p>
<p>From the perspective of optimality, our results highlight the necessity of the CNS to store specific synergies for every different context, i.e., posture, as previous studies suggested (de Rugy et al., <xref ref-type="bibr" rid="B18">2013</xref>; Sharif Razavian et al., <xref ref-type="bibr" rid="B55">2015</xref>). If the CNS were provided with enough modules (e.g., <italic>N</italic><sub><italic>mod</italic></sub> &#x0003E; 4) that minimize both DB and PB corresponding to the posture-dependent limb mechanics, they achieved much more accurate and faster control than individually muscle-optimized control (see <xref ref-type="fig" rid="F7">Figures 7C</xref>, <xref ref-type="fig" rid="F7">D</xref>, <xref ref-type="fig" rid="F10">10A</xref>, <xref ref-type="fig" rid="F10">B</xref>). However, strategy of storing every context-dependent control and synergy poses the problem of having to store an unlimited number of motor programs (Loeb, <xref ref-type="bibr" rid="B38">1983</xref>). One possible solution to this memory storage and optimality problem is approximating a wide range of movements through generalizable synergies and subsequent optimization through context specification of the synergies as necessary.</p>
<p>Similar to the good-enough control strategy (Loeb, <xref ref-type="bibr" rid="B39">2021</xref>), generalizable muscle synergies can be utilized across various motor contexts with reasonably good performance. While there is room for debate on such synergies, it can be potentially relevant to the shared muscle synergies observed in various static (Ting and Macpherson, <xref ref-type="bibr" rid="B66">2005</xref>; Torres-Oviedo et al., <xref ref-type="bibr" rid="B67">2006</xref>; Roh et al., <xref ref-type="bibr" rid="B49">2012</xref>; Leonardis et al., <xref ref-type="bibr" rid="B37">2020</xref>; Pham et al., <xref ref-type="bibr" rid="B45">2023</xref>) and dynamic motor tasks or contexts (d&#x00027;Avella and Bizzi, <xref ref-type="bibr" rid="B16">2005</xref>; Chvatal and Ting, <xref ref-type="bibr" rid="B14">2013</xref>; Barroso et al., <xref ref-type="bibr" rid="B6">2014</xref>). Interestingly, in the lower limb static task of the cat (Torres-Oviedo et al., <xref ref-type="bibr" rid="B67">2006</xref>), the experimental study reported that the rotation of the force direction exerted by shared muscle synergies is similar to limb axis rotation angles (McKay and Ting, <xref ref-type="bibr" rid="B40">2008</xref>). Sohn et al. demonstrated that spatial organization of these synergies can be formed in pursuit of generalization rather than optimization for each biomechanical context (Sohn and Ting, <xref ref-type="bibr" rid="B57">2016</xref>). We can relate the formation of such generalizable synergies to the minimization of DB. Suppose spatial organization of generalizable synergies is formed to minimize the average DB across similar biomechanical contexts. In that case, the CNS can efficiently generalize them for learning arbitrary similar biomechanical contexts quickly and with good enough generalization performance on average. Such DB-minimizing generalizable synergies may be represented at the medulla or spinal cord (Giszter et al., <xref ref-type="bibr" rid="B24">1993</xref>; Roh et al., <xref ref-type="bibr" rid="B48">2011</xref>), and robustly preserved through the subsequent development (Yang et al., <xref ref-type="bibr" rid="B69">2019</xref>).</p>
<p>On the other hand, the specification of synergies for the optimization may be done at the higher level of motor planning, such as cortical regions where more complicated information of dynamics is encoded as synergies (Overduin et al., <xref ref-type="bibr" rid="B42">2012</xref>, <xref ref-type="bibr" rid="B44">2015</xref>; Amundsen Huffmaster et al., <xref ref-type="bibr" rid="B3">2017</xref>). In these areas, minimization of both DB and PB is likely associated with movement optimization. However, modulation of PB may be a separate process from DB. Our experiment demonstrated that PB and DB affected learning independently to some extent. It may suggest that modulation of DB and PB of muscle synergies do not necessarily share the exact neural mechanisms. One recent study (Yaron et al., <xref ref-type="bibr" rid="B70">2020</xref>) reported that, unlike the force direction of modules, the force amplitude were adjusted in supralinear form. Moreover, several suggest that sensory feedback, essential for motor planning and online control, affects the amplitude and timing of muscle synergies control while never affecting synergies&#x00027; spatial organization (Inglis et al., <xref ref-type="bibr" rid="B32">1994</xref>; Stapley et al., <xref ref-type="bibr" rid="B59">2002</xref>; Cheung et al., <xref ref-type="bibr" rid="B13">2005</xref>). PB modulation may occur in areas related to online control planning and feedback control. Meanwhile, DB modulation may take place in areas related to offline motor planning schemes, such as the selection or combination of synergies expressed in cortical areas and the coordination of the extent to which non-synergetic control elements are intervened through a cortico-motoneuronal pathway (Isa et al., <xref ref-type="bibr" rid="B34">2007</xref>) or reticulospinal and vestibulospinal pathways (Cruce, <xref ref-type="bibr" rid="B15">1974</xref>).</p>
<p>To summarize, our research has shown that the performance of fixed muscle synergy control through learning can vary significantly depending on the synergy utilized. This highlights the need to consider the role of synergy in motor control beyond a simple comparative approach to optimality. Instead, we should focus on how to exploit or overcome the dependence of synergy on control performance, such as the pursuit of generalizability or the modulation of synergy with learning. These insights have important implications for our understanding of muscle synergies and their role in motor control.</p>
</sec>
</sec>
<sec sec-type="data-availability" id="s5">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec sec-type="author-contributions" id="s6">
<title>Author contributions</title>
<p>AF: Writing &#x02013; original draft. KK: Writing &#x02013; review &#x00026; editing. DO: Writing &#x02013; review &#x00026; editing. MH: Writing &#x02013; review &#x00026; editing.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="s7">
<title>Funding</title>
<p>The author(s) declare that financial support was received for the research, authorship, and publication of this article. This study was supported by the JSPS Grant-in-Aid for Scientific Research on Innovative Areas Hyper-Adaptability Project under Grant 22H04764 and the Graduate Program for Integration of Mechanical Systems (GP-Mech) of Tohoku University.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s8">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Al Borno</surname> <given-names>M.</given-names></name> <name><surname>Hicks</surname> <given-names>J. L.</given-names></name> <name><surname>Delp</surname> <given-names>S. L.</given-names></name></person-group> (<year>2020</year>). <article-title>The effects of motor modularity on performance, learning and generalizability in upper-extremity reaching: a computational analysis</article-title>. <source>J. Royal Soc. Interface</source> <volume>17</volume>:<fpage>20200011</fpage>. <pub-id pub-id-type="doi">10.1098/rsif.2020.0011</pub-id><pub-id pub-id-type="pmid">32486950</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alessandro</surname> <given-names>C.</given-names></name> <name><surname>Carbajal</surname> <given-names>J. P.</given-names></name> <name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name></person-group> (<year>2014</year>). <article-title>A computational analysis of motor synergies by dynamic response decomposition</article-title>. <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>191</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00191</pub-id><pub-id pub-id-type="pmid">24474915</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amundsen Huffmaster</surname> <given-names>S. L.</given-names></name> <name><surname>Van Acker</surname> <given-names>G. M.</given-names> <suffix>III.</suffix></name> <name><surname>Luchies</surname> <given-names>C. W.</given-names></name> <name><surname>Cheney</surname> <given-names>P. D.</given-names></name></person-group> (<year>2017</year>). <article-title>Muscle synergies obtained from comprehensive mapping of the primary motor cortex forelimb representation using high-frequency, long-duration icms</article-title>. <source>J. Neurophysiol</source>. <volume>118</volume>, <fpage>455</fpage>&#x02013;<lpage>470</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00784.2016</pub-id><pub-id pub-id-type="pmid">28446586</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barradas</surname> <given-names>V. R.</given-names></name> <name><surname>Koike</surname> <given-names>Y.</given-names></name> <name><surname>Schweighofer</surname> <given-names>N.</given-names></name></person-group> (<year>2024</year>). <article-title>Theoretical limits on the speed of learning inverse models explain the rate of adaptation in arm reaching tasks</article-title>. <source>Neural Netw</source>. <volume>170</volume>, <fpage>376</fpage>&#x02013;<lpage>389</lpage>. <pub-id pub-id-type="doi">10.1016/j.neunet.2023.10.049</pub-id><pub-id pub-id-type="pmid">38029719</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barradas</surname> <given-names>V. R.</given-names></name> <name><surname>Kutch</surname> <given-names>J. J.</given-names></name> <name><surname>Kawase</surname> <given-names>T.</given-names></name> <name><surname>Koike</surname> <given-names>Y.</given-names></name> <name><surname>Schweighofer</surname> <given-names>N.</given-names></name></person-group> (<year>2020</year>). <article-title>When 90% of the variance is not enough: residual emg from muscle synergy extraction influences task performance</article-title>. <source>J. Neurophysiol</source>. <volume>123</volume>, <fpage>2180</fpage>&#x02013;<lpage>2190</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00472.2019</pub-id><pub-id pub-id-type="pmid">32267198</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barroso</surname> <given-names>F. O.</given-names></name> <name><surname>Torricelli</surname> <given-names>D.</given-names></name> <name><surname>Moreno</surname> <given-names>J. C.</given-names></name> <name><surname>Taylor</surname> <given-names>J.</given-names></name> <name><surname>Gomez-Soriano</surname> <given-names>J.</given-names></name> <name><surname>Bravo-Esteban</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>Shared muscle synergies in human walking and cycling</article-title>. <source>J. Neurophysiol</source>. <volume>112</volume>, <fpage>1984</fpage>&#x02013;<lpage>1998</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00220.2014</pub-id><pub-id pub-id-type="pmid">25057144</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bebis</surname> <given-names>G.</given-names></name> <name><surname>Georgiopoulos</surname> <given-names>M.</given-names></name> <name><surname>da Vitoria Lobo</surname> <given-names>N.</given-names></name> <name><surname>Shah</surname> <given-names>M.</given-names></name></person-group> (<year>1999</year>). <article-title>Learning affine transformations</article-title>. <source>Pattern Recognit</source>. <volume>32</volume>, <fpage>1783</fpage>&#x02013;<lpage>1799</lpage>. <pub-id pub-id-type="doi">10.1016/S0031-3203(98)00178-2</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berg</surname> <given-names>C.</given-names></name> <name><surname>Caggiano</surname> <given-names>V.</given-names></name> <name><surname>Kumar</surname> <given-names>V.</given-names></name></person-group> (<year>2023</year>). <article-title>Sar: Generalization of physiological agility and dexterity via synergistic action representation</article-title>. <source>arXiv [preprint]</source>. <pub-id pub-id-type="doi">10.15607/RSS.2023.XIX.007</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berniker</surname> <given-names>M.</given-names></name> <name><surname>Jarc</surname> <given-names>A.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name> <name><surname>Tresch</surname> <given-names>M. C.</given-names></name></person-group> (<year>2009</year>). <article-title>Simplified and effective motor control based on muscle synergies to exploit musculoskeletal dynamics</article-title>. <source>Proc. Nat. Acad. Sci</source>. <volume>106</volume>, <fpage>7601</fpage>&#x02013;<lpage>7606</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.0901512106</pub-id><pub-id pub-id-type="pmid">19380738</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Berret</surname> <given-names>B.</given-names></name> <name><surname>Delis</surname> <given-names>I.</given-names></name> <name><surname>Gaveau</surname> <given-names>J.</given-names></name> <name><surname>Jean</surname> <given-names>F.</given-names></name></person-group> (<year>2019</year>). <article-title>Optimality and modularity in human movement: from optimal control to muscle synergies</article-title>, in <source>Biomechanics of anthropomorphic systems</source> (<publisher-loc>Springer</publisher-loc>), <fpage>105</fpage>&#x02013;<lpage>133</lpage>.</citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brock</surname> <given-names>O.</given-names></name> <name><surname>Valero-Cuevas</surname> <given-names>F.</given-names></name></person-group> (<year>2016</year>). <article-title>Transferring synergies from neuroscience to robotics: Comment on &#x0201C;hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands&#x0201D; by m. santello et al</article-title>. <source>Phys. Life Rev</source>. <volume>17</volume>, <fpage>27</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1016/j.plrev.2016.05.011</pub-id><pub-id pub-id-type="pmid">27212396</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>J.</given-names></name> <name><surname>Qiao</surname> <given-names>H.</given-names></name></person-group> (<year>2020</year>). <article-title>Muscle-synergies-based neuromuscular control for motion learning and generalization of a musculoskeletal system</article-title>. <source>IEEE Trans. Syst. Man Cybernet.: Syst</source>. <volume>51</volume>, <fpage>3993</fpage>&#x02013;<lpage>4006</lpage>. <pub-id pub-id-type="doi">10.1109/TSMC.2020.2966818</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheung</surname> <given-names>V. C.</given-names></name> <name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name> <name><surname>Tresch</surname> <given-names>M. C.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>2005</year>). <article-title>Central and sensory contributions to the activation and organization of muscle synergies during natural motor behaviors</article-title>. <source>J. Neurosci</source>. <volume>25</volume>, <fpage>6419</fpage>&#x02013;<lpage>6434</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.4904-04.2005</pub-id><pub-id pub-id-type="pmid">16000633</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chvatal</surname> <given-names>S. A.</given-names></name> <name><surname>Ting</surname> <given-names>L. H.</given-names></name></person-group> (<year>2013</year>). <article-title>Common muscle synergies for balance and walking</article-title>. <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>48</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00048</pub-id><pub-id pub-id-type="pmid">23653605</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cruce</surname> <given-names>W.</given-names></name></person-group> (<year>1974</year>). <article-title>A supraspinal monosynaptic input to hindlimb motoneurons in lumbar spinal cord of the frog, rana catesbiana</article-title>. <source>J. Neurophysiol</source>. <volume>37</volume>, <fpage>691</fpage>&#x02013;<lpage>704</lpage>. <pub-id pub-id-type="doi">10.1152/jn.1974.37.4.691</pub-id><pub-id pub-id-type="pmid">4366213</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>2005</year>). <article-title>Shared and specific muscle synergies in natural motor behaviors</article-title>. <source>Proc. Nat. Acad. Sci</source>. <volume>102</volume>, <fpage>3076</fpage>&#x02013;<lpage>3081</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.0500199102</pub-id><pub-id pub-id-type="pmid">15708969</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name> <name><surname>Giese</surname> <given-names>M.</given-names></name> <name><surname>Ivanenko</surname> <given-names>Y. P.</given-names></name> <name><surname>Schack</surname> <given-names>T.</given-names></name> <name><surname>Flash</surname> <given-names>T.</given-names></name></person-group> (<year>2015</year>). <source>Modularity in Motor Control: From Muscle Synergies to Cognitive Action Representation</source>.</citation>
</ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>de Rugy</surname> <given-names>A.</given-names></name> <name><surname>Loeb</surname> <given-names>G. E.</given-names></name> <name><surname>Carroll</surname> <given-names>T. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Are muscle synergies useful for neural control?</article-title> <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>19</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00019</pub-id><pub-id pub-id-type="pmid">23519326</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Delp</surname> <given-names>S. L.</given-names></name> <name><surname>Anderson</surname> <given-names>F. C.</given-names></name> <name><surname>Arnold</surname> <given-names>A. S.</given-names></name> <name><surname>Loan</surname> <given-names>P.</given-names></name> <name><surname>Habib</surname> <given-names>A.</given-names></name> <name><surname>John</surname> <given-names>C. T.</given-names></name> <etal/></person-group>. (<year>2007</year>). <article-title>Opensim: open-source software to create and analyze dynamic simulations of movement</article-title>. <source>IEEE Trans. Biomed. Eng</source>. <volume>54</volume>, <fpage>1940</fpage>&#x02013;<lpage>1950</lpage>. <pub-id pub-id-type="doi">10.1109/TBME.2007.901024</pub-id><pub-id pub-id-type="pmid">18018689</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Diamond</surname> <given-names>A.</given-names></name> <name><surname>Holland</surname> <given-names>O.</given-names></name></person-group> (<year>2014</year>). <article-title>Reaching control of a full-torso, modelled musculoskeletal robot using muscle synergies emergent under reinforcement learning</article-title>. <source>Bioinspirat. Biomimet</source>. <volume>9</volume>:<fpage>016015</fpage>. <pub-id pub-id-type="doi">10.1088/1748-3182/9/1/016015</pub-id><pub-id pub-id-type="pmid">24523354</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dittmer</surname> <given-names>S.</given-names></name> <name><surname>King</surname> <given-names>E. J.</given-names></name> <name><surname>Maass</surname> <given-names>P.</given-names></name></person-group> (<year>2019</year>). <article-title>Singular values for relu layers</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst</source>. <volume>31</volume>, <fpage>3594</fpage>&#x02013;<lpage>3605</lpage>. <pub-id pub-id-type="doi">10.1109/TNNLS.2019.2945113</pub-id><pub-id pub-id-type="pmid">31714239</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fischer</surname> <given-names>F.</given-names></name> <name><surname>Bachinski</surname> <given-names>M.</given-names></name> <name><surname>Klar</surname> <given-names>M.</given-names></name> <name><surname>Fleig</surname> <given-names>A.</given-names></name> <name><surname>M&#x000FC;ller</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>Reinforcement learning control of a biomechanical model of the upper extremity</article-title>. <source>Sci. Rep</source>. <volume>11</volume>:<fpage>14445</fpage>. <pub-id pub-id-type="doi">10.1038/s41598-021-93760-1</pub-id><pub-id pub-id-type="pmid">34262081</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gallego</surname> <given-names>J. A.</given-names></name> <name><surname>Perich</surname> <given-names>M. G.</given-names></name> <name><surname>Naufel</surname> <given-names>S. N.</given-names></name> <name><surname>Ethier</surname> <given-names>C.</given-names></name> <name><surname>Solla</surname> <given-names>S. A.</given-names></name> <name><surname>Miller</surname> <given-names>L. E.</given-names></name></person-group> (<year>2018</year>). <article-title>Cortical population activity within a preserved neural manifold underlies multiple motor behaviors</article-title>. <source>Nat. Commun</source>. <volume>9</volume>:<fpage>4233</fpage>. <pub-id pub-id-type="doi">10.1038/s41467-018-06560-z</pub-id><pub-id pub-id-type="pmid">30315158</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Giszter</surname> <given-names>S. F.</given-names></name> <name><surname>Mussa-Ivaldi</surname> <given-names>F. A.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>1993</year>). <article-title>Convergent force fields organized in the frog&#x00027;s spinal cord</article-title>. <source>J. Neurosci</source>. <volume>13</volume>, <fpage>467</fpage>&#x02013;<lpage>491</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.13-02-00467.1993</pub-id><pub-id pub-id-type="pmid">8426224</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hagio</surname> <given-names>S.</given-names></name> <name><surname>Kouzaki</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Modularity speeds up motor learning by overcoming mechanical bias in musculoskeletal geometry</article-title>. <source>J. Royal Soc. Interf</source>. <volume>15</volume>:<fpage>20180249</fpage>. <pub-id pub-id-type="doi">10.1098/rsif.2018.0249</pub-id><pub-id pub-id-type="pmid">30305418</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hayashibe</surname> <given-names>M.</given-names></name> <name><surname>Shimoda</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>Synergetic motor control paradigm for optimizing energy efficiency of multijoint reaching via tacit learning</article-title>. <source>Front. Comput. Neurosci</source>. <volume>8</volume>:<fpage>21</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2014.00021</pub-id><pub-id pub-id-type="pmid">24616695</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Herbert</surname> <given-names>R. D.</given-names></name> <name><surname>Gandevia</surname> <given-names>S. C.</given-names></name></person-group> (<year>2019</year>). <article-title>The passive mechanical properties of muscle</article-title>. <source>J. Appl. Physiol</source>. <volume>126</volume>, <fpage>1442</fpage>&#x02013;<lpage>1444</lpage>. <pub-id pub-id-type="doi">10.1152/japplphysiol.00966.2018</pub-id><pub-id pub-id-type="pmid">30412027</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Herzog</surname> <given-names>W.</given-names></name></person-group> (<year>2019</year>). <article-title>Passive force enhancement in striated muscle</article-title>. <source>J. Appl. Physiol</source>. <volume>126</volume>, <fpage>1782</fpage>&#x02013;<lpage>1789</lpage>. <pub-id pub-id-type="doi">10.1152/japplphysiol.00676.2018</pub-id><pub-id pub-id-type="pmid">31070958</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hilt</surname> <given-names>P. M.</given-names></name> <name><surname>Delis</surname> <given-names>I.</given-names></name> <name><surname>Pozzo</surname> <given-names>T.</given-names></name> <name><surname>Berret</surname> <given-names>B.</given-names></name></person-group> (<year>2018</year>). <article-title>Space-by-time modular decomposition effectively describes whole-body muscle activity during upright reaching in various directions</article-title>. <source>Front. Comput. Neurosci</source>. <volume>12</volume>:<fpage>20</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2018.00020</pub-id><pub-id pub-id-type="pmid">29666576</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hirashima</surname> <given-names>M.</given-names></name> <name><surname>Nozaki</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). <article-title>Learning with slight forgetting optimizes sensorimotor transformation in redundant motor systems</article-title>. <source>PLoS Comput. Biol</source>. <volume>8</volume>:<fpage>e1002590</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002590</pub-id><pub-id pub-id-type="pmid">22761568</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hirashima</surname> <given-names>M.</given-names></name> <name><surname>Oya</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). <article-title>How does the brain solve muscle redundancy? Filling the gap between optimization and muscle synergy hypotheses</article-title>. <source>Neurosci. Res</source>. <volume>104</volume>, <fpage>80</fpage>&#x02013;<lpage>87</lpage>. <pub-id pub-id-type="doi">10.1016/j.neures.2015.12.008</pub-id><pub-id pub-id-type="pmid">26724372</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Inglis</surname> <given-names>J. T.</given-names></name> <name><surname>Horak</surname> <given-names>F. B.</given-names></name> <name><surname>Shupert</surname> <given-names>C. L.</given-names></name> <name><surname>Jones-Rycewicz</surname> <given-names>C.</given-names></name></person-group> (<year>1994</year>). <article-title>The importance of somatosensory information in triggering and scaling automatic postural responses in humans</article-title>. <source>Exp. Brain Res</source>. <volume>101</volume>, <fpage>159</fpage>&#x02013;<lpage>164</lpage>. <pub-id pub-id-type="doi">10.1007/BF00243226</pub-id><pub-id pub-id-type="pmid">7843295</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Inouye</surname> <given-names>J. M.</given-names></name> <name><surname>Valero-Cuevas</surname> <given-names>F. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Muscle synergies heavily influence the neural control of arm endpoint stiffness and energy consumption</article-title>. <source>PLoS Comput. Biol</source>. <volume>12</volume>:<fpage>e1004737</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1004737</pub-id><pub-id pub-id-type="pmid">26867014</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Isa</surname> <given-names>T.</given-names></name> <name><surname>Ohki</surname> <given-names>Y.</given-names></name> <name><surname>Alstermark</surname> <given-names>B.</given-names></name> <name><surname>Pettersson</surname> <given-names>L.-G.</given-names></name> <name><surname>Sasaki</surname> <given-names>S.</given-names></name></person-group> (<year>2007</year>). <article-title>Direct and indirect cortico-motoneuronal pathways and control of hand/arm movements</article-title>. <source>Physiology</source> <volume>22</volume>, <fpage>145</fpage>&#x02013;<lpage>152</lpage>. <pub-id pub-id-type="doi">10.1152/physiol.00045.2006</pub-id><pub-id pub-id-type="pmid">17420305</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kargo</surname> <given-names>W. J.</given-names></name> <name><surname>Ramakrishnan</surname> <given-names>A.</given-names></name> <name><surname>Hart</surname> <given-names>C. B.</given-names></name> <name><surname>Rome</surname> <given-names>L. C.</given-names></name> <name><surname>Giszter</surname> <given-names>S. F.</given-names></name></person-group> (<year>2010</year>). <article-title>A simple experimentally based model using proprioceptive regulation of motor primitives captures adjusted trajectory formation in spinal frogs</article-title>. <source>J. Neurophysiol</source>. <volume>103</volume>, <fpage>573</fpage>&#x02013;<lpage>590</lpage>. <pub-id pub-id-type="doi">10.1152/jn.01054.2007</pub-id><pub-id pub-id-type="pmid">19657082</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kutsuzawa</surname> <given-names>K.</given-names></name> <name><surname>Hayashibe</surname> <given-names>M.</given-names></name></person-group> (<year>2022</year>). <article-title>Motor synergy generalization framework for new targets in multi-planar and multi-directional reaching task</article-title>. <source>R. Soc. Open Sci</source>. <volume>9</volume>:<fpage>211721</fpage>. <pub-id pub-id-type="doi">10.1098/rsos.211721</pub-id><pub-id pub-id-type="pmid">35620009</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leonardis</surname> <given-names>J. M.</given-names></name> <name><surname>Alkayyali</surname> <given-names>A. A.</given-names></name> <name><surname>Lipps</surname> <given-names>D. B.</given-names></name></person-group> (<year>2020</year>). <article-title>Posture-dependent neuromuscular contributions to three-dimensional isometric shoulder torque generation</article-title>. <source>J. Neurophysiol</source>. <volume>123</volume>, <fpage>1526</fpage>&#x02013;<lpage>1535</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00702.2019</pub-id><pub-id pub-id-type="pmid">32101487</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loeb</surname> <given-names>G. E.</given-names></name></person-group> (<year>1983</year>). <article-title>Finding common groud between robotics and physiology</article-title>. <source>Trends Neurosci</source>. <volume>6</volume>, <fpage>203</fpage>&#x02013;<lpage>204</lpage>. <pub-id pub-id-type="doi">10.1016/0166-2236(83)90093-0</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loeb</surname> <given-names>G. E.</given-names></name></person-group> (<year>2021</year>). <article-title>Learning to use muscles</article-title>. <source>J. Hum. Kinet</source>. <volume>76</volume>, <fpage>9</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.2478/hukin-2020-0084</pub-id><pub-id pub-id-type="pmid">33603922</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McKay</surname> <given-names>J. L.</given-names></name> <name><surname>Ting</surname> <given-names>L. H.</given-names></name></person-group> (<year>2008</year>). <article-title>Functional muscle synergies constrain force production during postural tasks</article-title>. <source>J. Biomech</source>. <volume>41</volume>, <fpage>299</fpage>&#x02013;<lpage>306</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbiomech.2007.09.012</pub-id><pub-id pub-id-type="pmid">17980370</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>McKay</surname> <given-names>J. L.</given-names></name> <name><surname>Ting</surname> <given-names>L. H.</given-names></name></person-group> (<year>2012</year>). <article-title>Optimization of muscle activity for task-level goals predicts complex changes in limb forces across biomechanical contexts</article-title>. <source>PLoS Comput. Biol</source>. <volume>8</volume>:<fpage>e1002465</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002465</pub-id><pub-id pub-id-type="pmid">22511857</pub-id></citation></ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Overduin</surname> <given-names>S. A.</given-names></name> <name><surname>dAvella</surname> <given-names>A.</given-names></name> <name><surname>Carmena</surname> <given-names>J. M.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>2012</year>). <article-title>Microstimulation activates a handful of muscle synergies</article-title>. <source>Neuron</source> <volume>76</volume>, <fpage>1071</fpage>&#x02013;<lpage>1077</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2012.10.018</pub-id><pub-id pub-id-type="pmid">23259944</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Overduin</surname> <given-names>S. A.</given-names></name> <name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name> <name><surname>Roh</surname> <given-names>J.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>2008</year>). <article-title>Modulation of muscle synergy recruitment in primate grasping</article-title>. <source>J. Neurosci</source>. <volume>28</volume>, <fpage>880</fpage>&#x02013;<lpage>892</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.2869-07.2008</pub-id><pub-id pub-id-type="pmid">18216196</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Overduin</surname> <given-names>S. A.</given-names></name> <name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name> <name><surname>Roh</surname> <given-names>J.</given-names></name> <name><surname>Carmena</surname> <given-names>J. M.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>2015</year>). <article-title>Representation of muscle synergies in the primate brain</article-title>. <source>J. Neurosci</source>. <volume>35</volume>, <fpage>12615</fpage>&#x02013;<lpage>12624</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.4302-14.2015</pub-id><pub-id pub-id-type="pmid">26377453</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pham</surname> <given-names>K.</given-names></name> <name><surname>Portilla-Jim&#x000E9;nez</surname> <given-names>M.</given-names></name> <name><surname>Roh</surname> <given-names>J.</given-names></name></person-group> (<year>2023</year>). <article-title>Generalizability of muscle synergies in isometric force generation versus point-to-point reaching in the human upper extremity workspace</article-title>. <source>Front. Hum. Neurosci</source>. <volume>17</volume>:<fpage>1144860</fpage>. <pub-id pub-id-type="doi">10.3389/fnhum.2023.1144860</pub-id><pub-id pub-id-type="pmid">37529403</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roberts</surname> <given-names>T. J.</given-names></name></person-group> (<year>2016</year>). <article-title>Contribution of elastic tissues to the mechanics and energetics of muscle function during movement</article-title>. <source>J. Exp. Biol</source>. <volume>219</volume>, <fpage>266</fpage>&#x02013;<lpage>275</lpage>. <pub-id pub-id-type="doi">10.1242/jeb.124446</pub-id><pub-id pub-id-type="pmid">26792339</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rodriguez</surname> <given-names>K. L.</given-names></name> <name><surname>Roemmich</surname> <given-names>R. T.</given-names></name> <name><surname>Cam</surname> <given-names>B.</given-names></name> <name><surname>Fregly</surname> <given-names>B. J.</given-names></name> <name><surname>Hass</surname> <given-names>C. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Persons with parkinson disease exhibit decreased neuromuscular complexity during gait</article-title>. <source>Clini. Neurophysiol</source>. <volume>124</volume>, <fpage>1390</fpage>&#x02013;<lpage>1397</lpage>. <pub-id pub-id-type="doi">10.1016/j.clinph.2013.02.006</pub-id><pub-id pub-id-type="pmid">23474055</pub-id></citation></ref>
<ref id="B48">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roh</surname> <given-names>J.</given-names></name> <name><surname>Cheung</surname> <given-names>V. C.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name></person-group> (<year>2011</year>). <article-title>Modules in the brain stem and spinal cord underlying motor behaviors</article-title>. <source>J. Neurophysiol</source>. <volume>106</volume>, <fpage>1363</fpage>&#x02013;<lpage>1378</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00842.2010</pub-id><pub-id pub-id-type="pmid">21653716</pub-id></citation></ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Roh</surname> <given-names>J.</given-names></name> <name><surname>Rymer</surname> <given-names>W. Z.</given-names></name> <name><surname>Beer</surname> <given-names>R. F.</given-names></name></person-group> (<year>2012</year>). <article-title>Robustness of muscle synergies underlying three-dimensional force generation at the hand in healthy humans</article-title>. <source>J. Neurophysiol</source>. <volume>107</volume>, <fpage>2123</fpage>&#x02013;<lpage>2142</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00173.2011</pub-id><pub-id pub-id-type="pmid">22279190</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rokni</surname> <given-names>U.</given-names></name> <name><surname>Richardson</surname> <given-names>A. G.</given-names></name> <name><surname>Bizzi</surname> <given-names>E.</given-names></name> <name><surname>Seung</surname> <given-names>H. S.</given-names></name></person-group> (<year>2007</year>). <article-title>Motor learning with unstable neural representations</article-title>. <source>Neuron</source> <volume>54</volume>, <fpage>653</fpage>&#x02013;<lpage>666</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2007.04.030</pub-id><pub-id pub-id-type="pmid">17521576</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>R&#x000FC;ckert</surname> <given-names>E.</given-names></name> <name><surname>d&#x00027;Avella</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Learned parametrized dynamic movement primitives with shared synergies for controlling robotic and musculoskeletal systems</article-title>. <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>138</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00138</pub-id><pub-id pub-id-type="pmid">24146647</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sartori</surname> <given-names>M.</given-names></name> <name><surname>Gizzi</surname> <given-names>L.</given-names></name> <name><surname>Lloyd</surname> <given-names>D. G.</given-names></name> <name><surname>Farina</surname> <given-names>D.</given-names></name></person-group> (<year>2013</year>). <article-title>A musculoskeletal model of human locomotion driven by a low dimensional set of impulsive excitation primitives</article-title>. <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>79</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00079</pub-id><pub-id pub-id-type="pmid">23805099</pub-id></citation></ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saul</surname> <given-names>K. R.</given-names></name> <name><surname>Hu</surname> <given-names>X.</given-names></name> <name><surname>Goehler</surname> <given-names>C. M.</given-names></name> <name><surname>Vidt</surname> <given-names>M. E.</given-names></name> <name><surname>Daly</surname> <given-names>M.</given-names></name> <name><surname>Velisar</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Benchmarking of dynamic simulation predictions in two software platforms using an upper limb musculoskeletal model</article-title>. <source>Comput. Methods Biomech. Biomed. Engin</source>. <volume>18</volume>, <fpage>1445</fpage>&#x02013;<lpage>1458</lpage>. <pub-id pub-id-type="doi">10.1080/10255842.2014.916698</pub-id><pub-id pub-id-type="pmid">24995410</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scott</surname> <given-names>S. H.</given-names></name></person-group> (<year>2008</year>). <article-title>Inconvenient truths about neural processing in primary motor cortex</article-title>. <source>J. Physiol</source>. <volume>586</volume>, <fpage>1217</fpage>&#x02013;<lpage>1224</lpage>. <pub-id pub-id-type="doi">10.1113/jphysiol.2007.146068</pub-id><pub-id pub-id-type="pmid">18187462</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sharif Razavian</surname> <given-names>R.</given-names></name> <name><surname>Mehrabi</surname> <given-names>N.</given-names></name> <name><surname>McPhee</surname> <given-names>J.</given-names></name></person-group> (<year>2015</year>). <article-title>A model-based approach to predict muscle synergies using optimization: application to feedback control</article-title>. <source>Front. Comput. Neurosci</source>. <volume>9</volume>:<fpage>121</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2015.00121</pub-id><pub-id pub-id-type="pmid">26500530</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shenoy</surname> <given-names>K. V.</given-names></name> <name><surname>Sahani</surname> <given-names>M.</given-names></name> <name><surname>Churchland</surname> <given-names>M. M.</given-names></name></person-group> (<year>2013</year>). <article-title>Cortical control of arm movements: a dynamical systems perspective</article-title>. <source>Annu. Rev. Neurosci</source>. <volume>36</volume>, <fpage>337</fpage>&#x02013;<lpage>359</lpage>. <pub-id pub-id-type="doi">10.1146/annurev-neuro-062111-150509</pub-id><pub-id pub-id-type="pmid">23725001</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sohn</surname> <given-names>M. H.</given-names></name> <name><surname>Ting</surname> <given-names>L. H.</given-names></name></person-group> (<year>2016</year>). <article-title>Suboptimal muscle synergy activation patterns generalize their motor function across postures</article-title>. <source>Front. Comput. Neurosci</source>. <volume>10</volume>:<fpage>7</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2016.00007</pub-id><pub-id pub-id-type="pmid">26869914</pub-id></citation></ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Song</surname> <given-names>Y.</given-names></name> <name><surname>Hirashima</surname> <given-names>M.</given-names></name> <name><surname>Takei</surname> <given-names>T.</given-names></name></person-group> (<year>2022</year>). <article-title>Neural network models for spinal implementation of muscle synergies</article-title>. <source>Front. Syst. Neurosci</source>. <volume>16</volume>:<fpage>800628</fpage>. <pub-id pub-id-type="doi">10.3389/fnsys.2022.800628</pub-id><pub-id pub-id-type="pmid">35370571</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stapley</surname> <given-names>P. J.</given-names></name> <name><surname>Ting</surname> <given-names>L. H.</given-names></name> <name><surname>Hulliger</surname> <given-names>M.</given-names></name> <name><surname>Macpherson</surname> <given-names>J. M.</given-names></name></person-group> (<year>2002</year>). <article-title>Automatic postural responses are delayed by pyridoxine-induced somatosensory loss</article-title>. <source>J. Neurosci</source>. <volume>22</volume>, <fpage>5803</fpage>&#x02013;<lpage>5807</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.22-14-05803.2002</pub-id><pub-id pub-id-type="pmid">12122040</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sternad</surname> <given-names>D.</given-names></name> <name><surname>Marino</surname> <given-names>H.</given-names></name> <name><surname>Charles</surname> <given-names>S. K.</given-names></name> <name><surname>Duarte</surname> <given-names>M.</given-names></name> <name><surname>Dipietro</surname> <given-names>L.</given-names></name> <name><surname>Hogan</surname> <given-names>N.</given-names></name></person-group> (<year>2013</year>). <article-title>Transitions between discrete and rhythmic primitives in a unimanual task</article-title>. <source>Front. Comput. Neurosci</source>. <volume>7</volume>:<fpage>90</fpage>. <pub-id pub-id-type="doi">10.3389/fncom.2013.00090</pub-id><pub-id pub-id-type="pmid">23888139</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Sy</surname> <given-names>H. V. N.</given-names></name> <name><surname>Nambu</surname> <given-names>I.</given-names></name> <name><surname>Wada</surname> <given-names>Y.</given-names></name></person-group> (<year>2016</year>). <article-title>The adjustment of muscle synergy recruitment by controlling muscle contraction during the reaching movement</article-title>, in <source>2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC)</source> (<publisher-loc>Budapest</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>000756</fpage>&#x02013;<lpage>000761</lpage>.</citation>
</ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ta&#x000EF;x</surname> <given-names>M.</given-names></name> <name><surname>Tran</surname> <given-names>M. T.</given-names></name> <name><surname>Sou&#x000E8;res</surname> <given-names>P.</given-names></name> <name><surname>Guigon</surname> <given-names>E.</given-names></name></person-group> (<year>2013</year>). <article-title>Generating human-like reaching movements with a humanoid robot: a computational approach</article-title>. <source>J. Comput. Sci</source>. <volume>4</volume>:<fpage>269</fpage>&#x02013;<lpage>284</lpage>. <pub-id pub-id-type="doi">10.1016/j.jocs.2012.08.001</pub-id></citation>
</ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Takei</surname> <given-names>T.</given-names></name> <name><surname>Confais</surname> <given-names>J.</given-names></name> <name><surname>Tomatsu</surname> <given-names>S.</given-names></name> <name><surname>Oya</surname> <given-names>T.</given-names></name> <name><surname>Seki</surname> <given-names>K.</given-names></name></person-group> (<year>2017</year>). <article-title>Neural basis for hand muscle synergies in the primate spinal cord</article-title>. <source>Proc. Nat. Acad. Sci</source>. <volume>114</volume>:<fpage>8643</fpage>&#x02013;<lpage>8648</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1704328114</pub-id><pub-id pub-id-type="pmid">28739958</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Takiyama</surname> <given-names>K.</given-names></name> <name><surname>Okada</surname> <given-names>M.</given-names></name></person-group> (<year>2012</year>). <article-title>Maximization of learning speed in the motor cortex due to neuronal redundancy</article-title>. <source>PLoS Comput. Biol</source>. <volume>8</volume>:<fpage>e1002348</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pcbi.1002348</pub-id><pub-id pub-id-type="pmid">22253586</pub-id></citation></ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ting</surname> <given-names>L. H.</given-names></name> <name><surname>Chiel</surname> <given-names>H. J.</given-names></name> <name><surname>Trumbower</surname> <given-names>R. D.</given-names></name> <name><surname>Allen</surname> <given-names>J. L.</given-names></name> <name><surname>McKay</surname> <given-names>J. L.</given-names></name> <name><surname>Hackney</surname> <given-names>M. E.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Neuromechanical principles underlying movement modularity and their implications for rehabilitation</article-title>. <source>Neuron</source> <volume>86</volume>, <fpage>38</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2015.02.042</pub-id><pub-id pub-id-type="pmid">25856485</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ting</surname> <given-names>L. H.</given-names></name> <name><surname>Macpherson</surname> <given-names>J. M.</given-names></name></person-group> (<year>2005</year>). <article-title>A limited set of muscle synergies for force control during a postural task</article-title>. <source>J. Neurophysiol</source>. <volume>93</volume>, <fpage>609</fpage>&#x02013;<lpage>613</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00681.2004</pub-id><pub-id pub-id-type="pmid">15342720</pub-id></citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Torres-Oviedo</surname> <given-names>G.</given-names></name> <name><surname>Macpherson</surname> <given-names>J. M.</given-names></name> <name><surname>Ting</surname> <given-names>L. H.</given-names></name></person-group> (<year>2006</year>). <article-title>Muscle synergy organization is robust across a variety of postural perturbations</article-title>. <source>J. Neurophysiol</source>. <volume>96</volume>, <fpage>1530</fpage>&#x02013;<lpage>1546</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00810.2005</pub-id><pub-id pub-id-type="pmid">16775203</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Winters</surname> <given-names>J.</given-names></name> <name><surname>Stark</surname> <given-names>L.</given-names></name> <name><surname>Seif-Naraghi</surname> <given-names>A.-H.</given-names></name></person-group> (<year>1988</year>). <article-title>An analysis of the sources of musculoskeletal system impedance</article-title>. <source>J. Biomech</source>. <volume>21</volume>, <fpage>1011</fpage>&#x02013;<lpage>1025</lpage>. <pub-id pub-id-type="doi">10.1016/0021-9290(88)90248-5</pub-id><pub-id pub-id-type="pmid">2577948</pub-id></citation></ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yang</surname> <given-names>Q.</given-names></name> <name><surname>Logan</surname> <given-names>D.</given-names></name> <name><surname>Giszter</surname> <given-names>S. F.</given-names></name></person-group> (<year>2019</year>). <article-title>Motor primitives are determined in early development and are then robustly conserved into adulthood</article-title>. <source>Proc. Nat. Acad. Sci</source>. <volume>116</volume>, <fpage>12025</fpage>&#x02013;<lpage>12034</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1821455116</pub-id><pub-id pub-id-type="pmid">31138689</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yaron</surname> <given-names>A.</given-names></name> <name><surname>Kowalski</surname> <given-names>D.</given-names></name> <name><surname>Yaguchi</surname> <given-names>H.</given-names></name> <name><surname>Takei</surname> <given-names>T.</given-names></name> <name><surname>Seki</surname> <given-names>K.</given-names></name></person-group> (<year>2020</year>). <article-title>Forelimb force direction and magnitude independently controlled by spinal modules in the macaque</article-title>. <source>Proc. Nat. Acad. Sci</source>. <volume>117</volume>, <fpage>27655</fpage>&#x02013;<lpage>27666</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1919253117</pub-id><pub-id pub-id-type="pmid">33060294</pub-id></citation></ref>
</ref-list>
</back>
</article>