<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Syst. Neurosci.</journal-id>
<journal-title>Frontiers in Systems Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Syst. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-5137</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnsys.2020.00046</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Dorsal Column Nuclei Neural Signal Features Permit Robust Machine-Learning of Natural Tactile- and Proprioception-Dominated Stimuli</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Loutit</surname> <given-names>Alastair J.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/677524/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Potas</surname> <given-names>Jason R.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/664921/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Medical Sciences, University of New South Wales Sydney</institution>, <addr-line>Kensington, NSW</addr-line>, <country>Australia</country></aff>
<aff id="aff2"><sup>2</sup><institution>The Eccles Institute of Neuroscience, John Curtin School of Medical Research, Australian National University</institution>, <addr-line>Canberra, ACT</addr-line>, <country>Australia</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Heiko J. Luhmann, Johannes Gutenberg University Mainz, Germany</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Robert A. Gaunt, University of Pittsburgh, United States; Juergen Konczak, University of Minnesota Twin Cities, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Jason R. Potas <email>j.potas&#x00040;unsw.edu.au</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>28</day>
<month>07</month>
<year>2020</year>
</pub-date>
<pub-date pub-type="collection">
<year>2020</year>
</pub-date>
<volume>14</volume>
<elocation-id>46</elocation-id>
<history>
<date date-type="received">
<day>25</day>
<month>01</month>
<year>2020</year>
</date>
<date date-type="accepted">
<day>22</day>
<month>06</month>
<year>2020</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2020 Loutit and Potas.</copyright-statement>
<copyright-year>2020</copyright-year>
<copyright-holder>Loutit and Potas</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract><p>Neural prostheses enable users to effect movement through a variety of actuators by translating brain signals into movement control signals. However, to achieve more natural limb movements from these devices, the restoration of somatosensory feedback is required. We used feature-learnability, a machine-learning approach, to assess signal features for their capacity to enhance decoding performance of neural signals evoked by natural tactile and proprioceptive somatosensory stimuli, recorded from the surface of the dorsal column nuclei (DCN) in urethane-anesthetized rats. The highest performing individual feature, spike amplitude, classified somatosensory DCN signals with 70% accuracy. The highest accuracy achieved was 87% using 13 features that were extracted from both high and low-frequency (LF) bands of DCN signals. In general, high-frequency (HF) features contained the most information about peripheral somatosensory events, but when features were acquired from short time-windows, classification accuracy was significantly improved by adding LF features to the feature set. We found that proprioception-dominated stimuli generalize across animals better than tactile-dominated stimuli, and we demonstrate how information that signal features contribute to neural decoding changes over the time-course of dynamic somatosensory events. These findings may inform the biomimetic design of artificial stimuli that can activate the DCN to substitute somatosensory feedback. Although, we investigated somatosensory structures, the feature set we investigated may also prove useful for decoding other (e.g., motor) neural signals.</p></abstract>
<kwd-group>
<kwd>feature learnability</kwd>
<kwd>neural prosthesis</kwd>
<kwd>supervised back-propagation artificial neural network</kwd>
<kwd>brain-machine interface</kwd>
<kwd>cuneate</kwd>
<kwd>gracile</kwd>
</kwd-group>
<counts>
<fig-count count="8"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="62"/>
<page-count count="19"/>
<word-count count="13079"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="introduction" id="s1">
<title>Introduction</title>
<p>Neural prostheses enable users to control robotic limbs, computer cursors, or even effect movement of the users own limbs, by translating brain signals into movement control signals (Ethier et al., <xref ref-type="bibr" rid="B14">2012</xref>; Hochberg et al., <xref ref-type="bibr" rid="B25">2012</xref>; Collinger et al., <xref ref-type="bibr" rid="B13">2013</xref>; Gilja et al., <xref ref-type="bibr" rid="B23">2015</xref>; Jarosiewicz et al., <xref ref-type="bibr" rid="B27">2015</xref>; Bouton et al., <xref ref-type="bibr" rid="B3">2016</xref>; Capogrosso et al., <xref ref-type="bibr" rid="B9">2016</xref>; Ajiboye et al., <xref ref-type="bibr" rid="B1">2017</xref>). Currently, neural prosthetic performance is still poor compared to natural limb movements, particularly for dexterous object manipulation. However, motor control performance can be significantly improved by restoring somatosensory feedback that rapidly updates limb status.</p>
<p>Several groups have stimulated monkey or human somatosensory cortex to evoke percepts such as vibration, pressure, and stimulus location, and have shown that this somatosensory feedback improves dexterous manipulation capabilities of motor neural prostheses (O&#x02019;Doherty et al., <xref ref-type="bibr" rid="B47">2009</xref>, <xref ref-type="bibr" rid="B46">2019</xref>; Tabot et al., <xref ref-type="bibr" rid="B57">2013</xref>; Klaes et al., <xref ref-type="bibr" rid="B29">2014</xref>; Kim et al., <xref ref-type="bibr" rid="B28">2015</xref>; Flesher et al., <xref ref-type="bibr" rid="B15">2016</xref>, <xref ref-type="bibr" rid="B16">2019</xref>; Salas et al., <xref ref-type="bibr" rid="B53">2018</xref>). However, we have recently suggested that the dorsal column nuclei (DCN) and their associated external cuneate nuclei, nuclei X, and Z (DCN-complex) have anatomical advantages over the cortex as a sensory neural prosthesis target (Loutit and Potas, <xref ref-type="bibr" rid="B37">2020a</xref>; Loutit et al., <xref ref-type="bibr" rid="B40">2020</xref>). Activating the DCN-complex with a neural prosthesis capable of mimicking natural somatosensory signals has the potential to simultaneously inform not only the cortex but several other regions essential for motor control, including the cerebellum and tegmentum that are bypassed by a cortical neural prosthesis.</p>
<p>While the DCN has begun to receive attention as a neural prosthetic target, microelectrode arrays have been chronically implanted in macaque DCN (Richardson et al., <xref ref-type="bibr" rid="B50">2015</xref>; Sritharan et al., <xref ref-type="bibr" rid="B54">2016</xref>; Loutit et al., <xref ref-type="bibr" rid="B38">2017</xref>, <xref ref-type="bibr" rid="B39">2019</xref>; Suresh et al., <xref ref-type="bibr" rid="B56">2017</xref>; Loutit and Potas, <xref ref-type="bibr" rid="B37">2020a</xref>). To date, these DCN rigid chronic electrode array implants have resulted in some failures due to head and neck movements damaging the wire bundles or dislodging the array from the brain tissue (Suresh et al., <xref ref-type="bibr" rid="B56">2017</xref>). However, rapidly advancing soft implantable electrode technologies, such as microelectrode &#x0201C;threads&#x0201D; that can be sewn into brain tissue at densities of approximately 3,000 electrodes/25 mm<sup>2</sup> (Musk and Neuralink, <xref ref-type="bibr" rid="B43">2019</xref>), present a promising solution for targeting the DCN (Loutit and Potas, <xref ref-type="bibr" rid="B37">2020a</xref>). Yet, knowledge of DCN neurophysiology and how to effectively activate DCN neural populations to restore somatosensory feedback is limited. Some state-of-the-art peripheral somatosensory neural prostheses use biomimetic stimulus patterns to mimic attributes of fast- or slowly-adapting afferents, by modulating stimulus frequency or amplitude at the onset, offset, static or dynamic phases of stimuli (Valle et al., <xref ref-type="bibr" rid="B58">2018</xref>; George et al., <xref ref-type="bibr" rid="B22">2019</xref>). These biomimetic stimulus patterns were reported to elicit more naturalistic sensations and improved object discrimination performance, compared to linear feedback algorithms that simply increase stimulus intensity (amplitude or frequency) with increased force applied to a robotic force sensor. To construct such biomimetic stimulus patterns for the DCN, we first need to determine which properties of DCN neural activity are most relevant to somatosensory stimuli from which they were evoked.</p>
<p>We previously devised a metric, which we termed <italic>feature-learnability</italic>, for quantifying information relevance of DCN neural signal features for discriminating somatosensory stimuli (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). Using feature-learnability, we demonstrated that electrical stimulation of peripheral afferents results in robust and reproducible DCN neuronal activity, within and across animals. This suggests that different animals undergo the same DCN neural processes in response to an electrically-evoked peripheral event. But how reproducible is DCN activity under conditions of naturally presented stimuli? In the present study, we used feature-learnability to assess a battery of DCN neural signal features for their information content about the natural peripheral stimuli from which they were evoked. Natural stimuli consist of a degree of mixed tactile and proprioceptive events; i.e., some tactile stimuli generate digit movement, and it is not possible to move a joint without distorting the skin around that joint. To study how tactile and proprioceptive information is captured by DCN signal features and how consistent this is across animals, we contrived tactile- and proprioceptive-dominant stimuli, whilst recording somatosensory-evoked DCN signals using a surface multielectrode array (sMEA). These stimuli are not exclusively tactile or proprioceptive, but rather, they mainly recruit one type of afferent whilst minimizing recruitment of the other.</p>
<p>In the present study, we aimed to explore the feature-learnability of DCN somatosensory potentials evoked by tactile- and proprioceptive-dominant stimuli. We use feature-learnability to evaluate a diverse set of neural signal features for information content relevant to decoding mechanically evoked tactile- and proprioception-dominated stimuli. From somatosensory-evoked DCN neural signals, we extracted 22 features from four categories: two categories, high-frequency (HF) and low-frequency (LF), were derived from time-domain signals, and the remaining two categories were derived from frequency-domain features; HF power spectral density (HF PSD), and LF power spectral density (LF PSD) features. As signal features represent underlying neuronal processes, high feature-learnability indicates the presence of a robust and reproducible neuronal process for natural stimuli. Furthermore, high feature-learnability across animals indicates that a similar neural process is present across different animals. How feature-learnability changes as a function of time throughout a dynamic stimulus indicates the changing importance of that feature to a peripheral event during different phases of its progression, and therefore is valuable for future biomimetic stimulation applications. While our primary focus was to investigate features of somatosensory DCN signals, the feature set and our approach to determining the most information-rich features for decoding neural signals may provide insight into other neural signal decoding applications, such as motor systems.</p>
</sec>
<sec sec-type="materials and methods" id="s2">
<title>Materials and Methods</title>
<sec id="s2-1">
<title>Animals</title>
<p>We used 8-week-old male Wistar rats (283&#x02013;464 g; <italic>n</italic> = 6; Australian Phenomics Facility, Canberra, ACT, Australia). There were 1&#x02013;3 animals housed per cage, with a 12/12-h light/dark cycle. Food and water were available for animals to access <italic>ad libitum</italic>. All procedures were approved by the Australian National University Animal Experimentation Ethics Committee (A2014/52) and adhered to the Australian code of practice for the care and use of animals for scientific purposes.</p>
</sec>
<sec id="s2-2">
<title>Surgery</title>
<p>Rats were anesthetized with urethane (1.4g kg<sup>&#x02212;1</sup> i.p.). A tracheotomy was performed, and a breathing tube inserted to aid natural respiration. Rats were placed in a stereotaxic frame with head flexion at &#x02212;20&#x000B0;; (Stoelting Instruments). The dorsal skin and muscles of the neck, and the dura and arachnoid mater were excised between the foramen magnum and the C1 vertebra to expose the dorsal surface of the brainstem. In most cases, the C1 vertebra was cut away with rongeurs to aid placement of an adapted surface multi-electrode array (sMEA; <italic>Nucleus 22 Auditory Brainstem Implant</italic>, Cochlear Limited). Details of the electrode dimensions are shown in the inset in <xref ref-type="fig" rid="F1">Figure 1</xref>, and further details of the electrode can be found in Chelvanayagam et al. (<xref ref-type="bibr" rid="B11">2008</xref>). A flexible plastic rod held by a micromanipulator on the stereotaxic frame was lightly pressed onto the sMEA to hold it symmetrically over the brainstem midline.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Mechanical stimulation conditions, recording arrangement, and example signals recorded from the dorsal column nuclei (DCN). <bold>(A)</bold> A schematic diagram of the mechanical stimulation and surface array recording paradigm. Each of the four limbs was individually stimulated with a mechanical stimulus as shown in the left insert, amounting to 16 possible combinations of stimulus type and location. The two possible tactile-dominated stimuli comprised a phase that applied a 20-g force with a dowel or a brush to the palmar or plantar surface; the two possible proprioceptive-dominated stimuli applied extension or flexion to one of the limbs which included <italic>move</italic>, <italic>hold</italic>, and <italic>return</italic> phases. Dorsal column nuclei signals were simultaneously recorded from seven electrodes of a surface multi-electrode array (right insert). <bold>(B)</bold> Examples of 5 s of DCN signal recordings in response to stimulation of the left forelimb with each of the four stimulus types. Signals are color-coded according to their corresponding recording electrode shown in the right insert of <bold>(A)</bold>. The timing of stimulus phases is shown below each signal example for each stimulus type. Gray lines indicate the start and end of stimulus-on/-off periods. Abbreviations: DCN, dorsal column nuclei; e1, electrode 1; e2, electrode 2; e3, electrode 3; e4, electrode 4; e5, electrode 5; e6, electrode 6; e7, electrode, 7; SEM, standard error of the mean.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0001.tif"/>
</fig>
</sec>
<sec id="s2-3">
<title>Stimulation and Recording</title>
<p>We applied two types each of tactile- and proprioception-dominated stimuli to the rat limbs amounting to 16 (4 stimuli &#x000D7; 4 limbs) possible mechanical stimulus conditions. The tactile-dominated stimuli were applied by pressing either a wooden dowel rod (diameter: 2.0 mm) or brush into the palmar/plantar pads of the paws. The brush was 25 mm in length, with diameter: 5.0 mm that tapered to a point over the last 10 mm. The rod and brush were fixed at the end of a flexible tube to deliver 20 g of force. The proprioception-dominated stimuli were applied to the rat by flexing or extending the rat&#x02019;s limbs. The rats&#x02019; limbs were fixed to a dowel rod with ethyl cyanoacrylate instant adhesive (Loctite<sup>&#x000AE;</sup>, Henkel Adhesive Technologies) which enabled the experimenter to directly manipulate the limbs. Both flexion and extension involved the movement of the hip, knee, and ankle joints for the lower limbs, and the shoulder, elbow, and wrist joints in the forelimb. Therefore, the proprioceptive-dominated stimuli activated afferents across the entire limb, spanning three joints, and the associated muscles, in addition to the cutaneous afferents activated throughout the limbs by the movement. We do not describe the stimuli as exclusively tactile or proprioceptive, because the application of the tactile-dominated stimuli might also activate receptors in the joints and intrinsic muscles of the paw, and the proprioception-dominated stimuli undoubtedly activated tactile receptors associated with hair and skin throughout the limbs, in addition to the proprioceptive receptors in the skin, muscles, tendons, and joints. All stimuli were applied by the experimenter who was triggered by the timing of a metronome.</p>
<p>Stimuli were applied for 2.4 s with a rest period of 2.4 s. Tactile-dominated stimuli had a stimulus on/off pattern (4.8 s per trial), but proprioception-dominated stimuli also had a 2.4 s period which was used to return the limb to the resting state, where it remained in resting state for 2.4 s (7.2 s per trial). Stimuli were applied in 10 sets of 10 trials (100 stimuli per type), with 30 s rest between sets.</p>
<p>DCN electrical signals were acquired through seven electrodes of the sMEA and filtered (50 Hz notch filter; 10 kHz low-pass filter) through custom-built amplifiers. The signals were then digitally recorded (40 kHz sample rate) through a PowerLab 16/35 acquisition system and viewed in LabChart Pro software (Version 8.1.1, AD Instruments, Bella Vista, NSW, Australia). The seven electrodes of the sMEA are referred to from rostral to caudal as follows: left side electrodes: e1, e2; midline electrodes: e3, e4, e5; right side electrodes: e6, e7 (<xref ref-type="fig" rid="F1">Figure 1A</xref>, right insert), and all seven electrodes combined are referred to as e1&#x02013;7.</p>
<p>The large electrodes in this surface array were able to cover most, if not all, of the gracile nuclei, approximately three-quarters of the cuneate nuclei, and parts of the external cuneate nuclei. These electrodes allow acquisition of neural activity from large populations of neurons simultaneously and thereby permit finding the most salient and information-rich signal features that dominate somatosensory-evoked activity across most of the DCN, and how these features vary over time.</p>
</sec>
<sec id="s2-4">
<title>Signal Processing and Feature Extraction</title>
<p>Signal processing, feature extraction, and analysis were performed offline (MATLAB version R2018a, MathWorks). We used 22 DCN signal features as artificial neural network (ANN) inputs. The names, descriptions, and examples of feature extraction for all 22 features are shown in <xref ref-type="fig" rid="F2">Figure 2</xref>. Features were categorized into LF (&#x0003C;200 Hz) and HF (&#x0003E;200 Hz) bands for analysis. Others have used a similar frequency (usually between 100 and 300 Hz) to separate LF activity that typically represents local field potentials, calcium spikes, and intrinsic neural membrane potentials, from HF activity that typically represents a single unit or multiunit spiking activity (Buzs&#x000E1;ki et al., <xref ref-type="bibr" rid="B6">2012</xref>). Four features were extracted from HF filtered (bandpass 0.55&#x02013;3.3 kHz; 5-order Butterworth filter) signals (HF features; <xref ref-type="fig" rid="F2">Figures 2A&#x02013;D</xref>), and five from LF signals (LF features; <xref ref-type="fig" rid="F2">Figures 2E&#x02013;I</xref>), which were quantified from the HF signals after they had been rectified and low-pass filtered (&#x0003C;80 Hz; 5-order Butterworth filter). For all time-domain signals in which peak amplitudes were measured, we used the <italic>prominence</italic> output variable from the <italic>findpeaks</italic> MATLAB function. Thirteen features were extracted from frequency spectrograms (<italic>spectrogram</italic> MATLAB function) of DCN signals bandpass filtered between 4&#x02013;5,000 Hz (8-order Butterworth). Eight of these features were quantified from the peak power spectral density of HF bands (HF PSD features): 200&#x02013;600 Hz, 600&#x02013;1,000 Hz, 1,000&#x02013;1,500 Hz, 1,500&#x02013;2,000 Hz, 2,000&#x02013;2,500 Hz, 2,500&#x02013;3,000 Hz, 3,000&#x02013;3,500 Hz, 3,500&#x02013;4,000 Hz (<xref ref-type="fig" rid="F2">Figure 2J</xref>). The other five spectral features were quantified from the peak power spectral density of LF bands (LF PSD features): 4&#x02013;8 Hz, 8&#x02013;13 Hz, 13&#x02013;40 Hz, 40&#x02013;80 Hz, 80&#x02013;200 Hz (<xref ref-type="fig" rid="F2">Figure 2K</xref>). For all filtering, we used a zero-phase response filter: <italic>filtfilt</italic> function (MATLAB).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Four categories of 22 dorsal column nuclei signal features extracted for artificial neural network machine-learning. Descriptions and examples of individual features, extracted from dorsal column nuclei signals at various time windows, used to calculate feature-learnability (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>) are shown. Individual features were divided into four categories (color-coded): four HF <bold>(A&#x02013;D)</bold>; five LF <bold>(E&#x02013;I)</bold>; eight HF PSD <bold>(J)</bold>; and five LF PSD <bold>(K)</bold>. The red line in <bold>(J)</bold> and <bold>(K)</bold> indicates stimulus onset. Abbreviations: HF, high-frequency, LF, low-frequency; HF PSD, high-frequency power spectral density; LF PSD, low-frequency power spectral density.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0002.tif"/>
</fig>
<p>HF and LF features contain multiunit activity information, which in some cases outperforms spiking activity or local field potentials in offline decoding of motor tasks (Stark and Abeles, <xref ref-type="bibr" rid="B55">2007</xref>) and has been used to control motor neural prostheses in tetraplegic patients (Flint et al., <xref ref-type="bibr" rid="B18">2013</xref>; Bouton et al., <xref ref-type="bibr" rid="B3">2016</xref>). The HF PSD features have been minimally investigated, but similar frequency band ranges have been used to decode motor signals in a neural prosthesis capable of effecting limb movement through neuromuscular stimulation (Bouton et al., <xref ref-type="bibr" rid="B3">2016</xref>). The LF PSD features have been widely investigated in the motor cortex during reaching and grasping movements or used as decoding features for electrocorticographic or electroencephalographic neural prosthetic control (Wolpaw et al., <xref ref-type="bibr" rid="B60">1991</xref>; Kostov and Polak, <xref ref-type="bibr" rid="B30">2000</xref>; Leuthardt et al., <xref ref-type="bibr" rid="B34">2004</xref>; Rickert et al., <xref ref-type="bibr" rid="B51">2005</xref>; Flint et al., <xref ref-type="bibr" rid="B17">2012</xref>; Chen et al., <xref ref-type="bibr" rid="B12">2013</xref>; Marathe and Taylor, <xref ref-type="bibr" rid="B41">2013</xref>; Bundy et al., <xref ref-type="bibr" rid="B5">2016</xref>).</p>
</sec>
<sec id="s2-5">
<title>Standardized Artificial Neural Network for Machine-Learning</title>
<p>Individual signal features extracted from each of the seven electrodes were paired to the stimuli that generated them, to create input/output pairs for machine-learning. All machine-learning experiments used a standardized ANN with a supervised learning classification algorithm (<italic>patternnet</italic> MATLAB function). The standardized ANN comprised 42 hidden neurons and 16 output neurons corresponding to the 16 possible stimuli (four stimulus types, presented to four different limbs). We selected the number of hidden neurons by increasing their number between 16 (the number of outputs) and 154 (the highest possible number of inputs from our feature set). For each number of hidden neurons, we determined the average feature-learnability with the minimum (7) and maximum (154) number of features included in the input set and found that 42 hidden neurons produced the highest average feature-learnability. Thus, only the input neurons were altered, depending on the number of input features required for each experiment. The ANN used gradient descent with momentum and the adaptive learning rate backpropagation training function <italic>traingdx</italic>. The hyperbolic tangent sigmoid function, <italic>tansig</italic>, was used in the hidden layer units, and a softmax transfer function (<italic>softmax</italic>) was used in the output layer. Both inputs and output targets were normalized such that all values fit between &#x02212;1 and 1, as per the <italic>patternnet</italic> default setting. For training, cross-validation, and testing, the inputs were separated into training, validation, and test subsets, using the <italic>patternnet</italic> default settings.</p>
</sec>
<sec id="s2-6">
<title>Feature-Learnability of Individual Features and Selection of Benchmark Input Feature Sets</title>
<p>Feature-learnability provides a stable measure of relevant information content provided by input features including a measure of the information content variability (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). We used the Within Individual Animal (WIA) approach (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>) for all feature-learnability testing unless otherwise specified. In this approach, input/output pairs from 1,600 stimuli were generated for each animal. For each animal, ten repeated training (70%), validation (15%), and testing (15%) machine-learning cycles were performed under random initializing conditions. These ten confusion matrices were averaged to produce a single representative confusion matrix for each animal, then the representative confusion matrices for all animals were averaged. Feature-learnability was determined by the mean &#x000B1; SEM derived from the diagonal of this matrix. To determine the feature-learnability of an individual feature, the inputs to the standardized ANN were restricted to the single input feature in question, resulting in a total of seven inputs (the signal feature extracted from each electrode).</p>
<p>To obtain a measure that represents the maximum possible information content contained in signal features, a benchmark feature set was determined that produces the highest feature-learnability outcomes. This feature-learnability benchmark facilitates comparisons of information content contained by individuals or subsets of input features. Individual features were extracted from all seven electrodes over the first 1,000 ms from stimulus onset, and feature-learnability determined. Individual features were then ranked from highest to lowest feature-learnability, prioritized by the largest means and smallest SEM (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). Input feature selection was performed using an adapted sequential forward floating search algorithm (Whitney, <xref ref-type="bibr" rid="B59">1971</xref>; Pudil et al., <xref ref-type="bibr" rid="B48">1994</xref>). Our approach differed from a typical sequential forward floating search algorithm as we added four features (one from each feature category) to the input set per round of feature-learnability testing, rather than one feature. We also used a sequential backward search in each round to test whether removing features improved feature-learnability. The search was continued until the possible feature combinations presented by this method were exhausted and the maximum feature-learnability was determined.</p>
<p>A second benchmark was determined for features extracted over an optimal short-time window length (described below). The identical approach was used as for the 1,000 ms window benchmark, except that features were extracted from the shorter time course.</p>
</sec>
<sec id="s2-7">
<title>Signal Feature Robustness Across Animals</title>
<p>To determine the generalisability of the features across animals we used the 1,000 ms window benchmark feature set to compare feature-learnability using a leave-one-out (LOO) approach. We randomly assigned input/output pairs from five animals into training (70%) and validation (30%) sets, and testing was performed on the remaining animal (100%). The LOO approach was applied such that each of the six animals was examined as the test data set once. For more details on these methods see Loutit et al. (<xref ref-type="bibr" rid="B39">2019</xref>).</p>
</sec>
<sec id="s2-8">
<title>Feature-Learnability of Different Time Windows and Optimal Short-Time Window Selection</title>
<p>We sought to determine feature-learnability based on a shorter time-window for two purposes. Firstly, the features we investigated may be useful for decoding neural signals unrelated to DCN-specific signal features, such as neural signals from motor systems. Typical motor decoding algorithms use time windows ranging from 50&#x02013;100 ms (Lebedev and Nicolelis, <xref ref-type="bibr" rid="B32">2017</xref>), which trades classification accuracy for a feasible reduction in time required for real-time applications. Secondly, some peripheral somatosensory neural prostheses use stimulus patterns that mimic natural peripheral afferent firing properties, like variations in firing rate shown by fast and slowly-adapting afferents at the onset and offset of a stimulus. These biomimetic approaches have succeeded in eliciting more natural somatosensory percepts than simpler stimulus patterns that use only amplitude or frequency modulation to encode stimulus intensity (Valle et al., <xref ref-type="bibr" rid="B58">2018</xref>; George et al., <xref ref-type="bibr" rid="B22">2019</xref>). Therefore, determining feature-learnability over shorter time windows may help determine which features could inform the construction of artificial stimulus patterns during different stimulus events, such as contact onset, static holding, and contact offset. Extraction of features over longer time windows might mix those encoding onset, hold, and offset, and therefore be less informative to a decoding algorithm.</p>
<p>To determine an optimal short-time window that provides the highest feature-learnability in the shortest time, we tested windows between 20 ms to 150 ms with 10 ms increments, 250 ms, and 500 ms, in addition to the 1,000 ms windows described above. All windows started at the time of stimulus onset. We plotted feature-learnability against time windows for each feature and used the <italic>findchangepts</italic> MATLAB function to determine the most abrupt change in feature-learnability. We then averaged the changepoint values across all features and rounded to the nearest time window. A benchmark set of signal features was determined for the optimal short-time window (described above).</p>
</sec>
<sec id="s2-9">
<title>Feature-Learnability Variations in Time During Stimulus Presentation</title>
<p>Once we established the optimal short-time window, we sought to use the short rolling window to extract features throughout stimulus presentation and determine how feature-learnability varied over time. To do this we extracted the 22 features from the optimal short-time window, sampled at 1,000 ms before the stimulus, then every 10 ms from 200 ms pre-stimulus to 4,000 ms post-stimulus. Finally, we tested feature-learnability for each of the features extracted from each of the 421 windows.</p>
</sec>
<sec id="s2-10">
<title>Statistical Analysis</title>
<p>We used R (version 3.4.4; R Core Team, <xref ref-type="bibr" rid="B49">2018</xref>) for all statistical analyses with the RStudio integrated development environment (version 1.1.442). For comparison of the feature-learnability benchmark within and across animals we used a linear model (LM; R <italic>lm</italic> function, <italic>stats</italic> package). For all other comparisons, we used a linear mixed-effects model (LMER; <italic>lmer</italic> function from the <italic>lmerTest</italic> package; Kuznetzova et al., <xref ref-type="bibr" rid="B31">2019</xref>). Multiple comparisons were performed using estimated marginal means comparisons with Tukey <italic>p</italic>-value adjustments [R <italic>emmeans</italic> function, <italic>emmeans</italic> package (Lenth et al., <xref ref-type="bibr" rid="B33">2019</xref>)]. We verified the model fitting by examining model residuals for normality. Where required, <italic>log</italic> or <italic>logit</italic> transformations (<italic>car</italic> package; Fox and Weisberg, <xref ref-type="bibr" rid="B19">2019</xref>) were applied to the data before statistical modeling. All data are expressed as means &#x000B1; SEM unless otherwise stated. Probabilities of <italic>p</italic> &#x0003C; 0.05 were deemed significant.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>All raw data and extracted features from six animals are available in an open data repository (Loutit and Potas, <xref ref-type="bibr" rid="B377">2020b</xref>).</p>
<sec id="s3-1">
<title>Tactile- and Proprioceptive-Dominated Stimuli Evoked Distinct Patterns of Neural Activity</title>
<p>Preliminary observations of the data revealed neural activity was greatest on midline electrodes and those ipsilateral to the site of stimulus. Tactile-dominated stimuli evoked activity that was greatest at stimulus onset and/or offset. Dowel stimuli generally evoked a short and sharp burst of neural activity that peaked within 10 ms of stimulus contact/removal, whereas the brush stimuli evoked a longer, ramped burst of neural activity that was comparatively delayed at onset/offset and to reach maximum (20&#x02013;30 ms). In some cases, brush stimuli evoked two initial bursts at stimulus onset. Proprioception-dominated stimuli evoked more neural activity than tactile-evoked stimuli. In general, flexion resulted in greater neural activity compared to extension, however, the time to reach maximum neural activity was similar for both proprioception-dominated stimuli, which was at approximately the midpoint of the movement. Examples of filtered signals (0.55&#x02013;3.3 kHz) acquired from seven electrodes in response to the four types of stimuli applied to the left forelimb are shown in <xref ref-type="fig" rid="F1">Figure 1B</xref>. Features representing neural signals are shown in <xref ref-type="fig" rid="F2">Figure 2</xref>.</p>
</sec>
<sec id="s3-2">
<title>Feature-Learnability of Individual Features</title>
<p>We sought to rank individual features for their capacity to be informative of stimulus type and location. <xref ref-type="fig" rid="F3">Figure 3A</xref> shows the rank order of feature-learnability for all 22 features extracted from the first 1,000 ms following the stimulus onset across all seven electrodes. All 22 features performed significantly greater than chance levels of 6.25%. Feature-learnability ranking clustered into three groups: (1) highest-performing features, comprising three of the four HF and one of the five LF features; (2) middle performing features, comprising the remaining LF and all but one of the HF PSD features; and (3) the lowest-performing features, comprising mainly LF PSD feature and the remaining HF and HF PSD features, all of which still performed three times greater than chance levels. These findings indicate that time-domain HF features are the most informative for determining a combination of stimulus location and type.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>One-thousand milliseconds window benchmark determined from individual and combined signal features.<bold> (A)</bold> Feature-learnability was derived from dorsal column nuclei signal features extracted from 1,000 ms windows starting at the onset of each stimulus. Features are ordered in feature-learnability rank order (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>) from highest to lowest feature-learnability from left to right. Colors indicate the feature category that individual features belong (as described in <xref ref-type="fig" rid="F2">Figure 2</xref>). Gold arrows indicate the 13 signal features that comprise the 1,000 ms window benchmark configuration also indicated in panel <bold>(B)</bold>. <bold>(B)</bold> Feature-learnability was determined after consecutively adding individual features from the same category (within-category features) that improved classification accuracy. The number of individual features included in within-category combinations is indicated by the bottom x-axis; curves are color-coded according to the within-category features. Feature-learnability was also determined by combining the within-category features from all four categories (combined-category features, plotted in cyan). The total number of individual features included in the combined-category feature combinations is indicated by the top x-axis; the gold arrow indicates the 1,000 ms window benchmark configuration for all subsequent comparisons. The black line indicates a chance level of classification (6.25%). Feature-learnability data expressed as mean &#x000B1; SEM. Abbreviations: HF, high-frequency, LF, low-frequency; HF PSD, high-frequency power spectral density; LF PSD, low-frequency power spectral density. See <xref ref-type="fig" rid="F2">Figure 2</xref> for feature name descriptions.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0003.tif"/>
</fig>
</sec>
<sec id="s3-3">
<title>Establishing a 1,000 ms Window Feature-Learnability Benchmark</title>
<p>We previously demonstrated that combinations of LF and HF signal features improve machine-learning outcomes (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). We, therefore, sought to determine a combination of input features that produced the highest feature-learnability and to establish a benchmark for subsequent comparisons. Combinations derived from the best performing pair of features from within the HF, LF, and HF PSD categories resulted in significant feature-learnability improvements, compared to single features (<italic>p</italic> &#x02264; 0.01, LMER, Tukey), but tended to plateau after adding the second feature (<xref ref-type="fig" rid="F3">Figure 3B</xref>). The best performing pair of frequency-domain features in the LF PSD category was not better than the best performing single LF PSD feature (<italic>p</italic> = 1.0, LMER, Tukey). The highest-ranked learnability from within-category feature combinations was achieved by combining all four HF features (86.5%). However, this HF 4-feature combination was not significantly greater than the 2 or 3-feature HF combinations (<italic>p</italic> = 1.0, LMER, Tukey), all of which also significantly out-performed the best individual HF feature and all other within-category combinations (<italic>p</italic> &#x02264; 0.0003, LMER, Tukey; <xref ref-type="fig" rid="F3">Figure 3B</xref>).</p>
<p>To determine if combinations of features from different categories improved feature-learnability, we combined the highest-ranked feature from each category (i.e., a combination with 4 features). This combination yielded significantly greater feature-learnability than all LF, LF PSD, and HF PSD highest-ranked feature combinations (<italic>p</italic> &#x02264; 0.0063, LMER, Tukey). Compared to the HF feature category, the 4-feature across-category combination was only significantly greater than the highest-ranked single HF feature (<italic>p</italic> &#x0003C; 0.0001, LMER, Tukey), but was not significantly different when additional HF features were added (<italic>p</italic> = 1.0, LMER, Tukey; <xref ref-type="fig" rid="F3">Figure 3B</xref>).</p>
<p>To find the combination with the highest-ranked feature-learnability, we sequentially added the next best features in groups of four (i.e., the next best individual feature from each of the four categories). The highest-ranked feature-learnability achieved was 87.2 &#x000B1; 1.3% with 13 features which we defined as our 1,000 ms window feature-learnability benchmark for subsequent comparisons. Despite improved feature-learnability with 13 features compared to 4, 8, or 11 features, there were no significant differences between feature-learnability outcomes of any of the across-category combined feature sets (p &#x02265; 0.66, LMER, Tukey; <xref ref-type="fig" rid="F3">Figure 3B</xref>). The individual features that contribute to the 1,000 ms benchmark combination are indicated in <xref ref-type="fig" rid="F3">Figure 3A</xref>, and their confusion matrices are shown in <xref ref-type="fig" rid="F4">Figures 4A&#x02013;D</xref>.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Machine-learning outcomes for individual and combinations of 1,000 ms window benchmark features. Panels <bold>(A&#x02013;D)</bold> shown are confusion matrices (mean of six animals) of machine-learning outcomes from 13 features comprising the benchmark feature set (<xref ref-type="fig" rid="F3">Figure 3A</xref>) grouped by their four categories (<xref ref-type="fig" rid="F2">Figure 2</xref>). Features in the left column were the first four features combined (blue curve, <xref ref-type="fig" rid="F3">Figure 3B</xref>), and each confusion matrix to the right shows successive additions to the feature set. The black arrow on the color bar below confusion matrices indicates a chance level (6.25%). <bold>(E&#x02013;H)</bold> The diagonal of each confusion matrix is plotted in the line graphs, with features in <bold>(A&#x02013;D)</bold> corresponding to line graphs <bold>(E&#x02013;H)</bold>, respectively. Dark lines in <bold>(E&#x02013;H)</bold> show means of six animals and the corresponding pale bars indicate &#x000B1; SEM; colors that are arbitrarily chosen. Superimposed is the benchmark feature-learnability (gold) for comparison; black straight lines indicate classification chance level (6.25%). See <xref ref-type="fig" rid="F2">Figure 2</xref> for feature descriptions.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0004.tif"/>
</fig>
<p>In summary, time-domain HF features resulted in the highest feature-learnability rankings, and although the benchmark feature set included 13 features from all four categories, benchmark feature-learnability was not significantly higher than the combination of two HF features (<italic>HF spike amplitude</italic> and <italic>HF spike count</italic>).</p>
</sec>
<sec id="s3-4">
<title>How Well do Individual Features Predict Different Mechanical Somatosensory Stimuli?</title>
<p>To determine what information the 1,000 ms benchmark input features contribute to feature-learnability, we plotted confusion matrices for all 13 features (<xref ref-type="fig" rid="F4">Figure 4</xref>). Correct predictions (i.e., the diagonal) of each matrix are replotted with their SEM in the right panels of <xref ref-type="fig" rid="F4">Figures 4E&#x02013;H</xref> to facilitate performance comparisons of each feature and to provide a measure of variability among animals.</p>
<p>The HF feature category (<xref ref-type="fig" rid="F4">Figure 4A</xref>) significantly outperformed all other categories (<italic>p</italic> &#x02264; 0.001, LMER, Tukey). Proprioception-dominated stimuli were significantly better classified than tactile-dominated stimuli by all categories (<italic>p</italic> &#x0003C; 0.0001, LMER, Tukey), except the LF PSD category (<xref ref-type="fig" rid="F4">Figure 4H</xref>, <italic>p</italic> = 0.74, LMER, Tukey). The forelimbs were significantly better classified than hindlimbs across all categories (<italic>p</italic> &#x02264; 0.004, LMER, Tukey), and for both tactile- and proprioceptive-dominated stimuli (<italic>p</italic> &#x0003C; 0.0001, LMER, Tukey). <italic>HF spike amplitude</italic> was the best predictor of tactile-dominated stimuli and significantly outperformed all other features (<italic>p</italic> &#x02264; 0.0026, LMER, Tukey; <xref ref-type="fig" rid="F4">Figures 4E&#x02013;H</xref>). <italic>HF integral</italic> was the best predictor of proprioceptive-dominated stimuli and significantly outperformed most other features (<italic>p</italic> &#x02264; 0.0019, LMER, Tukey), except <italic>HF spike count</italic> and <italic>LF sum burst amplitudes</italic> (<italic>p</italic> 1.0, LMER, Tukey; <xref ref-type="fig" rid="F4">Figures 4E&#x02013;H</xref>). Interestingly, the <italic>LF burst count</italic> predicted proprioceptive-dominated stimuli significantly better when evoked from right limbs compared to left limbs (<italic>p</italic> = 0.035, LMER, Tukey; <xref ref-type="fig" rid="F4">Figure 4F</xref>).</p>
</sec>
<sec id="s3-5">
<title>HF Feature Quantification</title>
<p>To investigate how <italic>HF spike amplitude</italic> predicted tactile stimuli significantly better than all other features, including the next highest performing feature <italic>HF spike count</italic>, we quantified <italic>HF spike amplitude</italic> and compared this to <italic>HF spike count</italic> acquired from each electrode and animal. We previously demonstrated that a feature&#x02019;s learnability is correlated to the number of instances different stimuli evoke significantly different magnitudes of that feature (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). We, therefore, quantified the two features from anatomically relevant electrodes, i.e., features acquired from stimuli applied to left forelimbs were quantified from left electrodes (e1 and e2), right forelimbs from right electrodes (e6 and e7), and hindlimbs from midline electrodes (e3, e4, e5).</p>
<p>Although the effect size was small, <italic>HF spike amplitude</italic> evoked by dowel stimuli (30.2 &#x000B1; 1.2 &#x003BC;V) were significantly higher than brush stimuli (29.7 &#x000B1; 1.0 &#x003BC;V; <italic>p</italic> = 1.3e-4, paired <italic>t</italic>-test), as were <italic>HF spike counts</italic> (dowel, 41.6 &#x000B1; 2.5 events; brush, 40.0 &#x000B1; 1.9 events; <italic>p</italic> = 0.041, paired <italic>t</italic>-test). <italic>HF spike amplitudes</italic> evoked by flexion (32.4 &#x000B1; 1.2 &#x003BC;V) were significantly higher than when evoked by extension (31.1 &#x000B1; 1.2 &#x003BC;V; <italic>p</italic> = 2.1e-12, paired <italic>t</italic>-test), as were <italic>HF spike counts</italic> (flexion, 129.1 &#x000B1; 8.2 events; extension 87.9 &#x000B1; 5.9 events; <italic>p</italic> = 3.3e-14). Moreover, <italic>HF spike amplitude</italic> of proprioception-dominated stimuli (31.7 &#x000B1; 0.5 &#x003BC;V) was significantly higher than when evoked from tactile-dominated stimuli (29.8 &#x000B1; 0.5 &#x003BC;V; <italic>p</italic> = 0.013, Student&#x02019;s <italic>t</italic>-test), and proprioception-evoked <italic>HF spike counts</italic> (108.5 &#x000B1; 5.7 events) were more than 2.5 times larger than when tactile-evoked (40.8 &#x000B1; 2.0 events; <italic>p</italic> = 8.4e-24, Student&#x02019;s <italic>t</italic>-test).</p>
<p>In summary, despite small effect sizes, the difference in the <italic>HF spike amplitude</italic> evoked from dowel vs. brush stimuli resulted in a much smaller probability value compared to <italic>HF spike counts</italic>, which may account for the improved tactile classification outcome from <italic>HF spike amplitude</italic>. Dowel, flexion, and proprioception-dominated stimuli evoke higher <italic>HF spike amplitudes</italic> and <italic>HF spike counts</italic> than a brush, extension, and tactile-dominated stimuli, respectively.</p>
</sec>
<sec id="s3-6">
<title>Signal Feature Robustness Across Animals</title>
<p>How generalizable are signal features of the 1,000 ms benchmark across different animals? To answer this question, we used the LOO approach to measure how features extracted from an individual animal perform when presented to a neural network trained by the same features derived from the remaining cohort of animals. This approach measures how features from one animal generalize to all other animals (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). Compared to the WIA approach derived from neural networks optimized for individual animals using 13 features over 1,000 ms (<xref ref-type="fig" rid="F5">Figure 5A</xref>), feature-learnability determined by the LOO approach (<xref ref-type="fig" rid="F5">Figure 5B</xref>) was significantly reduced, by almost half to that of the WIA approach (<xref ref-type="fig" rid="F5">Figure 5C</xref>; <italic>p</italic> &#x0003C; 2.2e-16, LMER). More than 50% of the reduction in feature-learnability derived by the LOO approach was accounted for by greater confusion errors associated with tactile-dominated stimuli, specifically, that dowel and brush stimuli were generally poorly discriminated, which were exacerbated by left/right errors for the hindlimb (<xref ref-type="fig" rid="F5">Figures 5B,C</xref>). Compared to the WIA approach, proprioception-dominated stimuli from the LOO approach demonstrated an insignificant 11% reduction in classification accuracy at the forelimb (<italic>p</italic> = 0.25, LMER, Tukey), but a 43% reduction associated with the hindlimb (<italic>p</italic> &#x0003C; 0.0001, LMER, Tukey; <xref ref-type="fig" rid="F5">Figure 5C</xref>). These results indicated that the 13 features contain information that is highly generalizable among animals for proprioceptive-dominated stimuli of the forelimb, but much less so for hindlimb proprioception and forelimb and hindlimb tactile-dominated stimuli.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Feature robustness across animals. Confusion matrix means are shown for WIA and LOO machine-learning models. These models use identical neural network architecture extracted from 1,000 ms post-stimulus onset, but differ by their training, validation, and testing data partitioning approaches. <bold>(A)</bold> The confusion matrix shows the mean values derived using the WIA approach for all six individual animals using the 13 mixed features that constitute the 1,000 ms feature-learnability benchmark (<xref ref-type="fig" rid="F3">Figure 3</xref>). The WIA approach partitions training, validation, and testing datasets from within individual animals (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>), thus machine-learning models are optimized for each animal. <bold>(B)</bold> The confusion matrix shows the mean values derived using the LOO approach for all six individual animals on the same input data set as <bold>(A)</bold>. The LOO approach trains machine-learning models from all other (<italic>n</italic> = 5) animals and tests on the remaining animal, and thereby quantifies feature-learnability for each animal against the background of all others. <bold>(C)</bold> A comparison of the feature-learnability (left bars) for the WIA (gold bars) and LOO (gray bars) approaches are shown [derived from the means &#x000B1; SEM of the diagonals in <bold>(A,B)</bold> respectively]. The large significant reduction of feature-learnability indicates that a large portion of information encoded in the signal features was unique to individual animals, but that a significant portion also generalizes across animals. The right bars show classification accuracy for stimulus classes across limbs (derived from means &#x000B1; SEM calculated from the six confusion matrices from all animals) for WIA (gold) and LOO (gray) approaches. LOO output demonstrates the 13 signal features are highly informative for all animals for the forelimb proprioception class, but significantly less informative for all hindlimb and tactile classes. <bold>(D)</bold> Same analysis as <bold>(A)</bold>, but WIA inputs restricted to the two best HF features (<italic>HF spike amplitude</italic> and <italic>HF spike count</italic>; <xref ref-type="fig" rid="F3">Figure 3</xref>). <bold>(E)</bold> Same data set as <bold>(D)</bold> using the LOO approach. <bold>(F)</bold> Identical analysis as per <bold>(C)</bold> but for the two best features <bold>(D&#x02013;E)</bold>. The LOO approach output for these two best features demonstrates a similar pattern shown for the 13 best features shown in <bold>(C)</bold>, indicating that <italic>HF spike amplitude</italic> and <italic>HF spike count</italic> generalize across animals for decoding forelimb proprioception-dominated stimuli. The black arrow on the color bar below confusion matrices indicates a chance level (6.25%). Abbreviations: WIA, within individual animals; LOO, leave-one-out; LF, forelimb; HF, hindlimb. *<italic>p</italic> &#x0003C; 0.05, **<italic>p</italic> &#x0003C; 0.01, ***<italic>p</italic> &#x0003C; 0.001.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0005.tif"/>
</fig>
<p>Combining the two highest-ranked HF features (<xref ref-type="fig" rid="F3">Figure 3</xref>) resulted in WIA feature-learnability (85.6 &#x000B1; 1.2; <xref ref-type="fig" rid="F5">Figure 5D</xref>) not significantly different from the combination of 13 features (87.2 &#x000B1; 1.3; <xref ref-type="fig" rid="F5">Figure 5A</xref>, <italic>p</italic> = 0.13, LMER). To determine how these two features alone generalize across animals, the LOO approach was applied (<xref ref-type="fig" rid="F5">Figures 5E,F</xref>). The LOO approach restricted to the two highest-ranked HF features revealed an almost identical pattern as the 13 features data set, but with the addition of forelimb/hindlimb confusion for tactile-dominated stimuli (<xref ref-type="fig" rid="F5">Figures 5E,F</xref>). Compared to the 13-feature combination, LOO feature-learnability of the 2-feature combination was overall significantly reduced (<italic>p</italic> = 0.002, LMER; <xref ref-type="fig" rid="F5">Figure 5F</xref>), which resulted because of reduced tactile stimulus classification accuracy that was generalized across both hind- and forelimbs (<italic>p</italic> = 0.025, Tukey; <xref ref-type="fig" rid="F5">Figures 5E,F</xref>). Interestingly, there was no significant reduction in proprioception performance in the LOO approach between the 13- and 2-feature sets (<italic>p</italic> = 0.37, LMER, Tukey).</p>
<p>These results indicate that the two HF features extracted over 1,000 ms can provide almost all of the information provided by the larger 13-feature set for forelimb proprioceptive-dominated stimulation, but the other 11 features contribute some additional information, common across all animals, which is important to discriminate hindlimb proprioceptive-stimuli as well as fore-and hindlimb tactile-dominated stimuli.</p>
</sec>
<sec id="s3-7">
<title>Learnability of Features Extracted Over Different Time Windows</title>
<p>Features extracted over a 1,000 ms period have little practical value for neural prosthetic feedback control. A DCN-targeted neural prosthetic device would need to provide stimulus features over shorter time windows to enable rapid updating of limb sensory status. To determine how learnable DCN signal features are over shorter periods, feature-learnability was calculated for each signal feature extracted over time windows ranging from 20&#x02013;500 ms starting from stimulus onset (<xref ref-type="fig" rid="F6">Figures 6A&#x02013;D</xref>). A window of 60 ms was determined as the time of most abrupt change in feature-learnability across all features (see arrows, <xref ref-type="fig" rid="F6">Figures 6A&#x02013;D</xref>) before reaching a plateau, where feature-learnability improved slightly, or not at all until much larger time windows (&#x02265;250 ms). Feature-learnability rank order derived from features extracted from 60 ms windows (<xref ref-type="fig" rid="F6">Figure 6E</xref>) was altered compared to 1,000 ms windows (<xref ref-type="fig" rid="F3">Figure 3A</xref>). Notably, <italic>HF integral</italic> out-ranked <italic>HF spike amplitude</italic> (the best feature from 1,000 ms windows), although these features were not significantly different (<italic>p</italic> = 0.052, LMER, Tukey; <xref ref-type="fig" rid="F6">Figure 6E</xref>), and the second-ranked feature was <italic>LF sum burst amplitudes</italic> (ranked 4<sup>th</sup> from 1,000 ms windows). <italic>HF&#x02019;s mean width</italic> remained the lowest-ranked feature.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>Benchmark signal features for an optimal short-time window. <bold>(A&#x02013;D)</bold> Feature-learnability of features extracted from time windows of varying lengths from 20 ms to 1,000 ms is shown in their HF <bold>(A)</bold>, LF <bold>(B)</bold>, HF PSD <bold>(C)</bold>, and LF PSD <bold>(D)</bold> signal feature categories. Colored lines and shading indicate the feature-learnability (mean &#x000B1; SEM) for each signal feature (colors arbitrarily chosen). Gold lines indicate the 1,000 ms window benchmark feature-learnability &#x000B1; SEM (see <xref ref-type="fig" rid="F4">Figure 4D</xref>) for comparison; black straight lines indicate classification chance level (6.25%). Arrows indicate the 60 ms window as the optimized duration across all features where the return of feature-learnability diminishes for increasing time windows. <bold>(E)</bold> Feature-learnability ranking of individual signal features is shown for the optimized short-time window (i.e., 60 ms). Gold arrows indicate the 13 signal features that comprise the benchmark configuration. <bold>(F)</bold> Benchmark signal features were determined for the optimized short-time window using the identical algorithm applied to determine the 1,000 ms window benchmark feature set shown in <xref ref-type="fig" rid="F3">Figure 3A</xref>; blue curve shows feature-learnability from combining across categories; gold arrow indicates benchmark configuration of 17 features (indicated in E). For comparison, the 1,000 ms window benchmark feature-learnability is shown (gold curve); the black straight lines indicate classification chance level (6.25%). See <xref ref-type="fig" rid="F2">Figure 2</xref> for feature descriptions and abbreviations.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0006.tif"/>
</fig>
<p>Combining the best two features (<italic>HF integral</italic> + <italic>LF sum burst amplitude</italic>) did not significantly improve feature-learnability (41.8 &#x000B1; 2.2) compared to <italic>HF integral</italic> alone (41.0 &#x000B1; 2.5, <italic>p</italic> = 0.09, paired <italic>t</italic>-test). A combination of four signal features that included the highest-ranked feature from each category extracted from 60 ms, significantly improved feature-learnability compared to most within-category combinations, except for the combination of two or more HF features (<italic>p</italic> &#x02265; 0.76) and five or more HF PSD features (<italic>p</italic> &#x02265; 0.35, LMER, Tukey; <xref ref-type="fig" rid="F6">Figure 6F</xref>). Also noteworthy was that feature-learnability from combining <italic>HF integral</italic> and <italic>HF spike amplitude</italic> was significantly greater than all other within-category feature combinations, except for three or more combined HF PSD features, all of which were not significantly different (<italic>p</italic> &#x02265; 0.6, LMER, Tukey). The 60 ms benchmark feature set, determined by the continual addition of the next best features from each category (where possible), resulted in a feature-learnability outcome of 59.4% from 17 features (gold arrows, <xref ref-type="fig" rid="F6">Figures 6E,F</xref>).</p>
</sec>
<sec id="s3-8">
<title>Temporal Profiles of Feature-Learnability During Mechanical Stimuli</title>
<p>To measure how informative signal features, extracted over a short period, are throughout stimulus presentation, we determined a feature-learnability time-series by extracting DCN signal features from 60 ms rolling windows (<xref ref-type="fig" rid="F7">Figure 7</xref>). We started by examining the feature-learnability temporal profile for the 60 ms benchmark 17-features set (indicated by gold arrows, <xref ref-type="fig" rid="F6">Figure 6E</xref>). This produced a complex waveform (gold trace, <xref ref-type="fig" rid="F7">Figure 7A</xref>) with three distinct peaks: the 1st is an abrupt, relatively sharp peak coinciding with the stimulus onset; the 2nd and 3rd peaks were broadened and peaked at the approximate midpoint of the stimuli and beginning of the stimulus-off/return phase, respectively. To establish which stimuli contributed to these peaks, neural networks were restricted to input/output data sets of tactile- or proprioception-dominated stimuli (<xref ref-type="fig" rid="F7">Figure 7A</xref>, red and blue traces, respectively). This revealed that the 1st peak arose from tactile-dominated stimuli, the 2nd peak arose from proprioceptive-dominated stimuli, whereas the 3rd peak arose from both tactile- and proprioceptive-dominated stimuli. Another interesting observation was that during the stimulus-off/return phase, feature-learnability was significantly elevated from chance levels, indicating that the input features during this period were informing the neural network of some information about the stimulation being performed.</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>Evolution of feature-learnability from 60 ms windows during natural mechanical stimuli.<bold> (A)</bold> Feature-learnability time-series determined by extracting features from a 60 ms sliding window advanced every 10 ms are shown for the 60 ms benchmark feature set of 17 features (<xref ref-type="fig" rid="F6">Figure 6E</xref>) for all stimuli (gold trace), as well as modified neural networks restricted to proprioceptive- or tactile-dominated inputs/outputs only (indicated by blue and red traces respectively). Expected feature-learnability by chance is indicated for all (gold) and proprioceptive- and tactile-dominated (black) stimuli. <bold>(B&#x02013;E)</bold> Feature-learnability time-series at 1,000 ms pre-stimulus and from 200 ms pre-stimulus to 4,000 ms post-stimulus are shown in their HF <bold>(B)</bold>, LF <bold>(C)</bold>, HF PSD <bold>(D)</bold>, and LF PSD <bold>(E)</bold> signal feature categories. Colored lines and shading indicate the feature-learnability (mean &#x000B1; SEM) for each signal feature (colors arbitrarily chosen). Gold lines indicate the 60 ms window benchmark feature-learnability &#x000B1; SEM (<xref ref-type="fig" rid="F6">Figure 6F</xref>) for comparison; black straight lines indicate classification chance level (6.25%). See <xref ref-type="fig" rid="F2">Figure 2</xref> for feature descriptions and abbreviations.</p></caption>
<graphic xlink:href="fnsys-14-00046-g0007.tif"/>
</fig>
<p>To determine how individual features contribute to feature-learnability over this time course, we examined feature-learnability time profiles for each of the 60 ms benchmark features (<xref ref-type="fig" rid="F7">Figures 7B&#x02013;D</xref>). For all features, the 3rd peak coincided with the commencement of the off-stimulus period and their amplitudes never exceeded their respective 1st or 2nd peaks. Of the four time-domain HF features, the maximum peak for three of these coincided with the 1st (tactile) peak, whereas the <italic>HF integral</italic> maximum fell on the 2nd (proprioceptive) peak (<xref ref-type="fig" rid="F7">Figure 7B</xref>). Feature-learnability returned to near-chance levels during the stimulus-off/return period for all HF features except <italic>HF spike amplitude</italic>, which remained significantly elevated. Of the five time-domain LF features, the maximum peak for two of these coincided with the 1st peak (<italic>LF max burst amplitude</italic> and <italic>LF mean burst amplitude</italic>), whereas the other three features had similar 1st and 2nd peak magnitudes (<xref ref-type="fig" rid="F7">Figure 7C</xref>). Feature-learnability returned to chance levels during the stimulus-off/return period for all LF features.</p>
<p>Of the eight HF PSD features, the maximum peak coincided with the 1st peak for two features derived from frequencies between 0.2&#x02013;1.0 kHz, whereas maximum feature-learnability coincided with the 2nd peak for features derived from frequencies between 1.5&#x02013;4.0 kHz (<xref ref-type="fig" rid="F7">Figure 7D</xref>). All HF PSD features remained elevated above chance levels during the stimulus-off period, with frequencies closer to the 2 kHz range demonstrating greater feature-learnability during the stimulus-off/return period. For all five LF PSD features, the maximum peak coincided with the 1st peak, and all remained slightly elevated above chance levels during the stimulus-off/return period (<xref ref-type="fig" rid="F7">Figure 7E</xref>).</p>
<p>To gain insight into why feature-learnability remained above chance levels during the stimulus-off/return period, we inspected confusion matrices from all animals for features associated with above-chance performance at 1-s pre-stimulus. <xref ref-type="fig" rid="F8">Figure 8</xref> shows examples of two features (<italic>HF spike amplitude</italic> and <italic>HF PSD 2.0&#x02013;2.5 kHz</italic>), which demonstrates that increased feature-learnability 1 s before stimulus arose for different reasons across different animals, but similar reasons within animals. One common theme was that the correct limb was identified for the two stimulus categories. In all but one animal, one or more outputs were correctly classified with &#x0003E;35% accuracy. To investigate if there were learning differences at the beginning vs the end of trials, we then divided data sets into thirds for: (i) each of the 10 trials; and (ii) for the 100 sequential stimulus presentations, to see if repeated stimuli within and across the trials contributed to improved outcomes. We found no difference in feature-learnability between the first-third and last-third of stimulus presentation within-trial sets, or across all 100 trials, indicating that there were no changes to feature-learnability as a result of repeating trials.</p>
<fig id="F8" position="float">
<label>Figure 8</label>
<caption><p>Individual animal machine learning outcomes for 60 ms window at 1 s pre-stimulus. Each confusion matrix shows the machine learning outcomes for individual animals (rows) for two features (columns) which demonstrated feature-learnability significantly above chance levels at 1 s pre-stimulus. Note the similarity within animals, but lack thereof across animals. The black arrow on the color bar below confusion matrices indicates a chance level (6.25%).</p></caption>
<graphic xlink:href="fnsys-14-00046-g0008.tif"/>
</fig>
<p>In summary, for 60 ms rolling windows some features performed better over periods rich in tactile-stimulus information and others over the proprioception-rich periods. PSD features derived from &#x0003C;1kHz, contributed more during tactile-rich periods, whereas that &#x0003E;1.5kHz contributed more toward proprioception-rich periods, while feature-learnability during the stimulus-off/return period was greatest for PSD features around 2 kHz and reduced for lower and higher frequencies. The reasons for above-chance performance during the stimulus-off/return period appears non-generalizable because it was different for each animal.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>Our study used feature-learnability to reveal several neural signal features that facilitate excellent decoding accuracy for mechanically-evoked tactile- and proprioception-dominated stimuli over a range of frequencies (4&#x02013;4,000 Hz). We demonstrated that individual features extracted over 1,000 ms of data from the HF category generally outperformed those from other categories and that only two HF features from somatosensory DCN-signals were required to achieve the 1,000 ms feature-learnability benchmark. With a shorter time-window of 60 ms&#x02014;one that is compatible with real-time applications&#x02014;decoding accuracy and robustness of signal features were greatly improved by adding relevant and diverse features, and reasonable classification accuracy was achieved despite sampling from electrodes with poor spatial resolution. We found proprioception-dominated stimuli were more accurately classified than tactile-dominated stimuli, and stimuli presented to the forelimbs were predicted better than hindlimbs. Our study established time courses that track how information content, for each feature, varies as a function of the mechanical stimulation phases. We discuss these findings below concerning the underlying DCN physiology after the following methodological considerations.</p>
<p>The sMEA used to capture surface potentials had relatively poor spatial resolution and a low number of electrodes. Others have shown that recording with higher electrode densities will permit greater classification accuracy (Mehring et al., <xref ref-type="bibr" rid="B42">2003</xref>; Bansal et al., <xref ref-type="bibr" rid="B2">2011</xref>; Wong et al., <xref ref-type="bibr" rid="B61">2016</xref>). Despite the low resolution, however, we found several features that reproducibly represent encoded somatosensory signals in the DCN leading to high classification accuracy. This suggests that many of the investigated features accurately predict DCN population activity, without the need for precise spatial resolution, and are therefore common or salient DCN activity features that may be used to inform the creation of biomimetic stimulus patterns (Saal and Bensmaia, <xref ref-type="bibr" rid="B52">2015</xref>; George et al., <xref ref-type="bibr" rid="B22">2019</xref>; Loutit and Potas, <xref ref-type="bibr" rid="B37">2020a</xref>). For example, some LF features showed high feature-learnability at stimulus onset, but low feature-learnability during later phases of the stimulus. If LF features represent large populations of neural activity (see &#x0201C;LF Features&#x0201D; section) then stimuli could be constructed to generate bursts of activity in large populations of neurons to signify the onset of a stimulus, but other features (likely HF features) may inform how to activate specific neurons during the later phases of the stimuli when many neurons have adapted to a stimulus. We, therefore, suggest that future DCN stimulation approaches would benefit from strategically placed, high-density electrode arrays that can activate specific neural populations within the DCN.</p>
<p>We described our stimuli as either tactile- or proprioception-dominated. While these stimuli target most of the intended afferents under investigation, we must acknowledge the diversity of afferents being recruited by our natural stimuli. For example, the 20 g force applied by the tactile-dominated stimuli to the palmar/plantar surfaces are likely to have also moved wrist/ankle and finger/toe joints, while the proprioception-dominated stimuli are likely to have activated hair and skin afferents around joints, on resting surfaces of the limb, and the skin where the actuator was attached that moved the limbs. These stimuli, therefore, do not activate tactile and proprioception afferents in isolation; however, the time courses of neural responses were characteristic of tactile and proprioceptive afferent firing, indicating that most intended afferents were appropriately activated. It is also worth noting that any natural stimulus will activate a mix of afferent populations and therefore activation of a pure afferent type would be a rare occurrence in nature.</p>
<sec id="s4-1">
<title>Prediction of Somatosensory Stimuli From Dorsal Column Nuclei Signals</title>
<p>Across all individual features and our benchmark feature set, proprioception-dominated stimuli were generally predicted better than tactile-dominated stimuli, and forelimbs were predicted better than hindlimbs. More accurate proprioception classification compared to tactile is likely to have resulted because there was a clear significant separation in the neural activity evoked by flexion and extension (indicated by the <italic>HF spike count</italic> feature alone), and both these proprioceptive stimuli evoked activity that was significantly different to both tactile stimuli, whereas, the significant difference and effect size was much less between the two tactile stimuli. Greater proprioception evoked activity may have resulted from activating more receptors and/or evoking more action potentials from each activated receptor, as described above. Furthermore, tactile stimuli evoked most activity at stimulus onset, then appeared to quickly adapt (<xref ref-type="fig" rid="F1">Figures 1B</xref>, <xref ref-type="fig" rid="F7">7A</xref>), whereas moving the limb evoked high activity levels throughout the entire duration of both proprioceptive stimuli, thus the potentially higher number of proprioceptors were also active for a longer duration.</p>
<p>Forelimbs may have been predicted better than hindlimbs because most hindlimb activities were acquired by the same midline electrodes which spanned across the two gracile nuclei on both sides, whereas each cuneate nucleus on either side had its electrode, thereby facilitating better spatial discrimination. Some of the hindlimb errors resulted from confusing tactile- and proprioceptive-dominated stimuli of the same limb (<xref ref-type="fig" rid="F4">Figures 4A&#x02013;D</xref>, <xref ref-type="fig" rid="F5">5B,E</xref>). Most hindlimb proprioceptive afferents either project onto DCN neurons in the ventral gracile nuclei or to nuclei X and Z, which are rostral nuclei that form part of the DCN-complex (for a comprehensive review see Loutit et al., <xref ref-type="bibr" rid="B40">2020</xref>). Although both hindlimbs tactile and proprioceptive afferents project to the DCN, the proprioceptive DCN regions may be too deep to acquire HF features, while nuclei X and Z were not covered by the placement of our electrode array. Thus, prediction of hindlimb stimuli may have relied mostly on tactile information to discriminate between the tactile and proprioceptive-dominated stimuli and were confined to midline electrodes, thereby reducing overall lower hindlimb prediction accuracy. Meanwhile, the external cuneate nuclei, part of the DCN-complex that exclusively receives forelimb proprioceptive afferents (Loutit et al., <xref ref-type="bibr" rid="B40">2020</xref>), were located partially under the lateral electrodes. Thus, tactile evoked forelimb activity was mainly acquired from both lateral and midline electrodes, whereas proprioceptive evoked forelimb activity was acquired mainly from lateral electrodes. The segregation of proprioceptive information across separate electrodes for forelimbs, but not hindlimb-evoked activity, is likely to explain the reduced feature-learnability derived from hindlimb stimuli.</p>
</sec>
<sec id="s4-2">
<title>Feature-Learnability Within and Across Animals</title>
<p>To determine if benchmark features are generally useful for robust decoding of mechanical stimuli in different animals and not unique to individual animals, we quantified feature-learnability using the LOO approach. This approach trains the machine-learning algorithm on features extracted from all other animals and tests on the remaining animal. We previously established that comparing feature-learnability under LOO and WIA conditions provide insight into how well, or poorly, DCN-signal extracted features generalize across animals (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>).</p>
<p>Forelimb flexion and extension were minimally perturbed under LOO conditions, indicating that 1,000 ms benchmark features were highly relevant across all animals for forelimb proprioception stimuli. However, LOO conditions reduced feature-learnability by 37%, which was mostly due to a more than 50% reduction in the ability to predict tactile stimuli and a 40% reduction in the ability to predict hindlimb proprioception-dominated stimuli. This indicates that a significant portion of the information contained within benchmark features are no longer relevant, or as generalizable, for tactile- and hindlimb-presented stimuli across the different animals.</p>
<p>Hindlimb stimuli classification errors (both tactile- and proprioception-dominated) mainly resulted from confusing the side of the body that a stimulus was presented. Signal asymmetry across the DCN surface, as we have previously shown for hindlimb stimulated nerves (Loutit et al., <xref ref-type="bibr" rid="B38">2017</xref>, <xref ref-type="bibr" rid="B39">2019</xref>), could lead to larger signal variations in left and right limb-derived activity, across the different animals we observed in the present study.</p>
</sec>
<sec id="s4-3">
<title>High-Frequency Features</title>
<p><italic>HF spike amplitude</italic> was the best performing feature for the 1,000 ms windows, and fourth in the 60 ms window, yet, to our knowledge, this signal feature has not been previously used for neural decoding. The <italic>HF spike amplitude</italic> feature resulted in fewer errors when classifying brush and dowel stimuli of the same limb, compared to all other features (<xref ref-type="fig" rid="F4">Figure 4</xref>), which implies that the machine-learning algorithm detected greater contrast in this feature&#x02019;s magnitude under the two tactile stimulus conditions compared to other features. We observed that at stimulus onset, dowel stimuli produced more precisely timed bursts of activity than brush stimuli. This may have facilitated the improved dowel/brush classification from the <italic>HF spike amplitude</italic> feature because spikes from multiple neurons or afferent fibers arriving at an electrode simultaneously (i.e., responses evoked by dowel stimuli) will summate, and therefore show higher average peak amplitudes than single spikes that have less temporal overlap (i.e., brush stimulus-evoked responses). This explanation is supported by the observed significantly greater <italic>HF spike amplitude</italic> evoked by a dowel, compared to brush stimuli.</p>
<p>The combination of <italic>HF spike amplitude</italic> and <italic>HF spike count</italic> features, extracted over 1,000 ms, was sufficient to achieve feature-learnability performance equivalent to the 87% feature-learnability benchmark. Furthermore, this 2-feature input configuration resulted in no confusion errors under WIA, and very few under LOO conditions, between the tactile and proprioception stimulus categories (i.e., no and few confusion errors in the lower left and upper right quadrants of <xref ref-type="fig" rid="F5">Figures 5D,E</xref> respectively). This result can be explained by the significant difference for <italic>HF spike amplitude</italic> and the &#x0003E;2.5-fold difference in <italic>HF spike count</italic> when tactile-, compared to proprioception-dominated stimuli were used.</p>
<p>For a fixed time-window, <italic>HF spike count</italic> provides information about spike frequency and the total number of action potentials generated by peripheral afferents. The large difference in this feature between tactile- and proprioception-dominated stimuli may have resulted from the relatively small vs. larger receptive field sizes respectively that these stimuli engaged. <italic>HF spike amplitude</italic> captures spiking temporal alignment (as discussed above) and spike magnitudes. Spike magnitudes are influenced by neuron and or axon size, as well as the event&#x02019;s distance from the electrode (Gasser and Grundfest, <xref ref-type="bibr" rid="B21">1939</xref>; Hunt, <xref ref-type="bibr" rid="B26">1951</xref>; Nelson, <xref ref-type="bibr" rid="B44">1966</xref>; Buchwald and Grover, <xref ref-type="bibr" rid="B4">1970</xref>; Grover and Buchwald, <xref ref-type="bibr" rid="B24">1970</xref>). Group I proprioceptive afferents generally have larger diameters than A&#x003B2; tactile afferents (Gasser, <xref ref-type="bibr" rid="B20">1941</xref>). In addition to the laterally placed external cuneate nucleus, proprioceptive afferents preferentially terminate deep on ventral DCN neurons (Campbell et al., <xref ref-type="bibr" rid="B7">1974</xref>), which have a high proportion of large somas (Cheema et al., <xref ref-type="bibr" rid="B10">1983</xref>) that are located 500&#x02013;700 &#x003BC;m below the brainstem surface in rats (Li et al., <xref ref-type="bibr" rid="B35">2012</xref>). Tactile afferents terminate on smaller neurons in a cluster zone that is located at approximately half the depth as the ventral DCN neurons (Li et al., <xref ref-type="bibr" rid="B35">2012</xref>). How these two neuronal populations (larger somas located deeper vs smaller somas located more superficially) affect spike magnitudes measured from the surface is difficult to assess without dedicated experiments, however, these anatomically segregated neuronal populations likely evoke different shaped spike waveforms. The combination of stimulus-evoked spike-timing, the signal location, and neuronal types responsible for generating the signal may, therefore, result in unique amplitude profiles for each of the stimuli, and thereby contribute to improved stimulus classification.</p>
</sec>
<sec id="s4-4">
<title>Low-Frequency Features</title>
<p>LF features are measures of the rectified signal envelope and therefore capture various aspects of spike bursts. For example, <italic>LF sum burst amplitude</italic>, <italic>LF</italic> <italic>max burst amplitude</italic>, and <italic>LF</italic> <italic>burst count</italic> provide information about burst frequency and magnitudes combined, the largest burst, and the frequency of bursts respectively. The LF feature category demonstrated varied feature-learnability, with its best performer, <italic>LF sum burst amplitudes</italic>, ranking in the top four features in the 1,000 ms and 60 ms windows. This feature likely represents very similar activity to <italic>HF integral</italic>, as both are extracted from rectified HF signals, and summing envelope peaks captures related information to the integral of the signal. Congruently, <italic>LF sum burst amplitudes</italic> and <italic>HF integral</italic> showed very similar feature-learnability characteristics (compare <xref ref-type="fig" rid="F2">Figures 2A</xref>, <xref ref-type="fig" rid="F6">6E</xref>, <xref ref-type="fig" rid="F7">7B,C</xref>) and confusion errors (<xref ref-type="fig" rid="F4">Figures 4A,B</xref>), and combining these two features did not significantly improve feature-learnability from <italic>HF integral</italic> alone. These features may capture a combination of HF events, slower synaptic activity, or subthreshold events, representing a measure of the signal energy in a neural population.</p>
</sec>
<sec id="s4-5">
<title>Power Spectral Density Features</title>
<p>The HF PSD feature set was similar to that used by Bouton et al. (<xref ref-type="bibr" rid="B3">2016</xref>) who extracted features over 100 ms windows for motor signal decoding in a brain-machine interface capable of effecting limb movement through neuromuscular stimulation. This feature set represents frequency power in the multiunit activity range, which is typically considered to be about 300&#x02013;6,000 Hz (Stark and Abeles, <xref ref-type="bibr" rid="B55">2007</xref>; our range: 200&#x02013;4,000 Hz). We found these features generally to be good predictors of somatosensory DCN signals. In our 60 ms window data, the frequency bands of 1.5&#x02013;2.5 kHz were of interest because: (1) the highest decoding for both tactile- and proprioception-dominated stimuli were found for this feature category over this range; and (2) frequency bands above 1.5 kHz showed a peak in the proprioception-dominated phase, while bands below 1.5 kHz, including the LF PSD features, had peaked in the tactile-dominated phase. Each of the eight HF PSD bands appeared to add some unique information not captured by the other bands, as successive additions of these features continued to improve feature-learnability until all the HF PSD features were exhausted (see the yellow line, <xref ref-type="fig" rid="F6">Figure 6F</xref>). However, feature-learnability derived from all eight HF bands was not significantly greater than combining <italic>HF integral</italic> and <italic>HF spike amplitude</italic>, indicating that these features could offer superior neural decoding compared to all HF PSD features.</p>
</sec>
<sec id="s4-6">
<title>Feature-Learnability Temporal Profiles</title>
<p><xref ref-type="fig" rid="F7">Figure 7</xref> provides insight into how neural activity captured by individual features is altered within 60 ms time windows across the dynamic stimuli. The best performing features over a specific period of the stimuli indicates that there are statistically different neural spiking behaviors (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>) across the different stimuli for the 60 ms window over which the feature was quantified. Tactile-dominated stimuli evoked small bursts of activity at stimulus onset, while proprioception-dominated stimuli evoked little activity at stimulus onset, but larger amounts during the middle of the stimulus and return periods on anatomically relevant electrodes (<xref ref-type="fig" rid="F1">Figure 1B</xref>). These phases of activity were captured by the peaks of the feature-learnability temporal profile (gold curve, <xref ref-type="fig" rid="F7">Figure 7A</xref>). The 1st peak of this temporal profile reflects the period where considerable tactile information is presented to the ANN because this peak is abolished when tactile data were omitted from the learning algorithm (blue curve, <xref ref-type="fig" rid="F7">Figure 7A</xref>), but remains when tactile data is present and proprioceptive data were omitted (red curve, <xref ref-type="fig" rid="F7">Figure 7A</xref>). The same logic dictates that the 2nd peak is attributed to the duration when maximum proprioceptive information is present. Interestingly, the tactile-dominated feature-learnability temporal profile coincides with the stereotyped characteristics of fast and slowly adapting afferent activity, whereas the proprioception feature-learnability temporal profile is consistent with the dynamic movement of the proprioceptive stimuli, with its peak coinciding when the limbs were maximally flexed or extended (i.e., at the midpoint of the <italic>Move</italic> phase, <xref ref-type="fig" rid="F7">Figure 7</xref>).</p>
<p>The feature-learnability temporal profiles of individual features (<xref ref-type="fig" rid="F7">Figures 7B&#x02013;E</xref>) provide insight into how significantly different a feature is for the different stimuli (and locations) throughout the progression of the mechanical stimuli (Loutit et al., <xref ref-type="bibr" rid="B39">2019</xref>). HF features capture information about single or multiunit spiking activity, for example, <italic>HF integral</italic>, <italic>HF spike count</italic> and <italic>HF spike amplitude</italic> provide information about signal energy, spiking frequency and amplitude respectively; the latter may relate to the anatomical location relative to the recording site. As LF features capture measures of spike bursts, greater feature-learnability of LF features over the time course of the stimuli indicates the phases of the stimulus where the bursting activity feature is significantly different across the stimuli. For example, LF PSD signal features below 200 Hz do not differ greatly across the proprioceptive-evoked regions of the stimuli, whereas their differences are greater and therefore contribute more toward decoding tactile events. The data suggests that most of the features were able to extract some level of information from single-/multi-unit spikes as well as burst behavior of neural activity during the initial contact of the tactile stimuli, which might reflect the afferent volley of sensory information arriving at the DCN.</p>
</sec>
<sec id="s4-7">
<title>Rest Period Activity</title>
<p>Feature-learnability remained above chance levels 1 s before stimuli were presented (<xref ref-type="fig" rid="F7">Figure 7</xref>) for the <italic>HF spike amplitude</italic> and all HF PSD features. This indicates that during the rest periods, some information specific to the limb and/or the stimulus being presented was encoded in these DCN signal features. That the more successful predictions were not consistent across all animals (<xref ref-type="fig" rid="F8">Figure 8</xref>), suggests that the prediction is not based on some residual activity from particular stimuli, but rather, multiple features in the same animal contributed information that was unique to that animal for a combination of stimulus and location. Furthermore, it was unlikely that above-chance level classification arose from some learned effect during repetitive stimulus presentations because feature-learnability was not different when comparing the first and last third of trials, although, it should be noted that training/testing data sets were also reduced to one third, making accurate classification more challenging.</p>
<p>What then could account for this predictive capacity before the stimuli? One possibility is that the limb undergoing repetitive stimulation experienced a different afferent activation status during the stimulus-off period compared to the remaining limbs. This could have arisen from continued reactivation of slowly adapting afferent activity during the off-stimulus period because of the continued interruption of the repetitive stimulation cycles, whereas the slowly adapting activity from the non-stimulated limbs would have greater opportunity to cease firing. An alternative explanation could be from activity resulting from long-lasting membrane potential depolarizations seen in DCN cells in response to sensory stimulation (Canedo et al., <xref ref-type="bibr" rid="B8">1998</xref>), or rhythmic activity that outlasts stimulation periods (Nu&#x000F1;ez and Bu&#x000F1;o, <xref ref-type="bibr" rid="B45">1999</xref>). We have not found evidence from other studies finding similarly high decoding accuracy in stimulus off periods. Nevertheless, this phenomenon demonstrates remarkable sensitivity of the HF PSD and <italic>HF spike amplitude</italic> features for capturing status differences in afferent populations.</p>
</sec>
</sec>
<sec sec-type="conclusion" id="s5">
<title>Conclusion</title>
<p>Feature-learnability enables us to assess the information contained in DCN surface potentials for decoding natural tactile- and proprioceptive-dominated somatosensory events. We identified individual, and combinations of signal features with superior decoding capacity, some of which, to our knowledge, are not currently routinely used for neural decoding. Generally, HF time-domain features are most informative for decoding somatosensory-evoked neural signals compared to frequency-domain features. These features may likely translate to the decoding applications for other neural signals (e.g., motor). For sufficiently large time windows, only two HF time-domain features are adequate to achieve benchmark decoding accuracy, but for shorter time windows that are more practical for real-time applications, increasing the number and diversity of features improves the decoding robustness and accuracy. We showed that a feature&#x02019;s decoding capacity is altered throughout a dynamic event. Knowledge of how the feature-learnability of different features varies throughout stimulus durations may inform future biomimetic stimulation patterns for a neural prosthesis capable of activating DCN neural populations to restore somatosensory feedback.</p>
</sec>
<sec id="s6">
<title>Data Availability Statement</title>
<p>The raw data and extracted features are available here: <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.12751/g-node.jjaaz4">https://doi.org/10.12751/g-node.jjaaz4</ext-link>.</p>
</sec>
<sec id="s7">
<title>Ethics Statement</title>
<p>The animal study was reviewed and approved by Australian National University Animal Experimentation Ethics Committee (A2014/52).</p>
</sec>
<sec id="s8">
<title>Author Contributions</title>
<p>JP: conception and design of the study. AL: performed the experiments, data collection and analysis and wrote the first draft of the manuscript. JP and AL: conception of analytical approach and contributed to manuscript revision, read and approved the submitted version.</p>
</sec>
<sec id="s9">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ack>
<p>This manuscript has been released as a pre-print at bioRxiv (<ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1101/831164">https://doi.org/10.1101/831164</ext-link>; Loutit and Potas, <xref ref-type="bibr" rid="B36">2019</xref>).</p>
</ack>
<fn-group>
<fn fn-type="financial-disclosure">
<p><bold>Funding.</bold> AL was supported by the Australian Government Research Training Program. We are extremely gratefully to the Bootes Medical Research Foundation for funding this project.</p>
</fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ajiboye</surname> <given-names>A. B.</given-names></name> <name><surname>Willett</surname> <given-names>F. R.</given-names></name> <name><surname>Young</surname> <given-names>D. R.</given-names></name> <name><surname>Memberg</surname> <given-names>W. D.</given-names></name> <name><surname>Murphy</surname> <given-names>B. A.</given-names></name> <name><surname>Miller</surname> <given-names>J. P.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration</article-title>. <source>Lancet</source> <volume>389</volume>, <fpage>1821</fpage>&#x02013;<lpage>1830</lpage>. <pub-id pub-id-type="doi">10.1016/s0140-6736(17)30601-3</pub-id><pub-id pub-id-type="pmid">28363483</pub-id></citation></ref>
<ref id="B2"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bansal</surname> <given-names>A. K.</given-names></name> <name><surname>Vargas-Irwin</surname> <given-names>C. E.</given-names></name> <name><surname>Truccolo</surname> <given-names>W.</given-names></name> <name><surname>Donoghue</surname> <given-names>J. P.</given-names></name></person-group> (<year>2011</year>). <article-title>Relationships among low-frequency local field potentials, spiking activity and three-dimensional reach and grasp kinematics in primary motor and ventral premotor cortices</article-title>. <source>J. Neurophysiol.</source> <volume>105</volume>, <fpage>1603</fpage>&#x02013;<lpage>1619</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00532.2010</pub-id><pub-id pub-id-type="pmid">21273313</pub-id></citation></ref>
<ref id="B3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bouton</surname> <given-names>C. E.</given-names></name> <name><surname>Shaikhouni</surname> <given-names>A.</given-names></name> <name><surname>Annetta</surname> <given-names>N. V.</given-names></name> <name><surname>Bockbrader</surname> <given-names>M. A.</given-names></name> <name><surname>Friedenberg</surname> <given-names>D. A.</given-names></name> <name><surname>Nielson</surname> <given-names>D. M.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Restoring cortical control of functional movement in a human with quadriplegia</article-title>. <source>Nature</source> <volume>533</volume>, <fpage>247</fpage>&#x02013;<lpage>250</lpage>. <pub-id pub-id-type="doi">10.1038/nature17435</pub-id><pub-id pub-id-type="pmid">27074513</pub-id></citation></ref>
<ref id="B4"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buchwald</surname> <given-names>J. S.</given-names></name> <name><surname>Grover</surname> <given-names>F. S.</given-names></name></person-group> (<year>1970</year>). <article-title>Amplitudes of background fast activity characteristic of specific brain sites</article-title>. <source>J. Neurophysiol.</source> <volume>33</volume>, <fpage>148</fpage>&#x02013;<lpage>159</lpage>. <pub-id pub-id-type="doi">10.1152/jn.1970.33.1.148</pub-id><pub-id pub-id-type="pmid">5411510</pub-id></citation></ref>
<ref id="B5"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bundy</surname> <given-names>D. T.</given-names></name> <name><surname>Pahwa</surname> <given-names>M.</given-names></name> <name><surname>Szrama</surname> <given-names>N.</given-names></name> <name><surname>Leuthardt</surname> <given-names>E. C.</given-names></name></person-group> (<year>2016</year>). <article-title>Decoding three-dimensional reaching movements using electrocorticographic signals in humans</article-title>. <source>J. Neural Eng.</source> <volume>13</volume>:<fpage>026021</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/13/2/026021</pub-id><pub-id pub-id-type="pmid">26902372</pub-id></citation></ref>
<ref id="B6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Buzs&#x000E1;ki</surname> <given-names>G.</given-names></name> <name><surname>Anastassiou</surname> <given-names>C. A.</given-names></name> <name><surname>Koch</surname> <given-names>C.</given-names></name></person-group> (<year>2012</year>). <article-title>The origin of extracellular fields and currents&#x02014;EEG, ECoG, LFP and spikes</article-title>. <source>Nat. Rev. Neurosci.</source> <volume>13</volume>, <fpage>407</fpage>&#x02013;<lpage>420</lpage>. <pub-id pub-id-type="doi">10.1038/nrn3241</pub-id><pub-id pub-id-type="pmid">22595786</pub-id></citation></ref>
<ref id="B7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Campbell</surname> <given-names>S. K.</given-names></name> <name><surname>Parker</surname> <given-names>T. D.</given-names></name> <name><surname>Welker</surname> <given-names>W.</given-names></name></person-group> (<year>1974</year>). <article-title>Somatotopic organization of the external cuneate nucleus in albino rats</article-title>. <source>Brain Res.</source> <volume>77</volume>, <fpage>1</fpage>&#x02013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1016/0006-8993(74)90801-4</pub-id><pub-id pub-id-type="pmid">4277655</pub-id></citation></ref>
<ref id="B8"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Canedo</surname> <given-names>A.</given-names></name> <name><surname>Martinez</surname> <given-names>L.</given-names></name> <name><surname>Mari&#x000F1;o</surname> <given-names>J.</given-names></name></person-group> (<year>1998</year>). <article-title>Tonic and bursting activity in the cuneate nucleus of the chloralose-anesthetized cat</article-title>. <source>Neuroscience</source> <volume>84</volume>, <fpage>603</fpage>&#x02013;<lpage>617</lpage>. <pub-id pub-id-type="doi">10.1016/s0306-4522(97)00554-x</pub-id><pub-id pub-id-type="pmid">9580341</pub-id></citation></ref>
<ref id="B9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Capogrosso</surname> <given-names>M.</given-names></name> <name><surname>Milekovic</surname> <given-names>T.</given-names></name> <name><surname>Borton</surname> <given-names>D.</given-names></name> <name><surname>Wagner</surname> <given-names>F.</given-names></name> <name><surname>Moraud</surname> <given-names>E. M.</given-names></name> <name><surname>Mignardot</surname> <given-names>J.-B.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>A brain-spine interface alleviating gait deficits after spinal cord injury in primates</article-title>. <source>Nature</source> <volume>539</volume>, <fpage>284</fpage>&#x02013;<lpage>288</lpage>. <pub-id pub-id-type="doi">10.1038/nature20118</pub-id><pub-id pub-id-type="pmid">27830790</pub-id></citation></ref>
<ref id="B10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cheema</surname> <given-names>S.</given-names></name> <name><surname>Whitsel</surname> <given-names>B. L.</given-names></name> <name><surname>Rustioni</surname> <given-names>A.</given-names></name></person-group> (<year>1983</year>). <article-title>The corticocuneate pathway in the cat: relations among terminal distribution patterns, cytoarchitecture, and single neuron functional properties</article-title>. <source>Somatosens. Res.</source> <volume>1</volume>, <fpage>169</fpage>&#x02013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.3109/07367228309144547</pub-id><pub-id pub-id-type="pmid">6679919</pub-id></citation></ref>
<ref id="B11"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chelvanayagam</surname> <given-names>D.</given-names></name> <name><surname>Vickery</surname> <given-names>R.</given-names></name> <name><surname>Kirkcaldie</surname> <given-names>M.</given-names></name> <name><surname>Coroneo</surname> <given-names>M.</given-names></name> <name><surname>Morley</surname> <given-names>J.</given-names></name></person-group> (<year>2008</year>). <article-title>Multichannel surface recordings on the visual cortex: implications for a neuroprosthesis</article-title>. <source>J. Neural Eng.</source> <volume>5</volume>, <fpage>125</fpage>&#x02013;<lpage>132</lpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/5/2/003</pub-id><pub-id pub-id-type="pmid">18382049</pub-id></citation></ref>
<ref id="B12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>C.</given-names></name> <name><surname>Shin</surname> <given-names>D.</given-names></name> <name><surname>Watanabe</surname> <given-names>H.</given-names></name> <name><surname>Nakanishi</surname> <given-names>Y.</given-names></name> <name><surname>Kambara</surname> <given-names>H.</given-names></name> <name><surname>Yoshimura</surname> <given-names>N.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Prediction of hand trajectory from electrocorticography signals in primary motor cortex</article-title>. <source>PLoS One</source> <volume>8</volume>:<fpage>e83534</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0083534</pub-id><pub-id pub-id-type="pmid">24386223</pub-id></citation></ref>
<ref id="B13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Collinger</surname> <given-names>J. L.</given-names></name> <name><surname>Wodlinger</surname> <given-names>B.</given-names></name> <name><surname>Downey</surname> <given-names>J. E.</given-names></name> <name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Tyler-Kabara</surname> <given-names>E. C.</given-names></name> <name><surname>Weber</surname> <given-names>D. J.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>High-performance neuroprosthetic control by an individual with tetraplegia</article-title>. <source>Lancet</source> <volume>381</volume>, <fpage>557</fpage>&#x02013;<lpage>564</lpage>. <pub-id pub-id-type="doi">10.1016/S0140-6736(12)61816-9</pub-id><pub-id pub-id-type="pmid">23253623</pub-id></citation></ref>
<ref id="B14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ethier</surname> <given-names>C.</given-names></name> <name><surname>Oby</surname> <given-names>E. R.</given-names></name> <name><surname>Bauman</surname> <given-names>M.</given-names></name> <name><surname>Miller</surname> <given-names>L. E.</given-names></name></person-group> (<year>2012</year>). <article-title>Restoration of grasp following paralysis through brain-controlled stimulation of muscles</article-title>. <source>Nature</source> <volume>485</volume>, <fpage>368</fpage>&#x02013;<lpage>371</lpage>. <pub-id pub-id-type="doi">10.1038/nature10987</pub-id><pub-id pub-id-type="pmid">22522928</pub-id></citation></ref>
<ref id="B15"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flesher</surname> <given-names>S. N.</given-names></name> <name><surname>Collinger</surname> <given-names>J. L.</given-names></name> <name><surname>Foldes</surname> <given-names>S. T.</given-names></name> <name><surname>Weiss</surname> <given-names>J. M.</given-names></name> <name><surname>Downey</surname> <given-names>J. E.</given-names></name> <name><surname>Tyler-Kabara</surname> <given-names>E. C.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Intracortical microstimulation of human somatosensory cortex</article-title>. <source>Sci. Transl. Med.</source> <volume>8</volume>:<fpage>361ra141</fpage>. <pub-id pub-id-type="doi">10.1126/scitranslmed.aaf8083</pub-id><pub-id pub-id-type="pmid">27738096</pub-id></citation></ref>
<ref id="B16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flesher</surname> <given-names>S. N.</given-names></name> <name><surname>Downey</surname> <given-names>J. E.</given-names></name> <name><surname>Weiss</surname> <given-names>J. M.</given-names></name> <name><surname>Hughes</surname> <given-names>C. L.</given-names></name> <name><surname>Herrera</surname> <given-names>A. J.</given-names></name> <name><surname>Tyler-Kabara</surname> <given-names>E. C.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Restored tactile sensation improves neuroprosthetic arm control</article-title>. <source>bioRxiv</source> [Preprint]. <pub-id pub-id-type="doi">10.1101/653428</pub-id></citation></ref>
<ref id="B17"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flint</surname> <given-names>R. D.</given-names></name> <name><surname>Lindberg</surname> <given-names>E. W.</given-names></name> <name><surname>Jordan</surname> <given-names>L. R.</given-names></name> <name><surname>Miller</surname> <given-names>L. E.</given-names></name> <name><surname>Slutzky</surname> <given-names>M. W.</given-names></name></person-group> (<year>2012</year>). <article-title>Accurate decoding of reaching movements from field potentials in the absence of spikes</article-title>. <source>J. Neural Eng.</source> <volume>9</volume>:<fpage>046006</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/9/4/046006</pub-id><pub-id pub-id-type="pmid">22733013</pub-id></citation></ref>
<ref id="B18"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Flint</surname> <given-names>R. D.</given-names></name> <name><surname>Wright</surname> <given-names>Z. A.</given-names></name> <name><surname>Scheid</surname> <given-names>M. R.</given-names></name> <name><surname>Slutzky</surname> <given-names>M. W.</given-names></name></person-group> (<year>2013</year>). <article-title>Long term, stable brain machine interface performance using local field potentials and multiunit spikes</article-title>. <source>J. Neural Eng.</source> <volume>10</volume>:<fpage>056005</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/10/5/056005</pub-id><pub-id pub-id-type="pmid">23918061</pub-id></citation></ref>
<ref id="B19"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Fox</surname> <given-names>J.</given-names></name> <name><surname>Weisberg</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <source>An R Companion to Applied Regression.</source> 3rd Edition. <publisher-loc>Thousand Oaks, CA</publisher-loc>: <publisher-name>Sage</publisher-name>.</citation></ref>
<ref id="B20"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gasser</surname> <given-names>H. S.</given-names></name></person-group> (<year>1941</year>). <article-title>The classification of nerve fibers</article-title>. <source>Ohio J. Sci.</source> <volume>41</volume>, <fpage>145</fpage>&#x02013;<lpage>159</lpage>.</citation></ref>
<ref id="B21"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gasser</surname> <given-names>H. S.</given-names></name> <name><surname>Grundfest</surname> <given-names>H.</given-names></name></person-group> (<year>1939</year>). <article-title>Axon diameters in relation to the spike dimensions and the conduction velocity in mammalian A fibers</article-title>. <source>Am. J. Physiol. Legacy Cont.</source> <volume>127</volume>, <fpage>393</fpage>&#x02013;<lpage>414</lpage>. <pub-id pub-id-type="doi">10.1152/ajplegacy.1939.127.2.393</pub-id></citation></ref>
<ref id="B22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>George</surname> <given-names>J. A.</given-names></name> <name><surname>Kluger</surname> <given-names>D. T.</given-names></name> <name><surname>Davis</surname> <given-names>T. S.</given-names></name> <name><surname>Wendelken</surname> <given-names>S. M.</given-names></name> <name><surname>Okorokova</surname> <given-names>E. V.</given-names></name> <name><surname>He</surname> <given-names>Q.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Biomimetic sensory feedback through peripheral nerve stimulation improves dexterous use of a bionic hand</article-title>. <source>Sci. Robot.</source> <volume>4</volume>:<fpage>eaax2352</fpage>. <pub-id pub-id-type="doi">10.1126/scirobotics.aax2352</pub-id></citation></ref>
<ref id="B23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gilja</surname> <given-names>V.</given-names></name> <name><surname>Pandarinath</surname> <given-names>C.</given-names></name> <name><surname>Blabe</surname> <given-names>C. H.</given-names></name> <name><surname>Nuyujukian</surname> <given-names>P.</given-names></name> <name><surname>Simeral</surname> <given-names>J. D.</given-names></name> <name><surname>Sarma</surname> <given-names>A. A.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Clinical translation of a high-performance neural prosthesis</article-title>. <source>Nat. Med.</source> <volume>21</volume>, <fpage>1142</fpage>&#x02013;<lpage>1145</lpage>. <pub-id pub-id-type="doi">10.1038/nm.3953</pub-id><pub-id pub-id-type="pmid">26413781</pub-id></citation></ref>
<ref id="B24"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Grover</surname> <given-names>F. S.</given-names></name> <name><surname>Buchwald</surname> <given-names>J. S.</given-names></name></person-group> (<year>1970</year>). <article-title>Correlation of cell size with amplitude of background fast activity in specific brain nuclei</article-title>. <source>J. Neurophysiol.</source> <volume>33</volume>, <fpage>160</fpage>&#x02013;<lpage>171</lpage>. <pub-id pub-id-type="doi">10.1152/jn.1970.33.1.160</pub-id><pub-id pub-id-type="pmid">5411511</pub-id></citation></ref>
<ref id="B25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hochberg</surname> <given-names>L. R.</given-names></name> <name><surname>Bacher</surname> <given-names>D.</given-names></name> <name><surname>Jarosiewicz</surname> <given-names>B.</given-names></name> <name><surname>Masse</surname> <given-names>N. Y.</given-names></name> <name><surname>Simeral</surname> <given-names>J. D.</given-names></name> <name><surname>Vogel</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Reach and grasp by people with tetraplegia using a neurally controlled robotic arm</article-title>. <source>Nature</source> <volume>485</volume>, <fpage>372</fpage>&#x02013;<lpage>375</lpage>. <pub-id pub-id-type="doi">10.1038/nature11076</pub-id><pub-id pub-id-type="pmid">22596161</pub-id></citation></ref>
<ref id="B26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hunt</surname> <given-names>C. C.</given-names></name></person-group> (<year>1951</year>). <article-title>The reflex activity of mammalian small-nerve fibres</article-title>. <source>J. Physiol.</source> <volume>115</volume>, <fpage>456</fpage>&#x02013;<lpage>469</lpage>. <pub-id pub-id-type="doi">10.1113/jphysiol.1951.sp004681</pub-id><pub-id pub-id-type="pmid">14898522</pub-id></citation></ref>
<ref id="B27"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jarosiewicz</surname> <given-names>B.</given-names></name> <name><surname>Sarma</surname> <given-names>A. A.</given-names></name> <name><surname>Bacher</surname> <given-names>D.</given-names></name> <name><surname>Masse</surname> <given-names>N. Y.</given-names></name> <name><surname>Simeral</surname> <given-names>J. D.</given-names></name> <name><surname>Sorice</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2015</year>). <article-title>Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface</article-title>. <source>Sci. Transl. Med.</source> <volume>7</volume>:<fpage>313ra179</fpage>. <pub-id pub-id-type="doi">10.1126/scitranslmed.aac7328</pub-id><pub-id pub-id-type="pmid">26560357</pub-id></citation></ref>
<ref id="B28"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>S.</given-names></name> <name><surname>Callier</surname> <given-names>T.</given-names></name> <name><surname>Tabot</surname> <given-names>G. A.</given-names></name> <name><surname>Gaunt</surname> <given-names>R. A.</given-names></name> <name><surname>Tenore</surname> <given-names>F. V.</given-names></name> <name><surname>Bensmaia</surname> <given-names>S. J.</given-names></name></person-group> (<year>2015</year>). <article-title>Behavioral assessment of sensitivity to intracortical microstimulation of primate somatosensory cortex</article-title>. <source>Proc. Natl. Acad. Sci. U S A</source> <volume>112</volume>, <fpage>15202</fpage>&#x02013;<lpage>15207</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1509265112</pub-id><pub-id pub-id-type="pmid">26504211</pub-id></citation></ref>
<ref id="B29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Klaes</surname> <given-names>C.</given-names></name> <name><surname>Shi</surname> <given-names>Y.</given-names></name> <name><surname>Kellis</surname> <given-names>S.</given-names></name> <name><surname>Minxha</surname> <given-names>J.</given-names></name> <name><surname>Revechkis</surname> <given-names>B.</given-names></name> <name><surname>Andersen</surname> <given-names>R. A.</given-names></name></person-group> (<year>2014</year>). <article-title>A cognitive neuroprosthetic that uses cortical stimulation for somatosensory feedback</article-title>. <source>J. Neural Eng.</source> <volume>11</volume>:<fpage>056024</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/11/5/056024</pub-id><pub-id pub-id-type="pmid">25242377</pub-id></citation></ref>
<ref id="B30"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kostov</surname> <given-names>A.</given-names></name> <name><surname>Polak</surname> <given-names>M.</given-names></name></person-group> (<year>2000</year>). <article-title>Parallel man-machine training in development of EEG-based cursor control</article-title>. <source>IEEE Trans. Rehabil. Eng.</source> <volume>8</volume>, <fpage>203</fpage>&#x02013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.1109/86.847816</pub-id><pub-id pub-id-type="pmid">10896187</pub-id></citation></ref>
<ref id="B31"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Kuznetzova</surname> <given-names>A.</given-names></name> <name><surname>Brockhoff</surname> <given-names>P. B.</given-names></name> <name><surname>Christensen</surname> <given-names>R. H. B.</given-names></name></person-group> (<year>2019</year>). <source>lmerTest: Tests in Linear Mixed Effects Models.</source> R Package version 3.1&#x02013;0ed.</citation></ref>
<ref id="B32"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lebedev</surname> <given-names>M. A.</given-names></name> <name><surname>Nicolelis</surname> <given-names>M. A.</given-names></name></person-group> (<year>2017</year>). <article-title>Brain-machine interfaces: from basic science to neuroprostheses and neurorehabilitation</article-title>. <source>Physiol. Rev.</source> <volume>97</volume>, <fpage>767</fpage>&#x02013;<lpage>837</lpage>. <pub-id pub-id-type="doi">10.1152/physrev.00027.2016</pub-id><pub-id pub-id-type="pmid">28275048</pub-id></citation></ref>
<ref id="B33"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Lenth</surname> <given-names>R.</given-names></name> <name><surname>Singmann</surname> <given-names>H.</given-names></name> <name><surname>Love</surname> <given-names>J.</given-names></name> <name><surname>Buerkner</surname> <given-names>P.</given-names></name> <name><surname>Herve</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <source>Estimated Marginal Means, AKA Least-Squares Means.</source> R Package 1.3.5 ed.</citation></ref>
<ref id="B34"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leuthardt</surname> <given-names>E. C.</given-names></name> <name><surname>Schalk</surname> <given-names>G.</given-names></name> <name><surname>Wolpaw</surname> <given-names>J. R.</given-names></name> <name><surname>Ojemann</surname> <given-names>J. G.</given-names></name> <name><surname>Moran</surname> <given-names>D. W.</given-names></name></person-group> (<year>2004</year>). <article-title>A brain-computer interface using electrocorticographic signals in humans</article-title>. <source>J. Neural Eng.</source> <volume>1</volume>, <fpage>63</fpage>&#x02013;<lpage>71</lpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/1/2/001</pub-id><pub-id pub-id-type="pmid">15876624</pub-id></citation></ref>
<ref id="B35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>C. X.</given-names></name> <name><surname>Yang</surname> <given-names>Q.</given-names></name> <name><surname>Waters</surname> <given-names>R. S.</given-names></name></person-group> (<year>2012</year>). <article-title>Functional and structural organization of the forelimb representation in cuneate nucleus in rat</article-title>. <source>Brain Res.</source> <volume>1468</volume>, <fpage>11</fpage>&#x02013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1016/j.brainres.2012.03.048</pub-id><pub-id pub-id-type="pmid">22800965</pub-id></citation></ref>
<ref id="B36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loutit</surname> <given-names>A. J.</given-names></name> <name><surname>Potas</surname> <given-names>J. R.</given-names></name></person-group> (<year>2019</year>). <article-title>Novel neural signal features permit robust machine-learning of natural tactile- and proprioception-dominated dorsal column nuclei signals</article-title>. <source>bioRxiv</source> [Preprint]. <pub-id pub-id-type="doi">10.1101/831164</pub-id></citation></ref>
<ref id="B37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loutit</surname> <given-names>A. J.</given-names></name> <name><surname>Potas</surname> <given-names>J. R.</given-names></name></person-group> (<year>2020a</year>). <article-title>Restoring somatosensation: advantages and current limitations of targeting the brainstem dorsal column nuclei complex</article-title>. <source>Front. Neurosci.</source> <volume>14</volume>:<fpage>156</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2020.00156</pub-id><pub-id pub-id-type="pmid">32184706</pub-id></citation></ref>
<ref id="B377"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loutit</surname> <given-names>A.</given-names></name> <name><surname>Potas</surname> <given-names>J.</given-names></name></person-group> (<year>2020b</year>). <article-title>Surface potential recordings from rat brainstem dorsal column nuclei in response to tactile and proprioceptive stimuli</article-title>. <source>G-Node</source>. <pub-id pub-id-type="doi">10.12751/g-node.jjaaz4</pub-id><pub-id pub-id-type="pmid">32184706</pub-id></citation></ref>
<ref id="B38"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loutit</surname> <given-names>A. J.</given-names></name> <name><surname>Maddess</surname> <given-names>T.</given-names></name> <name><surname>Redmond</surname> <given-names>S. J.</given-names></name> <name><surname>Morley</surname> <given-names>J. W.</given-names></name> <name><surname>Stuart</surname> <given-names>G. J.</given-names></name> <name><surname>Potas</surname> <given-names>J. R.</given-names></name></person-group> (<year>2017</year>). <article-title>Characterisation and functional mapping of surface potentials in the rat dorsal column nuclei</article-title>. <source>J. Physiol.</source> <volume>595</volume>, <fpage>4507</fpage>&#x02013;<lpage>4524</lpage>. <pub-id pub-id-type="doi">10.1113/jp273759</pub-id><pub-id pub-id-type="pmid">28333372</pub-id></citation></ref>
<ref id="B39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loutit</surname> <given-names>A. J.</given-names></name> <name><surname>Shivdasani</surname> <given-names>M. N.</given-names></name> <name><surname>Maddess</surname> <given-names>T.</given-names></name> <name><surname>Redmond</surname> <given-names>S. J.</given-names></name> <name><surname>Morley</surname> <given-names>J. W.</given-names></name> <name><surname>Stuart</surname> <given-names>G. J.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Peripheral nerve activation evokes machine-learnable signals in the dorsal column nuclei</article-title>. <source>Front. Syst. Neurosci.</source> <volume>13</volume>:<fpage>11</fpage>. <pub-id pub-id-type="doi">10.3389/fnsys.2019.00011</pub-id><pub-id pub-id-type="pmid">30983977</pub-id></citation></ref>
<ref id="B40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Loutit</surname> <given-names>A. J.</given-names></name> <name><surname>Vickery</surname> <given-names>R. M.</given-names></name> <name><surname>Potas</surname> <given-names>J. R.</given-names></name></person-group> (<year>2020</year>). <article-title>Functional organisation and connectivity of the dorsal column nuclei complex reveals a sensorimotor integration and distribution hub</article-title>. <source>J. Comp. Neurol.</source> [Epub ahead of print]. <pub-id pub-id-type="doi">10.1002/cne.24942</pub-id><pub-id pub-id-type="pmid">32374027</pub-id></citation></ref>
<ref id="B41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marathe</surname> <given-names>A. R.</given-names></name> <name><surname>Taylor</surname> <given-names>D. M.</given-names></name></person-group> (<year>2013</year>). <article-title>Decoding continuous limb movements from high-density epidural electrode arrays using custom spatial filters</article-title>. <source>J. Neural Eng.</source> <volume>10</volume>:<fpage>036015</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/10/3/036015</pub-id><pub-id pub-id-type="pmid">23611833</pub-id></citation></ref>
<ref id="B42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mehring</surname> <given-names>C.</given-names></name> <name><surname>Rickert</surname> <given-names>J.</given-names></name> <name><surname>Vaadia</surname> <given-names>E.</given-names></name> <name><surname>De Oliveira</surname> <given-names>S. C.</given-names></name> <name><surname>Aertsen</surname> <given-names>A.</given-names></name> <name><surname>Rotter</surname> <given-names>S.</given-names></name></person-group> (<year>2003</year>). <article-title>Inference of hand movements from local field potentials in monkey motor cortex</article-title>. <source>Nat. Neurosci.</source> <volume>6</volume>, <fpage>1253</fpage>&#x02013;<lpage>1254</lpage>. <pub-id pub-id-type="doi">10.3410/f.1016634.201016</pub-id><pub-id pub-id-type="pmid">14634657</pub-id></citation></ref>
<ref id="B43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Musk</surname> <given-names>E.</given-names></name> <collab>Neuralink</collab></person-group> (<year>2019</year>). <article-title>An integrated brain-machine interface platform with thousands of channels</article-title>. <source>J. Med. Internet Res.</source> <volume>21</volume>:<fpage>e16194</fpage>. <pub-id pub-id-type="doi">10.2196/16194</pub-id><pub-id pub-id-type="pmid">31642810</pub-id></citation></ref>
<ref id="B44"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nelson</surname> <given-names>P. G.</given-names></name></person-group> (<year>1966</year>). <article-title>Interaction between spinal motoneurons of the cat</article-title>. <source>J. Neurophysiol.</source> <volume>29</volume>, <fpage>275</fpage>&#x02013;<lpage>287</lpage>. <pub-id pub-id-type="doi">10.1152/jn.1966.29.2.275</pub-id><pub-id pub-id-type="pmid">5927462</pub-id></citation></ref>
<ref id="B45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nu&#x000F1;ez</surname> <given-names>A.</given-names></name> <name><surname>Bu&#x000F1;o</surname> <given-names>W.</given-names></name></person-group> (<year>1999</year>). <article-title><italic>In vitro</italic> electrophysiological properties of rat dorsal column nuclei neurons</article-title>. <source>Eur. J. Neurosci.</source> <volume>11</volume>, <fpage>1865</fpage>&#x02013;<lpage>1876</lpage>. <pub-id pub-id-type="doi">10.1046/j.1460-9568.1999.00605.x</pub-id><pub-id pub-id-type="pmid">10336654</pub-id></citation></ref>
<ref id="B47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x02019;Doherty</surname> <given-names>J. E.</given-names></name> <name><surname>Lebedev</surname> <given-names>M. A.</given-names></name> <name><surname>Hanson</surname> <given-names>T. L.</given-names></name> <name><surname>Fitzsimmons</surname> <given-names>N. A.</given-names></name> <name><surname>Nicolelis</surname> <given-names>M. A.</given-names></name></person-group> (<year>2009</year>). <article-title>A brain-machine interface instructed by direct intracortical microstimulation</article-title>. <source>Front. Integr. Neurosci.</source> <volume>3</volume>:<fpage>20</fpage>. <pub-id pub-id-type="doi">10.3389/neuro.07.020.2009</pub-id><pub-id pub-id-type="pmid">19750199</pub-id></citation></ref>
<ref id="B46"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x02019;Doherty</surname> <given-names>J. E.</given-names></name> <name><surname>Shokur</surname> <given-names>S.</given-names></name> <name><surname>Medina</surname> <given-names>L. E.</given-names></name> <name><surname>Lebedev</surname> <given-names>M. A.</given-names></name> <name><surname>Nicolelis</surname> <given-names>M. A. L.</given-names></name></person-group> (<year>2019</year>). <article-title>Creating a neuroprosthesis for active tactile exploration of textures</article-title>. <source>Proc. Natl. Acad. Sci. U S A</source> <volume>116</volume>, <fpage>21821</fpage>&#x02013;<lpage>21827</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1908008116</pub-id><pub-id pub-id-type="pmid">31591224</pub-id></citation></ref>
<ref id="B48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pudil</surname> <given-names>P.</given-names></name> <name><surname>Novovicov&#x000E1;</surname> <given-names>J.</given-names></name> <name><surname>Kittler</surname> <given-names>J.</given-names></name></person-group> (<year>1994</year>). <article-title>Floating search methods in feature selection</article-title>. <source>Pattern Recog. Lett.</source> <volume>15</volume>, <fpage>1119</fpage>&#x02013;<lpage>1125</lpage>. <pub-id pub-id-type="doi">10.1016/0167-8655(94)90127-9</pub-id></citation></ref>
<ref id="B49"><citation citation-type="book"><person-group person-group-type="author"><collab>R Core Team</collab></person-group>. (<year>2018</year>). <source>R: A Language and Environment for Statistical Computing</source> <publisher-loc>Vienna, Austria</publisher-loc>: <publisher-name>R Foundation for Statistical Computing</publisher-name>.</citation></ref>
<ref id="B50"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Richardson</surname> <given-names>A. G.</given-names></name> <name><surname>Weigand</surname> <given-names>P. K.</given-names></name> <name><surname>Sritharan</surname> <given-names>S. Y.</given-names></name> <name><surname>Lucas</surname> <given-names>T. H.</given-names></name></person-group> (<year>2015</year>). &#x0201C;<article-title>Somatosensory encoding with cuneate nucleus microstimulation: effects on downstream cortical activity</article-title>,&#x0201D; in <source>7th International IEEE/EMBS Conference on Neural Engineering (NER)</source>, (Montpellier, France: IEEE), 695&#x02013;698.</citation></ref>
<ref id="B51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rickert</surname> <given-names>J.</given-names></name> <name><surname>De Oliveira</surname> <given-names>S. C.</given-names></name> <name><surname>Vaadia</surname> <given-names>E.</given-names></name> <name><surname>Aertsen</surname> <given-names>A.</given-names></name> <name><surname>Rotter</surname> <given-names>S.</given-names></name> <name><surname>Mehring</surname> <given-names>C.</given-names></name></person-group> (<year>2005</year>). <article-title>Encoding of movement direction in different frequency ranges of motor cortical local field potentials</article-title>. <source>J. Neurosci.</source> <volume>25</volume>, <fpage>8815</fpage>&#x02013;<lpage>8824</lpage>. <pub-id pub-id-type="doi">10.1523/jneurosci.0816-05.2005</pub-id><pub-id pub-id-type="pmid">16192371</pub-id></citation></ref>
<ref id="B52"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saal</surname> <given-names>H. P.</given-names></name> <name><surname>Bensmaia</surname> <given-names>S. J.</given-names></name></person-group> (<year>2015</year>). <article-title>Biomimetic approaches to bionic touch through a peripheral nerve interface</article-title>. <source>Neuropsychologia</source> <volume>79</volume>, <fpage>344</fpage>&#x02013;<lpage>353</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2015.06.010</pub-id><pub-id pub-id-type="pmid">26092769</pub-id></citation></ref>
<ref id="B53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salas</surname> <given-names>M. A.</given-names></name> <name><surname>Bashford</surname> <given-names>L.</given-names></name> <name><surname>Kellis</surname> <given-names>S.</given-names></name> <name><surname>Jafari</surname> <given-names>M.</given-names></name> <name><surname>Jo</surname> <given-names>H.</given-names></name> <name><surname>Kramer</surname> <given-names>D.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Proprioceptive and cutaneous sensations in humans elicited by intracortical microstimulation</article-title>. <source>Elife</source> <volume>7</volume>:<fpage>e32904</fpage>. <pub-id pub-id-type="doi">10.7554/eLife.32904</pub-id><pub-id pub-id-type="pmid">29633714</pub-id></citation></ref>
<ref id="B54"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Sritharan</surname> <given-names>S. Y.</given-names></name> <name><surname>Richardson</surname> <given-names>A. G.</given-names></name> <name><surname>Weigand</surname> <given-names>P. K.</given-names></name> <name><surname>Planell-Mendez</surname> <given-names>I.</given-names></name> <name><surname>Liu</surname> <given-names>X.</given-names></name> <name><surname>Zhu</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2016</year>). &#x0201C;<article-title>Somatosensory encoding with cuneate nucleus microstimulation: detection of artificial stimuli</article-title>,&#x0201D; in <source>Proceedings of the 2016 IEEE 38th Annual International Conference of the Engineering in Medicine and Biology Society (EMBC)</source>, (Orlando, FL: IEEE). <pub-id pub-id-type="doi">10.1109/EMBC.2016.7591781</pub-id></citation></ref>
<ref id="B55"><citation citation-type="confproc"><person-group person-group-type="author"><name><surname>Stark</surname> <given-names>E.</given-names></name> <name><surname>Abeles</surname> <given-names>M.</given-names></name></person-group> (<year>2007</year>). <article-title>Predicting movement from multiunit activity</article-title>. <source>J. Neurosci.</source> <volume>27</volume>, <fpage>8387</fpage>&#x02013;<lpage>8394</lpage>. <pub-id pub-id-type="doi">10.1523/jneurosci.1321-07.2007</pub-id><pub-id pub-id-type="pmid">17670985</pub-id></citation></ref>
<ref id="B56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Suresh</surname> <given-names>A. K.</given-names></name> <name><surname>Winberry</surname> <given-names>J.</given-names></name> <name><surname>Versteeg</surname> <given-names>C.</given-names></name> <name><surname>Chowdhury</surname> <given-names>R. H.</given-names></name> <name><surname>Tomlinson</surname> <given-names>T.</given-names></name> <name><surname>Rosenow</surname> <given-names>J. M.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Methodological considerations for a chronic neural interface with the cuneate nucleus of macaques</article-title>. <source>J. Neurophysiol.</source> <volume>118</volume>, <fpage>3271</fpage>&#x02013;<lpage>3281</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00436.2017</pub-id><pub-id pub-id-type="pmid">28904101</pub-id></citation></ref>
<ref id="B57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tabot</surname> <given-names>G. A.</given-names></name> <name><surname>Dammann</surname> <given-names>J. F.</given-names></name> <name><surname>Berg</surname> <given-names>J. A.</given-names></name> <name><surname>Tenore</surname> <given-names>F. V.</given-names></name> <name><surname>Boback</surname> <given-names>J. L.</given-names></name> <name><surname>Vogelstein</surname> <given-names>R. J.</given-names></name> <etal/></person-group>. (<year>2013</year>). <article-title>Restoring the sense of touch with a prosthetic hand through a brain interface</article-title>. <source>Proc. Natl. Acad. Sci. U S A</source> <volume>110</volume>, <fpage>18279</fpage>&#x02013;<lpage>18284</lpage>. <pub-id pub-id-type="doi">10.1073/pnas.1221113110</pub-id><pub-id pub-id-type="pmid">24127595</pub-id></citation></ref>
<ref id="B58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Valle</surname> <given-names>G.</given-names></name> <name><surname>Mazzoni</surname> <given-names>A.</given-names></name> <name><surname>Iberite</surname> <given-names>F.</given-names></name> <name><surname>D&#x02019;anna</surname> <given-names>E.</given-names></name> <name><surname>Strauss</surname> <given-names>I.</given-names></name> <name><surname>Granata</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Biomimetic intraneural sensory feedback enhances sensation naturalness, tactile sensitivity and manual dexterity in a bidirectional prosthesis</article-title>. <source>Neuron</source> <volume>100</volume>, <fpage>37.e7</fpage>&#x02013;<lpage>45.e7</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuron.2018.08.033</pub-id><pub-id pub-id-type="pmid">30244887</pub-id></citation></ref>
<ref id="B59"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Whitney</surname> <given-names>A. W.</given-names></name></person-group> (<year>1971</year>). <article-title>A direct method of nonparametric measurement selection</article-title>. <source>IEEE Trans. Comput.</source> <volume>100</volume>, <fpage>1100</fpage>&#x02013;<lpage>1103</lpage>. <pub-id pub-id-type="doi">10.1109/t-c.1971.223410</pub-id></citation></ref>
<ref id="B60"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wolpaw</surname> <given-names>J. R.</given-names></name> <name><surname>Mcfarland</surname> <given-names>D. J.</given-names></name> <name><surname>Neat</surname> <given-names>G. W.</given-names></name> <name><surname>Forneris</surname> <given-names>C. A.</given-names></name></person-group> (<year>1991</year>). <article-title>An EEG-based brain-computer interface for cursor control</article-title>. <source>Electroencephalogr. Clin. Neurophysiol.</source> <volume>78</volume>, <fpage>252</fpage>&#x02013;<lpage>259</lpage>. <pub-id pub-id-type="doi">10.1016/0013-4694(91)90040-b</pub-id><pub-id pub-id-type="pmid">1707798</pub-id></citation></ref>
<ref id="B61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wong</surname> <given-names>Y. T.</given-names></name> <name><surname>Halupka</surname> <given-names>K.</given-names></name> <name><surname>Kameneva</surname> <given-names>T.</given-names></name> <name><surname>Cloherty</surname> <given-names>S. L.</given-names></name> <name><surname>Grayden</surname> <given-names>D. B.</given-names></name> <name><surname>Burkitt</surname> <given-names>A. N.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Spectral distribution of local field potential responses to electrical stimulation of the retina</article-title>. <source>J. Neural Eng.</source> <volume>13</volume>:<fpage>036003</fpage>. <pub-id pub-id-type="doi">10.1088/1741-2560/13/3/036003</pub-id><pub-id pub-id-type="pmid">27025402</pub-id></citation></ref>
</ref-list>
</back>
</article>
