<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2023.1113009</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Temporal and spatial characteristics of bone conduction as non-invasive haptic sensory feedback for upper-limb prosthesis</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Mayer</surname> <given-names>Raphael M.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/785195/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Mohammadi</surname> <given-names>Alireza</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/832590/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Tan</surname> <given-names>Ying</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/928036/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Alici</surname> <given-names>Gursel</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/94383/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Choong</surname> <given-names>Peter</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/132579/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Oetomo</surname> <given-names>Denny</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/948726/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Mechanical Engineering, The University of Melbourne</institution>, <addr-line>Parkville, VIC</addr-line>, <country>Australia</country></aff>
<aff id="aff2"><sup>2</sup><institution>School of Mechanical, Materials, Mechatronic and Biomedical Engineering, University of Wollongong</institution>, <addr-line>Wollongong, NSW</addr-line>, <country>Australia</country></aff>
<aff id="aff3"><sup>3</sup><institution>ARC Centre of Excellence for Electromaterials Science</institution>, <addr-line>Wollongong, NSW</addr-line>, <country>Australia</country></aff>
<aff id="aff4"><sup>4</sup><institution>Department of Surgery, St Vincent&#x00027;s Hospital, The University of Melbourne</institution>, <addr-line>Parkville, VIC</addr-line>, <country>Australia</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Min Li, Xi&#x00027;an Jiaotong University, China</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Gemma Carolina Bettelani, Technical University of Munich, Germany; Shan Luo, King&#x00027;s College London, United Kingdom</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Raphael M. Mayer <email>raphaelmariamayer&#x00040;gmail.com</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Neuroprosthetics, a section of the journal Frontiers in Neuroscience</p></fn></author-notes>
<pub-date pub-type="epub">
<day>28</day>
<month>03</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>17</volume>
<elocation-id>1113009</elocation-id>
<history>
<date date-type="received">
<day>30</day>
<month>11</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>24</day>
<month>02</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Mayer, Mohammadi, Tan, Alici, Choong and Oetomo.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Mayer, Mohammadi, Tan, Alici, Choong and Oetomo</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Bone conduction is a promising haptic feedback modality for upper-limb prosthesis users, however, its potential and characteristics as a non-invasive feedback modality have not been thoroughly investigated. This study aimed to establish the temporal and spatial characteristics of non-invasive bone conduction as a sensory feedback interface for upper-limb prostheses. Psychometric human-subject experiments were conducted on three bony landmarks of the elbow, with a vibrotactile transducer affixed to each to provide the stimulus. The study characterized the temporal domain by testing perception threshold and resolution in amplitude and frequency. The spatial domain was evaluated by assessing the ability of subjects to detect the number of simultaneous active stimulation sites. The experiment was conducted with ten able-bodied subjects and compared to two subjects with trans-radial amputation. The psychometric evaluation of the proposed non-invasive bone conduction feedback showed results comparable to invasive methods. The experimental results demonstrated similar amplitude and frequency resolution of the interface for all three stimulation sites for both able-bodied subjects and subjects with trans-radial amputation, highlighting its potential as a non-invasive feedback modality for upper-limb prostheses.</p></abstract>
<kwd-group>
<kwd>neuroprosthesis</kwd>
<kwd>sensory feedback restoration</kwd>
<kwd>human-robot interaction (HRI)</kwd>
<kwd>tactile feedback</kwd>
<kwd>bone conduction (BC)</kwd>
</kwd-group>
<counts>
<fig-count count="6"/>
<table-count count="5"/>
<equation-count count="3"/>
<ref-count count="34"/>
<page-count count="10"/>
<word-count count="7048"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>1. Introduction</title>
<p>Haptic sensory feedback plays an important role in effective closed-loop control of upper-limb prostheses (Saunders and Vijayakumar, <xref ref-type="bibr" rid="B26">2011</xref>; Antfolk et al., <xref ref-type="bibr" rid="B1">2013</xref>; Markovic et al., <xref ref-type="bibr" rid="B17">2018</xref>; Stephens-Fripp et al., <xref ref-type="bibr" rid="B30">2018</xref>; Farina et al., <xref ref-type="bibr" rid="B13">2021</xref>), promoting the body ownership of prosthetic arm users (Canzoneri et al., <xref ref-type="bibr" rid="B3">2013</xref>; Shehata et al., <xref ref-type="bibr" rid="B29">2020</xref>; Richard et al., <xref ref-type="bibr" rid="B24">2021</xref>) and the reduction of phantom limb pain management (Dietrich et al., <xref ref-type="bibr" rid="B10">2012</xref>). This feedback is generated through a form of stimulation that is encoded with relevant feedback information and delivered to the user&#x00027;s residual limb. The sensory feedback information can be used in a variety of applications including upper-limb prosthesis, e.g., for grasp force control (Childress, <xref ref-type="bibr" rid="B4">1980</xref>; Westling and Johansson, <xref ref-type="bibr" rid="B33">1984</xref>; Augurelle et al., <xref ref-type="bibr" rid="B2">2003</xref>; Antfolk et al., <xref ref-type="bibr" rid="B1">2013</xref>), haptic applications e.g., robotic teleoperation (Dahiya et al., <xref ref-type="bibr" rid="B8">2010</xref>) or virtual reality applications (Richard et al., <xref ref-type="bibr" rid="B24">2021</xref>).</p>
<p>Invasive and non-invasive haptic sensory feedback approaches have been investigated in the past (Cordella et al., <xref ref-type="bibr" rid="B7">2016</xref>; Stephens-Fripp et al., <xref ref-type="bibr" rid="B30">2018</xref>). Invasive approaches, such as implanted nerve electrodes, show great potential but limited applicability or desirability to a subset of the people living with limb loss due to the inherent surgical risks and potential limited lifetime of the electrodes (Schofield et al., <xref ref-type="bibr" rid="B27">2014</xref>; Cordella et al., <xref ref-type="bibr" rid="B7">2016</xref>; Farina and Ams&#x000FC;ss, <xref ref-type="bibr" rid="B12">2016</xref>; Svensson et al., <xref ref-type="bibr" rid="B31">2017</xref>). Non-invasive stimulation will therefore continue to play a strong role in prosthetic applications (Farina and Ams&#x000FC;ss, <xref ref-type="bibr" rid="B12">2016</xref>). It is also directly applicable in other areas such as in haptics and human robot interaction (Goodrich and Schultz, <xref ref-type="bibr" rid="B14">2007</xref>) and more generally in human machine interfaces (HMI) (Tahir et al., <xref ref-type="bibr" rid="B32">2018</xref>). The state of the arts of non-invasive tactile feedback are conventionally applied on the skin through electrotactile, vibrotactile and mechanotactile modalities to varying degrees of success (Antfolk et al., <xref ref-type="bibr" rid="B1">2013</xref>; Schofield et al., <xref ref-type="bibr" rid="B27">2014</xref>; Sensinger and Dosen, <xref ref-type="bibr" rid="B28">2020</xref>; Farina et al., <xref ref-type="bibr" rid="B13">2021</xref>). The shortcomings of these methods were comprehensively studied and summarized in two thorough review papers (Svensson et al., <xref ref-type="bibr" rid="B31">2017</xref>; Stephens-Fripp et al., <xref ref-type="bibr" rid="B30">2018</xref>). These shortcomings include: (1) The force dependency of perceived sensation in vibrotactile feedback, which can affect the accuracy and consistency of feedback information when the transducer is pressed against the skin; (2) Changes in the perception of both electrotactile and vibrotactile stimulation on the skin with varying locations, making it difficult to achieve precise and reliable feedback; (3) The bulky and high power consumption setup of the mechanotactile feedback, which can limit its practicality in real-world applications.</p>
<p>This paper focuses on the investigation of a non-invasive bone conduction modality as an interface to convey information to the human user. Bone conduction is a method of providing vibrotactile feedback through the bone. This approach relies on the transmission of vibrations/sound through the bone, which stimulates the Pacinian Corpuscles located around the bone (Clemente et al., <xref ref-type="bibr" rid="B6">2017</xref>). Bone conduction is a relatively recent and emerging modality which can potentially address the aforementioned shortcomings.</p>
<p>The potential of bone conduction as a haptic feedback interface for upper-limb prosthesis has been studied in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>) through mechanical stimulation of a bone-anchored (osseointegrated) prosthesis. Superior bandwidth compared to vibrotactile feedback on the skin was found in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>) for invasive bone conduction. This allows for richer feedback of sensory information to the human user.</p>
<p>While the results of the osseoperception using bone conduction were promising, it is only applicable for users with osseointegrated upper-limb prostheses. There are cases that osseointegration is not suited for people with upper-limb loss due to the lack of length or strength in the residual limb or the inherent surgical risks of the invasive technique (Schofield et al., <xref ref-type="bibr" rid="B27">2014</xref>; Cordella et al., <xref ref-type="bibr" rid="B7">2016</xref>; Farina and Ams&#x000FC;ss, <xref ref-type="bibr" rid="B12">2016</xref>; Svensson et al., <xref ref-type="bibr" rid="B31">2017</xref>). Therefore, non-invasive options such as stump sockets are expected to continue to play an important role in prosthesis.</p>
<p>In Mayer et al. (<xref ref-type="bibr" rid="B21">2019</xref>), the authors proposed the non-invasive bone conduction as haptic feedback system through vibrotactile stimulation of bony landmarks of the elbow. The preliminary results, with limited number of psychometric parameters and subjects, demonstrated comparable performance to the invasive bone conduction method (Mayer et al., <xref ref-type="bibr" rid="B21">2019</xref>, <xref ref-type="bibr" rid="B22">2020c</xref>). It provides a higher sensitivity of the perception of lower frequencies, allowing for the use of lower stimulation forces and therefore smaller and lower power consuming transducers. In addition, it has been observed that the non-invasive bone conduction is independent from the force pressing the transducers against the human subject (Mayer et al., <xref ref-type="bibr" rid="B20">2018</xref>). This is an important characteristic as volume fluctuations, present in residual limbs (Sanders et al., <xref ref-type="bibr" rid="B25">2012</xref>; Paterno et al., <xref ref-type="bibr" rid="B23">2018</xref>), no longer affect the perception of the provided sensory feedback.</p>
<p>The objective of this paper is to thoroughly investigate and determine the temporal and spatial characteristics of the non-invasive bone conduction with different user groups including subjects with amputation. The temporal parameters of the interface will be characterized by the lowest perceivable stimulation threshold and the smallest perceivable resolution in amplitude as well as frequency. The spatial parameters define the capabilities of the interface to perceive stimulation on multiple sites on the physiologically given bony landmarks on the elbow when stimulation was applied one-at-a-time. This is of interest in prosthetic grasping as combination of different types of feedback information are required (Westling and Johansson, <xref ref-type="bibr" rid="B33">1984</xref>; Johansson and Westling, <xref ref-type="bibr" rid="B15">1987</xref>; Augurelle et al., <xref ref-type="bibr" rid="B2">2003</xref>; Mayer et al., <xref ref-type="bibr" rid="B19">2020b</xref>). The temporal and spatial characteristics of the bone conduction has been conducted on both able-bodied subjects and subjects with trans-radial amputation and compared to each other and to the invasive bone conduction method.</p></sec>
<sec sec-type="methods" id="s2">
<title>2. Methodology</title>
<p>In this section, the measuring parameters, experimental setup, and protocol used to obtain temporal and spatial parameters as well as the statistical analysis are presented. The experiment was conducted with ten able-bodied subjects (SA) and two subjects with trans-radial amputation (ST), see <xref ref-type="table" rid="T1">Table 1</xref>. All subjects read the plain language statement and signed the consent form approved by the Ethics Committee of the University of Melbourne (Ethics Id 1852875.1).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Subjects were in the following results of able-bodied subjects are indicated as (SA) and for subjects with trans-radial Amputation as (ST).</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:#8f9496;color:#ffffff">
<th valign="top" align="left"><bold>Subject group</bold></th>
<th valign="top" align="center"><bold>Number</bold></th>
<th valign="top" align="center"><bold>Age</bold></th>
<th valign="top" align="center"><bold>Gender</bold></th>
</tr>
<tr style="background-color:#8f9496;color:#ffffff">
<th/>
<th/>
<th valign="top" align="center"><bold>(years)</bold></th>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Able bodied<break/>Subjects (SA)</td>
<td valign="top" align="center">10</td>
<td valign="top" align="center">26 &#x000B1; 3.9</td>
<td valign="top" align="center">2 F, 8 M</td>
</tr>
<tr>
<td valign="top" align="left">Subjects with trans-radial<break/>Amputation (ST)</td>
<td valign="top" align="center">2</td>
<td valign="top" align="center">29 &#x000B1; 8.5</td>
<td valign="top" align="center">0 F, 2 M</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>F, female; M, male.</p>
</table-wrap-foot>
</table-wrap>
<sec>
<title>2.1. Temporal and spatial parameters</title>
<p>The temporal domain is characterized by the perception threshold (PT) and the minimum noticeable difference for subjects, referred to as &#x0201C;just noticeable difference&#x0201D; (JND). The JND is obtained to quantify the perceivable resolution of the bone conduction interface for frequency and amplitude. The spatial domain is characterized by the ability to identify different stimulation sites (SPLIR).</p>
<sec>
<title>2.1.1. Perception threshold</title>
<p>PT is the minimum stimulation amplitude that subjects can perceive at a certain stimulation frequency at a certain stimulation site and can be represented as <italic>PT</italic>(<italic>f, l</italic>). For any given frequency <italic>f</italic> and site <italic>l</italic>, the amplitude thresholds changes for each person, as shown in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>, <xref ref-type="bibr" rid="B5">2016</xref>), and Mayer et al. (<xref ref-type="bibr" rid="B21">2019</xref>), thus it is necessary to be identified.</p></sec>
<sec>
<title>2.1.2. Just noticeable difference</title>
<p>The JND is determined for amplitude as well as frequency describing the resolution of the interface and therefore specifying the possible information rate of the interface. It is the minimum difference a subject can discriminate with a pre-determined probability. The <italic>JND</italic><sub><italic>f</italic></sub>(<italic>f, a, l</italic>) varies with stimulation amplitude <italic>a</italic> for a given stimulation frequency <italic>f</italic> and site <italic>l</italic>. The <italic>JND</italic><sub><italic>a</italic></sub>(<italic>f, a, l</italic>) varies with stimulation frequency <italic>f</italic> for a given stimulation amplitude <italic>a</italic> and site <italic>l</italic>. For a non-invasive bone conduction interface applied to the elbow (a natural location for the case of a transradial prosthetic arm), three accessible bony landmarks exist, namely the epicondylus (medialis and lateralis) and the ulnar olecranon. Therefore, multiple vibrotactile transducers can be deployed and potentially be used simultaneously. The spatial domain is therefore characterized by the spatial parameter single-point location identification rate (SPLIR).</p></sec>
<sec>
<title>2.1.3. Single-point location identification rate</title>
<p>SPLIR is the success rate that the subject correctly identifies the correct stimulation site. SPLIR is different for each site <italic>l</italic>:</p>
<disp-formula id="E1"><label>(1)</label><mml:math id="M1"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>S</mml:mi><mml:mi>P</mml:mi><mml:mi>L</mml:mi><mml:mi>I</mml:mi><mml:mi>R</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:msub><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi><mml:mi>o</mml:mi><mml:mi>r</mml:mi><mml:mi>r</mml:mi></mml:mrow></mml:msub><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow><mml:mrow><mml:mi>N</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>l</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:mfrac><mml:mo>,</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where <italic>N</italic><sub><italic>corr</italic></sub>(<italic>l</italic>) is the number of correct identified stimulations for the number of presented stimulations <italic>N</italic>(<italic>l</italic>) at site <italic>l</italic>.</p>
</sec></sec>
<sec>
<title>2.2. Experimental setup</title>
<p>The experiment was conducted using the setup shown in <xref ref-type="fig" rid="F1">Figure 1</xref>, where three <italic>Vibrotactile Transducers (VT)</italic> were driven by the <italic>frequency generator (FG)</italic> and <italic>amplifier (A)</italic> and controlled by the <italic>personal computer (PC)</italic>. The three transducers T1-T3 were placed onto the 3 bony landmarks of the elbow: epicondylis medialis (L1), ulnar olecranon (L2) and epicondylus lateralis (L3), see <xref ref-type="fig" rid="F1">Figure 1</xref>.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>The experimental setup: <bold>(A)</bold> three vibrotactile transducers (VT) are controlled <italic>via</italic> a personal computer (PC) connected <italic>via</italic> USB to a frequency generator (FG) and an amplifier (A); <bold>(B)</bold> the transducers are fixed onto the bony landmarks (figure shows right arm) of the dominant hand: (L1) epicondylis medialis, (L2) ulnar olecranon and (L3) epicondylus lateralis in 3D printed holder and medical grade double sided sticker and mounted.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnins-17-1113009-g0001.tif"/>
</fig>
<sec>
<title>2.2.1. Vibrotactile transducers</title>
<p>Three B81 transducers T1-T3 from RadioEar Corporation (USA) were utilized to provide the vibrotactile stimulus to the bony landmarks. All three transducers were calibrated using an Artificial Mastoid Type 4930 from Br&#x000FC;el &#x00026; Kj&#x000E6;re (Denmark) adjusted to produce the same force output of 121.5 dB at <italic>f</italic> &#x0003D; 1 kHz. The transducers were affixed to the bony landmarks, see <xref ref-type="fig" rid="F1">Figure 1</xref>, of the subjects using a 3D printed holder (PLA/TPU) and medical grade double sided sticker Type 1510 (3M&#x02122;).</p></sec>
<sec>
<title>2.2.2. Frequency generator</title>
<p>A National Instruments NI USB-6343 is used.</p></sec>
<sec>
<title>2.2.3. Amplifier</title>
<p>A 15W Public Address amplifier type A4017 from Redback Inc. (Australia) with 4 &#x02212; 16&#x003A9; output to drive the 12.5&#x003A9; B81 transducers and achieve a harmonic distortion of &#x0003C; 3% at 1 kHz.</p></sec>
<sec>
<title>2.2.4. Personal computer</title>
<p>A Windows Surface Book 2 (Intel Core i7-8, 16GB RAM, Windows 10&#x02122;) and a MATLAB<sup>&#x000AE;</sup> GUI, guiding the user through the experiment and controlling the stimulation parameters.</p>
</sec></sec>
<sec>
<title>2.3. Experimental protocol</title>
<p>The experiment is divided into temporal and spatial parameters. In order to reduce time effort for the subjects with trans-radial amputation, the able-bodied subjects carried out the whole experiment first. The longest time effort in the experiment was in the identification of the just noticeable difference. Therefore, this was carried out in stages: it was first done on the able-bodied subjects. The site with the lowest perception threshold was identified as L1. For the subjects with transradial amputation, this experiment was done for L1 instead of for all three sites, thus reducing the time-effort required from the subjects with amputation. The following explains the protocol for determining each parameter.</p>
<p>The temporal parameters, PT and JND, are obtained utilizing a single interval adjustment matrix (SIAM) method in order to reduce long trial times, requiring half the amount of repetitions compared to a standard two-interval forced-choice (2IFC). SIAM methods has been previously been implemented by Dosen et al. (<xref ref-type="bibr" rid="B11">2016</xref>) and shown to achieve same precision as a 2IFC test in Kaernbach (<xref ref-type="bibr" rid="B16">1990</xref>). In the SIAM procedure the outcome (hit, miss, false alarm, correct rejection) is used to adjust the signal level in a staircase manner. The response criterion is set to 0.5 which means the obtained PTs / JNDs are recognized with a 50% probability which is the same performance as in 2IFC tests (Kaernbach, <xref ref-type="bibr" rid="B16">1990</xref>). This was chosen according to Kaernbach (<xref ref-type="bibr" rid="B16">1990</xref>) where it was shown that it results in the best threshold estimate.</p>
<p>A SIAM matrix,</p>
<disp-formula id="E2"><label>(2)</label><mml:math id="M2"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>A</mml:mi><mml:mi>M</mml:mi><mml:mo>=</mml:mo><mml:mrow><mml:mo>[</mml:mo><mml:mrow><mml:mtable style="text-align:axis;" equalrows="false" columnlines="none none none none none none none none none" equalcolumns="false" class="array"><mml:mtr><mml:mtd><mml:mo>-</mml:mo><mml:mn>1</mml:mn></mml:mtd><mml:mtd><mml:mn>1</mml:mn></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mn>2</mml:mn></mml:mtd><mml:mtd><mml:mn>0</mml:mn></mml:mtd></mml:mtr></mml:mtable></mml:mrow><mml:mo>]</mml:mo></mml:mrow></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>as shown in Kaernbach (<xref ref-type="bibr" rid="B16">1990</xref>), achieves the best threshold estimate <italic>via</italic> a 50% target performance, i.e., half of the presented stimuli are blank. Blank stimulus means that it carries no stimulation for perception threshold and no change for JND tests. The provided stimulus <italic>S</italic><sub><italic>i</italic></sub> is therefore adjusted based on the response of the subject</p>
<disp-formula id="E3"><label>(3)</label><mml:math id="M3"><mml:mtable class="eqnarray" columnalign="left"><mml:mtr><mml:mtd><mml:msub><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi><mml:mo>&#x0002B;</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:msub><mml:mrow><mml:mi>S</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mi>S</mml:mi><mml:mi>I</mml:mi><mml:mi>A</mml:mi><mml:mi>M</mml:mi><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:mrow><mml:mi>a</mml:mi><mml:mo>,</mml:mo><mml:mi>b</mml:mi></mml:mrow><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mi>&#x003B4;</mml:mi><mml:mi>S</mml:mi></mml:mtd></mml:mtr></mml:mtable></mml:math></disp-formula>
<p>where &#x003B4;<italic>S</italic> is the step size. The index <italic>a</italic> determines if the stimulus was a blank (<italic>a</italic> &#x0003D; 1) or a true stimulation (<italic>a</italic> &#x0003D; 0). The index <italic>b</italic> is determined by the subject&#x00027;s yes/no response, where a yes means <italic>b</italic> &#x0003D; 1 and a no means <italic>b</italic> &#x0003D; 0. A correctly perceived stimulation changes the stimulus by &#x02212;1&#x003B4;<italic>S</italic> while an incorrectly perceived stimulation increases the stimulus by &#x0002B;1&#x003B4;<italic>S</italic>. An incorrect perception of a blank stimulation increases the stimulus by &#x0002B;2&#x003B4;<italic>S</italic> while a correct perception of a blank keeps it at the current level (Kaernbach, <xref ref-type="bibr" rid="B16">1990</xref>; Dosen et al., <xref ref-type="bibr" rid="B11">2016</xref>).</p>
<sec>
<title>2.3.1. Perception threshold</title>
<p>A complete psychophysical evaluation of the perception threshold would imply determining the PT at a step size determined by the Just Noticeable Difference Frequency difference (JND<sub><italic>f</italic></sub>). As the JND<sub><italic>f</italic></sub> is not known <italic>a priori</italic>, the preliminary results obtained in Mayer et al. (<xref ref-type="bibr" rid="B20">2018</xref>, <xref ref-type="bibr" rid="B21">2019</xref>, <xref ref-type="bibr" rid="B22">2020c</xref>) are used to define the frequency range, where the three sites L1-3 are each individually perceivable as well as dominant tactile perception is shown in a frequency range of <italic>f</italic> &#x02208; [100, 400, 750] Hz. The perception threshold <italic>PT</italic>(<italic>f, l</italic>) is obtained <italic>via</italic> SIAM (Kaernbach, <xref ref-type="bibr" rid="B16">1990</xref>) method. The threshold for each frequency <italic>f</italic> at the site <italic>l</italic> is obtained by presenting 26 repetitions and the amplitude adjusted according to the subjects feedback <italic>via</italic> SIAM method. The frequencies <italic>f</italic> are presented in a randomized manner at each site <italic>l</italic>. To allow for a technical implementation and selection of suitable transducers the Perception Threshold is given in Newton utilizing the previously obtained calibration (<xref ref-type="fig" rid="F2">Figure 2</xref>).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>The calibration curve for the transducers T1-T3 is used to calculate the perception threshold in Newton from the recorded Voltage applied to the transducers. The produced force <italic>F</italic><sub><italic>out</italic></sub> was measured for <italic>f</italic> &#x02208; [100, 200, 400, 750, 1,500, 3,000, and 6,000] Hz at an amplitude of <italic>a</italic> &#x02208; [0.1, 0.3, 0.5] V where the figure shows the obtained results at <italic>a</italic> &#x0003D; 0.5 V.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnins-17-1113009-g0002.tif"/>
</fig></sec>
<sec>
<title>2.3.2. Just noticeable difference</title>
<p>Similar to PT, a complete psychophysical characterization of the JND would imply determining a full range in amplitude/frequency (AF). This would result in an impractically large number of measurements, resulting in an excessively long duration of experiments for subjects. Hence, the AF domain was divided into discrete steps, called AF reference points, where <italic>f</italic><sub><italic>ref</italic></sub> &#x02208; [100, 400, 750] Hz and <italic>a</italic><sub><italic>ref</italic></sub> &#x02208; [0.1, 0.3, 0.5] V resulting in a combination of 9 AF points where the reference amplitudes and frequencies where chosen according to the preliminary results obtained in Mayer et al. (<xref ref-type="bibr" rid="B21">2019</xref>). At each AF reference point, the JND<sub><italic>f</italic></sub> and JND<sub><italic>a</italic></sub> were obtained in increasing direction (toward the maximum value). The JND is given in Volt, which can be used to derive the smallest necessary step size for an implementation and selection of suitable driver circuitry.</p></sec>
<sec>
<title>2.3.3. Single-point location identification rate</title>
<p>Spatial parameters were obtained according to Mayer et al. (<xref ref-type="bibr" rid="B22">2020c</xref>). The subjects were asked to report on the site L1-L3 of the stimulation. Therefore, the subjects were presented with the stimuli on the three different sites without <italic>a priori</italic> knowledge of the stimulation site. The order of stimulation sites were applied randomly from <italic>f</italic> &#x02208; [100, 200, 400, 750, 1,500, 3,000, and 6,000] Hz, <italic>a</italic> &#x0003D; 0.5 V and each repeated 10 times. Frequencies are choose according to the shown bandwidth in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>) and Mayer et al. (<xref ref-type="bibr" rid="B21">2019</xref>). Each stimulation was ON for 1 s. At the start of the experiment, the subjects were provided with the opportunity to familiarize themselves with the stimulation and therefore explore the association of the three stimulation sites by voluntary inducing stimuli on each site.</p>
</sec></sec>
<sec>
<title>2.4. Analysis</title>
<p>The statistical analysis in this study is utilized to investigate the difference between the physiological sites and the different subject groups.</p>
<sec>
<title>2.4.1. Effect of physiological locations</title>
<p>A non-parametric statistical analysis, specifically a Friedman Test (Daniel, <xref ref-type="bibr" rid="B9">1990</xref>) was applied to compare the three physiological sites for each temporal and spatial parameter. In case of statistical significant differences, this was followed up by a <italic>post-hoc</italic> analysis <italic>via</italic> Wilcoxon signed rank test (Wilcoxon, <xref ref-type="bibr" rid="B34">1945</xref>) to determine which of the three physiological sites was different. The <italic>p</italic>-value results are presented for the Friedman as well as the applied <italic>post-hoc</italic> Wilcoxon signed rank test.</p></sec>
<sec>
<title>2.4.2. Perception threshold</title>
<p>The achieved results of perception threshold are visually presented by plotting the mean and the stand deviation as an error bar.</p></sec>
<sec>
<title>2.4.3. Just noticeable difference</title>
<p>A summary plot shows the JND<sub><italic>a</italic></sub> and JND<sub><italic>f</italic></sub> at each AF reference point by its mean value, with the origin at the AF reference point. More details are shown in individual plots for each AF reference point for each site showing the obtained mean value and the stand deviation as an error bar.</p></sec>
<sec>
<title>2.4.4. Single-point location identification rate</title>
<p>The achieved results of perception threshold is visually presented similar as in Mayer et al. (<xref ref-type="bibr" rid="B22">2020c</xref>) by plotting the mean and the stand deviation as an error bar.</p></sec>
<sec>
<title>2.4.5. Difference between subject groups</title>
<p>A qualitative comparison between able-bodied subjects and subjects with trans-radial amputation (ST) was carried out to compare the two subject groups for each temporal and spatial parameter. The obtained mean values for the parameters are use for such comparison.</p></sec></sec></sec>
<sec sec-type="results" id="s3">
<title>3. Results</title>
<p>In this section, the temporal and spatial parameters are presented and compared statistically for the different sites/bony landmarks (L1-L3) at the elbow and qualitatively across different subject groups.</p>
<sec>
<title>3.1. Physiological sites</title>
<sec>
<title>3.1.1. Perception threshold</title>
<p>The results for PT are shown in <xref ref-type="fig" rid="F3">Figure 3</xref> and <xref ref-type="table" rid="T2">Table 2</xref>. The results of the obtained perception threshold, for the three physiological sites of able-bodied subjects (SA) and trans-radial amputees (ST) are shown in <xref ref-type="fig" rid="F3">Figure 3</xref>. The mean perception thresholds for <italic>SA</italic> is [0.015 0.45 0.2] N and for <italic>ST</italic> [0.015 0.21 0.25] N for [100 400 750] Hz.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Results of the psychophysical evaluation for PT of ten able-bodied subjects (SA) and for two trans-radial amputees (ST). Means and standard deviations of the identified PT at frequencies [100 400 750] Hz are shown.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnins-17-1113009-g0003.tif"/>
</fig>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>The <italic>p</italic>-values of the <underline>Friedman</underline> for perception threshold comparing the three different physiological sites L1, L2, and L3 at all frequencies is shown.</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:#8f9496;color:#ffffff">
<th valign="top" align="left" colspan="2"/>
<th valign="top" align="center" colspan="3"><bold>Frequency</bold></th>
</tr>
</thead>
<tbody>
<tr style="background-color:#8f9496;color:#ffffff">
<td valign="top" align="left" colspan="2"/>
<td valign="top" align="center"><bold>100 Hz</bold></td>
<td valign="top" align="center"><bold>400 Hz</bold></td>
<td valign="top" align="center"><bold>750 Hz</bold></td>
</tr> <tr>
<td valign="top" align="left">Friedman</td>
<td valign="top" align="center"><italic>L</italic>1 vs. <italic>L</italic>2 vs. <italic>L</italic>3</td>
<td valign="top" align="center">&#x02264;0.001*</td>
<td valign="top" align="center">0.273</td>
<td valign="top" align="center">&#x02264;0.001*</td>
</tr> <tr>
<td valign="middle" align="left">Wilcoxon</td>
<td valign="top" align="center"><italic>L</italic>1 vs. <italic>L</italic>2<break/><italic>L</italic>1 vs. <italic>L</italic>3<break/><italic>L</italic>2 vs. <italic>L</italic>3</td>
<td valign="top" align="center">0.002*<break/>0.002*<break/>0.059</td>
<td valign="top" align="center">-<break/>-<break/>-</td>
<td valign="top" align="center">0.002*<break/>0.002*<break/>0.059</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p>Significance level is <italic>p</italic> &#x0003C; 0.05. The <italic>p</italic>-values of the <italic>post-hoc</italic> Wilcoxon signed rank test for Perception Threshold comparing the three different physiological sites L1, L2 and L3 to each other over <italic>f</italic> &#x02208; [100, 400, 750] Hz of the ten able-bodied subjects is shown. Significance level is <italic>p</italic> &#x0003C; 0.05. *Indicates statistically significance.</p>
</table-wrap-foot>
</table-wrap>
<p>The Friedman test results, comparing the three different sites, are shown in <xref ref-type="table" rid="T2">Table 2</xref>. The obtained results indicate a statistically significant difference in performance for [100 750] Hz for the perception threshold for the three different sites. No statistical difference is observed at 400 Hz. A <italic>post-hoc</italic> test (Wilcoxon signed rank test), is performed for [100 750] Hz and the corresponding <italic>p</italic>-values are shown in <xref ref-type="table" rid="T2">Table 2</xref>. In the following, the obtained results are summarized:</p>
<p><bold>L1 vs. L2:</bold> A statistical significant difference for perception threshold at [100 750] Hz is shown in <xref ref-type="table" rid="T2">Table 2</xref> with L1 having a lower PT.</p>
<p><bold>L1 vs. L3:</bold> A statistical significant difference for perception threshold at [100 750] Hz is shown in <xref ref-type="table" rid="T2">Table 2</xref> with L1 having a lower PT.</p>
<p><bold>L2 vs. L3:</bold> No statistical significant difference was obtained for perception threshold at [100 750] Hz shown in <xref ref-type="table" rid="T2">Table 2</xref>.</p>
<p>Note that the <italic>p</italic>-values are at 0.059 for both cases, therefore they are only slightly above significance level of <italic>p</italic> &#x0003C; 0.05.</p></sec>
<sec>
<title>3.1.2. Just noticeable difference</title>
<p>The results for the just noticable difference in amplitude JND<sub><italic>a</italic></sub> are shown in <bold>Figure 5A</bold> and <xref ref-type="table" rid="T3">Table 3</xref>. The results for the just noticable difference in frequency JND<sub><italic>f</italic></sub> are shown in <bold>Figure 5B</bold> and <xref ref-type="table" rid="T4">Table 4</xref>. A combined plot is shown in <xref ref-type="fig" rid="F4">Figure 4</xref>, showing the mean at each site. The details of JND<sub><italic>a</italic></sub> and JND<sub><italic>f</italic></sub> are shown and discussed in the following.</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>The <italic>p</italic>-values of the <underline>Friedman</underline> for JND<sub><italic>a</italic></sub> comparing the three different physiological sites L1, L2, and L3 at all frequencies and amplitudes of the ten able-bodied subjects (SA) is given.</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:#8f9496;color:#ffffff">
<th/>
<th/>
<th valign="top" align="center"><bold>Amplitude</bold></th>
<th valign="top" align="center" colspan="3"><bold>Frequency</bold></th>
</tr>
</thead>
<tbody>
<tr style="background-color:#8f9496;color:#ffffff">
<td/>
<td/>
<td/>
<td valign="top" align="center"><bold>100 Hz</bold></td>
<td valign="top" align="center"><bold>400 Hz</bold></td>
<td valign="top" align="center"><bold>750 Hz</bold></td>
</tr>
<tr>
<td valign="top" align="left" rowspan="3">Friedman</td>
<td valign="top" align="left" rowspan="3">L1 vs. L2 vs. L3</td>
<td valign="top" align="center"><italic>0.1 V</italic></td>
<td valign="top" align="center">0.318</td>
<td valign="top" align="center">0.063</td>
<td valign="top" align="center">0.255</td>
</tr>
<tr>
<td valign="top" align="center">0.3 V</td>
<td valign="top" align="center">0.900</td>
<td valign="top" align="center">0.407</td>
<td valign="top" align="center">0.905</td>
</tr>
<tr>
<td valign="top" align="center">0.5 V</td>
<td valign="top" align="center">0.509</td>
<td valign="top" align="center">0.527</td>
<td valign="top" align="center">0.318</td>
</tr></tbody>
</table>
<table-wrap-foot>
<p>Significance level is taken at <italic>p</italic> &#x0003C; 0.05.</p>
</table-wrap-foot>
</table-wrap>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>The <italic>p</italic>-values of the <underline>Friedman</underline> for JND<sub><italic>f</italic></sub> comparing the three different physiological sites L1, L2, and L3 at all frequencies and amplitudes is given.</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:#8f9496;color:#ffffff">
<th/>
<th/>
<th valign="top" align="center"><bold>Amplitude</bold></th>
<th valign="top" align="center" colspan="3"><bold>Frequency</bold></th>
</tr>
</thead>
<tbody>
<tr style="background-color:#8f9496;color:#ffffff">
<td/>
<td/>
<td/>
<td valign="top" align="center"><bold>100 Hz</bold></td>
<td valign="top" align="center"><bold>400 Hz</bold></td>
<td valign="top" align="center"><bold>750 Hz</bold></td>
</tr>
<tr>
<td valign="top" align="left" rowspan="3">Friedman</td>
<td valign="top" align="left" rowspan="3">L1 vs. L2 vs. L3</td>
<td valign="top" align="center">0.1 V</td>
<td valign="top" align="center">0.828</td>
<td valign="top" align="center">0.018*</td>
<td valign="top" align="center">0.174</td>
</tr>
 <tr>
<td valign="top" align="center">0.3 V</td>
<td valign="top" align="center">0.565</td>
<td valign="top" align="center">0.717</td>
<td valign="top" align="center">0.008*</td>
</tr>
 <tr>
<td valign="top" align="center">0.5 V</td>
<td valign="top" align="center">0.140</td>
<td valign="top" align="center">0.143</td>
<td valign="top" align="center">0.500</td>
</tr> <tr>
<td valign="middle" align="left" rowspan="6">Wilcoxon</td>
<td valign="middle" align="left" rowspan="2"><bold><italic>L</italic>1<italic>vs</italic>.<italic>L</italic>2</bold></td>
<td valign="top" align="center">0.1 V</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.031*</td>
<td valign="top" align="center">-</td>
</tr>
 <tr>
<td valign="top" align="center">0.3 V</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.031*</td>
</tr>
 <tr>
<td valign="top" align="left" rowspan="2"><bold><italic>L</italic>1<italic>vs</italic>.<italic>L</italic>3</bold></td>
<td valign="top" align="center">0.1 V</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.406</td>
<td valign="top" align="center">-</td>
</tr>
 <tr>
<td valign="top" align="center">0.3 V</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.063</td>
</tr>
 <tr>
<td valign="top" align="left" rowspan="2"><bold><italic>L</italic>2<italic>vs</italic>.<italic>L</italic>3</bold></td>
<td valign="top" align="center">0.1 V</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.094</td>
<td valign="top" align="center">-</td>
</tr>
 <tr>
<td valign="top" align="center">0.3 V</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">1.0</td>
</tr></tbody>
</table>
<table-wrap-foot>
<p>Significance level is <italic>p</italic> &#x0003C; 0.05. Furthermore, the <italic>p</italic>-values of the <italic>post-hoc</italic> <underline>Wilcoxon signed rank test</underline> for JND<sub><italic>f</italic></sub> comparing the three different physiological sites L1, L2 and L3 to each other over all frequencies and amplitudes of the ten able-bodied subjects is shown. Significance level is <italic>p</italic> &#x0003C; 0.05. *Indicates statistically significance.</p>
</table-wrap-foot>
</table-wrap>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>This plot shows the combination of JND<sub><italic>a</italic></sub> (vertically) and JND<sub><italic>f</italic></sub> (horizontally) at each AF point. The JND<sub><italic>a</italic></sub> showing the amplitude resolution for 3 different frequencies at 3 different amplitudes and JND<sub><italic>f</italic></sub> giving the frequency resolution for 3 different amplitudes at 3 different frequencies in a summary plot of the obtained mean value of JND<sub><italic>a</italic></sub> (blue) and JND<sub><italic>f</italic></sub> (red) at each reference stimulus (black) giving. See <xref ref-type="fig" rid="F5">Figure 5</xref> for the detailed trends of each JND<sub><italic>a</italic></sub> and JND<sub><italic>f</italic></sub>. The results are shown for all three sites L1-L3 for the able-bodied subjects (SA) and for site L1 subjects with trans-radial amputation (ST).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnins-17-1113009-g0004.tif"/>
</fig>
<sec>
<title>3.1.2.1. JND<sub><italic>a</italic></sub></title>
<p>The obtained results of JND<sub><italic>a</italic></sub> are shown in <xref ref-type="fig" rid="F5">Figure 5A</xref>. The obtained results of the Friedman test comparing the three sites, as shown in <xref ref-type="table" rid="T3">Table 3</xref>, indicate no statistically significant difference between the three physiological sites, therefore no <italic>post-hoc</italic> test was performed.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>The plot in <bold>(A)</bold> shows the detailed JND<sub><italic>a</italic></sub> at the three different chosen AF reference frequencies for the three different AF reference amplitudes and <bold>(B)</bold> shows the detailed JND<sub><italic>f</italic></sub> for at the three different chosen AF reference amplitudes for the three different AF reference frequencies. Both are given for the three sites L1-L3 for <italic>SA</italic> and <italic>ST</italic>. The mean is plotted as solid line and the standard deviation given as error bar.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnins-17-1113009-g0005.tif"/>
</fig>
</sec>
<sec>
<title>3.1.2.2. JND<sub><italic>f</italic></sub></title>
<p>The obtained results of JND<sub><italic>f</italic></sub> are shown in <xref ref-type="fig" rid="F5">Figure 5B</xref>. The results of the Friedman test for the three sites of JND<sub><italic>f</italic></sub>, as shown in <xref ref-type="table" rid="T4">Table 4</xref>, indicate a statistically significant difference for JND<sub><italic>f</italic></sub> at [0.1 V, 400 Hz] as well as for [0.3 V, 750 Hz]. No statistically significant difference was found for all other discrete steps in the AF domain. The results of the <italic>post-hoc</italic> <underline>Wilcoxon signed rank test</underline> comparing the three different physiological sites L1, L2 and L3 to each other for 0.1 V at 400 Hz and 0.3 V at 750 Hz, shown in <xref ref-type="table" rid="T4">Table 4</xref>. In the following, the obtained results are summarized:</p>
<p><bold>L1 vs. L2:</bold> A statistical significant difference for JND<sub><italic>f</italic></sub> at 400 Hz for 0.1 V and 0.3 V is shown in <xref ref-type="table" rid="T4">Table 4</xref>.</p>
<p>No statistical significant difference was obtained for 0.1 V at 400 Hz and 0.3 V at 750 Hz is shown for</p>
<p><bold>L1 vs. L3</bold> as well as <bold>L2 vs. L3</bold> in <xref ref-type="table" rid="T4">Table 4</xref>.</p></sec></sec>
<sec>
<title>3.1.3. Single-point location identification rate</title>
<p>The results of the obtained SPLIR are shown in <xref ref-type="fig" rid="F6">Figure 6</xref> for all three physiological sites. The Friedman results for the three different sites, as shown in <xref ref-type="table" rid="T5">Table 5</xref>, indicate no statistically significant difference in performance for the different sites for SPLIR, hence, no <italic>post-hoc</italic> test was performed.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>The mean and standard deviation of the SPLIR for each site L1, L2, and L3 is shown. The results of the ten able-bodied subjects (SA) is plotted in solid lines and for subjects with trans-radial amputation (ST).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnins-17-1113009-g0006.tif"/>
</fig>
<table-wrap position="float" id="T5">
<label>Table 5</label>
<caption><p>The <italic>p</italic>-values of the <underline>Friedman</underline> for SPLIR comparing the three different physiological sites L1, L2, and L3 at all frequencies and amplitudes is given.</p></caption> 
<table frame="box" rules="all">
<thead>
<tr style="background-color:#8f9496;color:#ffffff">
<th/>
<th valign="top" align="center" colspan="7"><bold>Frequency</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td/>
<td valign="top" align="center"><bold>100 Hz</bold></td>
<td valign="top" align="center"><bold>200 Hz</bold></td>
<td valign="top" align="center"><bold>400 Hz</bold></td>
<td valign="top" align="center"><bold>750 Hz</bold></td>
<td valign="top" align="center"><bold>1,500 Hz</bold></td>
<td valign="top" align="center"><bold>3,000 Hz</bold></td>
<td valign="top" align="center"><bold>6,000 Hz</bold></td>
</tr> <tr>
<td valign="top" align="left">L1 vs. L2 vs. L3</td>
<td valign="top" align="center">0.581</td>
<td valign="top" align="center">0.460</td>
<td valign="top" align="center">0.867</td>
<td valign="top" align="center">0.104</td>
<td valign="top" align="center">0.081</td>
<td valign="top" align="center">0.704</td>
<td valign="top" align="center">0.103</td>
</tr></tbody>
</table>
<table-wrap-foot>
<p>Significance level is <italic>p</italic> &#x0003C; 0.05. *Indicates statistically significance.</p>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec>
<title>3.2. Subject groups</title>
<p>The obtained perception threshold of the two user groups, able-bodied subjects (SA) and subjects with trans-radial amputation (ST), are shown in <xref ref-type="fig" rid="F3">Figure 3</xref>. The results show a lower to similar perception threshold for <italic>ST</italic> compared to <italic>SA</italic>. A higher value is obtained for L3 at 750 Hz.</p>
<p>The obtained JND<sub><italic>a</italic></sub> of the two user groups is shown in <xref ref-type="fig" rid="F5">Figure 5A</xref>. The obtained JND<sub><italic>f</italic></sub> of the two user groups is shown in <xref ref-type="fig" rid="F5">Figure 5B</xref>. The obtained SPLIR of the two user groups is shown in <xref ref-type="fig" rid="F6">Figure 6</xref>.</p></sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>4. Discussion</title>
<p>In this section, the obtained results are discussed for: (a) the three physiological sites; (b) the different subject groups and compared to results obtained for invasive bone conduction in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>).</p>
<sec>
<title>4.1. Physiological sites</title>
<p>For <underline>perception threshold</underline> site L1 performed better (in statistically significance manner) than L2 and L3 at 100 and 750 Hz, while no difference was obtained at 400 Hz. Better performance of L1 can be explained by on the one hand allowing better contact to the bones in a non-invasive manner due to little skin and soft tissue in between transducer and bone. On the other hand the ulnar nerve runs behind the medial epicondyle on the inside of the elbow and might increase the perception by being mechanically stimulated. The results of the study did not reveal any statistically significant differences in PT between the three stimulation sites at 400 Hz. While the L1 site demonstrated the lowest value, the high variance of the results could account for the lack of statistical significance (see <xref ref-type="fig" rid="F3">Figure 3</xref>). One possible explanation for the variability in the results is the limited number of participants in the study. Another factor to consider is the findings of Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>), which suggest that stimulation frequencies above 400 Hz can be perceived as sound. As a result, the change in sensation from tactile-only to tactile and audio could contribute to the increased variability observed in the results. The obtained PT achieved for invasive bone conduction (Clemente et al., <xref ref-type="bibr" rid="B6">2017</xref>) which is a mean PT of [0.2, 0.1, 0.47] N compared to the results obtained in this study being [0.01, 0.45, 0.20] N for <italic>SA</italic> and [0.01, 0.21, 0.25] N for <italic>ST</italic> at f=[100, 400, 750] Hz. A smaller perception threshold at 100 Hz and 750 Hz for all three sites has been achieved for both user groups for non-invasive bone conduction feedback. The obtained PT at 400 Hz is higher than in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>) for all three sites.</p>
<p>Note that a lower perception threshold is the desired performance. Performing better with respect to PT means a lower perception threshold was obtained, allowing to use a bigger force range and therefore a larger bandwidth for the feedback information is available. It also allows the use of smaller transducers, as investigated in Mayer et al. (<xref ref-type="bibr" rid="B18">2020a</xref>), and therefore reduced energy consumption for battery powered prosthesis. Furthermore, lower stimulation force reduces the resulting noise and therefore increases the likelihood of the acceptance within the prosthetic field.</p>
<p>For <underline>JND<sub><italic>a</italic></sub></underline>, no statistically significant difference between different sites at the three different frequencies was obtained. As a result, each of the three sites is equally sensitive.</p>
<p>For <underline>JND<sub><italic>f</italic></sub></underline>, a statistically significant difference between different sites at [0.1 V, 400 Hz] as well as for [0.3 V, 750 Hz] was found. No statistical difference was found for all other stimulation permutations. In combination with the significantly lower PT, L1 has the biggest bandwidth for providing sensory feedback.</p>
<p>For <underline>SPLIR</underline>, no statistically significant difference between the different sites at the different frequencies was obtained, meaning each stimulation on each site can be located equally well. As reported previously in preliminary studies in Mayer et al. (<xref ref-type="bibr" rid="B22">2020c</xref>), SPLIR drops to at chance level above 1,500 Hz. Such a drop suggests that the site identification is superior for tactile perception, which is prevalent below 750 Hz (Mayer et al., <xref ref-type="bibr" rid="B21">2019</xref>), and the stimulation location can not be perceived auditory perception. The stimulation in the case of auditory perception is conducted <italic>via</italic> the bones to the auditory pathway. Stimulating on three different independent sites on the elbow will ultimately still lead to stimulation of the same auditory pathway and hence not allow the subject to distinguish the stimulation site.</p>
</sec>
<sec>
<title>4.2. Subject groups</title>
<p>Only qualitative discussion is performed in the comparison of subject groups, due to the small number of ST subjects available for the study. For <underline>perception threshold</underline>, subjects with trans-radial amputation qualitative show a lower PT than able-bodied subjects and therefore are more sensitive to stimulation. This allows the use of a wider force range / larger bandwidth for the feedback information, and the use of smaller transducers for reduced energy consumption. Furthermore, the subjects with trans-radial amputation achieve similar performance for PT using non invasive bone conduction compared to the subjects with invasive bone conduction studied in Clemente et al. (<xref ref-type="bibr" rid="B6">2017</xref>). For <underline>JND<sub><italic>a</italic></sub></underline>, similar to PT a slightly better performance was obtained for <italic>ST</italic> compared to <italic>SA</italic>. A smaller <underline>JND<sub><italic>a</italic></sub></underline> means a higher resolution of the feedback interface is feasible and therefore more detailed sensory feedback can be provided.</p>
<p>For <underline>JND<sub><italic>f</italic></sub></underline>, a slightly worse performance was obtained for <italic>ST</italic> compared to <italic>SA</italic>. A higher <underline>JND<sub><italic>f</italic></sub></underline> means a coarser resolution of the feedback interface necessary and therefore less detailed sensory feedback can be provided.</p>
<p>For <underline>SPLIR</underline>, similar performance for <italic>ST</italic> compared to <italic>SA</italic> was obtained. Both subject groups SPLIR drops to at chance level above 1,500 Hz, suggesting that the site identification is superior for tactile perception for both subject groups.</p>
<sec>
<title>4.2.1. Established interface parameters</title>
<p>The results obtained in this study suggest a usable bandwidth for bone conduction as a sensory feedback from 100 to 750 Hz when multiple transducers are used on multiple stimulation sites. The perception threshold is as low as 0.01 N at 100 Hz and increases to 0.2 N at 750 Hz. This range of force perception and frequency bandwidth suggest that commercially available transducers used in audiology could be used for bone conduction sensory feedback. Furthermore, the perception threshold for non-invasive bone conduction was found to be comparable to results obtained with invasive bone conduction techniques (Clemente et al., <xref ref-type="bibr" rid="B6">2017</xref>). The study also revealed that frequency resolution was more distinguishable than amplitude. This finding could have implications for the design of future bone conduction feedback systems, as it suggests that greater attention may need to be paid to the frequency content of the feedback signals.</p>
<p>It should be mentioned that sensory feedback bone conduction is not applicable for subjects with diseases affecting the perception of such stimulation e.g., a potential subject in this study had to be excluded due to the inability to perceive stimulation likely caused by rheumatoid arthritis.</p></sec></sec>
</sec>
<sec sec-type="conclusions" id="s5">
<title>5. Conclusion</title>
<p>This study has evaluated the temporal and spatial parameters of the non-invasive vibrotactile feedback on the bony landmarks of the elbow. The parameters are investigated on three different physiological sites over two user groups (able bodies and subjects with transradial amputation). The paper reports the effective operating range of frequencies and amplitudes and the resolutions that can be perceived generally by the human users.</p>
<p>The perception threshold on the ulnar olecranon (L1) is most sensitive for able-bodied subjects compared to the medial and lateral epicondylus. The perception threshold is lower and therefore more sensitive for subjects with trans-radial amputation compared to able-bodied subjects. A qualitatively smaller, and therefore more sensitive, perception threshold has been obtained compared to invasive bone conduction.</p>
<p>Previous research (Clemente et al., <xref ref-type="bibr" rid="B6">2017</xref>) showed that osseoperception, caused by mechanical vibrations through a bone-anchored (osseointegrated) prostheses, allows for a richer feedback and therefore was believed to play an important role in the sense of ownership of a prosthesis and the improvement of quality of live of people living with limb loss. The equivalent sensitivity achieved in non-invasive bone-conduction within this study highlights the potential of such an interface for conventional socket-based prostheses to not only provide richer feedback and functionality but also to enhance the sense of ownership of a prosthesis.</p>
<p>The resolution in amplitude and frequency of all three sites, as well as for able-bodied subject vs. subjects with trans-radial amputation, showed comparable performance. The detection of the stimulation site was not different between different sites as well as the two investigated user groups.</p></sec>
<sec sec-type="data-availability" id="s6">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p></sec>
<sec sec-type="ethics-statement" id="s7">
<title>Ethics statement</title>
<p>The studies involving human participants were reviewed and approved by Engineering Human Ethics Advisory Group at the University of Melbourne. The patients/participants provided their written informed consent to participate in this study.</p></sec>
<sec sec-type="author-contributions" id="s8">
<title>Author contributions</title>
<p>RM, AM, YT, and DO: literature, experiment, data, analysis, and paper. GA and PC: paper design, experiment design, and paper review. All authors contributed to the article and approved the submitted version.</p></sec>
</body>
<back>
<sec sec-type="funding-information" id="s9">
<title>Funding</title>
<p>The project was funded by the Valma Angliss Trust.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Antfolk</surname> <given-names>C.</given-names></name> <name><surname>D&#x00027;alonzo</surname> <given-names>M.</given-names></name> <name><surname>Ros&#x000E9;n</surname> <given-names>B.</given-names></name> <name><surname>Lundborg</surname> <given-names>G.</given-names></name> <name><surname>Sebelius</surname> <given-names>F.</given-names></name> <name><surname>Cipriani</surname> <given-names>C.</given-names></name></person-group> (<year>2013</year>). <article-title>Sensory feedback in upper limb prosthetics</article-title>. <source>Expert. Rev. Med. Devices</source> <volume>10</volume>, <fpage>45</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1586/erd.12.68</pub-id><pub-id pub-id-type="pmid">23278223</pub-id></citation></ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Augurelle</surname> <given-names>A. S.</given-names></name> <name><surname>Smith</surname> <given-names>A. M.</given-names></name> <name><surname>Lejeune</surname> <given-names>T.</given-names></name> <name><surname>Thonnard</surname> <given-names>J. L.</given-names></name></person-group> (<year>2003</year>). <article-title>Importance of cutaneous feedback in maintaining a secure grip during manipulation of hand-held objects</article-title>. <source>J. Neurophysiol</source>. <volume>89</volume>, <fpage>665</fpage>&#x02013;<lpage>671</lpage>. <pub-id pub-id-type="doi">10.1152/jn.00249.2002</pub-id><pub-id pub-id-type="pmid">12574444</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Canzoneri</surname> <given-names>E.</given-names></name> <name><surname>Marzolla</surname> <given-names>M.</given-names></name> <name><surname>Amoresano</surname> <given-names>A.</given-names></name> <name><surname>Verni</surname> <given-names>G.</given-names></name> <name><surname>Serino</surname> <given-names>A.</given-names></name></person-group> (<year>2013</year>). <article-title>Amputation and prosthesis implantation shape body and peripersonal space representations</article-title>. <source>Sci. Rep</source>. <volume>3</volume>, <fpage>2844</fpage>. <pub-id pub-id-type="doi">10.1038/srep02844</pub-id><pub-id pub-id-type="pmid">24088746</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Childress</surname> <given-names>D. S.</given-names></name></person-group> (<year>1980</year>). <article-title>Closed-loop control in prosthetic systems: historical perspective</article-title>. <source>Ann. Biomed. Eng</source>. <volume>8</volume>, <fpage>293</fpage>&#x02013;<lpage>303</lpage>. <pub-id pub-id-type="doi">10.1007/BF02363433</pub-id><pub-id pub-id-type="pmid">7027836</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Clemente</surname> <given-names>F.</given-names></name> <name><surname>D&#x00027;Alonzo</surname> <given-names>M.</given-names></name> <name><surname>Controzzi</surname> <given-names>M.</given-names></name> <name><surname>Edin</surname> <given-names>B. B.</given-names></name> <name><surname>Cipriani</surname> <given-names>C.</given-names></name></person-group> (<year>2016</year>). <article-title>Non-Invasive, temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses</article-title>. <source>IEEE Trans. Neural Syst. Rehabil. Eng</source>. <volume>24</volume>, <fpage>1314</fpage>&#x02013;<lpage>1322</lpage>. <pub-id pub-id-type="doi">10.1109/TNSRE.2015.2500586</pub-id><pub-id pub-id-type="pmid">26584497</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Clemente</surname> <given-names>F.</given-names></name> <name><surname>H&#x000E5;kansson</surname> <given-names>B.</given-names></name> <name><surname>Cipriani</surname> <given-names>C.</given-names></name> <name><surname>Wessberg</surname> <given-names>J.</given-names></name> <name><surname>Kulbacka-Ortiz</surname> <given-names>K.</given-names></name> <name><surname>Br&#x000E5;nemark</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Touch and hearing mediate osseoperception</article-title>. <source>Sci. Rep</source>. 7, 45363. <pub-id pub-id-type="doi">10.1038/srep45363</pub-id><pub-id pub-id-type="pmid">28349945</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cordella</surname> <given-names>F.</given-names></name> <name><surname>Ciancio</surname> <given-names>A. L.</given-names></name> <name><surname>Sacchetti</surname> <given-names>R.</given-names></name> <name><surname>Davalli</surname> <given-names>A.</given-names></name> <name><surname>Cutti</surname> <given-names>A. G.</given-names></name> <name><surname>Guglielmelli</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2016</year>). <article-title>Literature review on needs of upper limb prosthesis users</article-title>. <source>Front. Neurosci</source>. 10, 209. <pub-id pub-id-type="doi">10.3389/fnins.2016.00209</pub-id><pub-id pub-id-type="pmid">27242413</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dahiya</surname> <given-names>R.</given-names></name> <name><surname>Metta</surname> <given-names>G.</given-names></name> <name><surname>Valle</surname> <given-names>M.</given-names></name> <name><surname>Sandini</surname> <given-names>G.</given-names></name></person-group> (<year>2010</year>). <article-title>Tactile sensing&#x02013;from humans to humanoids</article-title>. <source>IEEE Trans. Rob</source>. <volume>26</volume>, <fpage>1</fpage>&#x02013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1109/TRO.2009.2033627</pub-id></citation></ref>
<ref id="B9">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Daniel</surname> <given-names>W.</given-names></name></person-group> (<year>1990</year>). <source>Applied Nonparametric Statistics, 2nd Edn</source>. <publisher-loc>Boston, MA</publisher-loc>: <publisher-name>PWS-KENT</publisher-name>.</citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dietrich</surname> <given-names>C.</given-names></name> <name><surname>Walter-Walsh</surname> <given-names>K.</given-names></name> <name><surname>Prei&#x000DF;ler</surname> <given-names>S.</given-names></name> <name><surname>Hofmann</surname> <given-names>G. O.</given-names></name> <name><surname>Witte</surname> <given-names>O. W.</given-names></name> <name><surname>Miltner</surname> <given-names>W. H.</given-names></name> <etal/></person-group>. (<year>2012</year>). <article-title>Sensory feedback prosthesis reduces phantom limb pain: proof of a principle</article-title>. <source>Neurosci. Lett</source>. <volume>507</volume>, <fpage>97</fpage>&#x02013;<lpage>100</lpage>. <pub-id pub-id-type="doi">10.1016/j.neulet.2011.10.068</pub-id><pub-id pub-id-type="pmid">22085692</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dosen</surname> <given-names>S.</given-names></name> <name><surname>Ninu</surname> <given-names>A.</given-names></name> <name><surname>Yakimovich</surname> <given-names>T.</given-names></name> <name><surname>Dietl</surname> <given-names>H.</given-names></name> <name><surname>Farina</surname> <given-names>D.</given-names></name></person-group> (<year>2016</year>). <article-title>A novel method to generate amplitude-frequency modulated vibrotactile stimulation</article-title>. <source>IEEE Trans. Haptics</source> <volume>9</volume>, <fpage>3</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1109/TOH.2015.2497229</pub-id><pub-id pub-id-type="pmid">26561483</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farina</surname> <given-names>D.</given-names></name> <name><surname>Ams&#x000FC;ss</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). <article-title>Reflections on the present and future of upper limb prostheses</article-title>. <source>Expert. Rev. Med. Devices</source> <volume>13</volume>, <fpage>321</fpage>&#x02013;<lpage>324</lpage>. <pub-id pub-id-type="doi">10.1586/17434440.2016.1159511</pub-id><pub-id pub-id-type="pmid">26924191</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Farina</surname> <given-names>D.</given-names></name> <name><surname>Vujaklija</surname> <given-names>I.</given-names></name> <name><surname>Br&#x000E5;nemark</surname> <given-names>R.</given-names></name> <name><surname>Bull</surname> <given-names>A. M. J.</given-names></name> <name><surname>Dietl</surname> <given-names>H.</given-names></name> <name><surname>Graimann</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Toward higher-performance bionic limbs for wider clinical use</article-title>. <source>Nat. Biomed. Eng</source>. <fpage>1</fpage>&#x02013;<lpage>13</lpage>. <pub-id pub-id-type="doi">10.1038/s41551-021-00732-x</pub-id><pub-id pub-id-type="pmid">34059810</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Goodrich</surname> <given-names>M. A.</given-names></name> <name><surname>Schultz</surname> <given-names>A. C.</given-names></name></person-group> (<year>2007</year>). <article-title>Human-robot interaction: a survey</article-title>. <source>Foundat. Trends Human Comput. Interact</source>. <volume>1</volume>, <fpage>203</fpage>&#x02013;<lpage>275</lpage>. <pub-id pub-id-type="doi">10.1561/1100000005</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johansson</surname> <given-names>R.</given-names></name> <name><surname>Westling</surname> <given-names>G.</given-names></name></person-group> (<year>1987</year>). <article-title>Signals in tactile afferents from the fingers eliciting adaptive motor responses during precision grip</article-title>. <source>Exp. Brain Res</source>. <volume>66</volume>:<fpage>141</fpage>&#x02013;<lpage>154</lpage>. <pub-id pub-id-type="doi">10.1007/BF00236210</pub-id><pub-id pub-id-type="pmid">3582528</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaernbach</surname> <given-names>C.</given-names></name></person-group> (<year>1990</year>). <article-title>A single-interval adjustment-matrix (SIAM) procedure for unbiased adaptive testing</article-title>. <source>J. Acoust. Soc. Am</source>. <volume>88</volume>, <fpage>2645</fpage>&#x02013;<lpage>2655</lpage>. <pub-id pub-id-type="doi">10.1121/1.399985</pub-id><pub-id pub-id-type="pmid">2283438</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Markovic</surname> <given-names>M.</given-names></name> <name><surname>Schweisfurth</surname> <given-names>M. A.</given-names></name> <name><surname>Engels</surname> <given-names>L. F.</given-names></name> <name><surname>Farina</surname> <given-names>D.</given-names></name> <name><surname>Dosen</surname> <given-names>S.</given-names></name></person-group> (<year>2018</year>). <article-title>Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping</article-title>. <source>J. Neuroeng. Rehabil</source>. 15, 81. <pub-id pub-id-type="doi">10.1186/s12984-018-0422-7</pub-id><pub-id pub-id-type="pmid">30176929</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. M.</given-names></name> <name><surname>Chen</surname> <given-names>S.</given-names></name> <name><surname>Li</surname> <given-names>Z.</given-names></name> <name><surname>Mohammadi</surname> <given-names>A.</given-names></name> <name><surname>Tan</surname> <given-names>Y.</given-names></name> <name><surname>Alici</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2020a</year>). <article-title>Investigation of vibrotactile transducers for a bone conduction sensory feedback system,</article-title> in <source>5th International Conference on NeuroRehabilitation (ICNR2020)</source> (<publisher-loc>Virtual</publisher-loc>).</citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. M.</given-names></name> <name><surname>Garcia-Rosas</surname> <given-names>R.</given-names></name> <name><surname>Mohammadi</surname> <given-names>A.</given-names></name> <name><surname>Tan</surname> <given-names>Y.</given-names></name> <name><surname>Alici</surname> <given-names>G.</given-names></name> <name><surname>Choong</surname> <given-names>P.</given-names></name> <etal/></person-group>. (<year>2020b</year>). <article-title>Tactile feedback in closed-loop control of myoelectric hand grasping: conveying information of multiple sensors simultaneously via a single feedback channel</article-title>. <source>Front. Neurosci</source>. 14, 348. <pub-id pub-id-type="doi">10.3389/fnins.2020.00348</pub-id><pub-id pub-id-type="pmid">32395102</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. M.</given-names></name> <name><surname>Mohammadi</surname> <given-names>A.</given-names></name> <name><surname>Alici</surname> <given-names>G.</given-names></name> <name><surname>Choong</surname> <given-names>P.</given-names></name> <name><surname>Oetomo</surname> <given-names>D.</given-names></name></person-group> (<year>2018</year>). <article-title>Static force dependency of bone conduction transducer as sensory feedback for stump-socket based prosthesis,</article-title> in <source>ACRA 2018 Proceedings</source> (<publisher-loc>Dearborn, MI</publisher-loc>: <publisher-name>Lincoln</publisher-name>).</citation></ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. M.</given-names></name> <name><surname>Mohammadi</surname> <given-names>A.</given-names></name> <name><surname>Alici</surname> <given-names>G.</given-names></name> <name><surname>Choong</surname> <given-names>P.</given-names></name> <name><surname>Oetomo</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Bone conduction as sensory feedback interface: a preliminary study,</article-title> in <source>41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)</source> (<publisher-loc>Berlin</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>5322</fpage>&#x02013;<lpage>5325</lpage>.<pub-id pub-id-type="pmid">31947058</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. M.</given-names></name> <name><surname>Mohammadi</surname> <given-names>A.</given-names></name> <name><surname>Tan</surname> <given-names>Y.</given-names></name> <name><surname>Alici</surname> <given-names>G.</given-names></name> <name><surname>Choong</surname> <given-names>P.</given-names></name> <name><surname>Oetomo</surname> <given-names>D.</given-names></name></person-group> (<year>2020c</year>). <article-title>Psychometric evaluation of multi-point tactile stimulation via bone conduction,</article-title> in <source>8th International Conference on Biomedical Robotics and Biomechatronics (BIOROB2020)</source> (<publisher-loc>New York, NY</publisher-loc>).</citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paterno</surname> <given-names>L.</given-names></name> <name><surname>Ibrahimi</surname> <given-names>M.</given-names></name> <name><surname>Gruppioni</surname> <given-names>E.</given-names></name> <name><surname>Menciassi</surname> <given-names>A.</given-names></name> <name><surname>Ricotti</surname> <given-names>L.</given-names></name></person-group> (<year>2018</year>). <article-title>Sockets for limb prostheses: a review of existing technologies and open challenges</article-title>. <source>IEEE Trans. Biomed. Eng</source>. <volume>65</volume>, <fpage>1996</fpage>&#x02013;<lpage>2010</lpage>. <pub-id pub-id-type="doi">10.1109/TBME.2017.2775100</pub-id><pub-id pub-id-type="pmid">29993506</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Richard</surname> <given-names>G.</given-names></name> <name><surname>Pietrzak</surname> <given-names>T.</given-names></name> <name><surname>Argelaguet</surname> <given-names>F.</given-names></name> <name><surname>L&#x000E9;cuyer</surname> <given-names>A.</given-names></name> <name><surname>Casiez</surname> <given-names>G.</given-names></name></person-group> (<year>2021</year>). <article-title>Studying the role of haptic feedback on virtual embodiment in a drawing task</article-title>. <source>Front. Virtual Reality</source> <volume>1</volume>, <fpage>573167</fpage>. <pub-id pub-id-type="doi">10.3389/frvir.2020.573167</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sanders</surname> <given-names>J. E.</given-names></name> <name><surname>Allyn</surname> <given-names>K. J.</given-names></name> <name><surname>Harrison</surname> <given-names>D. S.</given-names></name> <name><surname>Myers</surname> <given-names>T. R.</given-names></name> <name><surname>Ciol</surname> <given-names>M. A.</given-names></name> <name><surname>Tsai</surname> <given-names>E. C.</given-names></name></person-group> (<year>2012</year>). <article-title>Preliminary investigation of residual-limb fluid volume changes within one day</article-title>. <source>J. Rehabil. Res. Dev</source>. 49, 10. <pub-id pub-id-type="doi">10.1682/JRRD.2011.12.0236</pub-id><pub-id pub-id-type="pmid">23516051</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saunders</surname> <given-names>I.</given-names></name> <name><surname>Vijayakumar</surname> <given-names>S.</given-names></name></person-group> (<year>2011</year>). <article-title>The role of feed-forward and feedback processes for closed-loop prosthesis control</article-title>. <source>J. Neuroeng. Rehabil</source>. <volume>8</volume>, <fpage>1</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1186/1743-0003-8-60</pub-id><pub-id pub-id-type="pmid">22032545</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schofield</surname> <given-names>J. S.</given-names></name> <name><surname>Evans</surname> <given-names>K. R.</given-names></name> <name><surname>Carey</surname> <given-names>J. P.</given-names></name> <name><surname>Hebert</surname> <given-names>J. S.</given-names></name></person-group> (<year>2014</year>). <article-title>Applications of sensory feedback in motorized upper extremity prosthesis: a review</article-title>. <source>Expert. Rev. Med. Devices</source> <volume>11</volume>, <fpage>499</fpage>&#x02013;<lpage>511</lpage>. <pub-id pub-id-type="doi">10.1586/17434440.2014.929496</pub-id><pub-id pub-id-type="pmid">24928327</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sensinger</surname> <given-names>J. W.</given-names></name> <name><surname>Dosen</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>A review of sensory feedback in upper-limb prostheses from the perspective of human motor control</article-title>. <source>Front. Neurosci</source>. 14, 345. <pub-id pub-id-type="doi">10.3389/fnins.2020.00345</pub-id><pub-id pub-id-type="pmid">32655344</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shehata</surname> <given-names>A. W.</given-names></name> <name><surname>Rehani</surname> <given-names>M.</given-names></name> <name><surname>Jassat</surname> <given-names>Z. E.</given-names></name> <name><surname>Hebert</surname> <given-names>J. S.</given-names></name></person-group> (<year>2020</year>). <article-title>Mechanotactile sensory feedback improves embodiment of a prosthetic hand during active use</article-title>. <source>Front. Neurosci</source>. 14, 263. <pub-id pub-id-type="doi">10.3389/fnins.2020.00263</pub-id><pub-id pub-id-type="pmid">32273838</pub-id></citation></ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Stephens-Fripp</surname> <given-names>B.</given-names></name> <name><surname>Alici</surname> <given-names>G.</given-names></name> <name><surname>Mutlu</surname> <given-names>R.</given-names></name></person-group> (<year>2018</year>). <article-title>A Review of Non-Invasive Sensory Feedback Methods for Transradial Prosthetic Hands</article-title>. <source>IEEE Access</source> <volume>6</volume>:<fpage>6878</fpage>&#x02013;<lpage>6899</lpage>. <pub-id pub-id-type="doi">10.1109/ACCESS.2018.2791583</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Svensson</surname> <given-names>P.</given-names></name> <name><surname>Wijk</surname> <given-names>U.</given-names></name> <name><surname>Bj&#x000F6;rkman</surname> <given-names>A.</given-names></name> <name><surname>Antfolk</surname> <given-names>C.</given-names></name></person-group> (<year>2017</year>). <article-title>A review of invasive and non-invasive sensory feedback in upper limb prostheses</article-title>. <source>Expert Rev. Med. Devices</source> <volume>14</volume>, <fpage>439</fpage>&#x02013;<lpage>447</lpage>. <pub-id pub-id-type="doi">10.1080/17434440.2017.1332989</pub-id><pub-id pub-id-type="pmid">28532184</pub-id></citation></ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tahir</surname> <given-names>A. M.</given-names></name> <name><surname>Iqbal</surname> <given-names>J.</given-names></name> <name><surname>Aized</surname> <given-names>T.</given-names></name></person-group> (<year>2018</year>). <article-title>Human machine interface: robotizing the instinctive living</article-title>. <source>Int. Rob. Automat. J</source>. <volume>4</volume>, <fpage>1</fpage>&#x02013;<lpage>0</lpage>. <pub-id pub-id-type="doi">10.15406/iratj.2018.04.00142</pub-id></citation></ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Westling</surname> <given-names>G.</given-names></name> <name><surname>Johansson</surname> <given-names>R.</given-names></name></person-group> (<year>1984</year>). <article-title>Factors influencing the force control during precision grip</article-title>. <source>Exp. Brain Res</source>. <volume>53</volume>, <fpage>277</fpage>&#x02013;<lpage>284</lpage>. <pub-id pub-id-type="doi">10.1007/BF00238156</pub-id><pub-id pub-id-type="pmid">6705863</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wilcoxon</surname> <given-names>F.</given-names></name></person-group> (<year>1945</year>). <article-title>Individual comparisons by ranking methods</article-title>. <source>Biometr. Bull</source>. <volume>1</volume>, <fpage>80</fpage>&#x02013;<lpage>83</lpage>. <pub-id pub-id-type="doi">10.2307/3001968</pub-id></citation></ref>
</ref-list> 
</back>
</article>