Search

Objective. Closed-loop myoelectric prostheses, which combine supplementary sensory feedback and electromyography (EMG) based control, hold the potential to narrow the divide between natural and bionic hands. The use of these devices, however, requires dedicated training. Therefore, it is crucial to develop methods that quantify how users acquire skilled control over their prostheses to effectively monitor skill progression and inform the development of interfaces that optimize this process. Approach. Building on theories of skill learning in human motor control, we measured speed-accuracy tradeoff functions (SAFs) to comprehensively characterize learning-induced changes in skill-as opposed to merely tracking changes in task success across training-facilitated by a closed-loop interface that combined proportional control and EMG feedback. Sixteen healthy participants and one individual with a transradial limb loss participated in a three-day experiment where they were instructed to perform the box-and-blocks task using a timed force-matching paradigm at four specified speeds to reach two target force levels, such that the SAF could be determined. Main results. We found that the participants' accuracy increased in a similar way across all speeds we tested. Consequently, the shape of the SAF remained similar across days, at both force levels. Further, we observed that EMG feedback enabled participants to improve their motor execution in terms of reduced trial-by-trial variability, a hallmark of skilled behavior. We then fit a power law model of the SAF, and demonstrated how the model parameters could be used to identify and monitor changes in skill. Significance. We comprehensively characterized how an EMG feedback interface enabled skill acquisition, both at the level of task performance and movement execution. More generally, we believe that the proposed methods are effective for measuring and monitoring user skill progression in closed-loop prosthesis control., (Creative Commons Attribution license.)

Objective . Closed-loop prosthesis interfaces, which combine electromyography (EMG)-based control with supplementary feedback, represent a promising direction for developing the next generation of bionic limbs. However, we still lack an understanding of how users utilize these interfaces and how to evaluate competing solutions. In this study, we used the framework of speed-accuracy trade-off functions (SAF) to understand, evaluate, and compare the performance of two closed-loop user-prosthesis interfaces. Approach . Ten able-bodied participants and an amputee performed a force-matching task in a functional box-and-block setup at three different speeds. All participants were subjected to both interfaces in a crossover study design with a 1 week washout period. Importantly, both interfaces used direct proportional control but differed in the feedback provided to the participant (EMG feedback vs. Force feedback). We estimated the SAFs afforded by the two interfaces and sought to understand how the participants planned and executed the task under the various conditions. Main results . We found that execution speed significantly influenced performance, and that EMG feedback afforded better overall performance, especially at medium speeds. Notably, we found that there was a difference in the SAF between the two interfaces, with EMG feedback enabling participants to attain higher accuracies faster than Force feedback. Furthermore, both interfaces enabled participants to develop flexible control policies, while EMG feedback also afforded participants the ability to generate smoother, more repeatable EMG commands. Significance . Overall, the results indicate that the performance of closed-loop prosthesis interfaces depends critically on the feedback approach and execution speed. This study showed that the SAF framework could be used to reveal the differences between feedback approaches, which might not have been detected if the assessment was performed at a single speed. Therefore, we argue that it is important to consider the speed-accuracy trade-offs to rigorously evaluate and compare user-prosthesis interfaces., (© 2022 IOP Publishing Ltd.)

Objective. Supplemental sensory feedback for myoelectric prostheses can provide both psychosocial and functional benefits during prosthesis control. However, the impact of feedback depends on multiple factors and there is insufficient understanding about the fundamental role of such feedback in prosthesis use. The framework of human motor control enables us to systematically investigate the user-prosthesis control loop. In this study, we explore how different task objectives such as speed and accuracy shape the control policy developed by participants in a prosthesis force-matching task. Approach. Participants were randomly assigned to two groups that both used identical electromyography control interface and prosthesis force feedback, through vibrotactile stimulation, to perform a prosthesis force-matching task. However, the groups received different task objectives specifying speed and accuracy demands. We then investigated the control policies developed by the participants. To this end, we not only evaluated how successful or fast participants were but also analyzed the behavioral strategies adopted by the participants to obtain such performance gains. Main results. First, we observed that participants successfully integrated supplemental prosthesis force feedback to develop both feedforward and feedback control policies, as demanded by the task objectives. We then observed that participants who first developed a (slow) feedback policy were quickly able to adapt their policy to more stringent speed demands, by switching to a combined feedforward-feedback control strategy. However, the participants who first developed a (fast) feedforward policy were not able to change their control policy and adjust to greater accuracy demands. Significance. Overall, the results signify how the framework of human motor control can be applied to study the role of feedback in user-prosthesis interaction. The results also reveal the utility of training prosthesis users to integrate supplemental feedback into their state estimation by designing training protocols that encourage the development of combined feedforward and feedback policy., (© 2021 IOP Publishing Ltd.)

Objective. The nervous system subconsciously estimates the state of the body as a weighted average of the information from various sensory sources, where the weights reflect the perceived reliability of each source. Loss of motor functions can be partially compensated using assistive systems (e.g. prostheses), which may also restore somatosensory feedback through tactile stimulation. Whether such artificial feedback is integrated in the neural state estimation process is not known. Approach. In this study, able-bodied subjects performed a grasp force matching task with supplementary non-invasive electrotactile stimulation with a frequency proportional to grasp force magnitude. Before the task, a brief training session taught the subjects to associate the sensation of electrotactile stimulation with the generated grasp force. In some trials, the force-frequency mapping was biased to introduce an unnoticeable mismatch between natural and electrotactile force feedback, thereby provoking the subject to subconsciously estimate the force as a compromise between the two sources of information. Main results. The outcome of this compromise revealed the weights assigned to each feedback type. The grasp forces were significantly affected by the biased mappings, as indicated by the average estimated relative weights (electrotactile: 0.69 ± 0.29; natural: 0.31 ± 0.29). Across subjects, this weight was correlatedr2=0.75) with the improvement in force matching precision when adding the unbiased electrotactile feedback to the natural force feedback, as predicted by maximum likelihood estimation. This shows that even after minimal training the nervous system adopts electrotactile stimulation as a highly reliable source of information that can improve the precision in the estimation of the grip force. Significance. This result has important implications for the restoration of sensory feedback in upper limb prostheses as it indicates that even non-invasive stimulation can be integrated naturally (i.e. subconsciously and effectively) in the motor controlloop., (© 2021 IOP Publishing Ltd.)

Objective. Brain-computer interface (BCI) systems can be employed to provide motor and communication assistance to patients suffering from neuromuscular diseases, such as amyotrophic lateral sclerosis (ALS). Movement related cortical potentials (MRCPs), which are naturally generated during movement execution, can be used to implement a BCI triggered by motor attempts. Such BCI could assist impaired motor functions of ALS patients during disease progression, and facilitate the training for the generation of reliable MRCPs. The training aspect is relevant to establish a communication channel in the late stage of the disease. Therefore, the aim of this study was to investigate the possibility of detecting MRCPs associated to movement intention in ALS patients with different levels of disease progression from slight to complete paralysis. Approach. Electroencephalography signals were recorded from nine channels in 30 ALS patients at various stages of the disease while they performed or attempted to perform hand movements timed to a visual cue. The movement detection was implemented using offline classification between movement and rest phase. Temporal and spectral features were extracted using 500 ms sliding windows with 50% overlap. The detection was tested for each individual channel and two surrogate channels by performing feature selection followed by classification using linear and non-linear support vector machine and linear discriminant analysis. Main results. The results demonstrated that the detection performance was high in all patients (accuracy 80.5 ± 5.6%) but that the classification parameters (channel, features and classifier) leading to the best performance varied greatly across patients. When the same channel and classifier were used for all patients (participant-generic analysis), the performance significantly decreased (accuracy 74 ± 8.3%). Significance. The present study demonstrates that to maximize the detection of brain waves across ALS patients at different stages of the disease, the classification pipeline should be tuned to each patient individually., (© 2021 IOP Publishing Ltd.)

Objective. The implementation of somatosensory feedback in upper limb myoelectric prostheses is an important step towards the restoration of lost sensory-motor functions. EMG feedback is a recently proposed method for closing the control loop wherein the myoelectric signal that drives the prosthesis is also used to generate the feedback provided to the user. Therefore, the characteristics of the myoelectric signal (variability and sensitivity) are likely to significantly affect the ability of the subject to utilize this feedback for online control of the prosthesis. Approach. In the present study, we investigated how the cutoff frequency of the low-pass filter (0.5, 1 and 1.5 Hz) and normalization value (20%, 40% and 60% of the maximum voluntary contraction (MVC)), that are used for the generation of the myoelectric signal, affect the quality of closed-loop control with EMG feedback. Lower cutoff and normalization decrease the intrinsic variability of the EMG but also increase the time lag between the contraction and the feedback (cutoff) as well as the sensitivity of the myoelectric signal (normalization). Ten participants were asked to generate three grasp force levels with a myoelectric prosthetic hand, while receiving five-level vibrotactile EMG feedback, over nine experimental runs (all parameter combinations). Main results. The outcome measure was the success rate (SR) in achieving the appropriate level of myoelectric signal (primary outcome) and grasping force (secondary outcome). Overall, the experiments demonstrated that EMG feedback provided robust control across conditions. Nevertheless, the performance was significantly better for the lowest cutoff (0.5 Hz) and higher normalization (40% and 60%). The highest SR for the EMG was 71.9%, achieved in the condition (40% MVC and 0.5 Hz), and this was 24.1% higher than that in the condition (20% MVC and 1.5 Hz), which resulted in the lowest performance. The SR for the force followed a similar trend. Significance. This is the first study that systematically explored the parameter space for the calibration of EMG feedback, which is a critical step for the future clinical application of this approach., (© 2021 IOP Publishing Ltd.)

Objective: Artificial proprioceptive feedback from a myoelectric prosthesis is an important aspect in enhancing embodiment and user satisfaction, possibly lowering the demand for visual attention while controlling a prosthesis in everyday tasks. Contemporary myoelectric prostheses are advanced mechatronic systems with multiple degrees of freedom, and therefore, to communicate the prosthesis state, the feedback interface needs to transmit several variables simultaneously. In the present study, two different configurations for conveying proprioceptive information of wrist rotation and hand aperture through multichannel electrotactile stimulation were developed and evaluated during online myoelectric control., Approach: Myoelectric recordings were acquired from the dominant forearm and electrotactile stimulation was delivered on the non-dominant forearm using a compact interface. The first feedback configuration, which was based on spatial coding, transmitted the information using a moving tactile stimulus, whereas the second, amplitude-based configuration conveyed the position via sensation intensity. Thirteen able-bodied subjects used pattern classification-based myoelectric control with both feedback configurations to accomplish a target-reaching task., Main Results: High task performance (completion rate > 90%) was observed for both configurations, with no significant difference in completion rate, time to reach the target, distance error and path efficiency, respectively., Significance: Overall, the results demonstrated that both feedback configurations allowed subjects to perceive and interpret two feedback variables delivered simultaneously, despite using a compact stimulation interface. This is an encouraging result for the prospect of communicating the full state of a multifunctional hand prosthesis.

Objective: Brain computer interfacing (BCI) is a promising method to control assistive systems for patients with severe disabilities. Recently, we have presented a novel BCI approach that combines an electrotactile menu and a brain switch, which allows the user to trigger many commands robustly and efficiently. However, the commands are timed to periodic tactile cues and this may challenge online control. In the present study, therefore, we implemented and evaluated a novel approach for online closed-loop control using the proposed BCI., Approach: Eleven healthy subjects used the novel method to move a cursor in a 2D space. To assure robust control with properly timed commands, the BCI was integrated within a state machine allowing the subject to start the cursor movement in the selected direction and asynchronously stop the cursor. The brain switch was controlled using motor execution (ME) or imagery (MI) and the menu implemented four (straight movements) or eight commands (straight and diagonal movements)., Main Results: The results showed a high completion rate of a target hitting task (~97% and ~92% for ME and MI, respectively), with a small number of collisions, when four-channel control was used. There was no significant difference in outcome measures between MI and ME, and performance was similar for four and eight commands., Significance: These results demonstrate that the novel state-based scheme driven by a robust BCI can be successfully utilized for online control. Therefore, it can be an attractive solution for providing the user an online-control interface with many commands, which is difficult to achieve using classic BCI solutions.

Objective: We propose, design and test a novel thin-film multichannel electrode that can be used for both recording from and stimulating a muscle in acute implants., Approach: The system is built on a substrate of polyimide and contains 12 recording and three stimulation sites made of platinum. The structure is 420 µm wide, 20 µm thick and embeds the recording and stimulation contacts on the two sides of the polyimide over an approximate length of 2 cm. We show representative applications in healthy individuals as well as tremor patients. The designed system was tested by a psychometric characterization of the stimulation contacts in six tremor patients and three healthy individuals determining the perception threshold and current limit as well as the success rate in discriminating elicited sensations (electrotactile feedback). Also, we investigated the possibility of using the intramuscular electrode for reducing tremor in one patient by electrical stimulation delivered with timing based on the electromyographic activity recorded with the same electrode., Main Results: In the tremor patients, the current corresponding to the perception threshold and the current limit were 0.7  ±  0.2 and 1.4  ±  0.7 mA for the wrist flexor muscles and 0.4  ±  0.2 and 1.5  ±  0.7 mA for the extensors. In one patient, closed-loop stimulation resulted in a decrease of the tremor power  >50%. In healthy individuals the perception threshold and current limits were 0.9  ±  0.6 and 2.1  ±  0.6 mA for the extensor carpi radialis muscle. The subjects could distinguish four or six stimulation patterns (two or three stimulation sites  ×  two stimulation current amplitudes) with true positive rate  >80% (two subjects) and  >60% (one subject), respectively., Significance: The proposed electrode provides a compact multichannel interface for recording electromyogram and delivering electrical stimulation in applications such as neuroprostheses for tremor suppression and closed-loop myoelectric prostheses.

Objective: Dexterous upper-limb prostheses are available today to restore grasping, but an effective and reliable feed-forward control is still missing. The aim of this work was to improve the robustness and reliability of myoelectric control by using context information from sensors embedded within the prosthesis., Approach: We developed a context-driven myoelectric control scheme (cxMYO) that incorporates the inference of context information from proprioception (inertial measurement unit) and exteroception (force and grip aperture) sensors to modulate the outputs of myoelectric control. Further, a realistic evaluation of the cxMYO was performed online in able-bodied subjects using three functional tasks, during which the cxMYO was compared to a purely machine-learning-based myoelectric control (MYO)., Main Results: The results demonstrated that utilizing context information decreased the number of unwanted commands, improving the performance (success rate and dropped objects) in all three functional tasks. Specifically, the median number of objects dropped per round with cxMYO was zero in all three tasks and a significant increase in the number of successful transfers was seen in two out of three functional tasks. Additionally, the subjects reported better user experience., Significance: This is the first online evaluation of a method integrating information from multiple on-board prosthesis sensors to modulate the output of a machine-learning-based myoelectric controller. The proposed scheme is general and presents a simple, non-invasive and cost-effective approach for improving the robustness of myoelectric control.

Objective: Providing sensory feedback to the user of the prosthesis is an important challenge. The common approach is to use tactile stimulation, which is easy to implement but requires training and has limited information bandwidth. In this study, we propose an alternative approach based on augmented reality., Approach: We have developed the GLIMPSE, a Google Glass application which connects to the prosthesis via a Bluetooth interface and renders the prosthesis states (EMG signals, aperture, force and contact) using augmented reality (see-through display) and sound (bone conduction transducer). The interface was tested in healthy subjects that used the prosthesis with (FB group) and without (NFB group) feedback during a modified clothespins test that allowed us to vary the difficulty of the task. The outcome measures were the number of unsuccessful trials, the time to accomplish the task, and the subjective ratings of the relevance of the feedback., Main Results: There was no difference in performance between FB and NFB groups in the case of a simple task (basic, same-color clothespins test), but the feedback significantly improved the performance in a more complex task (pins of different resistances). Importantly, the GLIMPSE feedback did not increase the time to accomplish the task. Therefore, the supplemental feedback might be useful in the tasks which are more demanding, and thereby less likely to benefit from learning and feedforward control. The subjects integrated the supplemental feedback with the intrinsic sources (vision and muscle proprioception), developing their own idiosyncratic strategies to accomplish the task., Significance: The present study demonstrates a novel self-contained, ready-to-deploy, wearable feedback interface. The interface was successfully tested and was proven to be feasible and functionally beneficial. The GLIMPSE can be used as a practical solution but also as a general and flexible instrument to investigate closed-loop prosthesis control.

Objective: A drawback of active prostheses is that they detach the subject from the produced forces, thereby preventing direct mechanical feedback. This can be compensated by providing somatosensory feedback to the user through mechanical or electrical stimulation, which in turn may improve the utility, sense of embodiment, and thereby increase the acceptance rate., Approach: In this study, we compared a novel approach to closing the loop, namely EMG feedback (emgFB), to classic force feedback (forceFB), using electrotactile interface in a realistic task setup. Eleven intact-bodied subjects and one transradial amputee performed a routine grasping task while receiving emgFB or forceFB. The two feedback types were delivered through the same electrotactile interface, using a mixed spatial/frequency coding to transmit 8 discrete levels of the feedback variable. In emgFB, the stimulation transmitted the amplitude of the processed myoelectric signal generated by the subject (prosthesis input), and in forceFB the generated grasping force (prosthesis output). The task comprised 150 trials of routine grasping at six forces, randomly presented in blocks of five trials (same force). Interquartile range and changes in the absolute error (AE) distribution (magnitude and dispersion) with respect to the target level were used to assess precision and overall performance, respectively., Main Results: Relative to forceFB, emgFB significantly improved the precision of myoelectric commands (min/max of the significant levels) for 23%/36% as well as the precision of force control for 12%/32%, in intact-bodied subjects. Also, the magnitude and dispersion of the AE distribution were reduced. The results were similar in the amputee, showing considerable improvements., Significance: Using emgFB, the subjects therefore decreased the uncertainty of the forward pathway. Since there is a correspondence between the EMG and force, where the former anticipates the latter, the emgFB allowed for predictive control, as the subjects used the feedback to adjust the desired force even before the prosthesis contacted the object. In conclusion, the online emgFB was superior to the classic forceFB in realistic conditions that included electrotactile stimulation, limited feedback resolution (8 levels), cognitive processing delay, and time constraints (fast grasping).

Objective: Closing the loop in myoelectric prostheses by providing artificial somatosensory feedback to the user is an important need for prosthetic users. Previous studies investigated feedback strategies in combination with the control of one degree of freedom of simple grippers. Modern hands, however, are sophisticated multifunction systems. In this study, we assessed multichannel electrotactile feedback integrated with an advanced method for the simultaneous and proportional control of individual fingers of a dexterous hand., Approach: The feedback used spatial and frequency coding to provide information on the finger positions (normalized flexion angles). A comprehensive set of conditions have been investigated in 28 able-bodied subjects, including feedback modalities (visual, electrotactile and no feedback), control tasks (fingers and grasps), systems (virtual and real hand), control methods (ideal and realistic) and range of motion (low and high). The task for the subjects was to operate the hand using closed-loop myoelectric control and generate the desired movement (e.g., selected finger or grasp at a specific level of closure)., Main Results: The subjects could perceive the multichannel and multivariable electrotactile feedback and effectively exploit it to improve the control performance with respect to open-loop grasping. The improvement however depended on the reliability of the feedforward control, with less consistent control exhibiting performance trends that were more complex across the conditions., Significance: The results are promising for the potential application of advanced feedback to close the control loop in sophisticated prosthetic systems.

Objective: Myoelectric activity volitionally generated by the user is often used for controlling hand prostheses in order to replicate the synergistic actions of muscles in healthy humans during grasping. Muscle synergies in healthy humans are based on the integration of visual perception, heuristics and proprioception. Here, we demonstrate how sensor fusion that combines artificial vision and proprioceptive information with the high-level processing characteristics of biological systems can be effectively used in transradial prosthesis control., Approach: We developed a novel context- and user-aware prosthesis (CASP) controller integrating computer vision and inertial sensing with myoelectric activity in order to achieve semi-autonomous and reactive control of a prosthetic hand. The presented method semi-automatically provides simultaneous and proportional control of multiple degrees-of-freedom (DOFs), thus decreasing overall physical effort while retaining full user control. The system was compared against the major commercial state-of-the art myoelectric control system in ten able-bodied and one amputee subject. All subjects used transradial prosthesis with an active wrist to grasp objects typically associated with activities of daily living., Main Results: The CASP significantly outperformed the myoelectric interface when controlling all of the prosthesis DOF. However, when tested with less complex prosthetic system (smaller number of DOF), the CASP was slower but resulted with reaching motions that contained less compensatory movements. Another important finding is that the CASP system required minimal user adaptation and training., Significance: The CASP constitutes a substantial improvement for the control of multi-DOF prostheses. The application of the CASP will have a significant impact when translated to real-life scenarious, particularly with respect to improving the usability and acceptance of highly complex systems (e.g., full prosthetic arms) by amputees.

Objective: Technologically advanced assistive devices are nowadays available to restore grasping, but effective and effortless control integrating both feed-forward (commands) and feedback (sensory information) is still missing. The goal of this work was to develop a user friendly interface for the semi-automatic and closed-loop control of grasping and to test its feasibility., Approach: We developed a controller based on stereovision to automatically select grasp type and size and augmented reality (AR) to provide artificial proprioceptive feedback. The system was experimentally tested in healthy subjects using a dexterous hand prosthesis to grasp a set of daily objects. The subjects wore AR glasses with an integrated stereo-camera pair, and triggered the system via a simple myoelectric interface., Main Results: The results demonstrated that the subjects got easily acquainted with the semi-autonomous control. The stereovision grasp decoder successfully estimated the grasp type and size in realistic, cluttered environments. When allowed (forced) to correct the automatic system decisions, the subjects successfully utilized the AR feedback and achieved close to ideal system performance., Significance: The new method implements a high level, low effort control of complex functions in addition to the low level closed-loop control. The latter is achieved by providing rich visual feedback, which is integrated into the real life environment. The proposed system is an effective interface applicable with small alterations for many advanced prosthetic and orthotic/therapeutic rehabilitation devices.