Search

This study demonstrates the feasibility of detecting motor intent from brain activity of chronic stroke patients using an asynchronous electroencephalography (EEG)-based brain machine interface (BMI). Intent was inferred from movement related cortical potentials (MRCPs) measured over an optimized set of EEG electrodes. Successful intent detection triggered the motion of an upper-limb exoskeleton (MAHI Exo-II), to guide movement and to encourage active user participation by providing instantaneous sensory feedback. Several BMI design features were optimized to increase system performance in the presence of single-trial variability of MRCPs in the injured brain: 1) an adaptive time window was used for extracting features during BMI calibration; 2) training data from two consecutive days were pooled for BMI calibration to increase robustness to handle the day-to-day variations typical of EEG, and 3) BMI predictions were gated by residual electromyography (EMG) activity from the impaired arm, to reduce the number of false positives. This patient-specific BMI calibration approach can accommodate a broad spectrum of stroke patients with diverse motor capabilities. Following BMI optimization on day 3, testing of the closed-loop BMI-MAHI exoskeleton, on 4th and 5th days of the study, showed consistent BMI performance with overall mean true positive rate (TPR) = 62.7 +/- 21.4 % on day 4 and 67.1 +/- 14.6 % on day 5. The overall false positive rate (FPR) across subjects was 27.74 +/- 37.46 % on day 4 and 27.5 +/- 35.64 % on day 5; however for two subjects who had residual motor function and could benefit from the EMG-gated BMI, the mean FPR was quite low (< 10 %). On average, motor intent was detected -367 +/- 328 ms before movement onset during closed-loop operation. These findings provide evidence that closed-loop EEG-based BMI for stroke patients can be designed and optimized to perform well across multiple days without system recalibration.

Wearable haptic devices transmit information via touch receptors in the skin, yet devices located on parts of the body with high densities of receptors, such as fingertips and hands, impede interactions. Other locations that are well‐suited for wearables, such as the wrists and arms, suffer from lower perceptual sensitivity. The emergence of textile‐based wearable devices introduces new techniques of fabrication that can be leveraged to address these constraints and enable new modes of haptic interactions. This article formalizes the concept of “multiscale” interaction, an untapped paradigm for haptic wearables, enabling enhanced delivery of information via textile‐based haptic modules. In this approach, users choose the depth and detail of their haptic experiences by varying their interaction mode. Flexible prototyping methods enable multiscale haptic bands that provide both body‐scale interactions (on the forearm) and hand‐scale interactions (on the fingers and palm). A series of experiments assess participants’ ability to identify pressure states and spatial locations delivered by these bands across these interaction scales. A final experiment demonstrates the encoding of three‐bit information into prototypical multiscale interactions, showcasing the paradigm's efficacy. This research lays the groundwork for versatile haptic communication and wearable design, offering users the ability to select interaction modes for receiving information.

Transcutaneous spinal stimulation (TSS) is a promising rehabilitative intervention to restore motor function and coordination for individuals with spinal cord injury (SCI). The effects of TSS are most commonly assessed by evaluating muscle response to stimulation using surface electromyography (sEMG). Given the increasing use of robotic devices to deliver therapy and the emerging potential of hybrid rehabilitation interventions that combine neuromodulation with robotic devices, there is an opportunity to leverage the on-board sensors of the robots to measure kinematic and torque changes of joints in the presence of stimulation. This paper explores the potential for robotic assessment of the effects of TSS delivered to the cervical spinal cord. We used a four degree-of-freedom exoskeleton to measure the torque response of upper limb (UL) joints during stimulation, while simultaneously recording sEMG. We analyzed joint torque and electromyography data generated during TSS delivered over individual sites of the cervical spinal cord in neurologically intact participants. We show that site-specific effects of TSS are manifested not only by modulation of the amplitude of spinally evoked motor potentials in UL muscles, but also by changes in torque generated by individual UL joints. We observed preferential resultant action of proximal muscles and joints with stimulation at the rostral site, and of proximal joints with rostral-lateral stimulation. Robotic assessment can be used to measure the effects of TSS, and could be integrated into complex control algorithms that govern the behavior of hybrid neuromodulation-robotic systems.

Individuals who have suffered a spinal cord injury often require assistance to complete daily activities, and for individuals with tetraplegia, recovery of upper-limb function is among their top priorities. Hybrid functional electrical stimulation (FES) and exoskeleton systems have emerged as a potential solution to provide upper limb movement assistance. These systems leverage the user’s own muscles via FES and provide additional movement support via an assistive exoskeleton. To date, these systems have focused on single joint movements, limiting their utility for the complex movements necessary for independence. In this paper, we extend our prior work on model predictive control (MPC) of hybrid FES-exo systems and present a multi degree of freedom (DOF) hybrid controller that uses the controller’s cost function to achieve desired behavior. In studies with neurologically intact individuals, the hybrid controller is compared to an exoskeleton acting alone for movement assistance scenarios incorporating multiple degrees-of-freedom of the limb to explore the potential for exoskeleton power consumption reduction and impacts on tracking accuracy. Additionally, each scenario is explored in simulation using the models required to generate the MPC formulation. The two DOF hybrid controller implementation saw reductions in power consumption and satisfactory trajectory tracking in both the physical and simulated systems. In the four DOF implementation, the experimental results showed minor improvements for some joints of the upper limb. In simulation, we observed comparable performance as in the two DOF implementation.

Recent advances in extended reality (XR) technologies make seeing and hearing virtual objects commonplace, yet strategies for synthesizing haptic interactions with virtual objects continue to be limited. Two design principles govern the rendering of believable and intuitive haptic feedback: movement through open space must feel “free” while contact with virtual objects must feel stiff. Herein, a novel multisensory approach that conveys proprioception and effort through illusory visual feedback and refers to the wrist, via a bracelet interface, discrete and continuous interaction forces that would otherwise occur at the hands and fingertips, is presented. Results demonstrate that users reliably discriminate the stiffness of virtual buttons when provided with multisensory pseudohaptic feedback, comprising tactile pseudohaptic feedback (discrete vibrotactile feedback and continuous squeeze cues in a bracelet interface) and visual pseudohaptic illusions of touch interactions. Compared to the use of tactile or visual pseudohaptic feedback alone, multisensory pseudohaptic feedback expands the range of physical stiffnesses that are intuitively associated with the rendered virtual interactions and reduces individual differences in physical‐to‐virtual stiffness mappings. This multisensory approach, which leaves users' hands unencumbered, provides a flexible framework for synthesizing a wide array of touch‐enabled interactions in XR, with great potential for enhancing user experiences.

IntroductionIndividuals who have suffered a cervical spinal cord injury prioritize the recovery of upper limb function for completing activities of daily living. Hybrid FES-exoskeleton systems have the potential to assist this population by providing a portable, powered, and wearable device; however, realization of this combination of technologies has been challenging. In particular, it has been difficult to show generalizability across motions, and to define optimal distribution of actuation, given the complex nature of the combined dynamic system.MethodsIn this paper, we present a hybrid controller using a model predictive control (MPC) formulation that combines the actuation of both an exoskeleton and an FES system. The MPC cost function is designed to distribute actuation on a single degree of freedom to favor FES control effort, reducing exoskeleton power consumption, while ensuring smooth movements along different trajectories. Our controller was tested with nine able-bodied participants using FES surface stimulation paired with an upper limb powered exoskeleton. The hybrid controller was compared to an exoskeleton alone controller, and we measured trajectory error and torque while moving the participant through two elbow flexion/extension trajectories, and separately through two wrist flexion/extension trajectories.ResultsThe MPC-based hybrid controller showed a reduction in sum of squared torques by an average of 48.7 and 57.9% on the elbow flexion/extension and wrist flexion/extension joints respectively, with only small differences in tracking accuracy compared to the exoskeleton alone.DiscussionTo realize practical implementation of hybrid FES-exoskeleton systems, the control strategy requires translation to multi-DOF movements, achieving more consistent improvement across participants, and balancing control to more fully leverage the muscles' capabilities.