Search

The increasing use of smart technical devices in our everyday lives has necessitated the use of muscle-machine interfaces (MuMI) that are intuitive and that can facilitate immersive interactions with these devices. The most common method to develop MuMIs is using Electromyography (EMG) based signals. However, due to several drawbacks of EMG-based interfaces, alternative methods to develop MuMI are being explored. In our previous work, we presented a new MuMI called Lightmyography (LMG), which achieved outstanding results compared to a classic EMG-based interface in a five-gesture classification task. In this study, we extend our previous work experimentally validating the efficiency of the LMG armband in classifying thirty-two different gestures from six participants using a deep learning technique called Temporal Multi-Channel Vision Transformers (TMC-ViT). The efficiency of the proposed model was assessed using accuracy. Moreover, two different undersampling techniques are compared. The proposed thirty-two-gesture classifiers achieve accuracies as high as 92%. Finally, we employ the LMG interface in the real-time control of a robotic hand using ten different gestures, successfully reproducing several grasp types from taxonomy grasps presented in the literature.

The need for more practical, robust, and affordable prosthetic hands for amputees has led to significant advancements in their functionality. However, the challenge of designing prostheses that balance dexterity, functionality, and affordability still persists. The lack of prosthetic designs that can efficiently address the needs of amputees for both heavy manual labor and social interactions, while also being lightweight and dexterous, is still evident. This paper presents a design for an anthropomorphic, adaptive, lightweight, body-powered prosthetic hand built for performing Activities of Daily Living using a selectively lockable differential mechanism. The proposed differential mechanism allows the users to flex and lock the prosthesis' fingers in a wide range of poses and grasps. The performance of the body-powered prosthesis is experimentally validated with three different types of experiments: i) object grasping, ii) total grasping strength, and iii) individual finger force exertion. The resultant prosthetic hand is lightweight and comfortable to wear and is adequately capable of grasping a wide range of objects, including items commonly used in cleaning and cooking applications where waterproofness is essential.

Currently, ~ 1.5 million American deaf-blind individuals depend on the availability of interpreting services to communicate in their primary conversational language, tactile American Sign Language (ASL). In an effort to give the deaf-blind community access to a device that facilitates independent communication using tactile ASL, we developed TATUM (Tactile ASL Translational User Mechanism). TATUM employs 15 degrees of actuation in a hand-wrist system that is capable of signing the 26-letter ASL alphabet. Leveraging Interpres, an independent cloud-based service, all servo sequences that render desired fingerspelled letters and ASL words are stored in a web application programming interface (API). A validation study including both deaf and deaf-blind participants confirmed that the TATUM hand mimics a human hand both in size and feel. The current design of TATUM attained an average recognition rate of 94.7% in visual validation, indicative of the potential to support deaf and deaf-blind individuals in communicating via visual and tactile ASL.

Recognising and classifying human hand gestures is important for effective communication between humans and machines in applications such as human-robot interaction, human to robot skill transfer, and control of prosthetic devices. Although there are already many interfaces that enable decoding of the intention and action of humans, they are either bulky or they rely on techniques that need careful positioning of the sensors, causing inconvenience when the system needs to be used in real-life scenarios and environments. Moreover, electromyography (EMG), which is the most commonly used technique, captures EMG signals that have a nonlinear relationship with the human intention and motion. In this work, we present lightmyography (LMG) a new muscle machine interfacing method for decoding human intention and motion. Lightmyography utilizes light propagation through elastic media and the change of light luminosity to detect silicone deformation. Lightmyography is similar to forcemyography in the sense that they both record muscular contractions through skin displacements. In order to experimentally validate the efficiency of the proposed method, we designed an interface consisting of five LMG sensors to perform gesture classification experiments. Using this device, we were able to accurately detect a series of different hand postures and gestures. We also compared LMG data with processed EMG data.

With an increasing number of robotic and prosthetic devices, there is a need for intuitive Muscle-Machine Interfaces (MuMIs) that allow the user to have an embodied interaction with the devices they are controlling. Such MuMIs can be developed using machine learning based methods that utilize myoelectric activations from the muscles of the user to decode their intention. However, the choice of the learning method is subjective and depends on the features extracted from the raw Electromyography signals as well as on the intended application. In this work, we compare the performance of five machine learning methods and eight time-domain feature extraction techniques in discriminating between different gestures executed by the user of an EMG based MuMI. From the results, it can be seen that the Willison Amplitude performs consistently better for all the machine learning methods compared in this study, while the Zero Crossings achieves the worst results for the Decision Trees and the Random Forests and the Variance offers the worst performance for all the other learning methods. The Random Forests method is shown to achieve the best results in terms of achieved accuracies (has the lowest variance between subjects). In order to experimentally validate the efficiency of the Random Forest classifier and the Willison Amplitude technique, a series of gestures were decoded in a real-time manner from the myoelectric activations of the operator and they were used to control a robot hand.

Adaptive, tendon-driven and affordable prosthetic devices have received an increased interest over the last decades. Prosthetic devices range from body-powered solutions to fully actuated systems. Despite the significant progress in the field, most existing solutions are expensive, heavy, and bulky, or they cannot be used for partial hand amputations. In this paper, we focus on the development of adaptive, tendon-driven, glove-based, affordable prostheses for partial hand amputations and we propose two compact and lightweight devices (a body powered and a motor driven version). The efficiency of the devices is experimentally validated and their performance is evaluated using two different types of tests: i) grasping tests that involve different everyday objects and ii) tests that assess the force exertion capabilities of the proposed prostheses.

Soft, underactuated, and wearable robotic exo-gloves have received an increased interest over the last years. These devices can be used to improve the capabilities of healthy individuals or to assist people that suffer from neurological and musculoskeletal diseases. Despite the significant progress in the field, most existing solutions are still heavy and expensive, they require an external power source to operate, and they are not wearable. In this paper, we focus on the development of an affordable, underactuated, tendon-driven, wearable exo-glove equipped with a novel four-output differential mechanism that provides grasping capabilities enhancement to the user. The device and the differential mechanism are experimentally tested and assessed using three different types of experiments: i) grasping tests that involve different everyday objects, ii) force exertion capability tests that assess the fingertip forces for different types of grasps, and iii) tendon tension tests that estimate the maximum tendon tension that can be obtained by employing the proposed differential. The device considerably improves the grasping capabilities of the user with a weight of 690 g and an operation autonomy of a whole day.

The field of Brain Machine Interfaces (BMI) has attracted an increased interest due to its multiple applications in the health and entertainment domains. A BMI enables a direct interface between the brain and machines and is capable of translating neuronal information into meaningful actions (e.g., Electromyography based control of a prosthetic hand). One of the biggest challenges in developing a surface Electromyography (sEMG) based interface is the selection of the right muscles for the execution of a desired task. In this work, we investigate optimal muscle selections for sEMG based decoding of dexterous in-hand manipulation motions. To do that, we use EMG signals derived from 14 muscle sites of interest (7 on the hand and 7 on the forearm) and an optical motion capture system that records the object motion. The regression problem is formulated using the Random Forests methodology that is based on decision trees. Regarding features selection, we use the following time-domain features: root mean square, waveform length and zero crossings. A 5-fold cross validation procedure is used for model assessment purposes and the importance values are calculated for each feature. This pilot study shows that the muscles of the hand contribute more than the muscles of the forearm to the execution of inhand manipulation tasks and that the myoelectric activations of the hand muscles provide better estimation accuracies for the decoding of manipulation motions. These outcomes suggest that the loss of the hand muscles in certain amputations limits the amputees' ability to perform a dexterous, EMG based control of a prosthesis in manipulation tasks. The results discussed can also be used for improving the efficiency and intuitiveness of EMG based interfaces for healthy subjects.

In this paper we present a series of design directions for the development of affordable, compliant, modular, underactuated robot fingers, that can be used as prostheses by amputees that suffer from various partial hand amputations (index to pinky fingers are considered). Our design is based on parametric models that have been derived from hand anthropometry studies. Various interfaces have been considered in order to control the prosthesis, depending on the type and level of amputation. More precisely: 1) An Electromyography (EMG) based interface is used to control the robot fingers employing the EMG signals of the human forearm muscles 2) A flex sensors based interface is used to record the motion of the intact finger/fingers and predict the motion of the prosthesis implementing a synergistic behavior in an efficient manner, 3) A body powered interface is used for those that want to achieve even lower cost, with robust intuitive operation. Following the proposed design directions, an amputee will be able to replicate our fingers and develop personalized, affordable, light-weight but yet efficient prostheses.