Search

This study delves into decoding hand gestures using surface electromyography (EMG) signals collected via a precision Myo-armband sensor, leveraging machine learning algorithms. The research entails rigorous data preprocessing to extract features and labels from raw EMG data. Following partitioning into training and testing sets, four traditional machine learning models are scrutinized for their efficacy in classifying finger movements across seven distinct gestures. The analysis includes meticulous parameter optimization and five-fold cross-validation to evaluate model performance. Among the models assessed, the Random Forest emerges as the top performer, consistently delivering superior precision, recall, and F1-score values across gesture classes, with ROC-AUC scores surpassing 99%. These findings underscore the Random Forest model as the optimal classifier for our EMG dataset, promising significant advancements in healthcare rehabilitation engineering and enhancing human-computer interaction technologies.

Nowadays, surface electromyography (sEMG) is evolving as a technology for hand gesture recognition. Detailed studies have revealed the capacity of EMG signals to access detailed information, particularly in the classification of hand gestures. Indeed, this advancement emerges as an interesting element in refining the recognition and interpretation of sign languages and exploring deeper into the phonology of signed languages. Aligned with this advancement and the need for a reliable and mobile sign language recognition system, we introduce a specialized sEMG dataset, acquired using the Myo armband. This device is adept at capturing recordings at frequencies of up to 200 Hz. The dataset focuses on the 28 letters of the Arabic alphabet and 10 digits using hand gestures, with each gesture captured into 400 frames. This considerable collection of 18,716 samples was achieved with the cooperation of three contributors, providing a varied and comprehensive range of gestural data., (© 2023 The Author(s).)

Background: Muscle strength and dexterity impairments are common among patients with multiple sclerosis (MS) producing limitations in activities of daily living related to the upper limb (UL). This study aimed to evaluate the effectiveness of serious games specifically developed for the MYO Armband® capture sensor in improving forearm and wrist mobility, UL muscle strength, dexterity, fatigue, functionality, quality of life, satisfaction, adverse effects and compliance., Methods: A double-blinded (allocation concealment was performed by a blinded investigator and by blinding for assessors) randomised controlled trial was conducted. The sample was randomised into two groups: an experimental group that received treatment based on UL serious games designed by the research team and controlled by the MYO Armband® gesture capture sensor, along with conventional rehabilitation and a control group that received the same conventional rehabilitation for the UL. Both groups received two 60-min sessions per week over an eight-week period. Wrist range of motion (goniometry), grip muscle strength (Jamar® dynamometer), coordination and gross UL dexterity (Box and Block Test), fatigue (Fatigue Severity Scale), functionality (ABILHAND), quality of life (Multiple Sclerosis Impact Scale-29), adverse effects (Simulator Sickness Questionnaire, SSQ), perceived workload (NASA-Task load index), satisfaction (Client Satisfaction Questionnaire-8 (CSQ-8), Satisfaction with Technology Scale, System Usability Scale (SUS) and QUEST 2.0) and compliance (attendance) were assessed in both groups pre-treatment, post-treatment and during a follow-up period of 2 weeks without receiving any treatment., Results: Significant differences were observed in the experimental group compared to the control group in the assessment of forearm supination (p = .004) and grip strength (p = .004). Adverse effects were minimal (SSQ: 7/100 points) and perceived workload was low (NASA-Task Load Index: 25/100 points) in the experimental group. The MYO Armband® technology proved to be useful for the participants (SUS: 80.66/100) and the satisfaction scales received high scores (QUEST 2.0: 59.4/70 points; Satisfaction with Technology: 84.36/100 points). There were significant differences between the groups in terms of attendance percentage (p = .029)., Conclusions: An experimental protocol using MYO Armband®-based serious games designed for UL rehabilitation showed improvements in active wrist range of motion and handgrip strength in patients with MS, with high satisfaction, minimal adverse effects and workload and excellent compliance., Trial Registration Number: This randomised controlled trial has been registered at ClinicalTrials.gov Identifier: NCT04171908., (© 2023. BioMed Central Ltd., part of Springer Nature.)

Purpose: For an in-depth analysis of the learning benefits that a stereoscopic view presents during endoscopic training, surgeons required a custom surgical evaluation system enabling simulator independent evaluation of endoscopic skills. Automated surgical skill assessment is in dire need since supervised training sessions and video analysis of recorded endoscope data are very time-consuming. This paper presents a first step towards a multimodal training evaluation system, which is not restricted to certain training setups and fixed evaluation metrics., Methods: With our system we performed data fusion of motion and muscle-action measurements during multiple endoscopic exercises. The exercises were performed by medical experts with different surgical skill levels, using either two or three-dimensional endoscopic imaging. Based on the multi-modal measurements, training features were calculated and their significance assessed by distance and variance analysis. Finally, the features were used automatic classification of the used endoscope modes., Results: During the study, 324 datasets from 12 participating volunteers were recorded, consisting of spatial information from the participants' joint and right forearm electromyographic information. Feature significance analysis showed distinctive significance differences, with amplitude-related muscle information and velocity information from hand and wrist being among the most significant ones. The analyzed and generated classification models exceeded a correct prediction rate of used endoscope type accuracy rate of 90%., Conclusion: The results support the validity of our setup and feature calculation, while their analysis shows significant distinctions and can be used to identify the used endoscopic view mode, something not apparent when analyzing time tables of each exercise attempt. The presented work is therefore a first step toward future developments, with which multivariate feature vectors can be classified automatically in real-time to evaluate endoscopic training and track learning progress., (© 2022. The Author(s).)

Background: The ability to perform activities of daily living (ADL) is essential to preserving functional independence and quality of life. In recent years, rehabilitation strategies based on new technologies, such as MYO Armband ® , have been implemented to improve dexterity in people with upper limb impairment. Over the last few years, many studies have been published focusing on the accuracy of the MYO Armband ® to capture electromyographic and inertial data, as well as the clinical effects of using it as a rehabilitation tool in people with loss of upper limb function. Nevertheless, to our knowledge, there has been no systematic review of this subject., Methods: A systematically comprehensive literature search was conducted in order to identify original studies that answered the PICO question (patient/population, intervention, comparison, and outcome): What is the accuracy level and the clinical effects of the MYO Armband ® in people with motor impairment of the upper limb compared with other assessment techniques or interventions or no intervention whatsoever? The following data sources were used: Pubmed, Scopus, Web of Science, ScienceDirect, Physiotherapy Evidence Database, and the Cochrane Library. After identifying the eligible articles, a cross-search of their references was also completed for additional studies. The following data were extracted from the papers: study design, disease or condition, intervention, sample, dosage, outcome measures or data collection procedure and data analysis and results. The authors independently collected these data following the CONSORT 2010 statement when possible, and eventually reached a consensus on the extracted data, resolving disagreements through discussion. To assess the methodological quality of papers included, the tool for the critical appraisal of epidemiological cross-sectional studies was used, since only case series studies were identified after the search. Additionally, the articles were classified according to the levels of evidence and grades of recommendation for diagnosis studies established by the Oxford Center for Evidence-Based Medicine. Also, The Cochrane Handbook for Systematic Reviews of Interventions was used by two independent reviewers to assess risk of bias, assessing the six different domains. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was followed to carry out this review., Results: 10 articles with a total 180 participants were included in the review. The characteristics of included studies, sample and intervention characteristics, outcome measures, the accuracy of the system and effects of the interventions and the assessment of methodological quality of the studies and risk of bias are shown., Conclusions: Therapy with the MYO Armband ® has shown clinical changes in range of motion, dexterity, performance, functionality and satisfaction. It has also proven to be an accurate system to capture signals from the forearm muscles in people with motor impairment of the upper limb. However, further research should be conducted using bigger samples, well-defined protocols, comparing with control groups or comparing with other assessment or therapeutic tools, since the studies published so far present a high risk of bias and low level of evidence and grade of recommendation.

Hand gesture recognition (HGR) systems using electromyography (EMG) bracelet-type sensors are currently largely used over other HGR technologies. However, bracelets are susceptible to electrode rotation, causing a decrease in HGR performance. In this work, HGR systems with an algorithm for orientation correction are proposed. The proposed orientation correction method is based on the computation of the maximum energy channel using a synchronization gesture. Then, the channels of the EMG are rearranged in a new sequence which starts with the maximum energy channel. This new sequence of channels is used for both training and testing. After the EMG channels are rearranged, this signal passes through the following stages: pre-processing, feature extraction, classification, and post-processing. We implemented user-specific and user-general HGR models based on a common architecture which is robust to rotations of the EMG bracelet. Four experiments were performed, taking into account two different metrics which are the classification and recognition accuracy for both models implemented in this work, where each model was evaluated with and without rotation of the bracelet. The classification accuracy measures how well a model predicted which gesture is contained somewhere in a given EMG, whereas recognition accuracy measures how well a model predicted when it occurred, how long it lasted, and which gesture is contained in a given EMG. The results of the experiments (without and with orientation correction) executed show an increase in performance from 44.5% to 81.2% for classification and from 43.3% to 81.3% for recognition in user-general models, while in user-specific models, the results show an increase in performance from 39.8% to 94.9% for classification and from 38.8% to 94.2% for recognition. The results obtained in this work evidence that the proposed method for orientation correction makes the performance of an HGR robust to rotations of the EMG bracelet.

This work discusses a novel human-robot interface for a climbing robot for inspecting weld beads in storage tanks in the petrochemical industry. The approach aims to adapt robot autonomy in terms of the operator's experience, where a remote industrial joystick works in conjunction with an electromyographic armband as inputs. This armband is worn on the forearm and can detect gestures from the operator and rotation angles from the arm. Information from the industrial joystick and the armband are used to control the robot via a Fuzzy controller. The controller works with sliding autonomy (using as inputs data from the angular velocity of the industrial controller, electromyography reading, weld bead position in the storage tank, and rotation angles executed by the operator's arm) to generate a system capable of recognition of the operator's skill and correction of mistakes from the operator in operating time. The output from the Fuzzy controller is the level of autonomy to be used by the robot. The levels implemented are Manual (operator controls the angular and linear velocities of the robot); Shared (speeds are shared between the operator and the autonomous system); Supervisory (robot controls the angular velocity to stay in the weld bead, and the operator controls the linear velocity); Autonomous (the operator defines endpoint and the robot controls both linear and angular velocities). These autonomy levels, along with the proposed sliding autonomy, are then analyzed through robot experiments in a simulated environment, showing each of these modes' purposes. The proposed approach is evaluated in virtual industrial scenarios through real distinct operators.

In this paper, a customizable wearable 3D-printed bionic arm is designed, fabricated, and optimized for a right arm amputee. An experimental test has been conducted for the user, where control of the artificial bionic hand is accomplished successfully using surface electromyography (sEMG) signals acquired by a multi-channel wearable armband. The 3D-printed bionic arm was designed for the low cost of 295 USD, and was lightweight at 428 g. To facilitate a generic control of the bionic arm, sEMG data were collected for a set of gestures (fist, spread fingers, wave-in, wave-out) from a wide range of participants. The collected data were processed and features related to the gestures were extracted for the purpose of training a classifier. In this study, several classifiers based on neural networks, support vector machine, and decision trees were constructed, trained, and statistically compared. The support vector machine classifier was found to exhibit an 89.93% success rate. Real-time testing of the bionic arm with the optimum classifier is demonstrated.

The importance of estimating human movement has increased in the field of human motion capture. HTC VIVE is a popular device that provides a convenient way of capturing human motions using several sensors. Recently, the motion of only users' hands has been captured, thereby greatly reducing the range of motion captured. This paper proposes a framework to estimate single-arm orientations using soft sensors mainly by combining a Bi-long short-term memory (Bi-LSTM) and two-layer LSTM. Positions of the two hands are measured using an HTC VIVE set, and the orientations of a single arm, including its corresponding upper arm and forearm, are estimated using the proposed framework based on the estimated positions of the two hands. Given that the proposed framework is meant for a single arm, if orientations of two arms are required to be estimated, the estimations are performed twice. To obtain the ground truth of the orientations of single-arm movements, two Myo gesture-control sensory armbands are employed on the single arm: one for the upper arm and the other for the forearm. The proposed framework analyzed the contextual features of consecutive sensory arm movements, which provides an efficient way to improve the accuracy of arm movement estimation. In comparison with the ground truth, the proposed method estimated the arm movements using a dynamic time warping distance, which was the average of 73.90% less than that of a conventional Bayesian framework. The distinct feature of our proposed framework is that the number of sensors attached to end-users is reduced. Additionally, with the use of our framework, the arm orientations can be estimated with any soft sensor, and good accuracy of the estimations can be ensured. Another contribution is the suggestion of the combination of the Bi-LSTM and two-layer LSTM.

Introduction: The most common way of assessing surgical performance is by expert raters to view a surgical task and rate a trainee's performance. However, there is huge potential for automated skill assessment and workflow analysis using modern technology. The aim of the present study was to evaluate machine learning (ML) algorithms using the data of a Myo armband as a sensor device for skills level assessment and phase detection in laparoscopic training., Materials and Methods: Participants of three experience levels in laparoscopy performed a suturing and knot tying task on silicon models. Experts rated performance using Objective Structured Assessment of Surgical Skills (OSATS). Participants wore Myo armbands (Thalmic Labs™, Ontario, Canada) to record acceleration, angular velocity, orientation, and Euler orientation. ML algorithms (decision forest, neural networks, boosted decision tree) were compared for skill level assessment and phase detection., Results: 28 participants (8 beginner, 10 intermediate, 10 expert) were included, and 99 knots were available for analysis. A neural network regression model had the lowest mean absolute error in predicting OSATS score (3.7 ± 0.6 points, r 2 = 0.03 ± 0.81; OSATS min.-max.: 4-37 points). An ensemble of binary-class neural networks yielded the highest accuracy in predicting skill level (beginners: 82.2% correctly identified, intermediate: 3.0%, experts: 79.5%) whereas standard statistical analysis failed to discriminate between skill levels. Phase detection on raw data showed the best results with a multi-class decision jungle (average 16% correctly identified), but improved to 43% average accuracy with two-class boosted decision trees after Dynamic time warping (DTW) application., Conclusion: Modern machine learning algorithms aid in interpreting complex surgical motion data, even when standard analysis fails. Dynamic time warping offers the potential to process and compare surgical motion data in order to allow automated surgical workflow detection. However, further research is needed to interpret and standardize available data and improve sensor accuracy.

In this paper, we propose a novel approach to eLearning that makes use of smart wearable sensors. Traditional eLearning supports the remote and mobile learning of mostly theoretical knowledge. Here we discuss the possibilities of eLearning to support the training of manual skills. We employ forearm armbands with inertial measurement units and surface electromyography sensors to detect and analyse the user's hand motions and evaluate their performance. Hand hygiene is chosen as the example activity, as it is a highly standardized manual task that is often not properly executed. The World Health Organization guidelines on hand hygiene are taken as a model of the optimal hygiene procedure, due to their algorithmic structure. Gesture recognition procedures based on artificial neural networks and hidden Markov modeling were developed, achieving recognition rates of 98 . 30 % ( ± 1 . 26 % ) for individual gestures. Our approach is shown to be promising for further research and application in the mobile eLearning of manual skills.