Search

This study delves into decoding hand gestures using surface electromyography (EMG) signals collected via a precision Myo-armband sensor, leveraging machine learning algorithms. The research entails rigorous data preprocessing to extract features and labels from raw EMG data. Following partitioning into training and testing sets, four traditional machine learning models are scrutinized for their efficacy in classifying finger movements across seven distinct gestures. The analysis includes meticulous parameter optimization and five-fold cross-validation to evaluate model performance. Among the models assessed, the Random Forest emerges as the top performer, consistently delivering superior precision, recall, and F1-score values across gesture classes, with ROC-AUC scores surpassing 99%. These findings underscore the Random Forest model as the optimal classifier for our EMG dataset, promising significant advancements in healthcare rehabilitation engineering and enhancing human–computer interaction technologies. [ABSTRACT FROM AUTHOR]

This study explores the development and pilot testing of an exergame designed for the rehabilitation of individuals with upper limb deficits. While traditional physiotherapy is effective, it often fails to fully engage patients due to its repetitive nature. This research integrates a novel exergame into physiotherapy regimens, aiming to enhance patient motivation through a gaming experience that complements conventional sessions. The exergame is structured around a narrative-driven adventure, with exercises embedded in gameplay that mirror adjustable physiotherapy routines. It utilizes the Myo armband, a wearable electromyography device, to capture muscle activity and movement. The system, part of a web-based platform, is easily deployable in various settings, including home environments. Comprehensive evaluations with health professionals and neurological patients indicate that the exergame significantly improves patient engagement. This study not only demonstrates the potential of exergames in enhancing traditional therapy but also underscores the importance of patient-centered therapeutic tools. [ABSTRACT FROM AUTHOR]

This work presents a semi-supervised multilayer neural network (MLNN) with an Autoencoder to develop a classification model for recognizing hand gestures from electromyographic (EMG) signals. Using a Myo armband equipped with eight non-invasive surface-mounted biosensors, raw surface EMG (sEMG) sensor data were captured corresponding to five hand gestures: Fist, Open hand, Wave in, Wave out, and Double tap. The sensor collected data underwent preprocessing, feature extraction, label assignment, and dataset organization for classification tasks. The model implementation, validation, and testing demonstrated its efficacy after incorporating synthetic sEMG data generated by an Autoencoder. In comparison to the state-of-the-art techniques from the literature, the proposed model exhibited strong performance, achieving accuracy of 99.68%, 100%, and 99.26% during training, validation, and testing, respectively. Comparatively, the proposed MLNN with Autoencoder model outperformed a K-Nearest Neighbors model established for comparative evaluation.

This study explores the development and pilot testing of an exergame designed for the rehabilitation of individuals with upper limb deficits. While traditional physiotherapy is effective, it often fails to fully engage patients due to its repetitive nature. This research integrates a novel exergame into physiotherapy regimens, aiming to enhance patient motivation through a gaming experience that complements conventional sessions. The exergame is structured around a narrative-driven adventure, with exercises embedded in gameplay that mirror adjustable physiotherapy routines. It utilizes the Myo armband, a wearable electromyography device, to capture muscle activity and movement. The system, part of a web-based platform, is easily deployable in various settings, including home environments. Comprehensive evaluations with health professionals and neurological patients indicate that the exergame significantly improves patient engagement. This study not only demonstrates the potential of exergames in enhancing traditional therapy but also underscores the importance of patient-centered therapeutic tools.

This study delves into decoding hand gestures using surface electromyography (EMG) signals collected via a precision Myo-armband sensor, leveraging machine learning algorithms. The research entails rigorous data preprocessing to extract features and labels from raw EMG data. Following partitioning into training and testing sets, four traditional machine learning models are scrutinized for their efficacy in classifying finger movements across seven distinct gestures. The analysis includes meticulous parameter optimization and five-fold cross-validation to evaluate model performance. Among the models assessed, the Random Forest emerges as the top performer, consistently delivering superior precision, recall, and F1-score values across gesture classes, with ROC-AUC scores surpassing 99%. These findings underscore the Random Forest model as the optimal classifier for our EMG dataset, promising significant advancements in healthcare rehabilitation engineering and enhancing human–computer interaction technologies.

Abstract Background Muscle strength and dexterity impairments are common among patients with multiple sclerosis (MS) producing limitations in activities of daily living related to the upper limb (UL). This study aimed to evaluate the effectiveness of serious games specifically developed for the MYO Armband® capture sensor in improving forearm and wrist mobility, UL muscle strength, dexterity, fatigue, functionality, quality of life, satisfaction, adverse effects and compliance. Methods A double-blinded (allocation concealment was performed by a blinded investigator and by blinding for assessors) randomised controlled trial was conducted. The sample was randomised into two groups: an experimental group that received treatment based on UL serious games designed by the research team and controlled by the MYO Armband® gesture capture sensor, along with conventional rehabilitation and a control group that received the same conventional rehabilitation for the UL. Both groups received two 60-min sessions per week over an eight-week period. Wrist range of motion (goniometry), grip muscle strength (Jamar® dynamometer), coordination and gross UL dexterity (Box and Block Test), fatigue (Fatigue Severity Scale), functionality (ABILHAND), quality of life (Multiple Sclerosis Impact Scale-29), adverse effects (Simulator Sickness Questionnaire, SSQ), perceived workload (NASA-Task load index), satisfaction (Client Satisfaction Questionnaire-8 (CSQ-8), Satisfaction with Technology Scale, System Usability Scale (SUS) and QUEST 2.0) and compliance (attendance) were assessed in both groups pre-treatment, post-treatment and during a follow-up period of 2 weeks without receiving any treatment. Results Significant differences were observed in the experimental group compared to the control group in the assessment of forearm supination (p = .004) and grip strength (p = .004). Adverse effects were minimal (SSQ: 7/100 points) and perceived workload was low (NASA-Task Load Index: 25/100 points) in the experimental group. The MYO Armband® technology proved to be useful for the participants (SUS: 80.66/100) and the satisfaction scales received high scores (QUEST 2.0: 59.4/70 points; Satisfaction with Technology: 84.36/100 points). There were significant differences between the groups in terms of attendance percentage (p = .029). Conclusions An experimental protocol using MYO Armband®-based serious games designed for UL rehabilitation showed improvements in active wrist range of motion and handgrip strength in patients with MS, with high satisfaction, minimal adverse effects and workload and excellent compliance. Trial registration number: This randomised controlled trial has been registered at ClinicalTrials.gov Identifier: NCT04171908.

Nowadays, surface electromyography (sEMG) is evolving as a technology for hand gesture recognition. Detailed studies have revealed the capacity of EMG signals to access detailed information, particularly in the classification of hand gestures. Indeed, this advancement emerges as an interesting element in refining the recognition and interpretation of sign languages and exploring deeper into the phonology of signed languages. Aligned with this advancement and the need for a reliable and mobile sign language recognition system, we introduce a specialized sEMG dataset, acquired using the Myo armband. This device is adept at capturing recordings at frequencies of up to 200 Hz. The dataset focuses on the 28 letters of the Arabic alphabet and 10 digits using hand gestures, with each gesture captured into 400 frames. This considerable collection of 18,716 samples was achieved with the cooperation of three contributors, providing a varied and comprehensive range of gestural data.

Background: Muscle strength and dexterity impairments are common among patients with multiple sclerosis (MS) producing limitations in activities of daily living related to the upper limb (UL). This study aimed to evaluate the effectiveness of serious games specifically developed for the MYO Armband® capture sensor in improving forearm and wrist mobility, UL muscle strength, dexterity, fatigue, functionality, quality of life, satisfaction, adverse effects and compliance. Methods: A double-blinded (allocation concealment was performed by a blinded investigator and by blinding for assessors) randomised controlled trial was conducted. The sample was randomised into two groups: an experimental group that received treatment based on UL serious games designed by the research team and controlled by the MYO Armband® gesture capture sensor, along with conventional rehabilitation and a control group that received the same conventional rehabilitation for the UL. Both groups received two 60-min sessions per week over an eight-week period. Wrist range of motion (goniometry), grip muscle strength (Jamar® dynamometer), coordination and gross UL dexterity (Box and Block Test), fatigue (Fatigue Severity Scale), functionality (ABILHAND), quality of life (Multiple Sclerosis Impact Scale-29), adverse effects (Simulator Sickness Questionnaire, SSQ), perceived workload (NASA-Task load index), satisfaction (Client Satisfaction Questionnaire-8 (CSQ-8), Satisfaction with Technology Scale, System Usability Scale (SUS) and QUEST 2.0) and compliance (attendance) were assessed in both groups pre-treatment, post-treatment and during a follow-up period of 2 weeks without receiving any treatment. Results: Significant differences were observed in the experimental group compared to the control group in the assessment of forearm supination (p =.004) and grip strength (p =.004). Adverse effects were minimal (SSQ: 7/100 points) and perceived workload was low (NASA-Task Load Index: 25/100 points) in the experimental group. The MYO Armband® technology proved to be useful for the participants (SUS: 80.66/100) and the satisfaction scales received high scores (QUEST 2.0: 59.4/70 points; Satisfaction with Technology: 84.36/100 points). There were significant differences between the groups in terms of attendance percentage (p =.029). Conclusions: An experimental protocol using MYO Armband®-based serious games designed for UL rehabilitation showed improvements in active wrist range of motion and handgrip strength in patients with MS, with high satisfaction, minimal adverse effects and workload and excellent compliance. Trial registration number: This randomised controlled trial has been registered at ClinicalTrials.gov Identifier: NCT04171908. [ABSTRACT FROM AUTHOR]

Background: The ability to perform activities of daily living (ADL) is essential to preserving functional independence and quality of life. In recent years, rehabilitation strategies based on new technologies, such as MYO Armband®, have been implemented to improve dexterity in people with upper limb impairment. Over the last few years, many studies have been published focusing on the accuracy of the MYO Armband® to capture electromyographic and inertial data, as well as the clinical effects of using it as a rehabilitation tool in people with loss of upper limb function. Nevertheless, to our knowledge, there has been no systematic review of this subject. Methods: A systematically comprehensive literature search was conducted in order to identify original studies that answered the PICO question (patient/population, intervention, comparison, and outcome): What is the accuracy level and the clinical effects of the MYO Armband® in people with motor impairment of the upper limb compared with other assessment techniques or interventions or no intervention whatsoever? The following data sources were used: Pubmed, Scopus, Web of Science, ScienceDirect, Physiotherapy Evidence Database, and the Cochrane Library. After identifying the eligible articles, a cross-search of their references was also completed for additional studies. The following data were extracted from the papers: study design, disease or condition, intervention, sample, dosage, outcome measures or data collection procedure and data analysis and results. The authors independently collected these data following the CONSORT 2010 statement when possible, and eventually reached a consensus on the extracted data, resolving disagreements through discussion. To assess the methodological quality of papers included, the tool for the critical appraisal of epidemiological cross-sectional studies was used, since only case series studies were identified after the search. Additionally, the articles were classified according to the levels of evidence and grades of recommendation for diagnosis studies established by the Oxford Center for Evidence-Based Medicine. Also, The Cochrane Handbook for Systematic Reviews of Interventions was used by two independent reviewers to assess risk of bias, assessing the six different domains. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was followed to carry out this review. Results: 10 articles with a total 180 participants were included in the review. The characteristics of included studies, sample and intervention characteristics, outcome measures, the accuracy of the system and effects of the interventions and the assessment of methodological quality of the studies and risk of bias are shown. Conclusions: Therapy with the MYO Armband® has shown clinical changes in range of motion, dexterity, performance, functionality and satisfaction. It has also proven to be an accurate system to capture signals from the forearm muscles in people with motor impairment of the upper limb. However, further research should be conducted using bigger samples, well-defined protocols, comparing with control groups or comparing with other assessment or therapeutic tools, since the studies published so far present a high risk of bias and low level of evidence and grade of recommendation. [ABSTRACT FROM AUTHOR]

This research presents work on control of a prosthetic arm using surface electromyography (sEMG) signals acquired from triceps and biceps of fifteen healthy and four amputated subjects. Myo armband was used to acquire sEMG signals corresponding to four different arm motions: elbow extension, elbow flexion, wrist pronation, and wrist supination. Ten time-domain features were extracted and considered for classification to recognize the four-arm motions. These features and their various combinations were used to train four different classifiers, in both offline and real-time settings. It was found that the combination of signal mean and waveform length as a feature and k-nearest neighbors as classifier performed significantly better (p < 0.05) than all other combinations in both offline and real-time settings. The offline accuracies of 95.8% and 68.1% and real-time accuracies of 91.9% and 60.1% were obtained for healthy and amputated subjects, respectively. Results obtained using the presented scheme successfully demonstrate that using suitable features and classifier, classification accuracies can be significantly improved for transhumeral prosthesis, thereby, providing better, wearable and non-invasive control of prostheses using sEMG signals. [ABSTRACT FROM AUTHOR]

Bu çalışma kapsamında insansız bir kara aracının kişinin el ve parmak hareketleri ile uzaktan kontrolü gerçekleştirilmiştir. Beyinden kol kaslarına iletilen ve kişinin el hareketlerini gerçekleştirmesini sağlayan Elektromiyografi (EMG) sinyalleri, kişinin koluna giydiği sekiz EMG sensör içeren bileklik vasıtası ile gerçek zamanlı olarak alınmıştır. Raspberry pi 3 gömülü sistem kartı üzerinde geliştirilen sinyal işleme, öznitelik çıkarımı ve sınıflandırma algoritmaları kullanılarak anlamlandırılmıştır. Başka bir deyişle el hareketin örüntüsü (el kapama, parmak açma, serçe parmak temas, bilek dışa bükme, vs.) ile EMG sinyal grubu arasındaki ilişkiler tanımlanmıştır. Anlamlandırılan her bir el hareketi araç için bir hareketi kontrol komutu (el kapama: araç ileri, parmak açma: araç dur, serçe parmağa temas: sola dönüş, bilek dışa bükme: sağa dönüş, vs.) olarak kullanılmıştır. Böylece insan – mobil araç etkileşim ağı kurulmuştur. Kurulan insan- mobil araç etkileşim ağı sayesinde el hareketleri ile mobil aracın gerçek zamanlı hareket kontrolü ortalama % 92 başarı ile gerçekleştirilmiştir.

In this brief, an enhanced robotic learning interface has been investigated using Beetle Antennae Search (BAS) and Extreme Learning Machine (ELM). The initial values of learning weights and bias of the network have significant effect on the performance of the ELM, hence, BAS algorithm was employed to optimize the initial values of learning weights and bias. Kinect v2 camera sensor was applied to obtain the endpoint’s position of the upper limb, MYO armband was used to measure the corresponding joint angle values. Those aforementioned data formed the dataset to be trained by ELM and after training the ELM model was able to generate angle values by only giving position as input without a need to carry out kinematic calculations. The proposed method has been validated by conducting series of experimental studies on a KUKA iiwa robot. [ABSTRACT FROM AUTHOR]

Background: The ability to perform activities of daily living (ADL) is essential to preserving functional independence and quality of life. In recent years, rehabilitation strategies based on new technologies, such as MYO Armband®, have been implemented to improve dexterity in people with upper limb impairment. Over the last few years, many studies have been published focusing on the accuracy of the MYO Armband® to capture electromyographic and inertial data, as well as the clinical effects of using it as a rehabilitation tool in people with loss of upper limb function. Nevertheless, to our knowledge, there has been no systematic review of this subject. Methods: A systematically comprehensive literature search was conducted in order to identify original studies that answered the PICO question (patient/population, intervention, comparison, and outcome): What is the accuracy level and the clinical effects of the MYO Armband® in people with motor impairment of the upper limb compared with other assessment techniques or interventions or no intervention whatsoever? The following data sources were used: Pubmed, Scopus, Web of Science, ScienceDirect, Physiotherapy Evidence Database, and the Cochrane Library. After identifying the eligible articles, a cross-search of their references was also completed for additional studies. The following data were extracted from the papers: study design, disease or condition, intervention, sample, dosage, outcome measures or data collection procedure and data analysis and results. The authors independently collected these data following the CONSORT 2010 statement when possible, and eventually reached a consensus on the extracted data, resolving disagreements through discussion. To assess the methodological quality of papers included, the tool for the critical appraisal of epidemiological cross-sectional studies was used, since only case series studies were identified after the search. Additionally, the articles were classified according to the levels of evidence and grades of recommendation for diagnosis studies established by the Oxford Center for Evidence-Based Medicine. Also, The Cochrane Handbook for Systematic Reviews of Interventions was used by two independent reviewers to assess risk of bias, assessing the six different domains. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was followed to carry out this review. Results: 10 articles with a total 180 participants were included in the review. The characteristics of included studies, sample and intervention characteristics, outcome measures, the accuracy of the system and effects of the interventions and the assessment of methodological quality of the studies and risk of bias are shown. Conclusions: Therapy with the MYO Armband® has shown clinical changes in range of motion, dexterity, performance, functionality and satisfaction. It has also proven to be an accurate system to capture signals from the forearm muscles in people with motor impairment of the upper limb. However, further research should be conducted using bigger samples, well-defined protocols, comparing with control groups or comparing with other assessment or therapeutic tools, since the studies published so far present a high risk of bias and low level of evidence and grade of recommendation.

Featured Application: Results of this work could be useful in the field of hand gesture recognition based on myoelectric signal processing, which has widespread usage for robotic arms and upper limb prosthesis control. The surface electromyography signal (sEMG) is widely used for gesture characterization; its reliability is strongly connected to the features extracted from sEMG recordings. This study aimed to investigate the use of two complexity measures, i.e., fuzzy entropy (FEn) and permutation entropy (PEn) for hand gesture characterization. Fourteen upper limb movements, sorted into three sets, were collected on ten subjects and the performances of FEn and PEn for gesture descriptions were analyzed for different computational parameters. FEn and PEn were able to properly cluster the expected numbers of gestures, but computational parameters were crucial for ensuring clusters' separability and proper gesture characterization. FEn and PEn were also compared with other eighteen classical time and frequency domain features through the minimum redundancy maximum relevance algorithm and showed the best predictive importance scores in two gesture sets; they also had scores within the subset of the best five features in the remaining one. Further, the classification accuracies of four different feature sets presented remarkable increases when FEn and PEn are included as additional features. Outcomes support the use of FEn and PEn for hand gesture description when computational parameters are properly selected, and they could be useful in supporting the development of robotic arms and prostheses myoelectric control. [ABSTRACT FROM AUTHOR]

ABSTRAK Sinyal EMG merupakan salah satu sinyal yang dapat digunakan untuk memberikan perintah pada kursi roda listrik. Sinyal EMG yang digunakan diambil dari sinyal otot fleksor dan ekstensor yang berada di tangan kanan. Sinyal tersebut diambil menggunakan sensor Myo Armband. Klasifikasi sinyal EMG diambil dari pergerakan jari yang mewakili perintah gerak yaitu jari kelingking untuk bergerak maju, jari manis untuk berhenti, jari tengah untuk belok kanan dan jari telunjuk untuk belok kiri. Setiap sinyal EMG diekstraksi fitur untuk menentukan karakteristik sinyal sehingga fitur yang diperoleh adalah Average Absolute Value, Root Mean Square, Simple Integral Square, EMG Simple Variant and Integrated EMG. Kemudian fitur tersebut digunakan sebagai input dari metode klasifikasi Artificial Neural Network Backpropagation. Jumlah data latih yang digunakan adalah 800 data sedangkan data uji yang digunakan adalah 200 data. Tingkat keberhasilan proses klasifikasi ini sebesar 93%. Kata kunci: electromyogram, artificial neural network, klasifikasi sinyal, tangan kanan, Myo Armband. ABSTRACT EMG signal is one of the signals that can be used to give orders to electric wheelchairs. The EMG signal used is taken from the flexor and extensor muscle signals in the right hand. The signal is taken using the Myo Armband sensor. The EMG signal classification is taken from the movement of the finger which represents the command of motion ie the little finger to move forward, ring finger to stop, middle finger to turn right and index finger to turn left. Each EMG signal is extracted features to determine the signal characteristics so that the features obtained are Average Absolute Value, Root Mean Square, Simple Integral Square, EMG Simple Variant and Integrated EMG. Then the feature is used as input from the Backpropagation classification method. The amount of training data used is 800 data while the test data used is 200 data. The success rate of this classification process is 93%. Keywords: electromyogram, artificial neural network, signal classification, right hand, Myo Armband.

Kalman filter has been successfully applied to fuse the motion capture data collected from Kinect sensor and a pair of MYO armbands to teleoperate a robot. A new strategy utilizing the vector approach has been developed to accomplish a specific motion capture task. The arm motion of the operator is captured by a Kinect sensor and programmed with Processing software. Two MYO armbands with the inertial measurement unit embedded are worn on the operator's arm, which is used to detect the upper arm motion of the human operator. This is utilized to recognize and to calculate the precise speed of the physical motion of the operator's arm. User Datagram Protocol is employed to send the human movement to a simulated Baxter robot arm for teleoperation. In order to obtain joint angles for human limb utilizing vector approach, RosPy and Python script programming has been utilized. A series of experiments have been conducted to test the performance of the proposed technique, which provides the basis for the teleoperation of simulated Baxter robot.

Nowadays, surface electromyography (sEMG) is evolving as a technology for hand gesture recognition. Detailed studies have revealed the capacity of EMG signals to access detailed information, particularly in the classification of hand gestures. Indeed, this advancement emerges as an interesting element in refining the recognition and interpretation of sign languages and exploring deeper into the phonology of signed languages. Aligned with this advancement and the need for a reliable and mobile sign language recognition system, we introduce a specialized sEMG dataset, acquired using the Myo armband. This device is adept at capturing recordings at frequencies of up to 200 Hz. The dataset focuses on the 28 letters of the Arabic alphabet and 10 digits using hand gestures, with each gesture captured into 400 frames. This considerable collection of 18,716 samples was achieved with the cooperation of three contributors, providing a varied and comprehensive range of gestural data., (© 2023 The Author(s).)

This research work presents the design of the electronics modules of Adam's Hand, a transradial myoelectric prosthesis based on an innovative mechanism which can actuate five three‐phalanges fingers (15 degrees of freedom) with just one motor, instead of the five/six motors conventionally used in other prosthetic devices; moreover, the prosthesis uses two servomotors to actuate the wrist movements. Adam's Hand fingertips are provided with temperature and pressure sensors, while the user myoelectric signals are acquired wirelessly by means of the Myo armband, a wearable device provided with eight electromyography electrodes, a nine‐axis inertial measurement unit, and a transmission module. These data are received through an HM‐11 BLE module, connected to Adam's Hand custom PCB, which features an Arduino Micro board. This board processes all the data and drives the actuators by means of properly chosen drivers. A Raspberry Pi 3 board manages a touchscreen display – which can be used to visualise the gathered data – and sends them to a dedicate cloud platform, so that the orthopaedic technicians who take care of Adam's Hand users can monitor them in real time, thus improving their recovery during the rehabilitation period. [ABSTRACT FROM AUTHOR]

Hand gesture recognition (HGR) systems using electromyography (EMG) bracelet-type sensors are currently largely used over other HGR technologies. However, bracelets are susceptible to electrode rotation, causing a decrease in HGR performance. In this work, HGR systems with an algorithm for orientation correction are proposed. The proposed orientation correction method is based on the computation of the maximum energy channel using a synchronization gesture. Then, the channels of the EMG are rearranged in a new sequence which starts with the maximum energy channel. This new sequence of channels is used for both training and testing. After the EMG channels are rearranged, this signal passes through the following stages: pre-processing, feature extraction, classification, and post-processing. We implemented user-specific and user-general HGR models based on a common architecture which is robust to rotations of the EMG bracelet. Four experiments were performed, taking into account two different metrics which are the classification and recognition accuracy for both models implemented in this work, where each model was evaluated with and without rotation of the bracelet. The classification accuracy measures how well a model predicted which gesture is contained somewhere in a given EMG, whereas recognition accuracy measures how well a model predicted when it occurred, how long it lasted, and which gesture is contained in a given EMG. The results of the experiments (without and with orientation correction) executed show an increase in performance from 44.5% to 81.2% for classification and from 43.3% to 81.3% for recognition in user-general models, while in user-specific models, the results show an increase in performance from 39.8% to 94.9% for classification and from 38.8% to 94.2% for recognition. The results obtained in this work evidence that the proposed method for orientation correction makes the performance of an HGR robust to rotations of the EMG bracelet.

The surface electromyography signal (sEMG) is widely used for gesture characterization; its reliability is strongly connected to the features extracted from sEMG recordings. This study aimed to investigate the use of two complexity measures, i.e., fuzzy entropy (FEn) and permutation entropy (PEn) for hand gesture characterization. Fourteen upper limb movements, sorted into three sets, were collected on ten subjects and the performances of FEn and PEn for gesture descriptions were analyzed for different computational parameters. FEn and PEn were able to properly cluster the expected numbers of gestures, but computational parameters were crucial for ensuring clusters’ separability and proper gesture characterization. FEn and PEn were also compared with other eighteen classical time and frequency domain features through the minimum redundancy maximum relevance algorithm and showed the best predictive importance scores in two gesture sets; they also had scores within the subset of the best five features in the remaining one. Further, the classification accuracies of four different feature sets presented remarkable increases when FEn and PEn are included as additional features. Outcomes support the use of FEn and PEn for hand gesture description when computational parameters are properly selected, and they could be useful in supporting the development of robotic arms and prostheses myoelectric control.

This work discusses a novel human–robot interface for a climbing robot for inspecting weld beads in storage tanks in the petrochemical industry. The approach aims to adapt robot autonomy in terms of the operator’s experience, where a remote industrial joystick works in conjunction with an electromyographic armband as inputs. This armband is worn on the forearm and can detect gestures from the operator and rotation angles from the arm. Information from the industrial joystick and the armband are used to control the robot via a Fuzzy controller. The controller works with sliding autonomy (using as inputs data from the angular velocity of the industrial controller, electromyography reading, weld bead position in the storage tank, and rotation angles executed by the operator’s arm) to generate a system capable of recognition of the operator’s skill and correction of mistakes from the operator in operating time. The output from the Fuzzy controller is the level of autonomy to be used by the robot. The levels implemented are Manual (operator controls the angular and linear velocities of the robot); Shared (speeds are shared between the operator and the autonomous system); Supervisory (robot controls the angular velocity to stay in the weld bead, and the operator controls the linear velocity); Autonomous (the operator defines endpoint and the robot controls both linear and angular velocities). These autonomy levels, along with the proposed sliding autonomy, are then analyzed through robot experiments in a simulated environment, showing each of these modes’ purposes. The proposed approach is evaluated in virtual industrial scenarios through real distinct operators.

Surface electromyographic signal (sEMG) is a kind of bioelectrical signal, which records the data of muscle activity intensity. Most sEMG-based hand gesture recognition, which uses machine learning as the classifier, depends on feature extraction of sEMG data. Recently, a deep leaning-based approach such as recurrent neural network (RNN) has provided a choice to automatically learn features from raw data. This paper presents a novel hand gesture prediction method by using an RNN model to learn from raw sEMG data and predict gestures. The sEMG signals of 21 short-term hand gestures of 13 subjects were recorded with a Myo armband, which is a non-intrusive, low cost, commercial portable device. At the start of the gesture, the trained model outputs an instantaneous prediction for the sEMG data. Experimental results showed that the more time steps of data that were known, the higher instantaneous prediction accuracy the proposed model gave. The predicted accuracy reached about 89.6% when the data of 40-time steps (200 ms) were used to predict hand gesture. This means that the gesture could be predicted with a delay of 200 ms after the hand starts to perform the gesture, instead of waiting for the end of the gesture.

In this paper, a customizable wearable 3D-printed bionic arm is designed, fabricated, and optimized for a right arm amputee. An experimental test has been conducted for the user, where control of the artificial bionic hand is accomplished successfully using surface electromyography (sEMG) signals acquired by a multi-channel wearable armband. The 3D-printed bionic arm was designed for the low cost of 295 USD, and was lightweight at 428 g. To facilitate a generic control of the bionic arm, sEMG data were collected for a set of gestures (fist, spread fingers, wave-in, wave-out) from a wide range of participants. The collected data were processed and features related to the gestures were extracted for the purpose of training a classifier. In this study, several classifiers based on neural networks, support vector machine, and decision trees were constructed, trained, and statistically compared. The support vector machine classifier was found to exhibit an 89.93% success rate. Real-time testing of the bionic arm with the optimum classifier is demonstrated.

The importance of estimating human movement has increased in the field of human motion capture. HTC VIVE is a popular device that provides a convenient way of capturing human motions using several sensors. Recently, the motion of only users’ hands has been captured, thereby greatly reducing the range of motion captured. This paper proposes a framework to estimate single-arm orientations using soft sensors mainly by combining a Bi-long short-term memory (Bi-LSTM) and two-layer LSTM. Positions of the two hands are measured using an HTC VIVE set, and the orientations of a single arm, including its corresponding upper arm and forearm, are estimated using the proposed framework based on the estimated positions of the two hands. Given that the proposed framework is meant for a single arm, if orientations of two arms are required to be estimated, the estimations are performed twice. To obtain the ground truth of the orientations of single-arm movements, two Myo gesture-control sensory armbands are employed on the single arm: one for the upper arm and the other for the forearm. The proposed framework analyzed the contextual features of consecutive sensory arm movements, which provides an efficient way to improve the accuracy of arm movement estimation. In comparison with the ground truth, the proposed method estimated the arm movements using a dynamic time warping distance, which was the average of 73.90% less than that of a conventional Bayesian framework. The distinct feature of our proposed framework is that the number of sensors attached to end-users is reduced. Additionally, with the use of our framework, the arm orientations can be estimated with any soft sensor, and good accuracy of the estimations can be ensured. Another contribution is the suggestion of the combination of the Bi-LSTM and two-layer LSTM.

Technological developments to support the current learning system are so fast that there is an interactive innovation technology for educational trends. One of the technologies implemented is an interactive presentation application in a multimedia class or smart presentation system. This technology makes it possible to control the presentation in a natural way with their hand movements. This introduction can replace conventional mouse roles and functions to facilitate teacher performance in applying interactive technology in the classroom. To build this intelligent presentation system, it is divided into several parts: 1) Recognition sensor arm movement using Myo armband; 2) Hand gesture of hand movements made several steps include: a) data retrieval based on realtime and wireless; b) feature extraction; c) classification using artificial neural network; and 3) Smart presentation, is a presentation system that can understand human behavior and provide interactive presentations.The expected benefits of the results of this study are, with the construction of intelligent presentation systems using hand-gesturing recognition based on the classification of electromyography signals, 1) Make presentations more efficient, engaging and easier to understand, and also make the discussion more interactive and improve communication; 2) Assists the presenter of material in exposing the material by using a presentation control system based on hand gestures.

Hand gestures will become a mainstream method of manipulating human computer interfaces (HCIs). For disabled people with mobility problems, hand gesture-based HCIs should be specifically designed. To achieve effective hand gesture HCIs, this study integrated a mobile service robot platform, three-dimensional (3D) imaging sensors, and wearable Myo armband device. Four kernel techniques are presented: (1) Myo armband software development kit hand gesture recognition using a two-layer hierarchy scheme to significantly increase hand gesture command numbers, (2) identity recognition of users using clustering-based support vector machine classifiers with a designed root mean square surface electromyography (RMS-sEMG) feature, (3) robot vehicle navigation with effective obstacle avoidance using a conceptually simple and computationally fast approach, and (4) efficient vehicle positioning based on the face-detection information of the user provided from the 3D imaging sensor to receive the hand gestures commands of the user with disabilities. [ABSTRACT FROM AUTHOR]

Kalman filter has been successfully applied to fuse the motion capture data collected from Kinect sensor and a pair of MYO armbands to teleoperate a robot. A new strategy utilizing the vector approach has been developed to accomplish a specific motion capture task. The arm motion of the operator is captured by a Kinect sensor and programmed with Processing software. Two MYO armbands with the inertial measurement unit embedded are worn on the operator's arm, which is used to detect the upper arm motion of the human operator. This is utilized to recognize and to calculate the precise speed of the physical motion of the operator's arm. User Datagram Protocol is employed to send the human movement to a simulated Baxter robot arm for teleoperation. In order to obtain joint angles for human limb utilizing vector approach, RosPy and Python script programming has been utilized. A series of experiments have been conducted to test the performance of the proposed technique, which provides the basis for the teleoperation of simulated Baxter robot. [ABSTRACT FROM AUTHOR]

This paper presents the development of a Robot Operating System (ROS)-based mobile robot control using electromyography (EMG) signals. The proposed robot’s structure is specifically designed to provide modularity and is controlled by a Raspberry Pi 3 running on top of an ROS application and a Teensy microcontroller. The EMG muscle commands are sent to the robot with hand gestures that are captured using a Thalmic Myo Armband and recognized using a k-Nearest Neighbour (k-NN) classifier. The robot’s performance is evaluated by navigating it through specific paths while solely controlling it through the EMG signals and using the collision avoidance approach. Thus, this paper aims to expand the research on the topic, introducing a more accurate classification system with a wider set of gestures, hoping to come closer to a usable real-life application.

In this paper, we propose a novel approach to eLearning that makes use of smart wearable sensors. Traditional eLearning supports the remote and mobile learning of mostly theoretical knowledge. Here we discuss the possibilities of eLearning to support the training of manual skills. We employ forearm armbands with inertial measurement units and surface electromyography sensors to detect and analyse the user's hand motions and evaluate their performance. Hand hygiene is chosen as the example activity, as it is a highly standardized manual task that is often not properly executed. TheWorld Health Organization guidelines on hand hygiene are taken as a model of the optimal hygiene procedure, due to their algorithmic structure. Gesture recognition procedures based on artificial neural networks and hidden Markov modeling were developed, achieving recognition rates of 98.30% (±1.26%) for individual gestures. Our approach is shown to be promising for further research and application in the mobile eLearning of manual skills. [ABSTRACT FROM AUTHOR]

The classification of the bio-signal has been used for various purposes in the literature as they are versatile in diagnosis of anomalies, improvement of overall health and sport performance and creating intuitive human computer interfaces. However, automatic identification of the signal patterns on a streaming real-time signal requires a series of complex procedures. A plethora of heuristic methods, such as neural networks and fuzzy systems, have been proposed as a solution. These methods stipulate certain conditions, such as preconditioning the signals, manual feature selection and large number of training samples. In this study, we introduce a novel variant and application of the Collaborative Representation based Classification (CRC) in spectral domain for recognition of hand gestures using raw surface electromyography (EMG) signals. The CRC based methods do not require large number of training samples for an efficient pattern classification. Additionally, we present a training procedure in which a high end subspace clustering method is employed for clustering the representative samples into their corresponding class labels. Thereby, the need for feature extraction and spotting patterns manually on the training samples is obviated. We presented the intuitive use of spectral features via circulant matrices. The proposed Spectral Collaborative Representation based Classification (SCRC) is able to recognize gestures with higher levels of accuracy for a fairly rich gesture set compared to the available methods. The worst recognition result which is the best in the literature is obtained as 97.3% among the four sets of the experiments for each hand gestures. The recognition results are reported with a substantial number of experiments and labeling computation. [ABSTRACT FROM AUTHOR]

The effect of user experience on user satisfaction metrics in using MYO armband (hand gesture navigation) to control interactive maps and various other applications is still in a research state. In general, usability can be measured in terms of effectiveness, efficiency and satisfaction based on the metrics-task completion, error counts, task times and satisfaction scores. In this paper, we considered only satisfaction metrics. A simple and widely used System Usability Scale (SUS) questionnaire model is implemented to suggest some guidelines about the use of MYO armband. Another questionnaire, with a focus on ergonomic issues related to the use of the device such as Social Acceptability, Ease of use and ease of learning, Comfort and Stress, attempted do discover characteristics of hand gesture navigation using MYO. The results of this study can be used in a way to support the development of interactive maps using hand gesture navigation. [ABSTRACT FROM AUTHOR]

• Finger gestures are difficult to process due to overlapping layered structure of the arm muscles. • By examining the effects of gyroscope data, a new feature has been tried to be given to the literature. • EMG and gyroscope signals were acquired using Myo Armband with surface electrodes. • The data set used was shared in the supplementary documents section of the journal. • The highest performance features were determined using sequential forward feature selection. Gestures of the human hand can be identified through processing of surface electromyography (sEMG) signals. The human hand can perform many gestures via manipulation of the fingers. With correct classification of finger gestures, the mobility of a prosthetic hand can be increased and provide greater functionally. In this study, reliable classification was obtained for sEMG finger data acquired from a Myo armband placed on the lower forearm. In order to improve classification, gyroscopic signals, not previously used in other studies, were investigated in the sEMG finger data. Data was acquired from ten normal subjects using the Myo armband to identify 6 finger gestures: thumb, index finger, middle finger, little finger, ring finger and rest. Participants repeated each gesture thirty times. sEMG signals were preprocessed to extract features. 17 features were used in the feature matrix. By using the sequential forward feature selection method, the highest performance feature set was determined. Support Vector Machine, K-Nearest Neighbor and multilayer artificial neural network were used as classification algorithm. The classification was made using the Classification Learner Application and Neural Network Pattern Recognition Tool in Matlab®. The best performance with the features extracted only from sEMG data was 94.40% using the Artificial Neural Networks (ANN) method. The best performance with the features extracted from both sEMG and gyroscopic data was 96.30% (p-value < 0.05)with the ANN method. It is seen that gyroscopic signals can increase classification performance. [ABSTRACT FROM AUTHOR]

In this paper, we propose a novel approach to eLearning that makes use of smart wearable sensors. Traditional eLearning supports the remote and mobile learning of mostly theoretical knowledge. Here we discuss the possibilities of eLearning to support the training of manual skills. We employ forearm armbands with inertial measurement units and surface electromyography sensors to detect and analyse the user’s hand motions and evaluate their performance. Hand hygiene is chosen as the example activity, as it is a highly standardized manual task that is often not properly executed. The World Health Organization guidelines on hand hygiene are taken as a model of the optimal hygiene procedure, due to their algorithmic structure. Gesture recognition procedures based on artificial neural networks and hidden Markov modeling were developed, achieving recognition rates of 98 . 30 % ( ± 1 . 26 % ) for individual gestures. Our approach is shown to be promising for further research and application in the mobile eLearning of manual skills.