1. Wireless Mouth Motion Recognition System Based on EEG-EMG Sensors for Severe Speech Impairments.
- Author
-
Moon KS, Kang JS, Lee SQ, Thompson J, and Satterlee N
- Subjects
- Humans, Mouth physiopathology, Mouth physiology, Adult, Male, Movement physiology, Neural Networks, Computer, Speech Disorders diagnosis, Speech Disorders physiopathology, Female, Wearable Electronic Devices, Machine Learning, Electroencephalography methods, Electroencephalography instrumentation, Electromyography methods, Electromyography instrumentation, Wireless Technology instrumentation, Signal Processing, Computer-Assisted
- Abstract
This study aims to demonstrate the feasibility of using a new wireless electroencephalography (EEG)-electromyography (EMG) wearable approach to generate characteristic EEG-EMG mixed patterns with mouth movements in order to detect distinct movement patterns for severe speech impairments. This paper describes a method for detecting mouth movement based on a new signal processing technology suitable for sensor integration and machine learning applications. This paper examines the relationship between the mouth motion and the brainwave in an effort to develop nonverbal interfacing for people who have lost the ability to communicate, such as people with paralysis. A set of experiments were conducted to assess the efficacy of the proposed method for feature selection. It was determined that the classification of mouth movements was meaningful. EEG-EMG signals were also collected during silent mouthing of phonemes. A few-shot neural network was trained to classify the phonemes from the EEG-EMG signals, yielding classification accuracy of 95%. This technique in data collection and processing bioelectrical signals for phoneme recognition proves a promising avenue for future communication aids., Competing Interests: The authors declare no conflicts of interest.
- Published
- 2024
- Full Text
- View/download PDF