Search

In the field of brain-computer interface (BCI) based on motor imagery (MI), multi-channel electroencephalography (EEG) data is commonly utilized for MI task recognition to achieve sensory compensation or precise human-computer interaction. However, individual physiological differences, environmental variations, or redundant information and noise in certain channels can pose challenges and impact the performance of BCI systems. In this study, we introduce a channel selection method utilizing Hybrid-Recursive Feature Elimination (H-RFE) combined with residual graph neural networks for MI recognition. This channel selection method employs a recursive feature elimination strategy and integrates three classification methods, namely random forest, gradient boosting, and logistic regression, as evaluators for adaptive channel selection tailored to specific subjects. To fully exploit the spatiotemporal information of multi-channel EEG, this study employed a graph neural network embedded with residual blocks to achieve precise recognition of motor imagery. We conducted algorithm testing using the SHU dataset and the PhysioNet dataset. Experimental results show that on the SHU dataset, utilizing 73.44% of the total channels, the cross-session MI recognition accuracy is 90.03%. Similarly, in the PhysioNet dataset, using 72.5% of the channel data, the classification result also reaches 93.99%. Compared to traditional strategies such as selecting three specific channels, correlation-based channel selection, mutual information-based channel selection, and adaptive channel selection based on Pearson coefficients and spatial positions, the proposed method improved classification accuracy by 34.64%, 10.8%, 3.25% and 2.88% on the SHU dataset, and by 46.96%, 5.04%, 5.81% and 2.32% on the PhysioNet dataset, respectively. [ABSTRACT FROM AUTHOR]

This paper presents an innovative approach for the Feature Extraction method using Self-Attention, incorporating various Feature Selection techniques known as the AtSiftNet method to enhance the classification performance of motor imaginary activities using electrophotography (EEG) signals. Initially, the EEG signals were sorted and then denoised using multiscale principal component analysis to obtain clean EEG signals. However, we also conducted a non-denoised experiment. Subsequently, the clean EEG signals underwent the Self-Attention feature extraction method to compute the features of each trial (i.e., 350 × 18 ). The best 1 or 15 features were then extracted through eight different feature selection techniques. Finally, five different machine learning and neural network classification models were employed to calculate the accuracy, sensitivity, and specificity of this approach. The BCI competition III dataset IV-a was utilized for all experiments, encompassing the datasets of five volunteers who participated in the competition. The experiment findings reveal that the average accuracy of classification is highest among ReliefF (i.e., 99.946 % ), Mutual Information (i.e., 98.902 % ), Independent Component Analysis (i.e., 99.62 % ), and Principal Component Analysis (i.e., 98.884 % ) for both 1 and 15 best-selected features from each trial. These accuracies were obtained for motor imagery using a Support Vector Machine (SVM) as a classifier. In addition, five-fold validation was performed in this paper to assess the fair performance estimation and robustness of the model. The average accuracy obtained through five-fold validation is 99.89 % . The experiments' findings indicate that the suggested framework provides a resilient biomarker with minimal computational complexity, making it a suitable choice for advancing Motor Imagery Brain–Computer Interfaces (BCI). [ABSTRACT FROM AUTHOR]

Virtual reality (VR)–guided motor imagery (MI) is a widely used approach for motor rehabilitation, especially for patients with severe motor impairments. Most approaches provide visual guidance from the first‐person perspective (1PP). MI training with visual guidance from the third‐person perspective (3PP) remains largely unexplored. We argue that 3PP MI training has its own advantages and can supplement 1PP MI. For some movements beyond the view of 1PP, such as shoulder shrugging and other axial movements, MI are suitable performed under 3PP. However, the efficiency of existing paradigms for 3PP MI is unsatisfactory. We speculate that the absence of sense of body ownership (SOO) from 3PP could be one possible factor and hypothesize that 3PP MI could be enhanced by eliciting SOO over a 3PP avatar. Based on our hypothesis, a novel paradigm was proposed to enhance 3PP MI by inducing full‐body illusion (FBI) from 3PP, which is similar to the so‐called out‐of‐body experience (OBE), using synchronous visuo‐tactile stimulus with VR. The event‐related Electroencephalograph (EEG) desynchronization (ERD) at motor‐related regions from 31 healthy participants were calculated and compared with a control paradigm without "OBE" FBI induction. This study attempts to enhance 3PP MI with FBI induction. It offers an opportunity to perform MI guided by action observation from 3PP with elicited SOO to the observed avatar. We believe that 3PP MI could provide more possibilities for effective rehabilitation training, when SOO could be elicited to a virtual avatar and the present work demonstrates its viability and effectiveness. [ABSTRACT FROM AUTHOR]

• The increase of decoding precision of motor imaging EEG signal. • The hybrid TCN and ViT method achieves good results. • A shared convolution strategy and a dual-branching strategy. Brain-computer interface (BCI) is a technology that directly connects signals between the human brain and a computer or other external device. Motor imagery electroencephalographic (MI-EEG) signals are considered a promising paradigm for BCI systems, with a wide range of potential applications in medical rehabilitation, human–computer interaction, and virtual reality. Accurate decoding of MI-EEG signals poses a significant challenge due to issues related to the quality of the collected EEG data and subject variability. Therefore, developing an efficient MI-EEG decoding network is crucial and warrants research. This paper proposes a loss joint training model based on the vision transformer (VIT) and the temporal convolutional network (EEG-VTTCNet) to classify MI-EEG signals. To take advantage of multiple modules together, the EEG-VTTCNet adopts a shared convolution strategy and a dual-branching strategy. The dual-branching modules perform complementary learning and jointly train shared convolutional modules with better performance. We conducted experiments on the BCI Competition IV-2a and IV-2b datasets, and the proposed network outperformed the current state-of-the-art techniques with an accuracy of 84.58% and 90.94%, respectively, for the subject-dependent mode. In addition, we used t-SNE to visualize the features extracted by the proposed network, further demonstrating the effectiveness of the feature extraction framework. We also conducted extensive ablation and hyperparameter tuning experiments to construct a robust network architecture that can be well generalized. [ABSTRACT FROM AUTHOR]

AbstractThe brain-computer interface (BCI) systems based on motor imagery typically rely on a large number of electrode channels to acquire information. The rational selection of electroencephalography (EEG) channel combinations is crucial for optimizing computational efficiency and enhancing practical applicability. However, evaluating all potential channel combinations individually is impractical. This study aims to explore a strategy for quickly achieving a balance between maximizing channel reduction and minimizing precision loss. To this end, we developed a spatio-temporal attention perception network named STAPNet. Based on the channel contributions adaptively generated by its subnetwork, we propose an extended step bi-directional search strategy that includes variable ratio channel selection (VRCS) and strided greedy channel selection (SGCS), designed to enhance global search capabilities and accelerate the optimization process. Experimental results show that on the High Gamma and BCI Competition IV 2a public datasets, the framework respectively achieved average maximum accuracies of 91.47% and 84.17%. Under conditions of zero precision loss, the average number of channels was reduced by a maximum of 87.5%. Additionally, to investigate the impact of neural information loss due to channel reduction on the interpretation of complex brain functions, we employed a heatmap visualization algorithm to verify the universal importance and complete symmetry of the selected optimal channel combination across multiple datasets. This is consistent with the brain’s cooperative mechanism when processing tasks involving both the left and right hands. [ABSTRACT FROM AUTHOR]

Abstract In the field of brain-computer interface (BCI) based on motor imagery (MI), multi-channel electroencephalography (EEG) data is commonly utilized for MI task recognition to achieve sensory compensation or precise human-computer interaction. However, individual physiological differences, environmental variations, or redundant information and noise in certain channels can pose challenges and impact the performance of BCI systems. In this study, we introduce a channel selection method utilizing Hybrid-Recursive Feature Elimination (H-RFE) combined with residual graph neural networks for MI recognition. This channel selection method employs a recursive feature elimination strategy and integrates three classification methods, namely random forest, gradient boosting, and logistic regression, as evaluators for adaptive channel selection tailored to specific subjects. To fully exploit the spatiotemporal information of multi-channel EEG, this study employed a graph neural network embedded with residual blocks to achieve precise recognition of motor imagery. We conducted algorithm testing using the SHU dataset and the PhysioNet dataset. Experimental results show that on the SHU dataset, utilizing 73.44% of the total channels, the cross-session MI recognition accuracy is 90.03%. Similarly, in the PhysioNet dataset, using 72.5% of the channel data, the classification result also reaches 93.99%. Compared to traditional strategies such as selecting three specific channels, correlation-based channel selection, mutual information-based channel selection, and adaptive channel selection based on Pearson coefficients and spatial positions, the proposed method improved classification accuracy by 34.64%, 10.8%, 3.25% and 2.88% on the SHU dataset, and by 46.96%, 5.04%, 5.81% and 2.32% on the PhysioNet dataset, respectively.

Abstract Brain-computer interface (BCI) technology bridges the direct communication between the brain and machines, unlocking new possibilities for human interaction and rehabilitation. EEG-based motor imagery (MI) plays a pivotal role in BCI, enabling the translation of thought into actionable commands for interactive and assistive technologies. However, the constrained decoding performance of brain signals poses a limitation to the broader application and development of BCI systems. In this study, we introduce a convolutional Transformer network (CTNet) designed for EEG-based MI classification. Firstly, CTNet employs a convolutional module analogous to EEGNet, dedicated to extracting local and spatial features from EEG time series. Subsequently, it incorporates a Transformer encoder module, leveraging a multi-head attention mechanism to discern the global dependencies of EEG's high-level features. Finally, a straightforward classifier module comprising fully connected layers is followed to categorize EEG signals. In subject-specific evaluations, CTNet achieved remarkable decoding accuracies of 82.52% and 88.49% on the BCI IV-2a and IV-2b datasets, respectively. Furthermore, in the challenging cross-subject assessments, CTNet achieved recognition accuracies of 58.64% on the BCI IV-2a dataset and 76.27% on the BCI IV-2b dataset. In both subject-specific and cross-subject evaluations, CTNet holds a leading position when compared to some of the state-of-the-art methods. This underscores the exceptional efficacy of our approach and its potential to set a new benchmark in EEG decoding.

The accuracy of classifying motor imagery (MI) activities is a significant challenge when using brain–computer interfaces (BCIs). BCIs allow people with motor impairments to control external devices directly with their brains using electroencephalogram (EEG) patterns that translate brain activity into control signals. Many researchers have been working to develop MI-based BCI recognition systems using various time-frequency feature extraction and classification approaches. However, the existing systems still face challenges in achieving satisfactory performance due to large amount of non-discriminative and ineffective features. To get around these problems, we suggested a multiband decomposition-based feature extraction and classification method that works well, along with a strong feature selection method for MI tasks. Our method starts by splitting the preprocessed EEG signal into four sub-bands. In each sub-band, we then used a common spatial pattern (CSP) technique to pull out narrowband-oriented useful features, which gives us a high-dimensional feature vector. Subsequently, we utilized an effective feature selection method, Relief-F, which reduces the dimensionality of the final features. Finally, incorporating advanced classification techniques, we classified the final reduced feature vector. To evaluate the proposed model, we used the three different EEG-based MI benchmark datasets, and our proposed model achieved better performance accuracy than existing systems. Our model's strong points include its ability to effectively reduce feature dimensionality and improve classification accuracy through advanced feature extraction and selection methods. [ABSTRACT FROM AUTHOR]

Background: Parkinson's disease (PD) is a neurodegenerative disorder characterized by motor symptoms such as tremors, rigidity, and bradykinesia. Rehabilitation utilizing mirror neurons leverages the brain's capacity for action observation (AO) and motor imagery (MI) to enhance motor function. This approach involves patients imitating movements observed in therapists or videos, aiming to improve gait, coordination, and overall quality of life. Mirror neuron activation facilitates motor learning and may decelerate disease progression, thus enhancing patient mobility and independence. Methods: This scoping review aimed to map current evidence on PD therapies employing mirror neuron-based rehabilitation. Databases searched included PubMed, PEDro, and Cochrane. The review included randomized controlled trials (RCTs) and systematic reviews that examined the effects of AO and MI in PD rehabilitation. Results: Five studies met the inclusion criteria, encompassing various rehabilitation techniques focusing on AO and MI. These studies consistently demonstrated positive outcomes, such as reduced disease severity and improved quality of life, gait, and balance in PD patients. The activation of mirror neurons through AO and MI was shown to facilitate motor learning and contribute to improved functional mobility. Conclusions: Although the included studies support the beneficial impact of AO and MI techniques in PD rehabilitation, numerous questions remain unresolved. Further research is necessary to evaluate the potential integration of these techniques into standard physiotherapy routines for PD patients. This review highlights the promise of AO and MI in enhancing motor rehabilitation for PD, suggesting the need for more comprehensive studies to validate and refine these therapeutic approaches. [ABSTRACT FROM AUTHOR]

AbstractMotor imagery (MI) stands as a powerful paradigm within Brain-Computer Interface (BCI) research due to its ability to induce changes in brain rhythms detectable through common spatial patterns (CSP). However, the raw feature sets captured often contain redundant and invalid information, potentially hindering CSP performance. Methodology-wise, we propose the Information Fusion for Optimizing Temporal-Frequency Combination Pattern (IFTFCP) algorithm to enhance raw feature optimization. Initially, preprocessed data undergoes simultaneous processing in both time and frequency domains via sliding overlapping time windows and filter banks. Subsequently, we introduce the Pearson-Fisher combinational method along with Discriminant Correlation Analysis (DCA) for joint feature selection and fusion. These steps aim to refine raw electroencephalogram (EEG) features. For precise classification of binary MI problems, an Radial Basis Function (RBF)-kernel Support Vector Machine classifier is trained. To validate the efficacy of IFTFCP and evaluate it against other techniques, we conducted experimental investigations using two EEG datasets. Results indicate a notably superior classification performance, boasting an average accuracy of 78.14% and 85.98% on dataset 1 and dataset 2, which is better than other methods outlined in this article. The study’s findings suggest potential benefits for the advancement of MI-based BCI strategies, particularly in the domain of feature fusion. [ABSTRACT FROM AUTHOR]

The utmost issue in Motor Imagery Brain-Computer Interfaces (MI-BCI) is the BCI poor performance known as 'BCI inefficiency'. Although past research has attempted to find a solution by investigating factors influencing users' MI-BCI performance, the issue persists. One of the factors that has been studied in relation to MI-BCI performance is gender. Research regarding the influence of gender on a user's ability to control MI-BCIs remains inconclusive, mainly due to the small sample size and unbalanced gender distribution in past studies. To address these issues and obtain reliable results, this study combined four MI-BCI datasets into one large dataset with 248 subjects and equal gender distribution. The datasets included EEG signals from healthy subjects from both gender groups who had executed a right- vs. left-hand motor imagery task following the Graz protocol. The analysis consisted of extracting the Mu Suppression Index from C3 and C4 electrodes and comparing the values between female and male participants. Unlike some of the previous findings which reported an advantage for female BCI users in modulating mu rhythm activity, our results did not show any significant difference between the Mu Suppression Index of both groups, indicating that gender may not be a predictive factor for BCI performance. [ABSTRACT FROM AUTHOR]

Motor imagery (MI) paradigms have been widely used in neural rehabilitation and drowsiness state assessment. The progress in brain-computer interface (BCI) technology has emphasized the importance of accurately and efficiently detecting motor imagery intentions from electroencephalogram (EEG). Despite the recent breakthroughs made in developing EEG-based algorithms for decoding MI, the accuracy and efficiency of these models remain limited by technical challenges posed by cross-subject heterogeneity in EEG data processing and the scarcity of EEG data for training. Inspired by the optimal transport theory, this study aims to develop a novel three-stage transfer learning (TSTL) method, which uses the existing labeled data from a source domain to improve classification performance on an unlabeled target domain. Notably, the proposed method comprises three components, namely, the Riemannian tangent space mapping (RTSM), source domain transformer (SDT), and optimal subspace mapping (OSM). The RTSM maps a symmetric positive definite matrix from the Riemannian space to the tangent space to minimize the marginal probability distribution drift. The SDT transforms the source domain to a target domain by finding the optimal transport mapping matrix to reduce the joint probability distribution differences. The OSM finally maps the transformed source domain and original target domain to the same subspace to further mitigate the distribution discrepancy. The performance of the proposed method was validated on two public BCI datasets, and the average accuracy of the algorithm on two datasets was 72.24% and 69.29%. Our results demonstrated the improved performance of EEG-based MI detection in comparison with state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Robust classification of electroencephalogram data for motor imagery recognition is of paramount importance in brain–computer interface (BCI) domain. Since EEG signals are highly subject-dependent, inter-subject variations can greatly impair the robustness of motor imagery (MI) classification. Therefore, this study introduces a precisely designed deep learning architecture namely compact convolutional EEG classifier (CCEC) which achieves better performance in both precision and efficiency. Specifically, the recorded EEG signals are first denoised using multiscale principal component analysis (MSPCA) technique. Then, such raw EEG data are converted into small tempo-spatial data matrices with a two-step signal preprocessing technique. Finally, the tempo-spatial matrices are fed to the proposed CCEC model for MI classification. Experimental results on two benchmark datasets demonstrate that the proposed model not only performs exceptionally well in subject-specific case with an average classification accuracy of 98.2% on dataset 1 but also shows a reasonable average classification accuracy of 72.64% in the subject-independent case. Additionally, with a mere 10% adaptation to subject-specific data, a further improvement of 18% is achieved, thus attaining a noteworthy 90% accuracy in the inter-subject classification. Results also reveal that the proposed CCEC model is highly robust to noisy data, ensuring reliable performance in real-world scenarios. [ABSTRACT FROM AUTHOR]

The motor imagery brain-computer interface (MI-BCI) has the ability to use electroencephalogram (EEG) signals to control and communicate with external devices. By leveraging the unique characteristics of task-related brain signals, this system facilitates enhanced communication with these devices. Such capabilities hold significant potential for advancing rehabilitation and the development of assistive technologies. In recent years, deep learning has received considerable attention in the MI-BCI field due to its powerful feature extraction and classification capabilities. However, two factors significantly impact the performance of deep-learning models. The size of the EEG datasets influences how effectively these models can learn. Similarly, the ability of classification models to extract features directly affects their accuracy in recognizing patterns. In this paper, we propose a Multi-Scale Spatio-Temporal and Dynamic Graph Convolution Fusion Network (MST-DGCN) to address these issues. In the data-preprocessing stage, we employ two strategies, data augmentation and transfer learning, to alleviate the problem of an insufficient data volume in deep learning. By using multi-scale convolution, spatial attention mechanisms, and dynamic graph neural networks, our model effectively extracts discriminative features. The MST-DGCN mainly consists of three parts: the multi-scale spatio-temporal module, which extracts multi-scale information and refines spatial attention; the dynamic graph convolution module, which extracts key connectivity information; and the classification module. We conduct experiments on real EEG datasets and achieve an accuracy of 77.89% and a Kappa value of 0.7052, demonstrating the effectiveness of the MST-DGCN in MI-BCI tasks. Our research provides new ideas and methods for the further development of MI-BCI systems. [ABSTRACT FROM AUTHOR]

Abstract Background The most challenging aspect of rehabilitation is the repurposing of residual functional plasticity in stroke patients. To achieve this, numerous plasticity-based clinical rehabilitation programs have been developed. This study aimed to investigate the effects of motor imagery (MI)-based brain–computer interface (BCI) rehabilitation programs on upper extremity hand function in patients with chronic hemiplegia. Design A 2010 Consolidated Standards for Test Reports (CONSORT)-compliant randomized controlled trial. Methods Forty-six eligible stroke patients with upper limb motor dysfunction participated in the study, six of whom dropped out. The patients were randomly divided into a BCI group and a control group. The BCI group received BCI therapy and conventional rehabilitation therapy, while the control group received conventional rehabilitation only. The Fugl–Meyer Assessment of the Upper Extremity (FMA-UE) score was used as the primary outcome to evaluate upper extremity motor function. Additionally, functional magnetic resonance imaging (fMRI) scans were performed on all patients before and after treatment, in both the resting and task states. We measured the amplitude of low-frequency fluctuation (ALFF), regional homogeneity (ReHo), z conversion of ALFF (zALFF), and z conversion of ReHo (ReHo) in the resting state. The task state was divided into four tasks: left-hand grasping, right-hand grasping, imagining left-hand grasping, and imagining right-hand grasping. Finally, meaningful differences were assessed using correlation analysis of the clinical assessments and functional measures. Results A total of 40 patients completed the study, 20 in the BCI group and 20 in the control group. Task-related blood-oxygen-level-dependent (BOLD) analysis showed that when performing the motor grasping task with the affected hand, the BCI group exhibited significant activation in the ipsilateral middle cingulate gyrus, precuneus, inferior parietal gyrus, postcentral gyrus, middle frontal gyrus, superior temporal gyrus, and contralateral middle cingulate gyrus. When imagining a grasping task with the affected hand, the BCI group exhibited greater activation in the ipsilateral superior frontal gyrus (medial) and middle frontal gyrus after treatment. However, the activation of the contralateral superior frontal gyrus decreased in the BCI group relative to the control group. Resting-state fMRI revealed increased zALFF in multiple cerebral regions, including the contralateral precentral gyrus and calcarine and the ipsilateral middle occipital gyrus and cuneus, and decreased zALFF in the ipsilateral superior temporal gyrus in the BCI group relative to the control group. Increased zReHo in the ipsilateral cuneus and contralateral calcarine and decreased zReHo in the contralateral middle temporal gyrus, temporal pole, and superior temporal gyrus were observed post-intervention. According to the subsequent correlation analysis, the increase in the FMA-UE score showed a positive correlation with the mean zALFF of the contralateral precentral gyrus (r = 0.425, P

Background: The most challenging aspect of rehabilitation is the repurposing of residual functional plasticity in stroke patients. To achieve this, numerous plasticity-based clinical rehabilitation programs have been developed. This study aimed to investigate the effects of motor imagery (MI)-based brain–computer interface (BCI) rehabilitation programs on upper extremity hand function in patients with chronic hemiplegia. Design: A 2010 Consolidated Standards for Test Reports (CONSORT)-compliant randomized controlled trial. Methods: Forty-six eligible stroke patients with upper limb motor dysfunction participated in the study, six of whom dropped out. The patients were randomly divided into a BCI group and a control group. The BCI group received BCI therapy and conventional rehabilitation therapy, while the control group received conventional rehabilitation only. The Fugl–Meyer Assessment of the Upper Extremity (FMA-UE) score was used as the primary outcome to evaluate upper extremity motor function. Additionally, functional magnetic resonance imaging (fMRI) scans were performed on all patients before and after treatment, in both the resting and task states. We measured the amplitude of low-frequency fluctuation (ALFF), regional homogeneity (ReHo), z conversion of ALFF (zALFF), and z conversion of ReHo (ReHo) in the resting state. The task state was divided into four tasks: left-hand grasping, right-hand grasping, imagining left-hand grasping, and imagining right-hand grasping. Finally, meaningful differences were assessed using correlation analysis of the clinical assessments and functional measures. Results: A total of 40 patients completed the study, 20 in the BCI group and 20 in the control group. Task-related blood-oxygen-level-dependent (BOLD) analysis showed that when performing the motor grasping task with the affected hand, the BCI group exhibited significant activation in the ipsilateral middle cingulate gyrus, precuneus, inferior parietal gyrus, postcentral gyrus, middle frontal gyrus, superior temporal gyrus, and contralateral middle cingulate gyrus. When imagining a grasping task with the affected hand, the BCI group exhibited greater activation in the ipsilateral superior frontal gyrus (medial) and middle frontal gyrus after treatment. However, the activation of the contralateral superior frontal gyrus decreased in the BCI group relative to the control group. Resting-state fMRI revealed increased zALFF in multiple cerebral regions, including the contralateral precentral gyrus and calcarine and the ipsilateral middle occipital gyrus and cuneus, and decreased zALFF in the ipsilateral superior temporal gyrus in the BCI group relative to the control group. Increased zReHo in the ipsilateral cuneus and contralateral calcarine and decreased zReHo in the contralateral middle temporal gyrus, temporal pole, and superior temporal gyrus were observed post-intervention. According to the subsequent correlation analysis, the increase in the FMA-UE score showed a positive correlation with the mean zALFF of the contralateral precentral gyrus (r = 0.425, P < 0.05), the mean zReHo of the right cuneus (r = 0.399, P < 0.05). Conclusion: In conclusion, BCI therapy is effective and safe for arm rehabilitation after severe poststroke hemiparesis. The correlation of the zALFF of the contralateral precentral gyrus and the zReHo of the ipsilateral cuneus with motor improvements suggested that these values can be used as prognostic measures for BCI-based stroke rehabilitation. We found that motor function was related to visual and spatial processing, suggesting potential avenues for refining treatment strategies for stroke patients. Trial registration: The trial is registered in the Chinese Clinical Trial Registry (number ChiCTR2000034848, registered July 21, 2020). [ABSTRACT FROM AUTHOR]

The widely adopted paradigm in brain–computer interfaces (BCIs) involves motor imagery (MI), enabling improved communication between humans and machines. EEG signals derived from MI present several challenges due to their inherent characteristics, which lead to a complex process of classifying and finding the potential tasks of a specific participant. Another issue is that BCI systems can result in noisy data and redundant channels, which in turn can lead to increased equipment and computational costs. To address these problems, the optimal channel selection of a multiclass MI classification based on a Fusion convolutional neural network with Attention blocks (FCNNA) is proposed. In this study, we developed a CNN model consisting of layers of convolutional blocks with multiple spatial and temporal filters. These filters are designed specifically to capture the distribution and relationships of signal features across different electrode locations, as well as to analyze the evolution of these features over time. Following these layers, a Convolutional Block Attention Module (CBAM) is used to, further, enhance EEG signal feature extraction. In the process of channel selection, the genetic algorithm is used to select the optimal set of channels using a new technique to deliver fixed as well as variable channels for all participants. The proposed methodology is validated showing 6.41% improvement in multiclass classification compared to most baseline models. Notably, we achieved the highest results of 93.09% for binary classes involving left-hand and right-hand movements. In addition, the cross-subject strategy for multiclass classification yielded an impressive accuracy of 68.87%. Following channel selection, multiclass classification accuracy was enhanced, reaching 84.53%. Overall, our experiments illustrated the efficiency of the proposed EEG MI model in both channel selection and classification, showing superior results with either a full channel set or a reduced number of channels. [ABSTRACT FROM AUTHOR]

Introduction: Within the development of brain-computer interface (BCI) systems, it is crucial to consider the impact of brain network dynamics and neural signal transmission mechanisms on electroencephalogram-based motor imagery (MI-EEG) tasks. However, conventional deep learning (DL) methods cannot reflect the topological relationship among electrodes, thereby hindering the effective decoding of brain activity. Methods: Inspired by the concept of brain neuronal forward-forward (F-F) mechanism, a novel DL framework based on Graph Neural Network combined forward-forwardmechanism(F-FGCN) is presented. F-FGCN framework aims to enhance EEG signal decoding performance by applying functional topological relationships and signal propagation mechanism. The fusion process involves converting the multi-channel EEG into a sequence of signals and constructing a network grounded on the Pearson correlation coeffcient, effectively representing the associations between channels. Our model initially pre-trains the Graph Convolutional Network (GCN), and fine-tunes the output layer to obtain the feature vector. Moreover, the F-F model is used for advanced feature extraction and classification. Results and discussion: Achievement of F-FGCN is assessed on the PhysioNet dataset for a four-class categorization, compared with various classical and state-of-the-art models. The learned features of the F-FGCN substantially amplify the performance of downstream classifiers, achieving the highest accuracy of 96.11% and 82.37% at the subject and group levels, respectively. Experimental results affirm the potency of FFGCN in enhancing EEG decoding performance, thus paving the way for BCI applications. [ABSTRACT FROM AUTHOR]

Introduction: In recent years, the decoding of motor imagery (MI) from electroencephalography (EEG) signals has become a focus of research for brain-machine interfaces (BMIs) and neurorehabilitation. However, EEG signals present challenges due to their non-stationarity and the substantial presence of noise commonly found in recordings, making it difficult to design highly effective decoding algorithms. These algorithms are vital for controlling devices in neurorehabilitation tasks, as they activate the patient's motor cortex and contribute to their recovery. Methods: This study proposes a novel approach for decoding MI during pedalling tasks using EEG signals. A widespread approach is based on feature extraction using Common Spatial Patterns (CSP) followed by a linear discriminant analysis (LDA) as a classifier. The first approach covered in this work aims to investigate the efficacy of a task-discriminative feature extraction method based on CSP filter and LDA classifier. Additionally, the second alternative hypothesis explores the potential of a spectro-spatial Convolutional Neural Network (CNN) to further enhance the performance of the first approach. The proposed CNN architecture combines a preprocessing pipeline based on filter banks in the frequency domain with a convolutional neural network for spectro-temporal and spectro-spatial feature extraction. Results and discussion: To evaluate the approaches and their advantages and disadvantages, EEG data has been recorded fromseveral able-bodied users while pedalling in a cycle ergometer in order to train motor imagery decodingmodels. The results show levels of accuracy up to 80% in some cases. The CNN approach shows greater accuracy despite higher instability. [ABSTRACT FROM AUTHOR]

Motor imagery refers to the brain’s response during the mental simulation of physical activities, which can be detected through electroencephalogram (EEG) signals. However, EEG signals exhibit a low signal-to-noise ratio (SNR) due to various artifacts originating from other physiological sources. To enhance the classification performance of motor imagery tasks by increasing the SNR of EEG signals, several signal decomposition approaches have been proposed. Empirical mode decomposition (EMD) has shown promising results in extracting EEG components associated with motor imagery tasks more effectively than traditional linear decomposition algorithms such as Fourier and wavelet methods. Nevertheless, the EMD-based algorithm suffers from a significant challenge known as mode mixing, where frequency components intertwine with the intrinsic mode functions obtained through EMD. This issue severely hampers the accuracy of motor imagery classification. Despite numerous algorithms proposed, mode mixing remains a persistent issue. In this paper, we propose the Deep-EMD algorithm, a deep neural network-based approach to mode mixing problem. We employ two datasets to compare the motor imagery classification and mode mixing improvement achieved by the conventional EMD algorithms. Our experimental results demonstrate that the Deep-EMD algorithm effectively mitigates the mode mixing problem in decomposed EEG components, leading to improved motor imagery classification performance.

We propose EEG-SimpleConv, a straightforward 1D convolutional neural network for Motor Imagery decoding in BCI. Our main motivation is to propose a simple and performing baseline that achieves high classification accuracy, using only standard ingredients from the literature, to serve as a standard for comparison. The proposed architecture is composed of standard layers, including 1D convolutions, batch normalisations, ReLU activation functions and pooling functions. EEG-SimpleConv architecture is accompanied by a straightforward and tailored training routine, which is subjected to an extensive ablation study to quantify the influence of its components. We evaluate its performance on four EEG Motor Imagery datasets, including simulated online setups, and compare it to recent Deep Learning and Machine Learning approaches. EEG-SimpleConv is at least as good or far more efficient than other approaches, showing strong knowledge-transfer capabilities across subjects, at the cost of a low inference time. We believe that using standard components and ingredients can significantly help the adoption of Deep Learning approaches for BCI. We make the code of the models and the experiments accessible.

The motor imagery brain-computer interface (MI-BCI) based on electroencephalography (EEG) is a widely used human-machine interface paradigm. However, due to the non-stationarity and individual differences among subjects in EEG signals, the decoding accuracy is limited, affecting the application of the MI-BCI. In this paper, we propose the EISATC-Fusion model for MI EEG decoding, consisting of inception block, multi-head self-attention (MSA), temporal convolutional network (TCN), and layer fusion. Specifically, we design a DS Inception block to extract multi-scale frequency band information. And design a new cnnCosMSA module based on CNN and cos attention to solve the attention collapse and improve the interpretability of the model. The TCN module is improved by the depthwise separable convolution to reduces the parameters of the model. The layer fusion consists of feature fusion and decision fusion, fully utilizing the features output by the model and enhances the robustness of the model. We improve the two-stage training strategy for model training. Early stopping is used to prevent model overfitting, and the accuracy and loss of the validation set are used as indicators for early stopping. The proposed model achieves within-subject classification accuracies of 84.57% and 87.58% on BCI Competition IV Datasets 2a and 2b, respectively. And the model achieves cross-subject classification accuracies of 67.42% and 71.23% (by transfer learning) when training the model with two sessions and one session of Dataset 2a, respectively. The interpretability of the model is demonstrated through weight visualization method.

For Brain-Computer Interface (BCI) based on motor imagery (MI), the MI task is abstract and spontaneous, presenting challenges in measurement and control and resulting in a lower signal-to-noise ratio. The quality of the collected MI data significantly impacts the cross-subject calibration results. To address this challenge, we introduce a novel cross-subject calibration method based on passive tactile afferent stimulation, in which data induced by tactile stimulation is utilized to calibrate transfer learning models for cross-subject decoding. During the experiments, tactile stimulation was applied to either the left or right hand, with subjects only required to sense tactile stimulation. Data from these tactile tasks were used to train or fine-tune models and subsequently applied to decode pure MI data. We evaluated BCI performance using both the classical Common Spatial Pattern (CSP) combined with the Linear Discriminant Analysis (LDA) algorithm and a state-of-the-art deep transfer learning model. The results demonstrate that the proposed calibration method achieved decoding performance at an equivalent level to traditional MI calibration, with the added benefit of outperforming traditional MI calibration with fewer trials. The simplicity and effectiveness of the proposed cross-subject tactile calibration method make it valuable for practical applications of BCI, especially in clinical settings.

Convolutional neural networks (CNNs) have been successfully applied to motor imagery (MI)-based brain–computer interface (BCI). Nevertheless, single-scale CNN fail to extract abundant information over a wide spectrum from EEG signals, while typical multi-scale CNNs cannot effectively fuse information from different scales with concatenation-based methods. To overcome these challenges, we propose a new scheme equipped with attention-based dual-scale fusion convolutional neural network (ADFCNN), which jointly extracts and fuses EEG spectral and spatial information at different scales. This scheme also provides novel insight through self-attention for effective information fusion from different scales. Specifically, temporal convolutions with two different kernel sizes identify EEG $\boldsymbol{\mu }$ and $\boldsymbol{\beta }$ rhythms, while spatial convolutions at two different scales generate global and detailed spatial information, respectively, and the self-attention mechanism performs feature fusion based on the internal similarity of the concatenated features extracted by the dual-scale CNN. The proposed scheme achieves the superior performance compared with state-of-the-art methods in subject-specific motor imagery recognition on BCI Competition IV dataset 2a, 2b and OpenBMI dataset, with the cross-session average classification accuracies of 79.39% and significant improvements of 9.14% on BCI-IV2a, 87.81% and 7.66% on BCI-IV2b, 65.26% and 7.2% on OpenBMI dataset, and the within-session average classification accuracies of 86.87% and significant improvements of 10.89% on BCI-IV2a, 87.26% and 8.07% on BCI-IV2b, 84.29% and 5.17% on OpenBMI dataset, respectively. What is more, ablation experiments are conducted to investigate the mechanism and demonstrate the effectiveness of the dual-scale joint temporal-spatial CNN and self-attention modules. Visualization is also used to reveal the learning process and feature distribution of the model.

This paper presents an innovative approach for the Feature Extraction method using Self-Attention, incorporating various Feature Selection techniques known as the AtSiftNet method to enhance the classification performance of motor imaginary activities using electrophotography (EEG) signals. Initially, the EEG signals were sorted and then denoised using multiscale principal component analysis to obtain clean EEG signals. However, we also conducted a non-denoised experiment. Subsequently, the clean EEG signals underwent the Self-Attention feature extraction method to compute the features of each trial (i.e., 350×18). The best 1 or 15 features were then extracted through eight different feature selection techniques. Finally, five different machine learning and neural network classification models were employed to calculate the accuracy, sensitivity, and specificity of this approach. The BCI competition III dataset IV-a was utilized for all experiments, encompassing the datasets of five volunteers who participated in the competition. The experiment findings reveal that the average accuracy of classification is highest among ReliefF (i.e., 99.946%), Mutual Information (i.e., 98.902%), Independent Component Analysis (i.e., 99.62%), and Principal Component Analysis (i.e., 98.884%) for both 1 and 15 best-selected features from each trial. These accuracies were obtained for motor imagery using a Support Vector Machine (SVM) as a classifier. In addition, five-fold validation was performed in this paper to assess the fair performance estimation and robustness of the model. The average accuracy obtained through five-fold validation is 99.89%. The experiments’ findings indicate that the suggested framework provides a resilient biomarker with minimal computational complexity, making it a suitable choice for advancing Motor Imagery Brain–Computer Interfaces (BCI).

AbstractThe electroencephalogram (EEG) of the patient is used to identify their motor intention, which is then converted into a control signal through a brain-computer interface (BCI) based on motor imagery. Whenever gathering features from EEG signals, making a BCI is difficult in part because of the enormous dimensionality of the data. Three stages make up the suggested methodology: pre-processing, extraction of features, selection, and categorization. To remove unwanted artifacts, the EEG signals are filtered by a fifth-order Butterworth multichannel band-pass filter. This decreases execution time and memory use, both of which improve system performance. Then a novel multichannel optimized CSP-ICA feature extraction technique is used to separate and eliminate non-discriminative information from discriminative information in the EEG channels. Furthermore, CSP uses the concept of an Artificial Bee Colony (ABC) algorithm to automatically identify the simultaneous global ideal frequency band and time interval combination for the extraction and classification of common spatial pattern characteristics. Finally, a Tunable optimized feed-forward neural network (FFNN) classifier is utilized to extract and categorize the temporal and frequency domain features, which employs an FFNN classifier with Tunable-Q wavelet transform. The proposed framework, therefore optimizes signal processing, enabling enhanced EEG signal classification for BCI applications. The result shows that the models that use Tunable optimized FFNN produce higher classification accuracy of more than 20% when compared to the existing models. [ABSTRACT FROM AUTHOR]

Electroencephalography (EEG)-based brain—computer interface (BCI) is a non-invasive technology with potential in various healthcare applications, including stroke rehabilitation and neuro-feedback training. These applications typically require multi-channel EEG. However, setting up a multi-channel EEG headset is time-consuming, potentially resulting in patient reluctance to use the system despite its potential benefits. Therefore, we investigated the appropriate number of electrodes required for a successful BCI application in wearable devices using various numbers of EEG channels. EEG multi-frequency features were extracted using the "filter bank" feature extraction technique. A support vector machine (SVM) was used to classify a left/right-hand opening/closing motor imagery (MI) task. Nine electrodes around the center of the scalp (F3, Fz, F4, C3, Cz, C4, P3, Pz, and P4) provided high classification accuracy with a moderate setup time; hence, this system was selected as the minimal number of required channels. Spherical spline interpolation (SSI) was also applied to investigate the feasibility of generating EEG signals from limited channels on an EEG headset. We found classification accuracies of interpolated groups only, and combined interpolated and collected groups were significantly lower than the measured groups. The results indicate that SSI may not provide additional EEG data to improve classification accuracy of the collected minimal channels. The conclusion is that other techniques could be explored or a sufficient number of EEG channels must be collected without relying on generated data. Our proposed method, which uses a filter bank feature, session-dependent training, and the exploration of many groups of EEG channels, offers the possibility of developing a successful BCI application using minimal channels on an EEG device. [ABSTRACT FROM AUTHOR]

Motor imagery (MI) electroencephalogram (EEG) signal is recognized as a promising paradigm for brain-computer interface (BCI) systems and has been extensively employed in various BCI applications, including assisting disabled individuals, controlling devices and environments, and enhancing human capabilities. The high-performance decoding capability of MI-EEG signals is a key issue that impacts the development of the industry. However, decoding MI-EEG signals is challenging due to the low signal-to-noise ratio and inter-subject variability. In response to the aforementioned core problems, this paper proposes a novel end-to-end network, a fusion multi-branch 1D convolutional neural network (EEG-FMCNN), to decode MI-EEG signals without pre-processing. The utilization of multi-branch 1D convolution not only exhibits a certain level of noise tolerance but also addresses the issue of inter-subject variability to some extent. This is attributed to the ability of multi-branch architectures to capture information from different frequency bands, enabling the establishment of optimal convolutional scales and depths. Furthermore, we incorporate 1D squeeze-and-excitation (SE) blocks and shortcut connections at appropriate locations to further enhance the generalization and robustness of the network. In the BCI Competition IV-2a dataset, our proposed model has obtained good experimental results, achieving accuracies of 78.82% and 68.41% for subject-dependent and subject-independent modes, respectively. In addition, extensive ablative experiments and fine-tuning experiments were conducted, resulting in a notable 7% improvement in the average performance of the network, which holds significant implications for the generalization and application of the network. [ABSTRACT FROM AUTHOR]

Motor imagery (MI) brain-computer interface (BCI) assist users in establishing direct communication between their brain and external devices by decoding the movement intention of human electroencephalogram (EEG) signals. However, cerebral cortical potentials are highly rhythmic and sub-band features, different experimental situations and subjects have different categories of semantic information in specific sample target spaces. Feature fusion can lead to more discriminative features, but simple fusion of features from different embedding spaces leading to the model global loss is not easily convergent and ignores the complementarity of features. Considering the similarity and category contribution of different sub-band features, we propose a multi-band centroid contrastive reconstruction fusion network (MB-CCRF). We obtain multi-band spatio-temporal features by frequency division, preserving the task-related rhythmic features of different EEG signals; use a multi-stream cross-layer connected convolutional network to perform a deep feature representation for each sub-band separately; propose a centroid contrastive reconstruction fusion module, which maps different sub-band and category features into the same shared embedding space by comparing with category prototypes, reconstructing the feature semantic structure to ensure that the global loss of the fused features converges more easily. Finally, we use a learning mechanism to model the similarity between channel features and use it as the weight of fused sub-band features, thus enhancing the more discriminative features, suppressing the useless features. The experimental accuracy is 79.96% in the BCI competition Ⅳ-Ⅱa dataset. Moreover, the classification effect of sub-band features of different subjects is verified by comparison tests, the category propensity of different sub-band features is verified by confusion matrix tests and the distribution in different classes of each sub-band feature and fused feature are showed by visual analysis, revealing the importance of different sub-band features for the EEG-based MI classification task.

The accuracy of classifying motor imagery (MI) activities is a significant challenge when using brain–computer interfaces (BCIs). BCIs allow people with motor impairments to control external devices directly with their brains using electroencephalogram (EEG) patterns that translate brain activity into control signals. Many researchers have been working to develop MI-based BCI recognition systems using various time-frequency feature extraction and classification approaches. However, the existing systems still face challenges in achieving satisfactory performance due to large amount of non-discriminative and ineffective features. To get around these problems, we suggested a multiband decomposition-based feature extraction and classification method that works well, along with a strong feature selection method for MI tasks. Our method starts by splitting the preprocessed EEG signal into four sub-bands. In each sub-band, we then used a common spatial pattern (CSP) technique to pull out narrowband-oriented useful features, which gives us a high-dimensional feature vector. Subsequently, we utilized an effective feature selection method, Relief-F, which reduces the dimensionality of the final features. Finally, incorporating advanced classification techniques, we classified the final reduced feature vector. To evaluate the proposed model, we used the three different EEG-based MI benchmark datasets, and our proposed model achieved better performance accuracy than existing systems. Our model’s strong points include its ability to effectively reduce feature dimensionality and improve classification accuracy through advanced feature extraction and selection methods.

Abstract Background Motor imagery brain-computer interfaces (BCIs) is a classic and potential BCI technology achieving brain computer integration. In motor imagery BCI, the operational frequency band of the EEG greatly affects the performance of motor imagery EEG recognition model. However, as most algorithms used a broad frequency band, the discrimination from multiple sub-bands were not fully utilized. Thus, using convolutional neural network (CNNs) to extract discriminative features from EEG signals of different frequency components is a promising method in multisubject EEG recognition. Methods This paper presents a novel overlapping filter bank CNN to incorporate discriminative information from multiple frequency components in multisubject motor imagery recognition. Specifically, two overlapping filter banks with fixed low-cut frequency or sliding low-cut frequency are employed to obtain multiple frequency component representations of EEG signals. Then, multiple CNN models are trained separately. Finally, the output probabilities of multiple CNN models are integrated to determine the predicted EEG label. Results Experiments were conducted based on four popular CNN backbone models and three public datasets. And the results showed that the overlapping filter bank CNN was efficient and universal in improving multisubject motor imagery BCI performance. Specifically, compared with the original backbone model, the proposed method can improve the average accuracy by 3.69 percentage points, F1 score by 0.04, and AUC by 0.03. In addition, the proposed method performed best among the comparison with the state-of-the-art methods. Conclusion The proposed overlapping filter bank CNN framework with fixed low-cut frequency is an efficient and universal method to improve the performance of multisubject motor imagery BCI.

Brain-computer interface (BCI) technology is a topic of study with assistive robot systems that are expanding significantly nowadays. Several advancements have been made in the BCI sector to aid disabled people. However, most studies have used more electrodes, and most design structures are different from the anatomy of the human hand. To control robot fingers like real human hands with fewer electrodes is yet to be developed. This research aims to investigate the controllability of robot fingers using motor imagery. The proposed electroencephalogram (EEG) acquisition system comprises eight EEG electrodes attached to the primary motor cortex region of the human brain. The real human hand's anatomical behavior aided in the robot's development. Initially, the performance of the robot finger model was evaluated on the computer simulation. Finally, a robot model was developed, and flexion and extension movements were examined. According to the experiment's findings, finger flexion and extension control with eight EEG electrodes showed promising results with an accuracy of 90.0±1.43% and a precision of 0.89. Furthermore, we observed that as people age, the accuracy of robot control decreases.

IntroductionIn recent years, the decoding of motor imagery (MI) from electroencephalography (EEG) signals has become a focus of research for brain-machine interfaces (BMIs) and neurorehabilitation. However, EEG signals present challenges due to their non-stationarity and the substantial presence of noise commonly found in recordings, making it difficult to design highly effective decoding algorithms. These algorithms are vital for controlling devices in neurorehabilitation tasks, as they activate the patient's motor cortex and contribute to their recovery.MethodsThis study proposes a novel approach for decoding MI during pedalling tasks using EEG signals. A widespread approach is based on feature extraction using Common Spatial Patterns (CSP) followed by a linear discriminant analysis (LDA) as a classifier. The first approach covered in this work aims to investigate the efficacy of a task-discriminative feature extraction method based on CSP filter and LDA classifier. Additionally, the second alternative hypothesis explores the potential of a spectro-spatial Convolutional Neural Network (CNN) to further enhance the performance of the first approach. The proposed CNN architecture combines a preprocessing pipeline based on filter banks in the frequency domain with a convolutional neural network for spectro-temporal and spectro-spatial feature extraction.Results and discussionTo evaluate the approaches and their advantages and disadvantages, EEG data has been recorded from several able-bodied users while pedalling in a cycle ergometer in order to train motor imagery decoding models. The results show levels of accuracy up to 80% in some cases. The CNN approach shows greater accuracy despite higher instability.

The key to electroencephalography (EEG)-based brain-computer interface (BCI) lies in neural decoding, and its accuracy can be improved by using hybrid BCI paradigms, that is, fusing multiple paradigms. However, hybrid BCIs usually require separate processing processes for EEG signals in each paradigm, which greatly reduces the efficiency of EEG feature extraction and the generalizability of the model. Here, we propose a two-stream convolutional neural network (TSCNN) based hybrid brain-computer interface. It combines steady-state visual evoked potential (SSVEP) and motor imagery (MI) paradigms. TSCNN automatically learns to extract EEG features in the two paradigms in the training process and improves the decoding accuracy by 25.4% compared with the MI mode, and 2.6% compared with SSVEP mode in the test data. Moreover, the versatility of TSCNN is verified as it provides considerable performance in both single-mode (70.2% for MI, 93.0% for SSVEP) and hybrid-mode scenarios (95.6% for MI-SSVEP hybrid). Our work will facilitate the real-world applications of EEG-based BCI systems.

A Brain–Computer Interface (BCI) is a medium for communication between the human brain and computers, which does not rely on other human neural tissues, but only decodes Electroencephalography (EEG) signals and converts them into commands to control external devices. Motor Imagery (MI) is an important BCI paradigm that generates a spontaneous EEG signal without external stimulation by imagining limb movements to strengthen the brain's compensatory function, and it has a promising future in the field of computer-aided diagnosis and rehabilitation technology for brain diseases. However, there are a series of technical difficulties in the research of motor imagery-based brain–computer interface (MI-BCI) systems, such as: large individual differences in subjects and poor performance of the cross-subject classification model; a low signal-to-noise ratio of EEG signals and poor classification accuracy; and the poor online performance of the MI-BCI system. To address the above problems, this paper proposed a combined virtual electrode-based EEG Source Analysis (ESA) and Convolutional Neural Network (CNN) method for MI-EEG signal feature extraction and classification. The outcomes reveal that the online MI-BCI system developed based on this method can improve the decoding ability of multi-task MI-EEG after training, it can learn generalized features from multiple subjects in cross-subject experiments and has some adaptability to the individual differences of new subjects, and it can decode the EEG intent online and realize the brain control function of the intelligent cart, which provides a new idea for the research of an online MI-BCI system. [ABSTRACT FROM AUTHOR]

Brain–Computer Interfaces (BCIs) communicate between a given user and their nearest environment through brain signals. In the case of device handling, an accurate control-based BCI depends essentially on how the user performs corresponding mental tasks. In the BCI illiteracy-related literature, one subject could perform a defined paradigm better than another. Therefore, this work aims to identify recorded Electroencephalogram (EEG) signal segments related to the executed and imagined motor tasks for BCI system applications. The proposed approach implements pass-band filters and the Fast Independent Component Analysis (FastICA) algorithm to separate independent sources from raw EEG signals. Next, EEG features of selected channels are extracted using Hjorth parameters. Finally, a Support Vector Machines (SVMs)-based classifier identifies executed and imagined motor features. Concretely, the Physionet dataset, related to executed and imagined motor EEG signals, provided training, testing, and validating data. The numerical results let us discriminate between executed and imagined motor tasks accurately. Therefore, the proposed method offers a reliable alternative to extract EEG features for BCI based on executed and imagined movements. [ABSTRACT FROM AUTHOR]

Abstract As the main component of Brain-computer interface (BCI) technology, the classification algorithm based on EEG has developed rapidly. The previous algorithms were often based on subject-dependent settings, resulting in BCI needing to be calibrated for new users. In this work, we propose IMH-Net, an end-to-end subject-independent model. The model first uses Inception blocks extracts the frequency domain features of the data, then further compresses the feature vectors to extract the spatial domain features, and finally learns the global information and classification through Multi-Head Attention mechanism. On the OpenBMI dataset, IMH-Net obtained 73.90 ± 13.10% accuracy and 73.09 ± 14.99% F1-score in subject-independent manner, which improved the accuracy by 1.96% compared with the comparison model. On the BCI competition IV dataset 2a, this model also achieved the highest accuracy and F1-score in subject-dependent manner. The IMH-Net model we proposed can improve the accuracy of subject-independent Motor Imagery (MI), and the robustness of the algorithm is high, which has strong practical value in the field of BCI. [ABSTRACT FROM AUTHOR]

Recently, the discipline of Brain-Computer-Interface (BCI) has attracted attention to exploiting Electroencephalograph (EEG) mental activities such as Motor Imagery (MI). Neurons in the human brain are activated during these MI tasks and generate an electrical potential of small magnitude reached to the scalp as a signal. Classification of MI data is a primary problem in BCI systems. Classification accuracy of these biomedical signals emerges as a significant task in the scientific community. This work proposes two main ideas: a new preprocessing technique based on four EEG frequency bands and a new stacking method for three deep-learning architectures used to decode three classes of MI signals. The preprocessing stage was introduced using Fast Fourier Transform to perform frequency analysis and data aggregation functions to enhance the data view. Performance was evaluated using well-defined metrics: accuracy, precision, recall, and f1-score for multiple batch sizes, optimizers, and epochs. Experimental results were evaluated using a publicly available dataset (BCI Competition IV dataset 2a) and local data collected from four subjects using the EMOTIV EPOC headset. The highest f1-scores achieved with the R-CNN model were 94% and 84% using the aforementioned datasets. Our proposed models also outperform many related models studied in the literature. [ABSTRACT FROM AUTHOR]

This article presents a method for extracting neural signal features to identify the imagination of left- and right-hand grasping movements. A functional magnetic resonance imaging (fMRI) experiment is employed to identify four brain regions with significant activations during motor imagery (MI) and the effective connections between these regions of interest (ROIs) were calculated using Dynamic Window-level Granger Causality (DWGC). Then, a real-time fMRI (rt-fMRI) classification system for left- and right-hand MI is developed using the Open-NFT platform. We conducted data acquisition and processing on three subjects, and all of whom were recruited from a local college. As a result, the maximum accuracy of using Support Vector Machine (SVM) classifier on real-time three-class classification (rest, left hand, and right hand) with effective connections is 69.3%. And it is 3% higher than that of traditional multivoxel pattern classification analysis on average. Moreover, it significantly improves classification accuracy during the initial stage of MI tasks while reducing the latency effects in real-time decoding. The study suggests that the effective connections obtained through the DWGC method serve as valuable features for real-time decoding of MI using fMRI. Moreover, they exhibit higher sensitivity to changes in brain states. This research offers theoretical support and technical guidance for extracting neural signal features in the context of fMRI-based studies. [ABSTRACT FROM AUTHOR]

Non-stationarity of EEG signals leads to high variability between subjects, making it challenging to directly use data from other subjects (source domain) for the classifier in the current subject (target domain). In this study, we propose MI-DAGSC to address domain adaptation challenges in EEG-based motor imagery (MI) decoding. By combining domain-level information, class-level information, and inter-sample structure information, our model effectively aligns the feature distributions of source and target domains. This work is an extension of our previous domain adaptation work MI-DABAN (Li et al., 2023). Based on MI-DABAN, MI-DAGSC designs Sample-Feature Blocks (SFBs) and Graph Convolution Blocks (GCBs) to focus on intra-sample and inter-sample information. The synergistic integration of SFBs and GCBs enable the model to capture comprehensive information and understand the relationship between samples, thus improving representation learning. Furthermore, we introduce a triplet loss to enhance the alignment and compactness of feature representations. Extensive experiments on real EEG datasets demonstrate the effectiveness of MI-DAGSC, confirming that our method makes a valuable contribution to the MI-EEG decoding. Moreover, it holds great potential for various applications in brain–computer interface systems and neuroscience research. And the code of the proposed architecture in this study is available under https://github.com/zhangdx21/MI-DAGSC. • A model for reducing individual variability and leveraging all subjects' labeled data. • A domain adaptive method considering comprehensive information. • A framework for exploring inter-sample knowledge in EEG signals. • Non-shared Adversarial Method for Precise Distribution Alignment. [ABSTRACT FROM AUTHOR]

A brain–computer interface (BCI) is a computer-based system that allows for communication between the brain and the outer world, enabling users to interact with computers using neural activity. This brain signal is obtained from electroencephalogram (EEG) signals. A significant obstacle to the development of BCIs based on EEG is the classification of subject-independent motor imagery data since EEG data are very individualized. Deep learning techniques such as the convolutional neural network (CNN) have illustrated their influence on feature extraction to increase classification accuracy. In this paper, we present a multi-branch (five branches) 2D convolutional neural network that employs several hyperparameters for every branch. The proposed model achieved promising results for cross-subject classification and outperformed EEGNet, ShallowConvNet, DeepConvNet, MMCNN, and EEGNet_Fusion on three public datasets. Our proposed model, EEGNet Fusion V2, achieves 89.6% and 87.8% accuracy for the actual and imagined motor activity of the eegmmidb dataset and scores of 74.3% and 84.1% for the BCI IV-2a and IV-2b datasets, respectively. However, the proposed model has a bit higher computational cost, i.e., it takes around 3.5 times more computational time per sample than EEGNet_Fusion. [ABSTRACT FROM AUTHOR]

• The increase of decoding precision of motor imaging EEG signal. • The hybrid temporal-spatial convolution and Transformer method achieves good results. • Multi-head self-attention mechanism can better extract features. • The training parameters are few, the time is short, and the precision is high. Motor imagery (MI) is a brain-computer interface (BCI) technique in which specific brain regions are activated when people imagine their limbs (or muscles) moving, even without actual movement. The technology converts electroencephalogram (EEG) signals generated by the brain into computer-readable commands by measuring neural activity. Classification of motor imagery is one of the tasks in BCI. Researchers have done a lot of work on motor imagery classification, and the existing literature has relatively mature decoding methods for two-class motor tasks. However, as the categories of EEG-based motor imagery tasks increase, further exploration is needed for decoding research on four-class motor imagery tasks. In this study, we designed a hybrid neural network that combines spatiotemporal convolution and attention mechanisms. Specifically, the data is first processed by spatiotemporal convolution to extract features and then processed by a Multi-branch Convolution block. Finally, the processed data is input into the encoder layer of the Transformer for a self-attention calculation to obtain the classification results. Our approach was tested on the well-known MI datasets BCI Competition IV 2a and 2b, and the results show that the 2a dataset has a global average classification accuracy of 83.3% and a kappa value of 0.78. Experimental results show that the proposed method outperforms most of the existing methods. [ABSTRACT FROM AUTHOR]

Motor imagery (MI) is a traditional paradigm of brain-computer interface (BCI) and can assist users in creating direct connections between their brains and external equipment. The common spatial patterns algorithm is the most popular spatial filtering technique for collecting EEG signal features in MI-based BCI systems. Due to the defect that it only considers the spatial information of EEG signals and is susceptible to noise interference and other issues, its performance is diminished. In this study, we developed a Riemannian transform feature extraction method based on filter bank fusion with a combination of multiple time windows. First, we proposed the multi-time window data segmentation and recombination method by combining it with a filter group to create new data samples. This approach could capture individual differences due to the variation in time-frequency patterns across different participants, thereby improving the model's generalization performance. Second, Riemannian geometry was used for feature extraction from non-Euclidean structured EEG data. Then, considering the non-Gaussian distribution of EEG signals, the neighborhood component analysis (NCA) algorithm was chosen for feature selection. Finally, to meet real-time requirements and a low complexity, we employed a Support Vector Machine (SVM) as the classification algorithm. The proposed model achieved improved accuracy and robustness. In this study, we proposed an algorithm with superior performance on the BCI Competition IV dataset 2a, achieving an accuracy of 89%, a kappa value of 0.73 and an AUC of 0.9, demonstrating advanced capabilities. Furthermore, we analyzed data collected in our laboratory, and the proposed method achieved an accuracy of 77.4%, surpassing other comparative models. This method not only significantly improved the classification accuracy of motor imagery EEG signals but also bore significant implications for applications in the fields of brain-computer interfaces and neural engineering.