Search

A robust decoding model that can efficiently deal with the subject and period variation is urgently needed to apply the brain-computer interface (BCI) system. The performance of most electroencephalogram (EEG) decoding models depends on the characteristics of specific subjects and periods, which require calibration and training with annotated data prior to application. However, this situation will become unacceptable as it would be difficult for subjects to collect data for an extended period, especially in the rehabilitation process of disability based on motor imagery (MI). To address this issue, we propose an unsupervised domain adaptation framework called iterative self-training multisubject domain adaptation (ISMDA) that focuses on the offline MI task. First, the feature extractor is purposefully designed to map the EEG to a latent space of discriminative representations. Second, the attention module based on dynamic transfer matches the source domain and target domain samples with a higher coincidence degree in latent space. Then, an independent classifier oriented to the target domain is employed in the first stage of the iterative training process to cluster the samples of the target domain through similarity. Finally, a pseudolabel algorithm based on certainty and confidence is employed in the second stage of the iterative training process to adequately calibrate the error between prediction and empirical probabilities. To evaluate the effectiveness of the model, extensive testing has been performed on three publicly available MI datasets, the BCI IV IIa, the High gamma dataset, and Kwon et al. datasets. The proposed method achieved 69.51%, 82.38%, and 90.98% cross-subject classification accuracy on the three datasets, which outperforms the current state-of-the-art offline algorithms. Meanwhile, all results demonstrated that the proposed method could address the main challenges of the offline MI paradigm.

Objective . The extensive application of electroencephalography (EEG) in brain-computer interfaces (BCIs) can be attributed to its non-invasive nature and capability to offer high-resolution data. The acquisition of EEG signals is a straightforward process, but the datasets associated with these signals frequently exhibit data scarcity and require substantial resources for proper labeling. Furthermore, there is a significant limitation in the generalization performance of EEG models due to the substantial inter-individual variability observed in EEG signals. Approach . To address these issues, we propose a novel self-supervised contrastive learning framework for decoding motor imagery (MI) signals in cross-subject scenarios. Specifically, we design an encoder combining convolutional neural network and attention mechanism. In the contrastive learning training stage, the network undergoes training with the pretext task of data augmentation to minimize the distance between pairs of homologous transformations while simultaneously maximizing the distance between pairs of heterologous transformations. It enhances the amount of data utilized for training and improves the network's ability to extract deep features from original signals without relying on the true labels of the data. Main results . To evaluate our framework's efficacy, we conduct extensive experiments on three public MI datasets: BCI IV IIa, BCI IV IIb, and HGD datasets. The proposed method achieves cross-subject classification accuracies of 67.32%, 82.34%, and 81.13%on the three datasets, demonstrating superior performance compared to existing methods. Significance . Therefore, this method has great promise for improving the performance of cross-subject transfer learning in MI-based BCI systems., (© 2024 IOP Publishing Ltd.)

Electroencephalography-based Brain Computer Interfaces (BCIs) invariably have a degenerate performance due to the considerable individual variability. To address this problem, we develop a novel domain adaptation method with optimal transport and frequency mixup for cross-subject transfer learning in motor imagery BCIs. Specifically, the preprocessed EEG signals from source and target domain are mapped into latent space with an embedding module, where the representation distributions and label distributions across domains have a large discrepancy. We assume that there exists a non-linear coupling matrix between both domains, which can be utilized to estimate the distance of joint distributions for different domains. Depending on the optimal transport, the Wasserstein distance between source and target domains is minimized, yielding the alignment of joint distributions. Moreover, a new mixup strategy is also introduced to generalize the model, where the inputs trials are mixed in frequency domain rather than in raw space. The extensive experiments on three evaluation benchmarks are conducted to validate the proposed framework. All the results demonstrate that our method achieves a superior performance than previous state-of-the-art domain adaptation approaches.

Electroencephalography (EEG) decoding is an important part of Visual Evoked Potentials-based Brain-Computer Interfaces (BCIs), which directly determines the performance of BCIs. However, long-time attention to repetitive visual stimuli could cause physical and psychological fatigue, resulting in weaker reliable response and stronger noise interference, which exacerbates the difficulty of Visual Evoked Potentials EEG decoding. In this state, subjects' attention could not be concentrated enough and the frequency response of their brains becomes less reliable. To solve these problems, we propose an attention-based parallel multiscale convolutional neural network (AMS-CNN). Specifically, the AMS-CNN first extract robust temporal representations via two parallel convolutional layers with small and large temporal filters respectively. Then, we employ two sequential convolution blocks for spatial fusion and temporal fusion to extract advanced feature representations. Further, we use attention mechanism to weight the features at different moments according to the output-related interest. Finally, we employ a full connected layer with softmax activation function for classification. Two fatigue datasets collected from our lab are implemented to validate the superior classification performance of the proposed method compared to the state-of-the-art methods. Analysis reveals the competitiveness of multiscale convolution and attention mechanism. These results suggest that the proposed framework is a promising solution to improving the decoding performance of Visual Evoked Potential BCIs.

Electroencephalogram (EEG) has been widely used in brain computer interface (BCI) due to its convenience and reliability. The EEG-based BCI applications are majorly limited by the time-consuming calibration procedure for discriminative feature representation and classification. Existing EEG classification methods either heavily depend on the handcrafted features or require adequate annotated samples at each session for calibration. To address these issues, we propose a novel dynamic joint domain adaptation network based on adversarial learning strategy to learn domain-invariant feature representation, and thus improve EEG classification performance in the target domain by leveraging useful information from the source session. Specifically, we explore the global discriminator to align the marginal distribution across domains, and the local discriminator to reduce the conditional distribution discrepancy between sub-domains via conditioning on deep representation as well as the predicted labels from the classifier. In addition, we further investigate a dynamic adversarial factor to adaptively estimate the relative importance of alignment between the marginal and conditional distributions. To evaluate the efficacy of our method, extensive experiments are conducted on two public EEG datasets, namely, Datasets IIa and IIb of BCI Competition IV. The experimental results demonstrate that the proposed method achieves superior performance compared with the state-of-the-art methods.

Brain–computer interface (BCI) based on motor imagery electroencephalogram (EEG) has been widely used in various applications. Despite the previous efforts, the remained major challenges are effective feature extraction and the time-consuming calibration procedure. To address these issues, a novel multiattention adaptation network integrating the multiple attention mechanism and transfer learning is proposed to classify the EEG signals. First, the multiattention layer is introduced to automatically capture the dominant brain regions relevant to mental tasks without incorporating any prior knowledge about the physiology. Then, a multiattention convolutional neural network is employed to extract deep representation from raw EEG signals. Especially, a domain discriminator is applied to deep representation to reduce the differences between sessions for target subjects. The extensive experiments are conducted on three public EEG datasets (Dataset IIa and IIb of BCI Competition IV, and High Gamma dataset), achieving the competitive performance with average classification accuracy of 81.48%, 82.54%, and 93.97%, respectively. All the results outperform the state-of-the-art algorithms demonstrate the effectiveness and robustness of the proposed method. Importantly, we confirm that it is easier and more appropriate to transfer the information from local brain regions than from the whole brain. This enhances the transfer ability of deep features and, hence, it improves the performance of BCI systems. [ABSTRACT FROM AUTHOR]

Brain–computer interface (BCI) systems based on electroencephalography (EEG) signals have been extensively used in medical practice. To enhance the BCI performance, improving the classification accuracy of EEG signals is the key, which has always been the focus of research and development. In this article, a novel method integrating complex network and broad learning system (BLS) is proposed for visual evoked potential (VEP)-based BCI research. First, systematic VEP-based brain experiments are conducted for obtaining EEG signals, including steady-state VEP (SSVEP) and steady-state motion VEP (SSMVEP). Then, limited penetrable visibility graph (LPVG) and its degree sequence are employed to implement the preliminary feature extraction. All these features are finally fed into a BLS to study and classify the SSVEP and SSMVEP signals, respectively. The classification results show that our LPVG-based BLS can effectively classify VEP-based EEG signals, with average classification accuracy 96.22% for SSVEP and 74.54% for SSMVEP. These results are significantly better than other comparison methods as well as traditional CCA-based methods. All these open up new venues for studying EEG-based BCI systems via the fusion of network science and BLS. [ABSTRACT FROM AUTHOR]

Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject's intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients. [ABSTRACT FROM AUTHOR]

Steady State Motion Visual Evoked Potential (SSMVEP)-based Brain Computer Interface (BCI) is widely studied and has been used to varies of occasions on account of its good performance, mild stimulation, and free of additional training. We design a trolley control system based on SSMVEP signals and observe a phenomenon named “BCI Illiterate,” in which case some subjects present unsatisfactory performance with low classification accuracies. In order to cope with this challenging problem in real-world contexts, we introduce a deep learning (DL) method. The method allows improving the accuracies for both EEG literate and EEG illiterate. In particular, we firstly conduct SSMVEP experiments to obtain EEG signals from 10 subjects, including 5 EEG literates and 5 EEG illiterates. Then we construct a convolutional neural network with long short-term memory (CNN-LSTM) framework, which allows extracting the spectral, spatial, and temporal features of EEG signals, to realize the high classification accuracies of SSMVEP signals. The results show that DL method can reach 96.83% and 91.86% for EEG literate and EEG illiterate respectively, which are 12.68% and 31.08% higher than the results of traditional methods. These results indicate that DL method is not only suitable for EEG literate, but more importantly, can greatly improve the performance for EEG illiterate, which finally can enhance the robustness and universality of the SSMVEP-based BCI. [ABSTRACT FROM AUTHOR]

An urgent problem in the field of deep learning is the optimization of model construction, which frequently hinders its performance and often needs to be designed by experts. Optimizing the hyper-parameters remains a substantial obstacle in designing deep learning models, such as CNNs, in practice. In this paper, we propose an automatical optimization framework using binary coding system and GPSO with gradient penalties to select the structure. Such swarm intelligence optimization approaches have been used but not extensively exploited, and the existing work focuses on models with a fixed depth of networks. We design an experiment to arouse three types of emotion states for each subject, and simultaneously collect EEG signals corresponding to each emotion category. The GPSO-based method efficiently explores the solution space, allowing CNNs to obtain competitive classification performance over the dataset. Results indicate that our method based on the GPSO-optimized CNN model enables us to achieve a prominent classification accuracy, and the proposed method provides an effective automatic optimization framework for CNNs of the emotion recognition task with an uncertain depth of networks. [ABSTRACT FROM AUTHOR]

A brain-controlled vehicle (BCV) is a vehicle that uses the Brain–Computer interface (BCI) to analyze the driver's electroencephalogram (EEG) to obtain human control commands, which can help disabled people extend movement range and improve their self-independence. However, the performance of BCV is poor and the accuracy of BCI recognition varies considerably with different subjects, which severely restrict its promotion and application. To develop a better solution, with the concept of shared control, an intention preferenced fusion brain control strategy based on fuzzy logic is proposed. Firstly, based on Fuzzy Discrete Event System Supervision (FDES) theory, instructions of the driver are supervised and evaluated. At the same time, based on fuzzy logic an automatic controller which gives an automatic decision according to the cur-rent state of the vehicle is designed. Then according to the automatic decision and the correctness of the driver's instructions, a fuzzy reasoning is made, making the final decision more in line with human intentions. In order to verify the effectiveness of the proposed method, based on our previously-designed SSMVEP platform, we conduct virtual experiments, semi-object tests and full physical tests separately for verification. Compared with others shared control schemes, it not only achieves continuous control, but the final control-making is more in line with human intentions, which can encourage users to become more involved, enhancing their self-esteem and brain functions. • An intention preferenced fusion brain control strategy is proposed. • FDES theory is used to supervise the brain instructions. • An automatic controller is designed based on fuzzy logic. • Fuzzy reasoning is used to make the final decision more in line with human intentions. • Virtual experiments, semi-object tests and full physical tests are conducted for verification. [ABSTRACT FROM AUTHOR]