Search

Medically oriented Brain Computer Interfaces (BCIs) have been proposed as a promising approach addressed to individuals suffering from severe paralysis. Steady-State Visual Evoked Potentials (SSVEPs) in particular have been proven successful in many different applications, achieving high information throughput with short or even no training. However, efficient electric wheelchair navigation combining high accuracy and comfort is still not demonstrated. In this paper, we propose the use of an SSVEP-based universal control system featuring augmented reality (AR) glasses in an attempt to increase ease of use and patient acceptability without making compromises on BCI performance. The system received positive user-feedback, reaching a mean accuracy of 90%. Merits and pitfalls of the system proposed are also addressed. [ABSTRACT FROM AUTHOR]

Motor-modality-based brain computer interface (BCI) could promote the neural rehabilitation for stroke patients. Temporal-spatial analysis was commonly used for pattern recognition in this task. This paper introduced a novel connectivity network analysis for EEG-based feature selection. The network features of connectivity pattern not only captured the spatial activities responding to motor task, but also mined the interactive pattern among these cerebral regions. Furthermore, the effective combination between temporal-spatial analysis and network analysis was evaluated for improving the performance of BCI classification (81.7%). And the results demonstrated that it could raise the classification accuracies for most of patients (6 of 7 patients). This proposed method was meaningful for developing the effective BCI training program for stroke rehabilitation. [ABSTRACT FROM AUTHOR]

Brain-computer interface (BCI) usually suffers from the problem of low recognition accuracy and large calibration time, especially when identifying motor imagery tasks for subjects with indistinct features and classifying fine grained motion control tasks by electroencephalogram (EEG)-electromyogram (EMG) fusion analysis. To fill the research gap, this paper presents an end-to-end semi-supervised learning framework for EEG classification and EEG–EMG fusion analysis. Benefiting from the proposed metric learning based label estimation strategy, sampling criterion and progressive learning scheme, the proposed framework efficiently extracts distinctive feature embedding from the unlabeled EEG samples and achieves a 5.40% improvement on BCI Competition IV Dataset IIa with 80% unlabeled samples and an average 3.35% improvement on two public BCI datasets. By employing synchronous EMG features as pseudo labels for the unlabeled EEG samples, the proposed framework further extracts deep level features of the synergistic complementarity between the EEG signals and EMG features based on the deep encoders, which improves the performance of hybrid BCI (with a 5.53% improvement for the Upper Limb Motion Dataset and an average 4.34% improvement on two hybrid datasets). Moreover, the ablation experiments show that the proposed framework can substantially improve the performance of the deep encoders (with an average 5.53% improvement). The proposed framework not only largely improves the performance of deep networks in the BCI system, but also significantly reduces the calibration time for EEG-EMG fusion analysis, which shows great potential for building an efficient and high-performance hybrid BCI for the motor rehabilitation process. [ABSTRACT FROM AUTHOR]

Monitoring the depth of unconsciousness during anesthesia is beneficial in both clinical settings and neuroscience investigations to understand brain mechanisms. Electroencephalogram (EEG) has been used as an objective means of characterizing brain altered arousal and/or cognition states induced by anesthetics in real-time. Different general anesthetics affect cerebral electrical activities in different ways. However, the performance of conventional machine learning models on EEG data is unsatisfactory due to the low Signal to Noise Ratio (SNR) in the EEG signals, especially in the office-based anesthesia EEG setting. Deep learning models have been used widely in the field of Brain Computer Interface (BCI) to perform classification and pattern recognition tasks due to their capability of good generalization and handling noises. Compared to other BCI applications, where deep learning has demonstrated encouraging results, the deep learning approach for classifying different brain consciousness states under anesthesia has been much less investigated. In this paper, we propose a new framework based on meta-learning using deep neural networks, named Anes-MetaNet, to classify brain states under anesthetics. The Anes-MetaNet is composed of Convolutional Neural Networks (CNN) to extract power spectrum features, and a time consequence model based on Long Short-Term Memory (LSTM) networks to capture the temporal dependencies, and a meta-learning framework to handle large cross-subject variability. We use a multi-stage training paradigm to improve the performance, which is justified by visualizing the high-level feature mapping. Experiments on the office-based anesthesia EEG dataset demonstrate the effectiveness of our proposed Anes-MetaNet by comparison of existing methods. [ABSTRACT FROM AUTHOR]

The quantification of the spectral content of electroencephalogram (EEG) recordings has a substantial role in clinical and scientific applications. It is of particular relevance in the analysis of event-related brain oscillatory responses. This work is focused on the identification and quantification of relevant frequency patterns in motor imagery (MI) related EEGs utilized for brain-computer interface (BCI) purposes. The main objective of the paper is to perform comparative analysis of different approaches to spectral signal representation such as power spectral density (PSD) techniques, atomic decompositions, time-frequency (t-f) energy distributions, continuous and discrete wavelet approaches, from which band power features can be extracted and used in the framework of MI classification. The emphasis is on identifying discriminative properties of the feature sets representing EEG trials recorded during imagination of either leftor right-hand movement. Feature separability is quantified in the offline study using the classification accuracy (CA) rate obtained with linear and nonlinear classifiers. PSD approaches demonstrate the most consistent robustness and effectiveness in extracting the distinctive spectral patterns for accurately discriminating between left and right MI induced EEGs. This observation is based on an analysis of data recorded from eleven subjects over two sessions of BCI experiments. In addition, generalization capabilities of the classifiers reflected in their intersession performance are discussed in the paper. [ABSTRACT FROM AUTHOR]

The \ell_1-norm-based common spatial patterns (CSP-L1) approach is a recently developed technique for optimizing spatial filters in the field of electroencephalogram (EEG)-based brain computer interfaces. The \ell_1-norm-based expression of dispersion in CSP-L1 alleviates the negative impact of outliers. In this paper, we further improve the robustness of CSP-L1 by taking into account noise which does not necessarily have as large a deviation as with outliers. The noise modelling is formulated by using the waveform length of the EEG time course. With the noise modelling, we then regularize the objective function of CSP-L1, in which the \ell_1-norm is used in two folds: one is the dispersion and the other is the waveform length. An iterative algorithm is designed to resolve the optimization problem of the regularized objective function. A toy illustration and the experiments of classification on real EEG data sets show the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Although brain–computer interface (BCI) has potential application in the rehabilitation of neural disease and performance improvement of the human in the loop system, it is restricted in the laboratory environment. One of the hindrances behind this restriction is the requirement of a long training data collection session for the user prior to operation of the system at each time. Several approaches have been proposed including the reduction of training data maintaining the robust performance. One of them is active learning (AL) which asks for labeling the training samples and it has the potential to reach robust performance using reduced informative training set. In this paper, one of the AL methods, query by committee (QBC), is applied by forming the committee in heterogeneous and homogeneous feature space. In heterogeneous feature space, three state-of-the-art feature extraction methods are coupled with linear discriminant analysis classifier. For homogeneous feature space, random $K$ -fold sampling is applied after extracting the features using a single method to form the committee of $K$ -members. The joint accuracy by QBC-heterogeneous has obtained the baselines using maximum 35% of the whole training set. It also shows a significant difference at the 5% significance level from QBC-homogeneous selection as well as other contemporary AL methods and random selection method. Thus, QBC-heterogeneous has reduced the labeling effort and the training data collection effort significantly more than that of random labeling process. It infers that QBC is a potential candidate for abridging overall calibration time of BCI systems. [ABSTRACT FROM AUTHOR]

This special issue of the IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING provides a representative and comprehensive bird's-eye view of the most recent developments in brain-computer interface (BCI) technology from laboratories around the world. The 30 research communications and papers are the direct outcome of the Third International Meeting on Brain-Computer Interface Technology held at the Rensselaerville Institute, Rensselaerville, NY, in June 2005. Fifty-three research groups from North and South America, Europe, and Asia, representing the majority of all the existing BCI laboratories around the world, participated in this highly focused meeting sponsored by the National Institutes of Health and organized by the BCI Laboratory of the Wadsworth Center of the New York State Department of Health. As demonstrated by the papers in this special issue, the rapid advances in BCI research and development make this technology capable of providing communication and control to people severely disabled by amyotrophic lateral sclerosis (ALS), brainstem stroke, cerebral palsy, and other neuromuscular disorders. Future work is expected to improve the performance and utility of BCIs, and to focus increasingly on making them a viable, practical, and affordable communication alternative for many thousands of severely disabled people worldwide. [ABSTRACT FROM AUTHOR]

EEG-based brain–computer interface (BCI) technology creates non-biological pathways for conveying a user’s mental intent solely through noninvasively measured neural signals. While optimizing the performance of a single task has long been the focus of BCI research, in order to translate this technology into everyday life, realistic situations, in which multiple tasks are performed simultaneously, must be investigated. In this paper, we explore the concept of cognitive flexibility, or multitasking, within the BCI framework by utilizing a 2-D cursor control task, using sensorimotor rhythms (SMRs), and a four-target visual attention task, using steady-state visual evoked potentials (SSVEPs), both individually and simultaneously. We found no significant difference between the accuracy of the tasks when executing them alone (SMR—57.9% ± 15.4% and SSVEP—59.0% ± 14.2%) and simultaneously (SMR—54.9% ± 17.2% and SSVEP—57.5% ± 15.4%). These modest decreases in performance were supported by similar, non-significant changes in the electrophysiology of the SSVEP and SMR signals. In this sense, we report that multiple BCI tasks can be performed simultaneously without a significant deterioration in performance; this finding will help drive these systems toward realistic daily use in which a user’s cognition will need to be involved in multiple tasks at once. [ABSTRACT FROM PUBLISHER]

Computers offer valuable opportunities to people with physical disabilities. For example, a computer can allow someone with severe speech and motor-impairment to engage more fully with the world. This paper describes the design of a communication aid for motor-impaired users, who literally use computers as their communication partners. Currently, a low cost interface suitable for different types of motor-impaired users is hardly available. Additionally, the target audience of existing such systems is very much limited. The present work solved these problems by its adaptation mechanism. The adaptation mechanism provides an appropriate interface from an interface bank for each user before start of an interaction. The adaptation mechanism is continued during as well as after the end of interactions to make the system personalized to individual user. [ABSTRACT FROM AUTHOR]

A common method for designing brain-computer Interface (BCI) is to use electroencephalogram (EEG) signals extracted during mental tasks. In these BCI designs, features from EEG such as power and asymmetry ratios from delta, theta, alpha, and beta bands have been used in classifying different mental tasks. In this paper, the performance of the mental task based BCI design is improved by using spectral power and asymmetry ratios from gamma (24–37 Hz) band in addition to the lower frequency bands. In the experimental study, EEG signals extracted during five mental tasks from four subjects were used. Elman neural network (ENN) trained by the resilient backpropagation algorithm was used to classify the power and asymmetry ratios from EEG into different combinations of two mental tasks. The results indicated that 1) the classification performance and training time of the BCI design were improved through the use of additional gamma band features; 2) classification performances were nearly invariant to the number of ENN hidden units or feature extraction method. [ABSTRACT FROM AUTHOR]

For severely paralyzed individuals, alternative computer interfaces are becoming increasingly essential for everyday life as social and vocational activities are facilitated by information technology and as the environment becomes more automatic and remotely controllable. Tongue computer interfaces have proven to be desirable by the users partly due to their high degree of aesthetic acceptability, but so far the mature systems have shown a relatively low error-free text typing efficiency. This paper evaluated the intra-oral inductive tongue computer interface (ITCI) in its intended use: Error-free text typing in a generally available text editing system, Word. Individuals with tetraplegia and able bodied individuals used the ITCI for typing using a MATLAB interface and for Word typing for 4 to 5 experimental days, and the results showed an average error-free text typing rate in Word of 11.6 correct characters/min across all participants and of 15.5 correct characters/min for participants familiar with tongue piercings. Improvements in typing rates between the sessions suggest that typing ratescan be improved further through long-term use of the ITCI. [ABSTRACT FROM PUBLISHER]

Current brain-computer interface (BCI) systems suffer from high complex feature selectors in comparison to simple classifiers. Meanwhile, neurophysiological and experimental information are hard to be included in these two separate phases. In this paper, based on the hierarchical observation model, we proposed an empirical Bayesian linear discriminant analysis (BLDA), in which the neurophysiological and experimental priors are considered simultaneously; the feature selection, weighted differently, and classification are performed jointly, thus it provides a novel systematic algorithm framework which can utilize priors related to feature and trial in the classifier design in a BCI. BLDA was comparatively evaluated by two simulations of a two-class and a four-class problem, and then it was applied to two real four-class motor imagery BCI datasets. The results confirmed that BLDA is superior in accuracy and robustness to LDA, regularized LDA, and SVM. [ABSTRACT FROM AUTHOR]

The P300 component of an event related potential is widely used in conjunction with brain-computer interfaces (BCIs) to translate the subjects intent by mere thoughts into commands to control artificial devices. A well known application is the spelling of words while selection of the letters is carried out by focusing attention to the target letter. In this paper, we present a P300-based online BCI which reaches very competitive performance in terms of information transfer rates. In addition, we propose an online method that optimizes information transfer rates and/or accuracies. This is achieved by an algorithm which dynamically limits the number of subtrial presentations, according to the subject's current online performance in real-time. We present results of two studies based on 19 different healthy subjects in total who participated in our experiments (seven subjects in the first and 12 subjects in the second one). In the first, study peak information transfer rates up to 92 bits/min with an accuracy of 100% were achieved by one subject with a mean of 32 bits/min at about 80% accuracy. The second experiment employed a dynamic classifier which enables the user to optimize bitrates and/or accuracies by limiting the number of subtrial presentations according to the current online performance of the subject. At the fastest setting, mean information transfer rates could be improved to 50.61 bits/min (i.e., 13.13 symbols/mm). The most accurate results with 87.5% accuracy showed a transfer rate of 29.35 bits/min. [ABSTRACT FROM AUTHOR]

In this paper we propose a brain-computer interface (BCI) mouse based on P300 waves in electroencephalogram (EEG) signals. The system is analogue in that at no point a binary decision is made as to whether or not a P300 was actually produced in response to the stimuli. Instead, the 2-D motion of the pointer on the screen, using a novel BCI paradigm, is controlled by directly combining the amplitudes of the output produced by a filter in the presence of different stimuli. This filter and the features to be combined within it are optimised by an evolutionary algorithm. [ABSTRACT FROM AUTHOR]

This paper introduces the development of a practical brain-computer interface at Tsinghua University. The system uses frequency-coded steady-state visual evoked potentials to determine the gaze direction of the user. To ensure more universal applicability of the system, approaches for reducing user variation on system performance have been proposed. The information transfer rate (ITR) has been evaluated both in the laboratory and at the Rehabilitation Center of China, respectively. The system has been proved to be applicable to >90% of people with a high ITR in living environments. [ABSTRACT FROM AUTHOR]

In this paper, we examine the control signals that are required to generate stepping using two different intraspinal microstimulation (ISMS) paradigms and discuss the theoretical feasibility of controlling ISMS-evoked stepping using a brain computer interface. Tonic (constant amplitude) and phasic (modulated amplitude) ISMS protocols were used to produce stepping in the hind limbs of paralyzed cats. Low-amplitude tonic ISMS activated a spinal locomotor-like network that resulted in bilateral stepping of the hind limbs. Phasic ISMS generated coordinated stepping by simultaneously activating flexor synergies in one limb coupled with extensor synergies in the other. Using these ISMS paradigms, we propose that one or two independent cortical signals will be adequate for controlling ISMS-induced stepping after SCI. [ABSTRACT FROM AUTHOR]

Recent advances in the field of brain-computer interfaces (BCIs) have shown that BCIs have the potential to provide a powerful new channel of communication, completely independent of muscular and nervous systems. However, while there have been successful laboratory demonstrations, there are still issues that need to be addressed before BCIs can be used by nonexperts outside the laboratory. At IDIAP Research Institute, we have been investigating several areas that we believe will allow us to improve the robustness, flexibility, and reliability of BCIs. One area is recognition of cognitive error states, that is, identifying errors through the brain's reaction to mistakes. The production of these error potentials (ErrP) in reaction to an error made by the user is well established. We have extended this work by identifying a similar but distinct ErrP that is generated in response to an error made by the interface, (a misinterpretation of a command that the user has given). This ErrP can be satisfactorily identified in single trials and can be demonstrated to improve the theoretical performance of a BCI. A second area of research is online adaptation of the classifier. BCI signals change over time, both between sessions and within a single session, due to a number of factors. This means that a classifier trained on data from a previous session will probably not be optimal for a new session. In this paper, we present preliminary results from our investigations into supervised online learning that can be applied in the initial training phase. We also discuss the future direction of this research, including the combination of these two currently separate issues to create a potentially very powerful BCI. [ABSTRACT FROM AUTHOR]

In this paper, intracortical local field potentials (LFPs) and single units were recorded from the motor cortices of monkeys (Macaca fascicularis) while they preformed a standard three-dimensional (3-D) center-out reaching task. During the center-out task, the subjects held their hands at the location of a central target and then reached to one of eight peripheral targets forming the corners of a virtual cube. The spectral amplitudes of the recorded LFPs were calculated, with the high-frequency LFP (HF-LFP) defined as the average spectral amplitude change from baseline from 60 to 200 Hz. A 3-D linear regression across the eight center-out targets revealed that approximately 6% of the beta LFPs (18-26 Hz) and 18% of the HF-LFPs were tuned for velocity (p-value <0.05), while 10% of the beta LFPs and 15% of the HF-LFPs were tuned for position. These results suggest that a multidegree-of-freedom brain-machine interface is possible using high-frequency LFP recordings in motor cortex. [ABSTRACT FROM AUTHOR]

This paper describes the highlights of presentations and discussions during the Third International BCI Meeting in a workshop that evaluated potential brain-computer interface (BCI) signals and currently available recording methods. It defined the main potential user populations and their needs, addressed the relative advantages and disadvantages of noninvasive and implanted (i.e., invasive) methodologies, considered ethical issues, and focused on the challenges involved in translating BCI systems from the laboratory to widespread clinical use. The workshop stressed the critical importance of developing useful applications that establish the practical value of BCI technology. [ABSTRACT FROM AUTHOR]

A brain-computer interface (BCI) is a system that allows its users to control external devices with brain activity. Although the proof-of- concept was given decades ago, the reliable translation of user intent into device control commands is still a major challenge. Success requires the effective interaction of two adaptive controllers: the user's brain, which produces brain activity that encodes intent, and the BCI system, which translates that activity into device control commands. In order to facilitate this interaction, many laboratories are exploring a variety of signal analysis techniques to improve the adaptation of the BCI system to the user. In the literature, many machine learning and pattern classification algorithms have been reported to give impressive results when applied to BCI data in offline analyses. However, it is more difficult to evaluate their relative value for actual online use. BCI data competitions have been organized to provide objective formal evaluations of alternative methods. Prompted by the great interest in the first two BCI Competitions, we organized the third BCI Competition to address several of the most difficult and important analysis problems in BCI research. The paper describes the data sets that were provided to the competitors and gives an overview of the results. [ABSTRACT FROM AUTHOR]

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop charged with reviewing and evaluating the current state of and issues relevant to brain-computer interface (BCI) clinical applications. These include potential BCI users, applications, validation, getting BCIs to users, role of government and industry, plasticity, and ethics. [ABSTRACT FROM AUTHOR]

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop to review and evaluate the current state of BCI-related hardware and software. Technical requirements and current technologies, standardization procedures and future trends are covered. The main conclusion was recognition of the need to focus technical requirements on the users' needs and the need for consistent standards in BCI research. [ABSTRACT FROM AUTHOR]

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop charged with reviewing and evaluating the current state of and issues relevant to brain-computer interface (BCI) feature extraction and translation. The issues discussed include a taxonomy of methods and applications, time-frequency spatial analysis, optimization schemes, the role of insight in analysis, adaptation, and methods for quantifying BCI feedback. [ABSTRACT FROM AUTHOR]

This paper presents a feature extraction procedure (FEP) for a brain-computer interface (BCI) application where features are extracted from the electroencephalogram (EEG) recorded from subjects performing right and left motor imagery. Two neural networks (NNs) are trained to perform one-step-ahead predictions for the EEC time-series data, where one NN is trained on right motor imagery and the other on left motor imagery. Features are derived from the power (mean squared) of the pre- diction error or the power of the predicted signals. All features are calculated from a window through which all predicted signals pass. Separability of features is achieved due to the morphological differences of the EEG signals and each NNs specialization to the type of data on which it is trained. Linear discriminant analysis (LDA) is used for classification. This FEP is tested on three subjects off-line and classification accuracy (CA) rates range between 88% and 98%. The approach compares favorably to a well-known adaptive autoregressive (AAR) FEP and also a linear AAR model based prediction approach. [ABSTRACT FROM AUTHOR]

The steady-state visual evoked potential (SSVEP) has been employed successfully in brain-computer interface (BCI) research, but its use in a design entirely independent of eye movement has until recently not been reported. This paper presents strong evidence suggesting that the SSVEP can be used as an electrophysiological correlate of visual spatial attention that may be harnessed on its own or in conjunction with other correlates to achieve control in an independent BCL In this study, 64-channel electroencephalography data were recorded from subjects who covertly attended to one of two bilateral flicker stimuli with superimposed letter sequences. Offline classification of left/right spatial attention was attempted by extracting SSVEPs at optimal channels selected for each subject on the basis of the scalp distribution of SSVEP magnitudes. This yielded an average accuracy of approximately 71 % across ten subjects (highest 86%) comparable across two separate cases in which flicker frequencies were set within and outside the alpha range respectively. Further, combining SSVEP features with attention-dependent parieto-occipital alpha hand modulations resulted in an average accuracy of 79% (highest 87%). [ABSTRACT FROM AUTHOR]

The Brain-Computer Interface (BCI) research community has acknowledged that researchers are experiencing difficulties when they try to compare the BCI techniques described in the literature. In response to this situation, the community has stressed the need for objective methods to compare BCI technologies. Suggested improvements have included the development and use of benchmark applications and standard data sets. However, as a young, multidisciplinary research field, the BCI community lacks a common vocabulary. As a result, this deficiency leads to poor intergroup communication, which hinders the development of the desired methods of comparison. One of the principle reasons for the lack of common vocabulary is the absence of a common functional model of a BCI System. This paper proposes a new functional model for BCI System design. The model supports many features that facilitate the comparison of BCI technologies with other BCI and non-BCI user interface technologies. From this model, taxonomy for BCI System design is developed. Together the model and taxonomy are considered a general framework for BCI System design. The representational power of the proposed framework was evaluated by applying it to a set of existing BCI technologies. The framework could effectively describe all of the BCI System designs tested. Index Terms—Assistive technology; brain-computer interface (BCI); direct-brain interface (DBI); EEG; framework; functional model; taxonomy. [ABSTRACT FROM AUTHOR]

By the use of a brain-computer interface (BCI), it is possible for completely paralyzed patients, who have lost their ability to speak, to have a new possibility to communicate with their environment. The training with such a BCI system can be performed at the patient's home, if there is a responsible person present who is familiar with the system. This person has to adjust different parameters and to adapt the training individually to each patient. Since this function is usually taken over by the developers of the system, the number of patients who can be included in regular BCI training is restricted due to geographical distances. This paper describes the implementation of a telemonitoring system, which makes it possible for the developer to control and supervise the BCI training from his or her own place of work. First experiences with a patient living far away from the developer's lab are reported. Index Terms—Brain-computer interface (BCI); electroencephalogram (EEG); telemonitoring (TM) system. [ABSTRACT FROM AUTHOR]

In motor imagery brain–computer interfaces (BCIs), the symmetric positive-definite (SPD) covariance matrices of electroencephalogram (EEG) signals carry important discriminative information. In this paper, we intend to classify motor imagery EEG signals by exploiting the fact that the space of SPD matrices endowed with Riemannian distance is a high-dimensional Riemannian manifold. To alleviate the overfitting and heavy computation problems associated with conventional classification methods on high-dimensional manifold, we propose a framework for intrinsic sub-manifold learning from a high-dimensional Riemannian manifold. Considering a special case of SPD space, a simple yet efficient bilinear sub-manifold learning (BSML) algorithm is derived to learn the intrinsic sub-manifold by identifying a bilinear mapping that maximizes the preservation of the local geometry and global structure of the original manifold. Two BSML-based classification algorithms are further proposed to classify the data on a learned intrinsic sub-manifold. Experimental evaluation of the classification of EEG revealed that the BSML method extracts the intrinsic sub-manifold approximately $5\times $ faster and with higher classification accuracy compared with competing algorithms. The BSML also exhibited strong robustness against a small training dataset, which often occurs in BCI studies. [ABSTRACT FROM AUTHOR]

This paper summarizes the brain-computer interface (BCI )-related research being conducted at Aalborg University. Namely, an online synchronized BCI system using steady-state visual evoked potentials, and investigations on cortical modulation of movement-related parameters are presented. [ABSTRACT FROM AUTHOR]

Electroencephalography-based Brain Computer Interfaces (BCIs) invariably have a degenerate performance due to the considerable individual variability. To address this problem, we develop a novel domain adaptation method with optimal transport and frequency mixup for cross-subject transfer learning in motor imagery BCIs. Specifically, the preprocessed EEG signals from source and target domain are mapped into latent space with an embedding module, where the representation distributions and label distributions across domains have a large discrepancy. We assume that there exists a non-linear coupling matrix between both domains, which can be utilized to estimate the distance of joint distributions for different domains. Depending on the optimal transport, the Wasserstein distance between source and target domains is minimized, yielding the alignment of joint distributions. Moreover, a new mixup strategy is also introduced to generalize the model, where the inputs trials are mixed in frequency domain rather than in raw space. The extensive experiments on three evaluation benchmarks are conducted to validate the proposed framework. All the results demonstrate that our method achieves a superior performance than previous state-of-the-art domain adaptation approaches. [ABSTRACT FROM AUTHOR]

In this study, we present a new Deep Learning (DL) architecture for Motor Imagery (MI) based Brain Computer Interfaces (BCIs) called EEGSym. Our implementation aims to improve previous state-of-the-art performances on MI classification by overcoming inter-subject variability and reducing BCI inefficiency, which has been estimated to affect 10-50% of the population. This convolutional neural network includes the use of inception modules, residual connections and a design that introduces the symmetry of the brain through the mid-sagittal plane into the network architecture. It is complemented with a data augmentation technique that improves the generalization of the model and with the use of transfer learning across different datasets. We compare EEGSym’s performance on inter-subject MI classification with ShallowConvNet, DeepConvNet, EEGNet and EEG-Inception. This comparison is performed on 5 publicly available datasets that include left or right hand motor imagery of 280 subjects. This population is the largest that has been evaluated in similar studies to date. EEGSym significantly outperforms the baseline models reaching accuracies of 88.6±9.0 on Physionet, 83.3±9.3 on OpenBMI, 85.1±9.5 on Kaya2018, 87.4±8.0 on Meng2019 and 90.2±6.5 on Stieger2021. At the same time, it allows 95.7% of the tested population (268 out of 280 users) to reach BCI control (≥70% accuracy). Furthermore, these results are achieved using only 16 electrodes of the more than 60 available on some datasets. Our implementation of EEGSym, which includes new advances for EEG processing with DL, outperforms previous state-of-the-art approaches on inter-subject MI classification. [ABSTRACT FROM AUTHOR]

This study evaluated the effect of change in background on steady state visually evoked potentials (SSVEP) and steady state motion visually evoked potentials (SSMVEP) based brain computer interfaces (BCI) in a small-profile augmented reality (AR) headset. A four target SSVEP and SSMVEP BCI was implemented using the Cognixion AR headset prototype. An active (AB) and a non-active background (NB) were evaluated. The signal characteristics and classification performance of the two BCI paradigms were studied. Offline analysis was performed using canonical correlation analysis (CCA) and complex-spectrum based convolutional neural network (C-CNN). Finally, the asynchronous pseudo-online performance of the SSMVEP BCI was evaluated. Signal analysis revealed that the SSMVEP stimulus was more robust to change in background compared to SSVEP stimulus in AR. The decoding performance revealed that the C-CNN method outperformed CCA for both stimulus types and NB background, in agreement with results in the literature. The average offline accuracies for W = 1 s of C-CNN were (NB vs. AB): SSVEP: 82% ±15% vs. 60% ±21% and SSMVEP: 71.4% ± 22% vs. 63.5% ± 18%. Additionally, for W = 2 s, the AR-SSMVEP BCI with the C-CNN method was 83.3% ± 27% (NB) and 74.1% ±22% (AB). The results suggest that with the C-CNN method, the AR-SSMVEP BCI is both robust to change in background conditions and provides high decoding accuracy compared to the AR-SSVEP BCI. This study presents novel results that highlight the robustness and practical application of SSMVEP BCIs developed with a low-cost AR headset. [ABSTRACT FROM AUTHOR]

Brain computer interface (BCI) is a novel communication method that does not rely on the normal neural pathway between the brain and muscle of human. It can transform mental activities into relevant commands to control external equipment and establish direct communication pathway. Among different paradigms, steady-state visual evoked potential (SSVEP) is widely used due to its certain periodicity and stability of control. However, electroencephalogram (EEG) of SSVEP is extremely weak and companied with multi-scale and strong noise. Existing algorithms for classification are based on the principle of template matching and spatial filtering, which cannot obtain satisfied performance of feature extraction under the multi-scale noise. Especially for the subjects produce weak response for external stimuli in EEG representation, i.e., BCI-Illiteracy subject, traditional algorithms are difficult to recognize the internal patterns of brain. To address this issue, a novel method based on Chaos theory is proposed to extract feature of SSVEP. The rule of this method is applying the peculiarity of nonlinear dynamics system to detect feature of SSVEP by judging the state changes of chaotic systems after adding weak EEG. To evaluate the validity of proposed method, this research recruit 32 subjects to participate the experiment. All subjects are divided into two groups according to the preliminary classification accuracy (mean acc >70% or < 70%) by canonical correlation analysis and we define the accuracy above 70% as group A (normal subjects), below 70% as group B (BCI-Illiteracy). Then, the classification accuracy and information transmission rate of two groups are verified using Chaotic theory. Experimental results show that all classification methods using in our study achieve good performance for normal subjects while chaos obtain excellent performance and significant improvements than traditional methods for BCI-Illiteracy. [ABSTRACT FROM AUTHOR]

Electroencephalogram (EEG) has been widely used in brain computer interface (BCI) due to its convenience and reliability. The EEG-based BCI applications are majorly limited by the time-consuming calibration procedure for discriminative feature representation and classification. Existing EEG classification methods either heavily depend on the handcrafted features or require adequate annotated samples at each session for calibration. To address these issues, we propose a novel dynamic joint domain adaptation network based on adversarial learning strategy to learn domain-invariant feature representation, and thus improve EEG classification performance in the target domain by leveraging useful information from the source session. Specifically, we explore the global discriminator to align the marginal distribution across domains, and the local discriminator to reduce the conditional distribution discrepancy between sub-domains via conditioning on deep representation as well as the predicted labels from the classifier. In addition, we further investigate a dynamic adversarial factor to adaptively estimate the relative importance of alignment between the marginal and conditional distributions. To evaluate the efficacy of our method, extensive experiments are conducted on two public EEG datasets, namely, Datasets IIa and IIb of BCI Competition IV. The experimental results demonstrate that the proposed method achieves superior performance compared with the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The cover page of the journal "IEEE Transactions on Neural Systems & Rehabilitation Engineering" is presented, that includes the chart covering the topics of system architecture, wheelchair system and computer interface.

Motor Imagery (MI)-based Brain Computer Interface (BCI) system is a potential technology for active neurorehabilitation of stroke patients by complementing the conventional passive rehabilitation methods. Research to date mainly focused on classifying left vs. right hand/foot MI of stroke patients. Though a very few studies have reported decoding imagined hand movement directions using electroencephalogram (EEG)-based BCI, the experiments were conducted on healthy subjects. Our work analyzes MI-based brain cortical activity from EEG signals and decodes the imagined hand movement directions in stroke patients. The decoded direction (left vs. right) of hand movement imagination is used to provide control commands to a motorized arm support on which patient’s affected (paralyzed) arm is placed. This enables the patient to move his/her stroke-affected hand towards the intended (imagined) direction that aids neuroplasticity in the brain. The synchronization measure called Phase Locking Value (PLV), extracted from EEG, is the neuronal signature used to decode the directional movement of the MI task. Event-related desynchronization/synchronization (ERD/ERS) analysis on Mu and Beta frequency bands of EEG is done to select the time bin corresponding to the MI task. The dissimilarities between the two directions of MI tasks are identified by selecting the most significant channel pairs that provided maximum difference in PLV features. The training protocol has an initial calibration session followed by a feedback session with 50 trials of MI task in each session. The feedback session extracts PLV features corresponding to most significant channel pairs which are identified in the calibration session and is used to predict the direction of MI task in left/right direction. An average MI direction classification accuracy of 74.44% is obtained in performing the training protocol and 68.63% from the prediction protocol during feedback session on 16 stroke patients. [ABSTRACT FROM AUTHOR]

Humanoid robots are widely used in brain computer interface (BCI). Using a humanoid robot stimulus could increase the amplitude of event-related potentials (ERPs), which improves BCI performance. Since a humanoid robot contains many human elements, the element that increases the ERPs amplitude is unclear, and how to test the effect of it on the brain is a problem. This study used different graphic structures of an NAO humanoid robot to design three types of robot stimuli: a global robot, its local information, and its topological action. Ten subjects first conducted an odd-ball-based BCI (OD-BCI) by applying these stimuli. Then, they accomplished a delayed matching-to-sample task (DMST) that was used to specialize the encoding and retrieval phases of the OD-BCI task. In the retrieval phase of the DMST, the global stimulus induces the largest N200 and P300 potentials with the shortest latencies in the frontal, central, and occipital areas. This finding is in accordance with the P300 and classification performance of the OD-BCI task. When induced by the local stimulus, the subjects responded faster and more accurately in the retrieval phase of the DMST than in the other two conditions, indicating that the local stimulus improved the subject’s responses. These results indicate that the OD-BCI task causes subject’s retrieval work when the subject recognizes and outputs the stimulus. The global stimulus that contains topological and local elements could make brain react faster and induce larger ERPs, this finding could be used during the development of visual stimuli to improve BCI performance. [ABSTRACT FROM AUTHOR]

Objective: Classification of the neural activity of the brain is a well known problem in the field of brain computer interface. Machine learning based approaches for classification of brain activities do not reveal the underlying dynamics of the human brain. Methods: Since eigen decomposition has been found useful in a variety of applications, we conjecture that change of brain states would manifest in terms of changes in the invariant spaces spanned by eigen vectors as well as amount of variance along them. Based on this, our first approach is to track the brain state transitions by analysing invariant space variations over time. Whereas, our second approach analyses sub-band characteristic response vector formed using eigen values along with the eigen vectors to capture the dynamics. Result: We have taken two real time EEG datasets to demonstrate the efficacy of proposed approaches. It has been observed that in case of unimodal experiment, invariant spaces explicitly show the transitions of brain states. Whereas sub-band characteristic response vector approach gives better performance in the case of cross-modal conditions. Conclusions: Evolution of invariant spaces along with the eigen values may help in understanding and tracking the brain state transitions. Significance: The proposed approaches can track the activity transitions in real time. They do not require any training dataset. [ABSTRACT FROM AUTHOR]

Motor imagery based brain-computer interface (MI-BCI) has been studied for improvement of patients’ motor function in neurorehabilitation and motor assistance. However, the difficulties in performing imagery tasks limit its application. To overcome the limitation, an enhanced MI-BCI based on functional electrical stimulation (FES) and virtual reality (VR) is proposed in this study. On one hand, the FES is used to stimulate the subjects’ lower limbs before their imagination to make them experience the muscles’ contraction and improve their attention on the lower limbs, by which it is supposed that the subjects’ motor imagery (MI) abilities can be enhanced. On the other hand, a ball-kicking movement scenario from the first-person perspective is designed to provide visual guidance for performing MI tasks. The combination of FES and VR can be used to reduce the difficulties in performing MI tasks and improve classification accuracy. Finally, the comparison experiments were conducted on twelve healthy subjects to validate the performance of the enhanced MI-BCI. The results show that the classification performance can be improved significantly by using the proposed MI-BCI in terms of the classification accuracy (ACC), the area under the curve (AUC) and the F1 score (paired t-test, ${p} < 0.05$). [ABSTRACT FROM AUTHOR]

The common spatial pattern (CSP) method is a dimensionality reduction technique widely used in brain-computer interface (BCI) systems. In the two-class CSP problem, training data are linearly projected onto directions maximizing or minimizing the variance ratio between the two classes. The present contribution proves that kurtosis maximization performs CSP in an unsupervised manner, i.e., with no need for labeled data, when the classes follow Gaussian or elliptically symmetric distributions. Numerical analyses on synthetic and real data validate these findings in various experimental conditions, and demonstrate the interest of the proposed unsupervised approach. [ABSTRACT FROM AUTHOR]

Potable electroencephalography (EEG) devices have become critical for important research. They have various applications, such as in brain–computer interfaces (BCI). Numerous recent investigations have focused on the development of dry sensors, but few concern the simultaneous attachment of high-density dry sensors to different regions of the scalp to receive qualified EEG signals from hairy sites. An inflatable and wearable wireless 32-channel EEG device was designed, prototyped, and experimentally validated for making EEG signal measurements; it incorporates spring-loaded dry sensors and a novel gasbag design to solve the problem of interference by hair. The cap is ventilated and incorporates a circuit board and battery with a high-tolerance wireless (Bluetooth) protocol and low power consumption characteristics. The proposed system provides a 500/250 Hz sampling rate, and 24 bit EEG data to meet the BCI system data requirement. Experimental results prove that the proposed EEG system is effective in measuring audio event-related potential, measuring visual event-related potential, and rapid serial visual presentation. Results of this work demonstrate that the proposed EEG cap system performs well in making EEG measurements and is feasible for practical applications. [ABSTRACT FROM PUBLISHER]

Independent component analysis (ICA) has been widely applied to electroencephalographic (EEG) biosignal processing and brain–computer interfaces. The practical use of ICA, however, is limited by its computational complexity, data requirements for convergence, and assumption of data stationarity, especially for high-density data. Here we study and validate an optimized online recursive ICA algorithm (ORICA) with online recursive least squares (RLS) whitening for blind source separation of high-density EEG data, which offers instantaneous incremental convergence upon presentation of new data. Empirical results of this study demonstrate the algorithm's: 1) suitability for accurate and efficient source identification in high-density (64-channel) realistically-simulated EEG data; 2) capability to detect and adapt to nonstationarity in 64-ch simulated EEG data; and 3) utility for rapidly extracting principal brain and artifact sources in real 61-channel EEG data recorded by a dry and wearable EEG system in a cognitive experiment. ORICA was implemented as functions in BCILAB and EEGLAB and was integrated in an open-source Real-time EEG Source-mapping Toolbox (REST), supporting applications in ICA-based online artifact rejection, feature extraction for real-time biosignal monitoring in clinical environments, and adaptable classifications in brain–computer interfaces. [ABSTRACT FROM AUTHOR]

The typical control of myoelectric interfaces, whether in laboratory settings or real-life prosthetic applications, largely relies on visual feedback because proprioceptive signals from the controlling muscles are either not available or very noisy. We conducted a set of experiments to test whether artificial proprioceptive feedback, delivered noninvasively to another limb, can improve control of a two-dimensional myoelectrically-controlled computer interface. In these experiments, participants were required to reach a target with a visual cursor that was controlled by electromyogram signals recorded from muscles of the left hand, while they were provided with an additional proprioceptive feedback on their right arm by moving it with a robotic manipulandum. Provision of additional artificial proprioceptive feedback improved the angular accuracy of their movements when compared to using visual feedback alone but did not increase the overall accuracy quantified with the average distance between the cursor and the target. The advantages conferred by proprioception were present only when the proprioceptive feedback had similar orientation to the visual feedback in the task space and not when it was mirrored, demonstrating the importance of congruency in feedback modalities for multi-sensory integration. Our results reveal the ability of the human motor system to learn new inter-limb sensory-motor associations; the motor system can utilize task-related sensory feedback, even when it is available on a limb distinct from the one being actuated. In addition, the proposed task structure provides a flexible test paradigm by which the effectiveness of various sensory feedback and multi-sensory integration for myoelectric prosthesis control can be evaluated. [ABSTRACT FROM AUTHOR]

Recently, successful applications of independent component analysis (ICA) to electroencephalographic (EEG) signals have yielded tremendous insights into brain processes that underlie human cognition. Many studies have further established the feasibility of using independent processes to elucidate human cognitive states. However, various technical problems arise in the building of an online brain-computer interface (BCI). These include the lack of an automatic procedure for selecting independent components of interest (ICi) and the potential risk of not obtaining a desired ICi. Therefore, this study proposes an ICi-ensemble method that uses multiple classifiers with ICA processing to improve upon existing algorithms. The mechanisms that are used in this ensemble system include: 1) automatic ICi selection; 2) extraction of features of the resultant ICi; 3) the construction of parallel pipelines for effectively training multiple classifiers; and a 4) simple process that combines the multiple decisions. The proposed ICi-ensemble is demonstrated in a typical BCI application, which is the monitoring of participants' cognitive states in a realistic sustained-attention driving task. The results reveal that the proposed ICi-ensemble outperformed the previous method using a single ICi with ~ 7% (91.6% versus 84.3%) in the cognitive state classification. Additionally, the proposed ICi-ensemble method that characterizes the EEG dynamics of multiple brain areas favors the application of BCI in natural environments. [ABSTRACT FROM AUTHOR]

We are presenting a new wireless and wearable human computer interface called the dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities to use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users' tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact and ergonomic wireless headset. It also captures the users' voice wirelessly using a small microphone embedded in the same headset. Preliminary evaluation results based on 14 able-bodied subjects and three individuals with high level spinal cord injuries at level C3–C5 indicated that the dTDS headset, combined with a commercially available speech recognition (SR) software, can provide end users with significantly higher performance than either unimodal forms based on the tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry. [ABSTRACT FROM AUTHOR]

One of the changes seen in electroencephalography (EEG) data preceding human voluntary movement is a cortical potential called readiness potential (RP). Detection of this potential can benefit researchers in clinical neurosciences for rehabilitation of malfunctioning brain and those working on brain–computer interfacing to develop a suitable mechanism to detect the intention of movement. Here, a constrained blind source extraction (CBSE) is attempted for detection of RP. A suitable constraint is defined and applied. The results are also compared with those of the traditional blind source separation in terms of true positive rate, false positive rate, and computation time. The results show that the CBSE approach in overall has superior performance. [ABSTRACT FROM AUTHOR]

Brain-computer interfaces (BCIs) are known to suffer from spontaneous changes in the brain activity. If changes in the mental state of the user are reflected in the brain signals used for control, the behavior of a BCI is directly influenced by these states. We investigate the influence of a state of loss of control in a variant of Pacman on the performance of BCIs based on motor control. To study the effect a temporal loss of control has on the BCI performance, BCI classifiers were trained on electroencephalography (EEG) recorded during the normal control condition, and the classification performance on segments of EEG from the normal and loss of control condition was compared. Classifiers based on event-related desynchronization unexpectedly performed significantly better during the loss of control condition; for the event-related potential classifiers there was no significant difference in performance. [ABSTRACT FROM AUTHOR]

Abstract-We have developed a noninvasive, unobtrusive magnetic wireless tongue-computer interface, called "Tongue Drive," to provide people with severe disabilities with flexible and effective computer access and environment control. A small permanent magnet secured on the tongue by implantation, piercing, or tissue adhesives, is utilized as a tracer to track the tongue movements. The magnetic field variations inside and around the mouth due to the tongue movements are detected by a pair of three-axial linear magneto-inductive sensor modules mounted bilaterally on a headset near the user's cheeks. After being wirelessly transmitted to a portable computer, the sensor output signals are processed by a differential field cancellation algorithm to eliminate the external magnetic field interference, and translated into user control commands, which could then be used to access a desktop computer, maneuver a powered wheelchair, or control other devices in the user's environment. The system has been successfully tested on six able-bodied subjects for computer access by defining six individual commands to resemble mouse functions. Results show that the Tongue Drive system response time for 87% correctly completed commands is 0.8 s, which yields to an information transfer rate of ∼130 b/min. [ABSTRACT FROM AUTHOR]

The potential of computer games peripherals to measure the motor dysfunction in Parkinson's diseases is assessed. Of particular interest is the quantification of bradykinesia. Previous studies used modified or custom haptic interfaces, here an unmodified force feedback joystick and steering wheel are used with a laptop. During testing an on screen cursor moves in response to movements of the peripheral, the user has to track a continuously moving target (pursuit tracking), or move to a predetermined target (step tracking). All tasks use movement in the horizontal axis, allowing use of joystick or steering wheel. Two pursuit tracking tasks are evaluated, pseudo random movement, and a swept frequency task. Two step tracking tasks are evaluated, movement between two or between two of five fixed targets. Thirteen patients and five controls took part on a weekly basis. Patients were assessed for bradykinesia at each session using standard clinical measures. A range of quantitative measures was developed to allow comparison between and within patients and controls using analysis of variance (ANOVA). Both peripherals are capable of discriminating between controls and patients, and between patients with different levels of bradykinesia. Recommendations for test procedures and peripherals are given. [ABSTRACT FROM AUTHOR]