Search

Objective. Brain-computer interface (BCI) systems with large directly accessible instruction sets are one of the difficulties in BCI research. Research to achieve high target resolution (⩾100) has not yet entered a rapid development stage, which contradicts the application requirements. Steady-state visual evoked potential (SSVEP) based BCIs have an advantage in terms of the number of targets, but the competitive mechanism between the target stimulus and its neighboring stimuli is a key challenge that prevents the target resolution from being improved significantly. Approach. In this paper, we reverse the competitive mechanism and propose a frequency spatial multiplexing method to produce more targets with limited frequencies. In the proposed paradigm, we replicated each flicker stimulus as a 2 × 2 matrix and arrange the matrices of all frequencies in a tiled fashion to form the interaction interface. With different arrangements, we designed and tested three example paradigms with different layouts. Further we designed a graph neural network that distinguishes between targets of the same frequency by recognizing the different electroencephalography (EEG) response distribution patterns evoked by each target and its neighboring targets. Main results. Extensive experiment studies employing eleven subjects have been performed to verify the validity of the proposed method. The average classification accuracies in the offline validation experiments for the three paradigms are 89.16%, 91.38%, and 87.90%, with information transfer rates (ITR) of 51.66, 53.96, and 50.55 bits/min, respectively. Significance. This study utilized the positional relationship between stimuli and did not circumvent the competing response problem. Therefore, other state-of-the-art methods focusing on enhancing the efficiency of SSVEP detection can be used as a basis for the present method to achieve very promising improvements., (Creative Commons Attribution license.)

Brain-controlled wheelchairs are one of the most promising applications that can help people gain mobility after their normal interaction pathways have been compromised by neuromuscular diseases. The feasibility of using brain signals to control wheelchairs has been well demonstrated by healthy people in previous studies. However, most potential users of brain-controlled wheelchairs are people suffering from severe physical disabilities or who are in a "locked-in" state. To further validate the clinical practicability of our previously proposed P300-based brain-controlled wheelchair, in this study, 10 subjects with severe spinal cord injuries participated in three experiments and completed ten predefined tasks in each experiment. The average accuracy and information transfer rate (ITR) were 94.8% and 4.2 bits/min, respectively. Moreover, we evaluated the physiological and cognitive burdens experienced by these individuals before and after the experiments. There were no significant changes in vital signs during the experiment, indicating minimal physiological and cognitive burden. The patients' average systolic blood pressure before and after the experiment was 113±13.7 mmHg and 114±11.9 mmHg, respectively (P = 0.122). The patients' average heart rates before and after the experiment were 79±8.4/min and 79±8.2/min, respectively (P = 0.147). The average task load, measured by the National Aeronautics and Space Administration task load index, ranged from 10.0 to 25.5. The results suggest that the proposed P300-based brain-controlled wheelchair is safe and reliable; additionally, it does not significantly increase the patient's physical and mental task burden, demonstrating its potential value in clinical applications. Our study promotes the development of a more practical brain-controlled wheelchair system.

Objective: Dim target detection in remote sensing images is a significant and challenging problem. In this work, we seek to explore event-related brain responses of dim target detection tasks and extend the brain-computer interface (BCI) systems to this task for efficiency enhancement., Methods: We develop a BCI paradigm named Asynchronous Visual Evoked Paradigm (AVEP), in which subjects are required to search the dim targets within satellite images when their scalp electroencephalography (EEG) signals are simultaneously recorded. In the paradigm, stimulus onset time and target onset time are asynchronous because subjects need enough time to confirm whether there are targets of interest in the presented serial images. We further propose a Domain adaptive and Channel-wise attention-based Time-domain Convolutional Neural Network (DC-tCNN) to solve the single-trial EEG classification problem for the AVEP task. In this model, we design a multi-scale CNN module combined with a channel-wise attention module to effectively extract event-related brain responses underlying EEG signals. Meanwhile, domain adaptation is proposed to mitigate cross-subject distribution discrepancy., Results: The results demonstrate the superior performance and better generalizability of this model in classifying the single-trial EEG data of AVEP task in contrast to typical EEG deep learning networks. Visualization analyses of spatiotemporal features also illustrate the effectiveness and interpretability of our proposed paradigm and learning model., Conclusion: The proposed paradigm and model can effectively explore ambiguous event-related brain responses on EEG-based dim target detection tasks., Significance: Our work can provide a valuable reference for BCI-based image detection of dim targets.

This paper presents a self-paced brain-computer interface (BCI) based on the incorporation of an intelligent environment-understanding approach into a motor imagery (MI) BCI system for rehabilitation hospital environmental control. The interface integrates four types of daily assistance tasks: medical calls, service calls, appliance control and catering services. The system introduces intelligent environment understanding technology to establish preliminary predictions concerning a user's control intention by extracting potential operational objects in the current environment through an object detection neural network. According to the characteristics of the four types of control and services, we establish different response mechanisms and use an intelligent decision-making method to design and dynamically optimize the relevant control instruction set. The control feedback is communicated to the user via voice prompts; it avoids the use of visual channels throughout the interaction. The asynchronous and synchronous modes of the MI-BCI are designed to launch the control process and to select specific operations, respectively. In particular, the reliability of the MI-BCI is enhanced by the optimized identification algorithm. An online experiment demonstrated that the system can respond quickly and it generates an activation command in an average of 3.38s while effectively preventing false activations; the average accuracy of the BCI synchronization commands was 89.2%, which represents sufficiently effective control. The proposed system is efficient, applicable and can be used to both improve system information throughput and to reduce mental loads. The proposed system can be used to assist with the daily lives of patients with severe motor impairments., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2020. Published by Elsevier Ltd.)

Objective: To introduce a novel event-related potential (ERP)-based brain-computer interface (BCI) paradigm with active mental tasks multiplying precise judgment and visual cognitive capacities and evaluate its performance., Methods: This study employed a paradigm with three types of targets (true-, pseudo-, and non-), double flash codes, colors and color terms, and four test conditions. The primary hypothesis was that active mental tasks combining multiple cognitive capacities and clear judgment for different categories of stimuli increase the BCI performance and evoke stronger or specific ERPs. Classification methods were proposed and evaluated, and two were used in online experiments., Results: The modes containing active mental tasks provided higher accuracy than the control mode (by up to 19.06%). The color-word matching mode had the highest judgment level and achieved the best performance. True-stimuli evoked strong P3b, while pseudotarget signals provided obvious N4, but the control mode seemed less sensitive to both of them. Different types of stimuli evoked distinctive N2 and P3a components., Conclusion: An appropriate boost in the judgment level using multiple stimuli and cognitive approaches could be investigated to improve the BCI performance and evoke or enhance ERPs. Utilizing active mental tasks may be a promising way to promote BCIs., Significance: Active mental tasks combining multiple cognitive capacities and precise judgments were adopted in an ERP-based BCI. Color and color words were introduced as stimuli to construct an alternative paradigm, and the judgment levels of different conditions were calculated. High accuracies and the participants' preferences were obtained, which may promote the effective use of BCIs.

Multi-channel EEG data are usually necessary for spatial pattern identification in motor imagery (MI)-based brain computer interfaces (BCIs). To some extent, signals from some channels containing redundant information and noise may degrade BCI performance. We assume that the channels related to MI should contain common information when participants are executing the MI tasks. Based on this hypothesis, a correlation-based channel selection (CCS) method is proposed to select the channels that contained more correlated information in this study. The aim is to improve the classification performance of MI-based BCIs. Furthermore, a novel regularized common spatial pattern (RCSP) method is used to extract effective features. Finally, a support vector machine (SVM) classifier with the Radial Basis Function (RBF) kernel is trained to accurately identify the MI tasks. An experimental study is implemented on three public EEG datasets (BCI competition IV dataset 1, BCI competition III dataset IVa and BCI competition III dataset IIIa) to validate the effectiveness of the proposed methods. The results show that the CCS algorithm obtained superior classification accuracy (78% versus 56.4% for dataset1, 86.6% versus 76.5% for dataset 2 and 91.3% versus 85.1% for dataset 3) compared to the algorithm using all channels (AC), when CSP is used to extract the features. Furthermore, RCSP could further improve the classification accuracy (81.6% for dataset1, 87.4% for dataset2 and 91.9% for dataset 3), when CCS is used to select the channels., (Copyright © 2019 Elsevier Ltd. All rights reserved.)

In this paper, an asynchronous control paradigm based on sequential motor imagery (sMI) is proposed to enrich the control commands of a motor imagery -based brain-computer interface. We test the feasibility and report the performance of this paradigm in wheelchair navigation control. By sequentially imaging left- and right-hand movements, the subjects can complete four sMI tasks in an asynchronous mode that are then encoded to control six steering functions of a wheelchair, including moving forward, turning left, turning right, accelerating, decelerating, and stopping. Two experiments, a simulated experiment, and an online wheelchair navigation experiment, were conducted to evaluate the performance of the proposed approach in seven subjects. In summary, the subjects completed 99 of 105 experimental trials along a predefined route. The success rate was 94.2% indicating the practicality and the effectiveness of the proposed asynchronous control paradigm in wheelchair navigation control.

Background: Electroencephalogram-based brain-computer interfaces (BCIs) represent novel human machine interactive technology that allows people to communicate and interact with the external world without relying on their peripheral muscles and nervous system. Among BCI systems, brain-actuated wheelchairs are promising systems for the rehabilitation of severely motor disabled individuals who are unable to control a wheelchair by conventional interfaces. Previous related studies realized the easy use of brain-actuated wheelchairs that enable people to navigate the wheelchair through simple commands; however, these systems rely on offline calibration of the environment. Other systems do not rely on any prior knowledge; however, the control of the system is time consuming. In this paper, we have proposed an improved mobile platform structure equipped with an omnidirectional wheelchair, a lightweight robotic arm, a target recognition module and an auto-control module. Based on the you only look once (YOLO) algorithm, our system can, in real time, recognize and locate the targets in the environment, and the users confirm one target through a P300-based BCI. An expert system plans a proper solution for a specific target; for example, the planned solution for a door is opening the door and then passing through it, and the auto-control system then jointly controls the wheelchair and robotic arm to complete the operation. During the task execution, the target is also tracked by using an image tracking technique. Thus, we have formed an easy-to-use system that can provide accurate services to satisfy user requirements, and this system can accommodate different environments., Results: To validate and evaluate our system, an experiment simulating the daily application was performed. The tasks included the user driving the system closer to a walking man and having a conversation with him; going to another room through a door; and picking up a bottle of water on the desk and drinking water. Three patients (cerebral infarction; spinal injury; and stroke) and four healthy subjects participated in the test and all completed the tasks., Conclusion: This article presents a brain-actuated smart wheelchair system. The system is intelligent in that it provides efficient and considerate services for users. To test the system, three patients and four healthy subjects were recruited to participate in a test. The results demonstrate that the system works smartly and efficiently; with this system, users only need to issue small commands to get considerate services. This system is of significance for accelerating the application of BCIs in the practical environment, especially for patients who will use a BCI for rehabilitation applications.

The start of the cue is often used to initiate the feature window used to control motor imagery (MI)-based brain-computer interface (BCI) systems. However, the time latency during an MI period varies between trials for each participant. Fixing the starting time point of MI features can lead to decreased system performance in MI-based BCI systems. To address this issue, we propose a novel correlation-based time window selection (CTWS) algorithm for MI-based BCIs. Specifically, the optimized reference signals for each class were selected based on correlation analysis and performance evaluation. Furthermore, the starting points of time windows for both training and testing samples were adjusted using correlation analysis. Finally, the feature extraction and classification algorithms were used to calculate the classification accuracy. With two datasets, the results demonstrate that the CTWS algorithm significantly improved the system performance when compared to directly using feature extraction approaches. Importantly, the average improvement in accuracy of the CTWS algorithm on the datasets of healthy participants and stroke patients was 16.72% and 5.24%, respectively when compared to traditional common spatial pattern (CSP) algorithm. In addition, the average accuracy increased 7.36% and 9.29%, respectively when the CTWS was used in conjunction with Sub-Alpha-Beta Log-Det Divergences (Sub-ABLD) algorithm. These findings suggest that the proposed CTWS algorithm holds promise as a general feature extraction approach for MI-based BCIs., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

This paper presents a hybrid brain-computer interface (BCI) that combines motor imagery (MI) and P300 potential for the asynchronous operation of a brain-controlled wheelchair whose design is based on a Mecanum wheel. This paradigm is completely user-centric. By sequentially performing MI tasks or paying attention to P300 flashing, the user can use eleven functions to control the wheelchair: move forward/backward, move left/right, move left45/right45, accelerate/decelerate, turn left/right, and stop. The practicality and effectiveness of the proposed approach were validated in eight subjects, all of whom achieved good performance. The preliminary results indicated that the proposed hybrid BCI system with different mental strategies operating sequentially is feasible and has potential applications for practical self-paced control.

This study presented a paradigm for controlling a car using an asynchronous electroencephalogram (EEG)-based brain-computer interface (BCI) and presented the experimental results of a simulation performed in an experimental environment outside the laboratory. This paradigm uses two distinct MI tasks, imaginary left- and right-hand movements, to generate a multi-task car control strategy consisting of starting the engine, moving forward, turning left, turning right, moving backward, and stopping the engine. Five healthy subjects participated in the online car control experiment, and all successfully controlled the car by following a previously outlined route. Subject S1 exhibited the most satisfactory BCI-based performance, which was comparable to the manual control-based performance. We hypothesize that the proposed self-paced car control paradigm based on EEG signals could potentially be used in car control applications, and we provide a complementary or alternative way for individuals with locked-in disorders to achieve more mobility in the future, as well as providing a supplementary car-driving strategy to assist healthy people in driving a car., (Copyright © 2016 Elsevier Ltd. All rights reserved.)

Most P300 event-related potential (ERP)-based brain-computer interface (BCI) studies focus on gaze shift-dependent BCIs, which cannot be used by people who have lost voluntary eye movement. However, the performance of visual saccade-independent P300 BCIs is generally poor. To improve saccade-independent BCI performance, we propose a bimodal P300 BCI approach that simultaneously employs auditory and tactile stimuli. The proposed P300 BCI is a vision-independent system because no visual interaction is required of the user. Specifically, we designed a direction-congruent bimodal paradigm by randomly and simultaneously presenting auditory and tactile stimuli from the same direction. Furthermore, the channels and number of trials were tailored to each user to improve online performance. With 12 participants, the average online information transfer rate (ITR) of the bimodal approach improved by 45.43% and 51.05% over that attained, respectively, with the auditory and tactile approaches individually. Importantly, the average online ITR of the bimodal approach, including the break time between selections, reached 10.77 bits/min. These findings suggest that the proposed bimodal system holds promise as a practical visual saccade-independent P300 BCI.

Motor imagery (MI)-based brain-computer interfaces (BCIs) allow disabled individuals to control external devices voluntarily, helping us to restore lost motor functions. However, the number of control commands available in MI-based BCIs remains limited, limiting the usability of BCI systems in control applications involving multiple degrees of freedom (DOF), such as control of a robot arm. To address this problem, we developed a novel Morse code-inspired method for MI-based BCI design to increase the number of output commands. Using this method, brain activities are modulated by sequences of MI (sMI) tasks, which are constructed by alternately imagining movements of the left or right hand or no motion. The codes of the sMI task was detected from EEG signals and mapped to special commands. According to permutation theory, an sMI task with N-length allows 2 × (2(N)-1) possible commands with the left and right MI tasks under self-paced conditions. To verify its feasibility, the new method was used to construct a six-class BCI system to control the arm of a humanoid robot. Four subjects participated in our experiment and the averaged accuracy of the six-class sMI tasks was 89.4%. The Cohen's kappa coefficient and the throughput of our BCI paradigm are 0.88 ± 0.060 and 23.5bits per minute (bpm), respectively. Furthermore, all of the subjects could operate an actual three-joint robot arm to grasp an object in around 49.1s using our approach. These promising results suggest that the Morse code-inspired method could be used in the design of BCIs for multi-DOF control., (Copyright © 2015 Elsevier Ltd. All rights reserved.)

The present study proposes a hybrid brain-computer interface (BCI) with 64 selectable items based on the fusion of P300 and steady-state visually evoked potential (SSVEP) brain signals. With this approach, row/column (RC) P300 and two-step SSVEP paradigms were integrated to create two hybrid paradigms, which we denote as the double RC (DRC) and 4-D spellers. In each hybrid paradigm, the target is simultaneously detected based on both P300 and SSVEP potentials as measured by the electroencephalogram. We further proposed a maximum-probability estimation (MPE) fusion approach to combine the P300 and SSVEP on a score level and compared this approach to other approaches based on linear discriminant analysis, a naïve Bayes classifier, and support vector machines. The experimental results obtained from thirteen participants indicated that the 4-D hybrid paradigm outperformed the DRC paradigm and that the MPE fusion achieved higher accuracy compared with the other approaches. Importantly, 12 of the 13 participants, using the 4-D paradigm achieved an accuracy of over 90% and the average accuracy was 95.18%. These promising results suggest that the proposed hybrid BCI system could be used in the design of a high-performance BCI-based keyboard.

The aim of this study was to design a dynamically optimized steady-state visually evoked potential (SSVEP) brain-computer interface (BCI) system with enhanced performance relative to previous SSVEP BCIs in terms of the number of items selectable on the interface, accuracy, and speed. In this approach, the row/column (RC) paradigm was employed in a SSVEP speller to increase the number of items. The target is detected by subsequently determining the row and column coordinates. To improve spelling accuracy, we added a posterior processing after the canonical correlation analysis (CCA) approach to reduce the interfrequency variation between different subjects and named the new signal processing method CCA-RV, and designed a real-time biofeedback mechanism to increase attention on the visual stimuli. To achieve reasonable online spelling speed, both fixed and dynamic approaches for setting the optimal stimulus duration were implemented and compared. Experimental results for 11 subjects suggest that the CCA-RV method and the real-time biofeedback effectively increased accuracy compared with CCA and the absence of real-time feedback, respectively. In addition, both optimization approaches for setting stimulus duration achieved reasonable online spelling performance. However, the dynamic optimization approach yielded a higher practical information transfer rate (PITR) than the fixed optimization approach. The average online PITR achieved by the proposed adaptive SSVEP speller, including the time required for breaks between selections and error correction, was 41.08 bit/min. These results indicate that our BCI speller is promising for use in SSVEP-based BCI applications.

Objective. The number of items of a P300-based brain-computer interface (BCI) should be adjustable in accordance with the requirements of the specific tasks. To address this issue, we propose a novel task-oriented optimal approach aimed at increasing the performance of general P300 BCIs with different numbers of items. Approach. First, we proposed a stimulus presentation with variable dimensions (VD) paradigm as a generalization of the conventional single-character (SC) and row-column (RC) stimulus paradigms. Furthermore, an embedding design approach was employed for any given number of items. Finally, based on the score-P model of each subject, the VD flash pattern was selected by a linear interpolation approach for a certain task. Main results. The results indicate that the optimal BCI design consistently outperforms the conventional approaches, i.e., the SC and RC paradigms. Specifically, there is significant improvement in the practical information transfer rate for a large number of items. Significance. The results suggest that the proposed optimal approach would provide useful guidance in the practical design of general P300-based BCIs.

This study proposes a novel hybrid brain-computer interface (BCI) approach for increasing the spelling speed. In this approach, the P300 and steady-state visually evoked potential (SSVEP) detection mechanisms are devised and integrated so that the two brain signals can be used for spelling simultaneously. Specifically, the target item is identified by 2-D coordinates that are realized by the two brain patterns. The subarea/location and row/column speedy spelling paradigms were designed based on this approach. The results obtained for 14 healthy subjects demonstrate that the average online practical information transfer rate, including the time of break between selections and error correcting, achieved using our approach was 53.06 bits/min. The pilot studies suggest that our BCI approach could achieve higher spelling speed compared with the conventional P300 and SSVEP spellers.

Recently, the integration of different electrophysiological signals into an electroencephalogram (EEG) has become an effective approach to improve the practicality of brain-computer interface (BCI) systems, referred to as hybrid BCIs. In this paper, a hybrid BCI was designed by combining an EEG with electrocardiograph (EOG) signals and tested using a target selection experiment. Gaze direction from the EOG and the event-related (de)synchronization (ERD/ERS) induced by motor imagery from the EEG were simultaneously detected as the output of the BCI system. The target selection mechanism was based on the synthesis of the gaze direction and ERD activity. When an ERD activity was detected, the target corresponding to the gaze direction was selected; without ERD activity, no target was selected, even when a subjects gaze was directed at the target. With this mechanism, the operation of the BCI system is more flexible and voluntary. The accuracy and completion time of the target selection tasks during the online testing were 89.3% and 2.4 seconds, respectively. These results show the feasibility and practicality of this hybrid BCI system, which can potentially be used in the rehabilitation of disabled individuals.

Objective: Although extensive studies have shown improvement in spelling accuracy, the conventional P300 speller often exhibits errors, which occur in almost the same row or column relative to the target. To address this issue, we propose a novel hybrid brain-computer interface (BCI) approach by incorporating the steady-state visual evoked potential (SSVEP) into the conventional P300 paradigm., Approach: We designed a periodic stimuli mechanism and superimposed it onto the P300 stimuli to increase the difference between the symbols in the same row or column. Furthermore, we integrated the random flashings and periodic flickers to simultaneously evoke the P300 and SSVEP, respectively. Finally, we developed a hybrid detection mechanism based on the P300 and SSVEP in which the target symbols are detected by the fusion of three-dimensional, time-frequency features., Main Results: The results obtained from 12 healthy subjects show that an online classification accuracy of 93.85% and information transfer rate of 56.44 bit/min were achieved using the proposed BCI speller in only a single trial. Specifically, 5 of the 12 subjects exhibited an information transfer rate of 63.56 bit/min with an accuracy of 100%., Significance: The pilot studies suggested that the proposed BCI speller could achieve a better and more stable system performance compared with the conventional P300 speller, and it is promising for achieving quick spelling in stimulus-driven BCI applications.

In this study, a dynamic user interface (UI) is proposed in visual P300 Brain-Computer Interface (BCI) based environmental control system. A head-mounted Augmented Reality (AR) glass is used as the interactive media, which is used to assists the BCI system to build the dynamic UI with the scene in subject's field of view. In the dynamic UI, based on the objects detected by the AR glass, options are dynamically generated. The subject can assign tasks by selecting different options in the dynamic UI. Five subjects successfully completed the task of controlling household appliances and navigating wheelchairs to designated destinations. Compared to static UI, the proposed dynamic UI has a 17.4% improvement in time delay. On average, only 1.9% of the commands resulted in incorrect operations. The dynamic UI makes progress in reducing time delay and incorrect operations. The proposed system provides a brand-new interactive method in BCI based applications. [ABSTRACT FROM AUTHOR]

This study presents a brain–computer interface (BCI) system aimed at providing disabled patients with mobile solutions for practical use. The proposed system employs an omnidirectional chassis and a bionic robot arm to construct a multi-functional mobile platform. In addition, the system is equipped with a Kinect and 12 ultrasonic sensors to capture environment information. Based on artificial intelligence technology, the mobile system can understand the environment and smartly completes certain tasks. A hybrid BCI combined with movement imagery paradigm and asynchronous P300 paradigm is designed to translate human intent to computer commands. The users interact with the system in a flexible way: on the one hand, the user issues commands to drive the system directly; on the other hand, the system searches for predefined operable targets and reports the results to the user. Once the user confirms the target, the system will automatically complete the associated operation. To evaluate the system's performance, a testing environment with a small room, aisle, and an elevator was built to simulate the mobile tasks in the daily scene. Participants were instructed to operate the mobile system in the room, aisle, and using the elevator to go outdoors. In this study, four subjects participated in the test, and all of them completed the task. [ABSTRACT FROM AUTHOR]

In this paper, we presented a novel asynchronous speller for Chinese sinogram input by incorporating electroencephalography (EOG) into the conventional electroencephalography (EEG)-based spelling paradigm. An EOG-based brain switch was used to activate a classic row-column P300-based speller only when spelling was needed, enabling an asynchronous operation of the system. Then, the user could input sinograms by alternately performing P300 and double-blink tasks until he or she intended to stop spelling. With the incorporation of an EOG detector, the system achieved rapid sinogram input. In addition to asynchronous operation, the performance of the proposed speller was compared with that achieved by a P300-based method alone across 18 subjects. The proposed system showed a mean communication speed of approximately 2.39 sinograms per minute, an increase of 0.83 sinograms per minute compared with the P300-based method. The preliminary online performance indicated that the proposed paradigm is a very promising approach for practical Chinese sinogram input application. This system may also be expanded to users whose languages are written in logographic scripts to serve as an assistive communication tool. [ABSTRACT FROM AUTHOR]

This study presents the self-paced operation of a brain–computer interface (BCI) speller, which can be voluntarily turned on/off by merging a motor imagery (MI)-based brain switch into a P300-based BCI speller. From an off state (idle state), the users can generate a “control signal” by consciously changing the cognitive state differential from the idle state to turn on a P300-based spelling system when he or she wants to spell words. With the system turned on, the user can spell words, and then, the spelling system can be voluntarily turned off and switched to the initial state using a command. In this paradigm, the participants tried to perform the two different cognitive tasks sequentially, rather than simultaneously, and multiple EEG components were processed sequentially. The practicability and effectiveness of the proposed approach were validated by eleven participants, and all of them achieved a satisfactory performance. For the P300 speller, they achieved an average PITR of 42.61 bits/min. The preliminary results indicated that the proposed hybrid BCI system with different mental strategies operating sequentially is feasible and has potential applications for practical self-paced control. [ABSTRACT FROM PUBLISHER]

The majority of previously developed assistive communication brain-computer interface systems have primarily focused on languages that are written in alphabetic scripts. However, languages that are written in logographic scripts, such as those in Chinese hanzi (or sinograms), pose a challenge for the implementation of visual spelling systems because it is impossible to simultaneously display thousands of items in a stimulus matrix of a reasonable size. In this study, a P300 visual spelling system that uses a novel method to input Chinese sinograms developed with a Hanyu Pinyin-based method is presented. This method transcribes a Chinese Pinyin into initial consonant and vowel components according to its Mandarin pronunciation. In this paradigm, each sinogram is input by selecting the initial consonant and then the vowel components and subsequently selecting the sinogram itself. Ten healthy subjects participated in the study and achieved an average offline accuracy of 92.6% with a mean information transfer rate of 39.2 bits/min and an average online input speed of one sinogram per 43.9 s. The preliminary results presented here indicated that the online input of Chinese text using a Pinyin-based visual speller is feasible. [ABSTRACT FROM AUTHOR]

Abstract: Objective: Brain–computer interface (BCI) provides a mean of communication for the patients that are severely disabled by neuromuscular diseases. The performance of the classical P300 speller, however, declines noticeably in the gaze fixation condition. The speller paradigm presented in this paper aims to release the gaze dependency at the cost of an extra covert visual search task. Methods: Clusters of characters were presented sequentially in the near-central vision as stimulation. Participants fixed their gaze on the center, searched and recognized the target character with covert shift of attention. Random position (RP) and fixed position (FP) presentation modes designed with different searching set size (6 for RP, and ⩽2 for FP) were examined. Results: Online sessions using 10 stimulus sequences achieved character accuracies of 94.4% and 96.3% for RP and FP mode, respectively. For offline overall evaluation, the peak written symbol rate (WSR) of 1.38 symbols/min was obtained, with corresponding accuracies of 87.8% (RP) and 84.1% (FP). The P300 waveform of RP mode has evident longer latency and larger amplitude. Electrooculogram (EOG) analysis indicated that the performance was independent of gaze shift. Conclusions: The proposed speller could be operated effectively and gaze independently by healthy participants. Significance: The proposed gaze independent BCI approach promises reasonable communication capability for the profoundly paralyzed patients with head or ocular motor impairments. [Copyright &y& Elsevier]

Abstract: Most brain–computer interfaces (BCIs) are non-time-restraint systems. However, the method used to design a real-time BCI paradigm for controlling unstable devices is still a challenging problem. This paper presents a real-time feedback BCI paradigm for controlling an inverted pendulum on a cart (IPC). In this paradigm, sensorimotor rhythms (SMRs) were recorded using 15 active electrodes placed on the surface of the subject''s scalp. Subsequently, common spatial pattern (CSP) was used as the basic filter to extract spatial patterns. Finally, linear discriminant analysis (LDA) was used to translate the patterns into control commands that could stabilize the simulated inverted pendulum. Offline trainings were employed to teach the subjects to execute corresponding mental tasks, such as left/right hand motor imagery. Five subjects could successfully balance the online inverted pendulum for more than 35s. The results demonstrated that BCIs are able to control nonlinear unstable devices. Furthermore, the demonstration and extension of real-time continuous control might be useful for the real-life application and generalization of BCI. [Copyright &y& Elsevier]