Search

Copyright of Journal of Computer Engineering & Applications is the property of Beijing Journal of Computer Engineering & Applications Journal Co Ltd. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Electroencephalogram (EEG)-based brain–computer interfaces (BCIs) provide a novel approach for controlling external devices. BCI technologies can be important enabling technologies for people with severe mobility impairment. Endogenous paradigms, which depend on user-generated commands and do not need external stimuli, can provide intuitive control of external devices. This paper discusses BCIs to control various physical devices such as exoskeletons, wheelchairs, mobile robots, and robotic arms. These technologies must be able to navigate complex environments or execute fine motor movements. Brain control of these devices presents an intricate research problem that merges signal processing and classification techniques with control theory. In particular, obtaining strong classification performance for endogenous BCIs is challenging, and EEG decoder output signals can be unstable. These issues present myriad research questions that are discussed in this review paper. This review covers papers published until the end of 2021 that presented BCI-controlled dynamic devices. It discusses the devices controlled, EEG paradigms, shared control, stabilization of the EEG signal, traditional machine learning and deep learning techniques, and user experience. The paper concludes with a discussion of open questions and avenues for future work. [ABSTRACT FROM AUTHOR]

• Limited information in time domain results in limited performance of feature classification. • The particularity of EEG signal makes it difficult to measure. • The strong correlation of EEG signals makes it difficult to build feature extraction network. With the promotion of brain-computer interface technology, it is possible to study brain control system through EEG signals in recent years. In order to solve the problem of EEG signal classification effectively, a motor imagery classification algorithm based on recurrence plot convolution neural network is proposed. Firstly, EEG signals are preprocessed to enhance the signal intensity in the exercise interval. Secondly, time-domain and frequency-domain features are extracted respectively to construct the feature mode of recurrence plot. Finally, a new neural network is established to realize the accurate recognition of left and right movements. This research can also be transferred to other research fields. [Display omitted] [ABSTRACT FROM AUTHOR]

A brain-controlled vehicle (BCV) is a vehicle that uses the Brain–Computer interface (BCI) to analyze the driver's electroencephalogram (EEG) to obtain human control commands, which can help disabled people extend movement range and improve their self-independence. However, the performance of BCV is poor and the accuracy of BCI recognition varies considerably with different subjects, which severely restrict its promotion and application. To develop a better solution, with the concept of shared control, an intention preferenced fusion brain control strategy based on fuzzy logic is proposed. Firstly, based on Fuzzy Discrete Event System Supervision (FDES) theory, instructions of the driver are supervised and evaluated. At the same time, based on fuzzy logic an automatic controller which gives an automatic decision according to the cur-rent state of the vehicle is designed. Then according to the automatic decision and the correctness of the driver's instructions, a fuzzy reasoning is made, making the final decision more in line with human intentions. In order to verify the effectiveness of the proposed method, based on our previously-designed SSMVEP platform, we conduct virtual experiments, semi-object tests and full physical tests separately for verification. Compared with others shared control schemes, it not only achieves continuous control, but the final control-making is more in line with human intentions, which can encourage users to become more involved, enhancing their self-esteem and brain functions. • An intention preferenced fusion brain control strategy is proposed. • FDES theory is used to supervise the brain instructions. • An automatic controller is designed based on fuzzy logic. • Fuzzy reasoning is used to make the final decision more in line with human intentions. • Virtual experiments, semi-object tests and full physical tests are conducted for verification. [ABSTRACT FROM AUTHOR]

The mathematical properties of high-dimensional (HD) spaces show remarkable agreement with behaviors controlled by the brain. Computing with HD vectors, referred to as "hypervectors," is a brain-inspired alternative to computing with numbers. HD computing is characterized by generality, scalability, robustness, and fast learning, making it a prime candidate for utilization in application domains such as brain–computer interfaces. We describe the use of HD computing to classify electroencephalography (EEG) error-related potentials for noninvasive brain–computer interfaces. Our algorithm naturally encodes neural activity recorded from 64 EEG electrodes to a single temporal–spatial hypervector without requiring any electrode selection process. This hypervector represents the event of interest, can be analyzed to identify the most discriminative electrodes, and is used for recognition of the subject's intentions. Using the full set of training trials, HD computing achieves on average 5% higher single-trial classification accuracy compared to a conventional machine learning method on this task (74.5% vs. 69.5%) and offers further advantages: (1) Our algorithm learns fast: using only 34% of training trials it achieves an average accuracy of 70.5%, surpassing the conventional method. (2) Conventional method requires prior domain expert knowledge, or a separate process, to carefully select a subset of electrodes for a subsequent preprocessor and classifier, whereas our algorithm blindly uses all 64 electrodes, tolerates noises in data, and the resulting hypervector is intrinsically clustered into HD space; in addition, most preprocessing of the electrode signal can be eliminated while maintaining an average accuracy of 71.7%. [ABSTRACT FROM AUTHOR]

This paper proposes a brain–robot interface (BRI)-based control strategy in combination with the simultaneous localization and mapping (SLAM) to achieve the navigation and control of a mobile robot in uncertain environments. The BRI is based on steady state visually evoked potentials, utilizing the multivariate synchronization index classification algorithm to analyze the human electroencephalograph (EEG) signals in such a manner that human intentions can be recognized and motion commands can be produced for the brain controlled robot. The entire system is semi-autonomous since the navigation of mobile robot is commanded by the BRI, and the low-level motion of the mobile robot is autonomous with a designed kinematic controller. By utilizing vanishing points and door plates as the environmental features, a global metric map of the environment has been built by a sequential SLAM algorithm. The main contribution of this paper is the combination of an artificial potential field (APF) and the brain signals, which builds up the relationship between the strength of EEG signals and the intensity of the potential field. Through the proposed EEG-APF method, motion commands that would plan an obstacle-free trajectory in un-structured environments, can be obtained. The entire system has been tested with eight volunteer subjects, and all subjects are able to successfully fulfill manipulating mobile robot in the experiments. [ABSTRACT FROM AUTHOR]

What can the brain–computer interface (BCI) do? Wearing an electroencephalogram (EEG) headcap, you can control the flight of a drone in the laboratory by your thought; with electrodes inserted inside the brain, paralytic patients can drink by controlling a robotic arm with thinking. Both invasive and non-invasive BCI try to connect human brains to machines. In the past several decades, BCI technology has continued to develop, making science fiction into reality and laboratory inventions into indispensable gadgets. In July 2019, Neuralink, a company founded by Elon Musk, proposed a sewing machine-like device that can dig holes in the skull and implant 3072 electrodes onto the cortex, promising more accurate reading of what you are thinking, although many serious scientists consider the claim misleading to the public. Recently, National Science Review (NSR) interviewed Professor Bin He, the department head of Biomedical Engineering at Carnegie Mellon University, and a leading scientist in the non-invasive-BCI field. His team developed new methods for non-invasive BCI to control drones by thoughts. In 2019, Bin's team demonstrated the control of a robotic arm to follow a continuously randomly moving target on the screen. In this interview, Bin He recounted the history of BCI, as well as the opportunities and challenges of non-invasive BCI. [ABSTRACT FROM AUTHOR]

To enhance the performance of the brain-actuated robot system, a novel shared controller based on Bayesian approach is proposed for intelligently combining robot automatic control and brain-actuated control, which takes into account the uncertainty of robot perception, action and human control. Based on maximum a posteriori probability (MAP), this method establishes the probabilistic models of human and robot control commands to realize the optimal control of a brain-actuated shared control system. Application on an intelligent Bayesian shared control system based on steady-state visual evoked potential (SSVEP)-based brain machine interface (BMI) is presented for all-time continuous wheelchair navigation task. Moreover, to obtain more accurate brain control commands for shared controller and adapt the proposed system to the uncertainty of electroencephalogram (EEG), a hierarchical brain control mechanism with feedback rule is designed. Experiments have been conducted to verify the proposed system in several scenarios. Eleven subjects participated in our experiments and the results illustrate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

Brain–machine interfaces (BMIs) translate brain signals into control signals for an external device, such as a computer cursor or robotic limb. These signals can be obtained either noninvasively or invasively. Invasive recordings, using electrocorticography (ECoG) or intracortical microelectrodes, provide higher bandwidth and more informative signals. Rehabilitative BMIs, which aim to drive plasticity in the brain to enhance recovery after brain injury, have almost exclusively used non-invasive recordings, such electroencephalography (EEG) or magnetoencephalography (MEG), which have limited bandwidth and information content. Invasive recordings provide more information and spatiotemporal resolution, but do incur risk, and thus are not usually investigated in people with stroke or traumatic brain injury (TBI). Here, in this paper, we describe a new BMI paradigm to investigate the use of higher frequency signals in brain-injured subjects without incurring significant risk. We recorded EEG in TBI subjects who required hemicraniectomies (removal of a part of the skull). EEG over the hemicraniectomy (hEEG) contained substantial information in the high gamma frequency range (65–115 Hz). Using this information, we decoded continuous finger flexion force with moderate to high accuracy (variance accounted for 0.06 to 0.52), which at best approaches that using epidural signals. These results indicate that people with hemicraniectomies can provide a useful resource for developing BMI therapies for the treatment of brain injury. [ABSTRACT FROM AUTHOR]

Directly using brain signals to drive a vehicle may not only help persons with disabilities to regain driving ability but also provide a new alternative way for healthy people to control a vehicle. In this paper, we propose a new longitudinal control system based on electroencephalogram signals for brain-controlled vehicles (BCVs) by combining a user interface, a brain-computer interface (BCI) system, and a longitudinal control module. Driver-in-the-loop experiments were conducted by using two driving tests (i.e., the destination-approaching and car-following tests) with different subjects under two control conditions, i.e., the brain and manual control conditions. Experimental results show the feasibility of alone using brain signals to continuously perform the longitudinal control of a vehicle at a relatively high speed, at least for some users. This paper not only promotes the development of BCVs but also provides some insights into the research on how to apply BCIs to control other high-speed dynamic systems. [ABSTRACT FROM AUTHOR]

Brain control technology can restore communication between the brain and a prosthesis, and choosing a Brain-Computer Interface (BCI) paradigm to evoke electroencephalogram (EEG) signals is an essential step for developing this technology. In this paper, the Scene Graph paradigm used for controlling prostheses was proposed; this paradigm is based on Steady-State Visual Evoked Potentials (SSVEPs) regarding the Scene Graph of a subject’s intention. A mathematic model was built to predict SSVEPs evoked by the proposed paradigm and a sinusoidal stimulation method was used to present the Scene Graph stimulus to elicit SSVEPs from subjects. Then, a 2-degree of freedom (2-DOF) brain-controlled prosthesis system was constructed to validate the performance of the Scene Graph-SSVEP (SG-SSVEP)-based BCI. The classification of SG-SSVEPs was detected via the Canonical Correlation Analysis (CCA) approach. To assess the efficiency of proposed BCI system, the performances of traditional SSVEP-BCI system were compared. Experimental results from six subjects suggested that the proposed system effectively enhanced the SSVEP responses, decreased the degradation of SSVEP strength and reduced the visual fatigue in comparison with the traditional SSVEP-BCI system. The average signal to noise ratio (SNR) of SG-SSVEP was 6.31 ± 2.64 dB, versus 3.38 ± 0.78 dB of traditional-SSVEP. In addition, the proposed system achieved good performances in prosthesis control. The average accuracy was 94.58% ± 7.05%, and the corresponding high information transfer rate (IRT) was 19.55 ± 3.07 bit/min. The experimental results revealed that the SG-SSVEP based BCI system achieves the good performance and improved the stability relative to the conventional approach. [ABSTRACT FROM AUTHOR]

Abstract: Recently, a new system called brain control system has been developed rapidly. Brain control system is a human-computer integration control system based on brain-computer interface (BCI), which relies on human's ideas and thinking. Brain control system has been successfully applied in wide fields, assisting disabled patients daily life, training patients with stroke or limb injury, monitoring the state of human operator, as well as entertainment and smart house etc. In this paper, the background, basic principle, system structure and developments are firstly introduced briefly. The current research status focusing on the problems of electroencephalograph (EEG) signal pattern, control signal transfer algorithm and system application is summarized and analyzed in detail. The further research direction and problems are discussed. Finally, the future development of brain control is analyzed and prospects are given. [ABSTRACT FROM AUTHOR]