Search

The study of human reaction time (RT) is invaluable not only to understand the sensory-motor functions but also to translate brain signals into machine comprehensible commands that can facilitate augmentative and alternative communication using brain-computer interfaces (BCI). Recent developments in sensor technologies, hardware computational capabilities, and neural network models have significantly helped advance biomedical signal processing research. This study is an attempt to utilize state-of-the-art resources to explore the relationship between human behavioral responses during perceptual decision-making and corresponding brain signals in the form of electroencephalograms (EEG). In this paper, a generalized 3D convolutional neural network (CNN) architecture is introduced to estimate RT for a simple visual task using single-trial multi-channel EEG. Earlier comparable studies have also employed a number of machine learning and deep learning-based models, but none of them considered inter-channel relationships while estimating RT. On the contrary, the use of 3D convolutional layers enabled us to consider the spatial relationship among adjacent channels while simultaneously utilizing spectral information from individual channels. Our model can predict RT with a root mean square error of 91.5 ms and a correlation coefficient of 0.83. These results surpass all the previous results attained from different studies.Clinical relevance Novel approaches to decode brain signals can facilitate research on brain-computer interfaces (BCIs), psychology, and neuroscience, enabling people to utilize assistive devices by root-causing psychological or neuromuscular disorders.

The estimation of the visual stimulus-based reaction time (RT) using subtle and complex information from the brain signals is still a challenge, as the behavioral response during perceptual decision making varies inordinately across trials. Several investigations have tried to formulate the estimation based on electroencephalogram (EEG) signals. However, these studies are subject-specific and limited to regression-based analysis. In this paper, for the first time to our knowledge, a generalized model is introduced to estimate RT using single-trial EEG features for a simple visual reaction task, considering both regression and classification-based approaches. With the regression-based approach, we could predict RT with a root mean square error of 111.2 ms and a correlation coefficient of 0.74. A binary and a 3-class classifier model were trained, based on the magnitude of RT, for the classification approach. Accuracy of 79% and 72% were achieved for the binary and the 3-class classification, respectively. Limiting our study to only high and low RT groups, the model classified the two groups with an accuracy of 95%. Relevant EEG channels were evaluated to localize the part of the brain significantly responsible for RT estimation, followed by the isolation of important features.Clinical relevance- Electroencephalogram (EEG) signals can be used in Brain-computer interfaces (BCIs), enabling people with neuromuscular disorders like brainstem stroke, amyotrophic lateral sclerosis, and spinal cord injury to communicate with assistive devices. However, advancements regarding EEG signal analysis and interpretation are far from adequate, and this study is a step forward.