Search

Synchronous monitoring electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) have received significant attention in brain science research for their provision of more information on neuro-loop interactions. There is a need for an integrated hybrid EEG-fNIRS patch to synchronously monitor surface EEG and deep brain fNIRS signals. Here, we developed a hybrid EEG-fNIRS patch capable of acquiring high-quality, co-located EEG and fNIRS signals. This patch is wearable and provides easy cognition and emotion detection, while reducing the spatial interference and signal crosstalk by integration, which leads to high spatial–temporal correspondence and signal quality. The modular design of the EEG-fNIRS acquisition unit and optimized mechanical design enables the patch to obtain EEG and fNIRS signals at the same location and eliminates spatial interference. The EEG pre-amplifier on the electrode side effectively improves the acquisition of weak EEG signals and significantly reduces input noise to 0.9 μVrms, amplitude distortion to less than 2%, and frequency distortion to less than 1%. Detrending, motion correction algorithms, and band-pass filtering were used to remove physiological noise, baseline drift, and motion artifacts from the fNIRS signal. A high fNIRS source switching frequency configuration above 100 Hz improves crosstalk suppression between fNIRS and EEG signals. The Stroop task was carried out to verify its performance; the patch can acquire event-related potentials and hemodynamic information associated with cognition in the prefrontal area. [ABSTRACT FROM AUTHOR]

Neurovascular coupling (NVC) connects neural activity with hemodynamics and plays a vital role in sustaining brain function. Combining electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) is a promising way to explore the NVC. However, the high-order property of EEG data and variability of hemodynamic response function (HRF) across subjects have not been well considered in existing NVC studies. In this study, we proposed a novel framework to enhance the subject-specific parametric modeling of NVC from simultaneous EEG-fNIRS measurement. Specifically, task-related tensor decomposition of high-order EEG data was performed to extract the underlying connections in the temporal-spectral-spatial structures of EEG activities and identify the most relevant temporal signature within multiple trials. Subject-specific HRFs were estimated by parameters optimization of a double gamma function model. A canonical motor task experiment was designed to induce neural activity and validate the effectiveness of the proposed framework. The results indicated that the proposed framework significantly improves the reproducibility of EEG components and the correlation between the predicted hemodynamic activities and the real fNIRS signal. Moreover, the estimated parameters characterized the NVC differences in the task with two speeds. Therefore, the proposed framework provides a feasible solution for the quantitative assessment of the NVC function.

Synchronous monitoring electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) have received significant attention in brain science research for their provision of more information on neuro-loop interactions. There is a need for an integrated hybrid EEG-fNIRS patch to synchronously monitor surface EEG and deep brain fNIRS signals. Here, we developed a hybrid EEG-fNIRS patch capable of acquiring high-quality, co-located EEG and fNIRS signals. This patch is wearable and provides easy cognition and emotion detection, while reducing the spatial interference and signal crosstalk by integration, which leads to high spatial–temporal correspondence and signal quality. The modular design of the EEG-fNIRS acquisition unit and optimized mechanical design enables the patch to obtain EEG and fNIRS signals at the same location and eliminates spatial interference. The EEG pre-amplifier on the electrode side effectively improves the acquisition of weak EEG signals and significantly reduces input noise to 0.9 μVrms, amplitude distortion to less than 2%, and frequency distortion to less than 1%. Detrending, motion correction algorithms, and band-pass filtering were used to remove physiological noise, baseline drift, and motion artifacts from the fNIRS signal. A high fNIRS source switching frequency configuration above 100 Hz improves crosstalk suppression between fNIRS and EEG signals. The Stroop task was carried out to verify its performance; the patch can acquire event-related potentials and hemodynamic information associated with cognition in the prefrontal area.

This study objectively evaluated the effects of Virtual Reality Visual Cues (VRVCs) and Traditional Plane Visual Cues (TPVCs) on motor imagery (MI) subjects and Brain-Computer Interface (BCI) performance when building a classification model for MI-BCIs. Four metrics, namely, imagery stability, brain activation and connectivity, classification accuracy, and fatigue level, were used to evaluate the effects of TPVCs and VRVCs on subjects and MI-BCI performance. Nine male subjects performed four types of MI (left/right-hand grip strength) under VRVCs and TPVCs while EEG and fNIRS signals were acquired. FBCSP and HFD were used to extract features, and KNN was used to evaluate MI-BCI accuracy. Rt-DTW was used to evaluate MI stability. PSD topography and the brain functional network were used to assess brain activation and connectivity. Cognitive load and fNIRS mean features were used to evaluate fatigue. The mean classification accuracies of the four types of MI under TPVCs and VRVCs were 50.83% and 51.32%, respectively. However, MI was more stable under TPVCs. VRVCs enhanced the connectivity of the brain functional network during MI and increased the subjects' fatigue level. This study's head-mounted VRVCs increased the subjects' cognitive load and fatigue level. By comparing the performance of an MI-BCI under VRVCs and TPVCs using multiple metrics, this study provides insights for the future integration of MI-BCIs with VR. [ABSTRACT FROM AUTHOR]

To date, it is still unclear how word structure might impact lexical processing in the brain for languages with an impoverished system of grammatical morphology such as Chinese. In this study, concurrent electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) recordings were performed to inspect the temporal and spatial brain activities that are related to Chinese word structure (compound vs. derivation vs. non-morphological) effects. A masked priming paradigm was utilized on three lexical conditions (compound constitute priming, derivation constitute priming, and non-morphological priming) to tap Chinese native speakers' structural sensitivity to differing word structures. The compound vs. derivation structure effect was revealed by the behavioral data as well as the temporal and spatial brain activation patterns. In the masked priming task, Chinese derivations exhibited significantly enhanced brain activation in the frontal cortex and involved broader brain networks as compared with lexicalized compounds. The results were interpreted by the differing connection patterns between constitute morphemes within a given word structure from a spreading activation perspective. More importantly, we demonstrated that the Chinese word structure effect showed a distinct brain activation pattern from that of the dual-route mechanism in alphabetic languages. Therefore, this work paved a new avenue for comprehensively understanding the underlying cognitive neural mechanisms associated with Chinese derivations and coordinate compounds. [ABSTRACT FROM AUTHOR]

Achieving abstinence from drugs is a long journey and can be particularly challenging in the case of methamphetamine, which has a higher relapse rate than other drugs. Therefore, real-time monitoring of patients’ physiological conditions before and when cravings arise to reduce the chance of relapse might help to improve clinical outcomes. Conventional treatments, such as behavior therapy and peer support, often cannot provide timely intervention, reducing the efficiency of these therapies. To more effectively treat methamphetamine addiction in real-time, we propose an intelligent closed-loop transcranial magnetic stimulation (TMS) neuromodulation system based on multimodal electroencephalogram–functional near-infrared spectroscopy (EEG-fNIRS) measurements. This review summarizes the essential modules required for a wearable system to treat addiction efficiently. First, the advantages of neuroimaging over conventional techniques such as analysis of sweat, saliva, or urine for addiction detection are discussed. The knowledge to implement wearable, compact, and user-friendly closed-loop systems with EEG and fNIRS are reviewed. The features of EEG and fNIRS signals in patients with methamphetamine use disorder are summarized. EEG biomarkers are categorized into frequency and time domain and topography-related parameters, whereas for fNIRS, hemoglobin concentration variation and functional connectivity of cortices are described. Following this, the applications of two commonly used neuromodulation technologies, transcranial direct current stimulation and TMS, in patients with methamphetamine use disorder are introduced. The challenges of implementing intelligent closed-loop TMS modulation based on multimodal EEG-fNIRS are summarized, followed by a discussion of potential research directions and the promising future of this approach, including potential applications to other substance use disorders.

In this work, we introduce a deep learning architecture for evaluation on multimodal electroencephalographic (EEG) and functional near-infrared spectroscopy (fNIRS) recordings from 40 epileptic patients. Long short-term memory units and convolutional neural networks are integrated within a multimodal sequence-to-sequence autoencoder. The trained neural network predicts fNIRS signals from EEG, sans a priori, by hierarchically extracting deep features from EEG full spectra and specific EEG frequency bands. Results show that higher frequency EEG ranges are predictive of fNIRS signals with the gamma band inputs dominating fNIRS prediction as compared to other frequency envelopes. Seed based functional connectivity validates similar patterns between experimental fNIRS and our model's fNIRS reconstructions. This is the first study that shows it is possible to predict brain hemodynamics (fNIRS) from encoded neural data (EEG) in the resting human epileptic brain based on power spectrum amplitude modulation of frequency oscillations in the context of specific hypotheses about how EEG frequency bands decode fNIRS signals. [ABSTRACT FROM AUTHOR]

To date, it is still unclear how word structure might impact lexical processing in the brain for languages with an impoverished system of grammatical morphology such as Chinese. In this study, concurrent electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) recordings were performed to inspect the temporal and spatial brain activities that are related to Chinese word structure (compound vs. derivation vs. non-morphological) effects. A masked priming paradigm was utilized on three lexical conditions (compound constitute priming, derivation constitute priming, and non-morphological priming) to tap Chinese native speakers’ structural sensitivity to differing word structures. The compound vs. derivation structure effect was revealed by the behavioral data as well as the temporal and spatial brain activation patterns. In the masked priming task, Chinese derivations exhibited significantly enhanced brain activation in the frontal cortex and involved broader brain networks as compared with lexicalized compounds. The results were interpreted by the differing connection patterns between constitute morphemes within a given word structure from a spreading activation perspective. More importantly, we demonstrated that the Chinese word structure effect showed a distinct brain activation pattern from that of the dual-route mechanism in alphabetic languages. Therefore, this work paved a new avenue for comprehensively understanding the underlying cognitive neural mechanisms associated with Chinese derivations and coordinate compounds.

Background and Objective: The simultaneous execution of a motor and cognitive dual task may lead to the deterioration of task performance in one or both tasks due to cognitive-motor interference (CMI). Neuroimaging techniques are promising ways to reveal the underlying neural mechanism of CMI. However, existing studies have only explored CMI from a single neuroimaging modality, which lack built-in validation and comparison of analysis results. This work is aimed to establish an effective analysis framework to comprehensively investigate the CMI by exploring the electrophysiological and hemodynamic activities as well as their neurovascular coupling., Methods: Experiments including an upper limb single motor task, single cognitive task, and cognitive-motor dual task were designed and performed with 16 healthy young participants. Bimodal signals of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were recorded simultaneously during the experiments. A novel bimodal signal analysis framework was proposed to extract the task-related components for EEG and fNIRS signals respectively and analyze their correlation. Indicators including within-class similarity and between-class distance were utilized to validate the effectiveness of the proposed analysis framework compared to the canonical channel-averaged method. Statistical analysis was performed to investigate the difference in the behavior and neural correlates between the single and dual tasks., Results: Our results revealed that the extra cognitive interference caused divided attention in the dual task, which led to the decreased neurovascular coupling between fNIRS and EEG in all theta, alpha, and beta rhythms. The proposed framework was demonstrated to have a better ability in characterizing the neural patterns than the canonical channel-averaged method with significantly higher within-class similarity and between-class distance indicators., Conclusions: This study proposed a method to investigate CMI by exploring the task-related electrophysiological and hemodynamic activities as well as their neurovascular coupling. Our concurrent EEG-fNIRS study provides new insight into the EEG-fNIRS correlation analysis and novel evidence for the mechanism of neurovascular coupling in the CMI., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Objective . A motor imagery-based brain-computer interface (MI-BCI) translates spontaneous movement intention from the brain to outside devices. Multimodal MI-BCI that uses multiple neural signals contains rich common and complementary information and is promising for enhancing the decoding accuracy of MI-BCI. However, the heterogeneity of different modalities makes the multimodal decoding task difficult. How to effectively utilize multimodal information remains to be further studied. Approach . In this study, a multimodal MI decoding neural network was proposed. Spatial feature alignment losses were designed to enhance the feature representations extracted from the heterogeneous data and guide the fusion of features from different modalities. An attention-based modality fusion module was built to align and fuse the features in the temporal dimension. To evaluate the proposed decoding method, a five-class MI electroencephalography (EEG) and functional near infrared spectroscopy (fNIRS) dataset were constructed. Main results and significance . The comparison experimental results showed that the proposed decoding method achieved higher decoding accuracy than the compared methods on both the self-collected dataset and a public dataset. The ablation results verified the effectiveness of each part of the proposed method. Feature distribution visualization results showed that the proposed losses enhance the feature representation of EEG and fNIRS modalities. The proposed method based on EEG and fNIRS modalities has significant potential for improving decoding performance of MI tasks., (© 2023 IOP Publishing Ltd.)

Functional near-infrared spectroscopy (fNIRS) can be combined with electroencephalography (EEG) to continuously monitor the hemodynamic signal evoked by epileptic events such as seizures or interictal epileptiform discharges (IEDs, aka spikes). As estimation methods assuming a canonical shape of the hemodynamic response function (HRF) might not be optimal, we sought to model patient-specific HRF (sHRF) with a simple deconvolution approach for IED-related analysis with EEG–fNIRS data. Furthermore, a quadratic term was added to the model to account for the nonlinearity in the response when IEDs are frequent. Prior to analyzing clinical data, simulations were carried out to show that the HRF was estimable by the proposed deconvolution methods under proper conditions. EEG–fNIRS data of five patients with refractory focal epilepsy were selected due to the presence of frequent clear IEDs and their unambiguous focus localization. For each patient, both the linear sHRF and the nonlinear sHRF were estimated at each channel. Variability of the estimated sHRFs was seen across brain regions and different patients. Compared with the SPM8 canonical HRF (cHRF), including these sHRFs in the general linear model (GLM) analysis led to hemoglobin activations with higher statistical scores as well as larger spatial extents on all five patients. In particular, for patients with frequent IEDs, nonlinear sHRFs were seen to provide higher sensitivity in activation detection than linear sHRFs. These observations support using sHRFs in the analysis of IEDs with EEG–fNIRS data. [ABSTRACT FROM AUTHOR]

Achieving abstinence from drugs is a long journey and can be particularly challenging in the case of methamphetamine, which has a higher relapse rate than other drugs. Therefore, real-time monitoring of patients' physiological conditions before and when cravings arise to reduce the chance of relapse might help to improve clinical outcomes. Conventional treatments, such as behavior therapy and peer support, often cannot provide timely intervention, reducing the efficiency of these therapies. To more effectively treat methamphetamine addiction in real-time, we propose an intelligent closed-loop transcranial magnetic stimulation (TMS) neuromodulation system based on multimodal electroencephalogram-functional near-infrared spectroscopy (EEG-fNIRS) measurements. This review summarizes the essential modules required for a wearable system to treat addiction efficiently. First, the advantages of neuroimaging over conventional techniques such as analysis of sweat, saliva, or urine for addiction detection are discussed. The knowledge to implement wearable, compact, and user-friendly closed-loop systems with EEG and fNIRS are reviewed. The features of EEG and fNIRS signals in patients with methamphetamine use disorder are summarized. EEG biomarkers are categorized into frequency and time domain and topography-related parameters, whereas for fNIRS, hemoglobin concentration variation and functional connectivity of cortices are described. Following this, the applications of two commonly used neuromodulation technologies, transcranial direct current stimulation and TMS, in patients with methamphetamine use disorder are introduced. The challenges of implementing intelligent closed-loop TMS modulation based on multimodal EEG-fNIRS are summarized, followed by a discussion of potential research directions and the promising future of this approach, including potential applications to other substance use disorders., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Chen, Yang, Wu, Beier and Sawan.)

Highlights: [•] EEG-fNIRS study of 9 patients with posterior epilepsies. [•] Bilateral coverage of about 50% of the brain surface. [•] General linear model (GLM) analysis of interictal spikes and seizures. [•] GLM results broadly consistent with epileptic focus in 8/9 patients. [•] fNIRS responses lateralized to correct lobe and plausible posterior locations. [ABSTRACT FROM AUTHOR]

Summary: Purpose: Functional near-infrared spectroscopy (fNIRS) is a technique that allows continuous non-invasive monitoring of tissue oxygenation and haemodynamics in the brain. By using combined EEG-fNIRS recordings, we sought to better understand the pathophysiology of temporal lobe seizures. Results: Nine patients (5 males; mean age 35 years; range 11–56 years) with refractory mesial temporal lobe epilepsy underwent combined EEG-fNIRS recordings. Eight complex partial seizures from 3 patients were successfully recorded. All seizures were associated with significant local and remote haemodynamic changes which outlasted the duration of seizures. Over the epileptogenic temporal lobe, increased oxygenation [increase in cerebral blood volume (CBV) and oxyhaemoglobin (HbO), decrease in deoxyhaemoglobin (HbR)] was followed by a deoxygenated state [increase in HbR]. A similar haemodynamic profile was seen over the contralateral temporal lobe (even without evidence of epileptic propagation) though variations generally had lower amplitudes. Heterogeneous haemodynamic changes in remote frontal and/or parietal areas were also noted early on when epileptic activity was limited to the temporal lobe. Conclusion: EEG-fNIRS reveals complex local and remote oxygenation changes during temporal lobe seizures. [ABSTRACT FROM AUTHOR]