Search

Recently, we proposed a method to estimate repetitive spatiotemporal patterns from resting-state brain activity data (SpatioTemporal Pattern estimation, STeP) (Takeda et al., 2016). From such resting-state data as functional MRI (fMRI), STeP can estimate several spatiotemporal patterns and their onsets even if they are overlapping. Nowadays, a growing number of resting-state data are publicly available from such databases as the Autism Brain Imaging Data Exchange (ABIDE), which promote a better understanding of resting-state brain activities. In this study, we extend STeP to make it applicable to such big databases, thus proposing the method we call BigSTeP. From many subjects' resting-state data, BigSTeP estimates spatiotemporal patterns that are common across subjects (common spatiotemporal patterns) as well as the corresponding spatiotemporal patterns in each subject (subject-specific spatiotemporal patterns). After verifying the performance of BigSTeP by simulation tests, we applied it to over 1,000 subjects' resting-state fMRIs (rsfMRIs) obtained from ABIDE I. This revealed two common spatiotemporal patterns and the corresponding subject-specific spatiotemporal patterns. The common spatiotemporal patterns included spatial patterns resembling the default mode (DMN), sensorimotor, auditory, and visual networks, suggesting that these networks are time-locked with each other. We compared the subject-specific spatiotemporal patterns between autism spectrum disorder (ASD) and typically developed (TD) groups. As a result, significant differences were concentrated at a specific time in a pattern, when the DMN exhibited large positive activity. This suggests that the differences are context-dependent, that is, the differences in fMRI activities between ASDs and TDs do not always occur during the resting state but tend to occur when the DMN exhibits large positive activity. All of these results demonstrate the usefulness of BigSTeP in extracting inspiring hypotheses from big databases in a data-driven way., (Copyright © 2019 The Authors. Published by Elsevier Inc. All rights reserved.)

To understand information representation in human brain activity, it is important to investigate its fine spatial patterns at high temporal resolution. One possible approach is to use source estimation of magnetoencephalography (MEG) signals. Previous studies have mainly quantified accuracy of this technique according to positional deviations and dispersion of estimated sources, but it remains unclear how accurately MEG source estimation restores information content represented by spatial patterns of brain activity. In this study, using simulated MEG signals representing artificial experimental conditions, we performed MEG source estimation and multivariate pattern analysis to examine whether MEG source estimation can restore information content represented by patterns of cortical current in source brain areas. Classification analysis revealed that the corresponding artificial experimental conditions were predicted accurately from patterns of cortical current estimated in the source brain areas. However, accurate predictions were also possible from brain areas whose original sources were not defined. Searchlight decoding further revealed that this unexpected prediction was possible across wide brain areas beyond the original source locations, indicating that information contained in the original sources can spread through MEG source estimation. This phenomenon of "information spreading" may easily lead to false-positive interpretations when MEG source estimation and classification analysis are combined to identify brain areas that represent target information. Real MEG data analyses also showed that presented stimuli were able to be predicted in the higher visual cortex at the same latency as in the primary visual cortex, also suggesting that information spreading took place. These results indicate that careful inspection is necessary to avoid false-positive interpretations when MEG source estimation and multivariate pattern analysis are combined., Competing Interests: The authors have declared that no competing interests exist.

Functional near-infrared spectroscopy (fNIRS) is used to measure cerebral activity because it is simple and portable. However, scalp-hemodynamics often contaminates fNIRS signals, leading to detection of cortical activity in regions that are actually inactive. Methods for removing these artifacts using standard source-detector distance channels (Long-channel) tend to over-estimate the artifacts, while methods using additional short source-detector distance channels (Short-channel) require numerous probes to cover broad cortical areas, which leads to a high cost and prolonged experimental time. Here, we propose a new method that effectively combines the existing techniques, preserving the accuracy of estimating cerebral activity and avoiding the disadvantages inherent when applying the techniques individually. Our new method accomplishes this by estimating a global scalp-hemodynamic component from a small number of Short-channels, and removing its influence from the Long-channels using a general linear model (GLM). To demonstrate the feasibility of this method, we collected fNIRS and functional magnetic resonance imaging (fMRI) measurements during a motor task. First, we measured changes in oxygenated hemoglobin concentration (∆Oxy-Hb) from 18 Short-channels placed over motor-related areas, and confirmed that the majority of scalp-hemodynamics was globally consistent and could be estimated from as few as four Short-channels using principal component analysis. We then measured ∆Oxy-Hb from 4 Short- and 43 Long-channels. The GLM identified cerebral activity comparable to that measured separately by fMRI, even when scalp-hemodynamics exhibited substantial task-related modulation. These results suggest that combining measurements from four Short-channels with a GLM provides robust estimation of cerebral activity at a low cost., (Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.)

Visual information about lip and facial movements plays a role in audiovisual (AV) speech perception. Although this has been widely confirmed, previous behavioural studies have shown interlanguage differences, that is, native Japanese speakers do not integrate auditory and visual speech as closely as native English speakers. To elucidate the neural basis of such interlanguage differences, 22 native English speakers and 24 native Japanese speakers were examined in behavioural or functional Magnetic Resonance Imaging (fMRI) experiments while mono-syllabic speech was presented under AV, auditory-only, or visual-only conditions for speech identification. Behavioural results indicated that the English speakers identified visual speech more quickly than the Japanese speakers, and that the temporal facilitation effect of congruent visual speech was significant in the English speakers but not in the Japanese speakers. Using fMRI data, we examined the functional connectivity among brain regions important for auditory-visual interplay. The results indicated that the English speakers had significantly stronger connectivity between the visual motion area MT and the Heschl's gyrus compared with the Japanese speakers, which may subserve lower-level visual influences on speech perception in English speakers in a multisensory environment. These results suggested that linguistic experience strongly affects neural connectivity involved in AV speech integration.

Diffuse optical tomography (DOT) reconstructs 3-D tomographic images of brain activities from observations by near-infrared spectroscopy (NIRS) that is formulated as an ill-posed inverse problem. This brief presents a method for NIRS DOT based on a hierarchical Bayesian approach introducing the automatic relevance determination prior and the variational Bayes technique. Although the sparseness of the estimation strongly depends on the hyperparameters, in general, our method has less dependency on the hyperparameters. We confirm through numerical experiments that a schematic phase diagram of sparseness with respect to the hyperparameters has two regions: in one region hyperparameters give sparse solutions and in the other they give dense ones. The experimental results are supported by our theoretical analyses in simple cases.

One of the major obstacles in estimating cortical currents from MEG signals is the disturbance caused by magnetic artifacts derived from extra-cortical current sources such as heartbeats and eye movements. To remove the effect of such extra-brain sources, we improved the hybrid hierarchical variational Bayesian method (hyVBED) proposed by Fujiwara et al. (NeuroImage, 2009). hyVBED simultaneously estimates cortical and extra-brain source currents by placing dipoles on cortical surfaces as well as extra-brain sources. This method requires EOG data for an EOG forward model that describes the relationship between eye dipoles and electric potentials. In contrast, our improved approach requires no EOG and less a priori knowledge about the current variance of extra-brain sources. We propose a new method, "extra-dipole," that optimally selects hyper-parameter values regarding current variances of the cortical surface and extra-brain source dipoles. With the selected parameter values, the cortical and extra-brain dipole currents were accurately estimated from the simulated MEG data. The performance of this method was demonstrated to be better than conventional approaches, such as principal component analysis and independent component analysis, which use only statistical properties of MEG signals. Furthermore, we applied our proposed method to measured MEG data during covert pursuit of a smoothly moving target and confirmed its effectiveness., (Copyright © 2014 Elsevier Inc. All rights reserved.)

Brain activities related to cognitive functions, such as attention, occur with unknown and variable delays after stimulus onsets. Recently, we proposed a method (Common Waveform Estimation, CWE) that could extract such brain activities from magnetoencephalography (MEG) or electroencephalography (EEG) measurements. CWE estimates spatiotemporal MEG/EEG patterns occurring with unknown and variable delays, referred to here as unlocked waveforms, without hypotheses about their shapes. The purpose of this study is to demonstrate the usefulness of CWE for cognitive neuroscience. For this purpose, we show procedures to estimate unlocked waveforms using CWE and to examine their role. We applied CWE to the MEG epochs during Go trials of a visual Go/NoGo task. This revealed unlocked waveforms with interesting properties, specifically large alpha oscillations around the temporal areas. To examine the role of the unlocked waveform, we attempted to estimate the strength of the brain activity of the unlocked waveform in various conditions. We made a spatial filter to extract the component reflecting the brain activity of the unlocked waveform, applied this spatial filter to MEG data under different conditions (a passive viewing, a simple reaction time, and Go/NoGo tasks), and calculated the powers of the extracted components. Comparing the powers across these conditions suggests that the unlocked waveforms may reflect the inhibition of the task-irrelevant activities in the temporal regions while the subject attends to the visual stimulus. Our results demonstrate that CWE is a potential tool for revealing new findings of cognitive brain functions without any hypothesis in advance.

In this fMRI study we investigate neural processes related to the action observation network using a complex perceptual-motor task in pilots and non-pilots. The task involved landing a glider (using aileron, elevator, rudder, and dive brake) as close to a target as possible, passively observing a replay of one's own previous trial, passively observing a replay of an expert's trial, and a baseline do nothing condition. The objective of this study is to investigate two types of motor simulation processes used during observation of action: imitation based motor simulation and error-feedback based motor simulation. It has been proposed that the computational neurocircuitry of the cortex is well suited for unsupervised imitation based learning, whereas, the cerebellum is well suited for error-feedback based learning. Consistent with predictions, pilots (to a greater extent than non-pilots) showed significant differential activity when observing an expert landing the glider in brain regions involved with imitation based motor simulation (including premotor cortex PMC, inferior frontal gyrus IFG, anterior insula, parietal cortex, superior temporal gyrus, and middle temporal MT area) than when observing one's own previous trial which showed significant differential activity in the cerebellum (only for pilots) thought to be concerned with error-feedback based motor simulation. While there was some differential brain activity for pilots in regions involved with both Execution and Observation of the flying task (potential Mirror System sites including IFG, PMC, superior parietal lobule) the majority was adjacent to these areas (Observation Only Sites) (predominantly in PMC, IFG, and inferior parietal loblule). These regions showing greater activity for observation than for action may be involved with processes related to motor-based representational transforms that are not necessary when actually carrying out the task., (Copyright © 2013 Elsevier Inc. All rights reserved.)

Background: There is an accumulating body of evidence indicating that neuronal functional specificity to basic sensory stimulation is mutable and subject to experience. Although fMRI experiments have investigated changes in brain activity after relative to before perceptual learning, brain activity during perceptual learning has not been explored. This work investigated brain activity related to auditory frequency discrimination learning using a variational Bayesian approach for source localization, during simultaneous EEG and fMRI recording. We investigated whether the practice effects are determined solely by activity in stimulus-driven mechanisms or whether high-level attentional mechanisms, which are linked to the perceptual task, control the learning process., Results: The results of fMRI analyses revealed significant attention and learning related activity in left and right superior temporal gyrus STG as well as the left inferior frontal gyrus IFG. Current source localization of simultaneously recorded EEG data was estimated using a variational Bayesian method. Analysis of current localized to the left inferior frontal gyrus and the right superior temporal gyrus revealed gamma band activity correlated with behavioral performance., Conclusions: Rapid improvement in task performance is accompanied by plastic changes in the sensory cortex as well as superior areas gated by selective attention. Together the fMRI and EEG results suggest that gamma band activity in the right STG and left IFG plays an important role during perceptual learning.

State-space modeling is a promising approach for current source reconstruction from magnetoencephalography (MEG) because it constrains the spatiotemporal behavior of inverse solutions in a flexible manner. However, state-space model-based source localization research remains underdeveloped; extraction of spatially focal current sources and handling of the high dimensionality of the distributed source model remain problematic. In this study, we propose a novel state-space model-based method that resolves these problems, extending our previous source localization method to include a temporal constraint by state-space modeling. To enable focal current reconstruction, we account for spatially inhomogeneous temporal dynamics by introducing dynamics model parameters that differ for each cortical position. The model parameters and the intensity of the current sources are jointly estimated according to a bayesian framework. We circumvent the high dimensionality of the problem by assuming prior distributions of the model parameters to reduce the sensitivity to unmodeled components, and by adopting variational bayesian inference to reduce the computational cost. Through simulation experiments and application to real MEG data, we have confirmed that our proposed method successfully reconstructs focal current activities, which evolve with their temporal dynamics.

Reconstruction of movements from non-invasively recorded brain activity is a key technology for brain-machine interfaces (BMIs). However, electroencephalography (EEG) or magnetoencephalography (MEG) inevitably records a mixture of signals originating from many cortical regions, and thus it is not only less effective than invasive methods but also poses more difficulty for incorporating neuroscience knowledge. We combined two sparse Bayesian methods to overcome this difficulty. First, thousands of cortical currents were estimated on the order of millimeters and milliseconds by a hierarchical Bayesian MEG inverse method, and then a sparse regression method automatically selected only relevant cortical currents in accurate reconstruction of movements by a linear weighted sum of their time series. Using the combined methods, we reconstructed two-dimensional trajectories of the index fingertip during pointing movements to various directions by moving the wrist joint. A good generalization (reconstruction) performance was observed for test datasets: mean error between the predicted and actual positions was 15 mm, which was 7% of the path length of the required movement. The reconstruction accuracy of the proposed method was significantly higher than directly using MEG sensor signals. Moreover, spatial distribution and temporal characteristics of weight values revealed that the primary sensorimotor, higher motor, and parietal regions mainly contributed to the reconstruction with expected time courses. These results suggest that the combined sparse Bayesian methods provide effective means to predict movement trajectory from non-invasive brain activity directly related to sensorimotor control., (Copyright © 2010 Elsevier Inc. All rights reserved.)

The magnetic fields generated by eye movements are major artifacts in MEG measurements. We propose a hybrid hierarchical variational Bayesian method to remove eye movement artifacts from MEG data. Our method is an extension of the hierarchical variational Bayesian method for MEG source localization proposed by Sato et al. [Sato, M., Yoshioka, T., Kajihara, S., Toyama, K., Goda, N., Doya, K., and Kawato, M., (2004). Hierarchical Bayesian estimation for MEG inverse problem. NeuroImage 23(3), 806-826]. First, we assumed a single dipole at each left and right eyeball as a source of eye artifacts. Second, we constructed an EOG forward model describing the relationship between eye dipoles and electric potentials, i.e., EOG. Based on the Bayesian framework, the proposed method concurrently estimates eye and brain current sources from both MEG and EOG data. Thereby the brain current sources can be isolated from eye artifacts. The new method was tested in two ways. In the simulation experiments, the performance of eye artifact removal was evaluated from various aspects; locations of brain current sources, temporal correlation between eye and brain current sources, the level of MEG observation noise and so on. In real MEG experiments, we measured MEG and EOG data during smooth pursuit eye movements for a horizontally or circularly moving target. Our method successfully removed eye artifacts from the simulated and real MEG data with the estimation of brain current sources that were located in eye movement related areas. Our method should be widely applicable to MEG data obtained in tasks with non-negligible eye movements.

Perceptual experience consists of an enormous number of possible states. Previous fMRI studies have predicted a perceptual state by classifying brain activity into prespecified categories. Constraint-free visual image reconstruction is more challenging, as it is impractical to specify brain activity for all possible images. In this study, we reconstructed visual images by combining local image bases of multiple scales, whose contrasts were independently decoded from fMRI activity by automatically selecting relevant voxels and exploiting their correlated patterns. Binary-contrast, 10 x 10-patch images (2(100) possible states) were accurately reconstructed without any image prior on a single trial or volume basis by measuring brain activity only for several hundred random images. Reconstruction was also used to identify the presented image among millions of candidates. The results suggest that our approach provides an effective means to read out complex perceptual states from brain activity while discovering information representation in multivoxel patterns.

Source current estimation from MEG measurement is an ill-posed problem that requires prior assumptions about brain activity and an efficient estimation algorithm. In this article, we propose a new hierarchical Bayesian method introducing a hierarchical prior that can effectively incorporate both structural and functional MRI data. In our method, the variance of the source current at each source location is considered an unknown parameter and estimated from the observed MEG data and prior information by using the Variational Bayesian method. The fMRI information can be imposed as prior information on the variance distribution rather than the variance itself so that it gives a soft constraint on the variance. A spatial smoothness constraint, that the neural activity within a few millimeter radius tends to be similar due to the neural connections, can also be implemented as a hierarchical prior. The proposed method provides a unified theory to deal with the following three situations: (1) MEG with no other data, (2) MEG with structural MRI data on cortical surfaces, and (3) MEG with both structural MRI and fMRI data. We investigated the performance of our method and conventional linear inverse methods under these three conditions. Simulation results indicate that our method has better accuracy and spatial resolution than the conventional linear inverse methods under all three conditions. It is also shown that accuracy of our method improves as MRI and fMRI information becomes available. Simulation results demonstrate that our method appropriately resolves the inverse problem even if fMRI data convey inaccurate information, while the Wiener filter method is seriously deteriorated by inaccurate fMRI information. [Copyright &y& Elsevier]