Search

The present fMRI study aimed at highlighting patterns of brain activations and autonomic activity when confronted with high mental workload and the threat of auditory stressors. Twenty participants performed a complex cognitive task in either safe or aversive conditions. Our results showed that increased mental workload induced recruitment of the lateral frontoparietal executive control network (ECN), along with disengagement of medial prefrontal and posterior cingulate regions of the default mode network (DMN). Mental workload also elicited an increase in heart rate and pupil diameter. Task performance did not decrease under the threat of stressors, most likely due to efficient inhibition of auditory regions, as reflected by a large decrement of activity in the superior temporal gyri. The threat of stressors was also accompanied with deactivations of limbic regions of the salience network (SN), possibly reflecting emotional regulation mechanisms through control from dorsal medial prefrontal and parietal regions, as indicated by functional connectivity analyses. Meanwhile, the threat of stressors induced enhanced ECN activity, likely for improved attentional and cognitive processes toward the task, as suggested by increased lateral prefrontal and parietal activations. These fMRI results suggest that measuring the balance between ECN, SN, and DMN recruitment could be used for objective mental state assessment. In this sense, an extra recruitment of task‐related regions and a high ratio of lateral versus medial prefrontal activity may represent a relevant marker of increased but efficient mental effort, while the opposite may indicate a disengagement from the task due to mental overload and/or stressors., We highlighted patterns of brain activations and autonomic activity when confronted with high mental workload and auditory stressors. Mental workload induced recruitment of the fronto‐parietal executive control network (ECN), along with disengagement of the default mode network (DMN). Task performance did not decrease under stressors, most likely due to efficient emotional regulation mechanisms through control from dorsal brain areas.

International audience; Individuals often have reduced ability to hear alarms in real world situations (e.g., anesthesia monitoring, flying airplanes) when attention is focused on another task, sometimes with devastating consequences. This phenomenon is called inattentional deafness and usually occurs under critical high workload conditions. It is difficult to simulate the critical nature of these tasks in the laboratory. In this study, dry electroencephalography is used to investigate inattentional deafness in real flight while piloting an airplane. The pilots participating in the experiment responded to audio alarms while experiencing critical high workload situations. It was found that missed relative to detected alarms were marked by reduced stimulus evoked phase synchrony in theta and alpha frequencies (6–14 Hz) from 120 to 230 ms poststimulus onset. Correlation of alarm detection performance with intertrial coherence measures of neural phase synchrony showed different frequency and time ranges for detected and missed alarms. These results are consistent with selective attentional processes actively disrupting oscillatory coherence in sensory networks not involved with the primary task (piloting in this case) under critical high load conditions. This hypothesis is corroborated by analyses of flight parameters showing greater maneuvering associated with difficult phases of flight occurring during missed alarms. Our results suggest modulation of neural oscillation is a general mechanism of attention utilizing enhancement of phase synchrony to sharpen alarm perception during successful divided attention, and disruption of phase synchrony in brain networks when attentional demands of the primary task are great, such as in the case of inattentional deafness.

In spatial perception, visual information has higher acuity than auditory information and we often misperceive sound-source locations when spatially disparate visual stimuli are presented simultaneously. Ventriloquists make good use of this auditory illusion. In this study, we investigated neural substrates of the ventriloquism effect to understand the neural mechanism of multimodal integration. This study was performed in 2 steps. First, we investigated how sound locations were represented in the auditory cortex. Secondly, we investigated how simultaneous presentation of spatially disparate visual stimuli affects neural processing of sound locations. Based on the population rate code hypothesis that assumes monotonic sensitivity to sound azimuth across populations of broadly tuned neurons, we expected a monotonic increase of blood oxygenation level-dependent (BOLD) signals for more contralateral sounds. Consistent with this hypothesis, we found that BOLD signals in the posterior superior temporal gyrus increased monotonically as a function of sound azimuth. We also observed attenuation of the monotonic azimuthal sensitivity by spatially disparate visual stimuli. The alteration of the neural pattern was considered to reflect the neural mechanism of the ventriloquism effect. Our findings indicate that conflicting audiovisual spatial information of an event is associated with an attenuation of neural processing of auditory spatial localization.

In this fMRI study we investigate neural processes related to the action observation network using a complex perceptual-motor task in pilots and non-pilots. The task involved landing a glider (using aileron, elevator, rudder, and dive brake) as close to a target as possible, passively observing a replay of one's own previous trial, passively observing a replay of an expert's trial, and a baseline do nothing condition. The objective of this study is to investigate two types of motor simulation processes used during observation of action: imitation based motor simulation and error-feedback based motor simulation. It has been proposed that the computational neurocircuitry of the cortex is well suited for unsupervised imitation based learning, whereas, the cerebellum is well suited for error-feedback based learning. Consistent with predictions, pilots (to a greater extent than non-pilots) showed significant differential activity when observing an expert landing the glider in brain regions involved with imitation based motor simulation (including premotor cortex PMC, inferior frontal gyrus IFG, anterior insula, parietal cortex, superior temporal gyrus, and middle temporal MT area) than when observing one's own previous trial which showed significant differential activity in the cerebellum (only for pilots) thought to be concerned with error-feedback based motor simulation. While there was some differential brain activity for pilots in regions involved with both Execution and Observation of the flying task (potential Mirror System sites including IFG, PMC, superior parietal lobule) the majority was adjacent to these areas (Observation Only Sites) (predominantly in PMC, IFG, and inferior parietal loblule). These regions showing greater activity for observation than for action may be involved with processes related to motor-based representational transforms that are not necessary when actually carrying out the task.

Inattentional deafness is the failure to hear otherwise audible sounds (usually alarms) that may occur under high workload conditions. One potential cause for its occurrence could be an attentional bottleneck that occurs when task demands are high, resulting in lack of resources for processing of additional tasks. In this fMRI experiment, we explore the brain regions active during the occurrence of inattentional deafness using a difficult perceptual‐motor task in which the participants fly through a simulated Red Bull air race course and at the same time push a button on the joystick to the presence of audio alarms. Participants were instructed to focus on the difficult piloting task and to press the button on the joystick quickly when they noticed an audio alarm. The fMRI results revealed that audio misses relative to hits had significantly greater activity in the right inferior frontal gyrus IFG and the superior medial frontal cortex. Consistent with an attentional bottleneck, activity in these regions was also present for poor flying performance (contrast of gates missed versus gates passed for the flying task). A psychophysiological interaction analysis from the IFG identified reduced effective connectivity to auditory processing regions in the right superior temporal gyrus for missed audio alarms relative to audio alarms that were heard. This study identifies a neural signature of inattentional deafness in an ecologically valid situation by directly measuring differences in brain activity and effective connectivity between audio alarms that were not heard compared to those that were heard. Hum Brain Mapp 38:5440–5455, 2017. © 2017 Wiley Periodicals, Inc.

Transcranial direct current stimulation (tDCS) has been shown to enhance cognitive performance on a variety of tasks. It is hypothesized that tDCS enhances performance by affecting task related cortical excitability changes in networks underlying or connected to the site of stimulation facilitating long term potentiation. However, many recent studies have called into question the reliability and efficacy of tDCS to induce modulatory changes in brain activity. In this study, our goal is to investigate the individual differences in tDCS induced modulatory effects on brain activity related to the degree of enhancement in performance, providing insight into this lack of reliability. In accomplishing this goal, we used functional magnetic resonance imaging (fMRI) concurrently with tDCS stimulation (1 mA, 30 minutes duration) using a visual search task simulating real world conditions. The experiment consisted of three fMRI sessions: pre-training (no performance feedback), training (performance feedback which included response accuracy and target location and either real tDCS or sham stimulation given), and post-training (no performance feedback). The right posterior parietal cortex was selected as the site of anodal tDCS based on its known role in visual search and spatial attention processing. Our results identified a region in the right precentral gyrus, known to be involved with visual spatial attention and orienting, that showed tDCS induced task related changes in cortical excitability that were associated with individual differences in improved performance. This same region showed greater activity during the training session for target feedback of incorrect (target-error feedback) over correct trials for the tDCS stim over sham group indicating greater attention to target features during training feedback when trials were incorrect. These results give important insight into the nature of neural excitability induced by tDCS as it relates to variability in individual differences in improved performance shedding some light the apparent lack of reliability found in tDCS research.

Neural correlates of driving and of decision making have been investigated separately, but little is known about the underlying neural mechanisms of decision making in driving. Previous research discusses two types of decision making: reward‐weighted decision making and cost‐weighted decision making. There are many reward‐weighted decision making neuroimaging studies but there are few cost‐weighted studies. Considering that driving involves serious risk, it is assumed that decision making in driving is cost weighted. Therefore, neural substrates of cost‐weighted decision making can be assessed by investigation of driver's decision making. In this study, neural correlates of resolving uncertainty in driver's decision making were investigated. Turning right in left‐hand traffic at a signalized intersection was simulated by computer graphic animation based videos. When the driver's view was occluded by a big truck, the uncertainty of the oncoming traffic was resolved by an in‐car video assist system that presented the driver's occluded view. Resolving the uncertainty reduced activity in a distributed area including the amygdala and anterior cingulate. These results implicate the amygdala and anterior cingulate as serving a role in cost‐weighted decision making. Hum Brain Mapp 2009. © 2008 Wiley‐Liss, Inc.

Recent evidence from neuroscience indicates that the anticipation of external rewards may enhance declarative memory consolidation by increasing dopaminergic-modulated plasticity in the hippo- campus. A number of studies in psychology, however, have shown that external rewards may have null, or even negative, effects on learning. To shed light on this issue, we developed a novel task, in which native Japanese speakers were rewarded to learn unknown English words inside a functional MRI scan- ner. Rewards had no effect on recall performance unless we used a rating of reward-induced anxiety as a covariate. In this case, for highly rewarded words, we found a negative correlation between recall per- formance and anxiety ratings. For those words, high recall performance and low anxiety ratings were associated with enhanced activity in the midbrain dopaminergic centers, the hippocampus, and the amyg- dala. On the other hand, low recall performance and high anxiety ratings were associated with enhanced activity in the anterior cingulate and middle frontal gyrus, brain regions that have been shown to be involved with anxiety and divided attention, respectively. A connectivity analysis indicated positive func- tional connectivity between the midbrain dopaminergic centers and both the hippocampus and the amyg- dala, as well as negative connectivity between the anterior cingulate and the amygdala. Thus, both our be- havioral and imaging results suggest that the anticipation of rewards can, depending on the individual level of reward-induced anxiety, have either a beneficial effect or a negative effect on word learning. Hum Brain Mapp 29:237-249, 2008. V C 2007 Wiley-Liss, Inc.

Neuronal operations associated with the top-down control process of shifting attention from one locus to another involve a network of cortical regions, and their influence is deemed fundamental to visual perception. However, the extent and nature of these operations within primary visual areas are unknown. In this paper, we used magnetoencephalography (MEG) in combination with magnetic resonance imaging (MRI) to determine whether, prior to the onset of a visual stimulus, neuronal activity within early visual cortex is affected by covert attentional shifts. Time/frequency analyses were used to identify the nature of this activity. Our results show that shifting attention towards an expected visual target results in a late-onset (600 ms postcue onset) depression of alpha activity which persists until the appearance of the target. Independent component analysis (ICA) and dipolar source modeling confirmed that the neuronal changes we observed originated from within the calcarine cortex. Our results further show that the amplitude changes in alpha activity were induced not evoked (i.e., not phase-locked to the cued attentional task). We argue that the decrease in alpha prior to the onset of the target may serve to prime the early visual cortex for incoming sensory information. We conclude that attentional shifts affect activity within the human calcarine cortex by altering the amplitude of spontaneous alpha rhythms and that subsequent modulation of visual input with attentional engagement follows as a consequence of these localized changes in oscillatory activity. © 2005 Elsevier B.V. All rights reserved.

Left fusiform gyrus and left angular gyrus are considered to be respectively involved with visual form processing and associating visual and auditory (phonological) information in reading. However, there are a number of studies that fail to show the contribution of these regions in carrying out these aspects of reading. Considerable differences in the type of stimuli and tasks used in the various studies may account for the discrepancy in results. This functional magnetic resonance imaging (fMRI) study attempts to control aspects of experimental stimuli and tasks to specifically investigate brain regions involved with visual form processing and character-to-phonological (i.e., simple grapheme-to-phonological) conversion processing for single letters. Subjects performed a two-back identification task using known Japanese, and previously unknown Korean, and Thai phonograms before and after training on one of the unknown language orthographies. Japanese subjects learned either five Korean or five Thai phonograms. Brain regions related to visual form processing were assessed by comparing activity related to native (Japanese) phonograms with that of non-native (Korean and Thai) phonograms. There was no significant differential brain activity for visual form processing. Brain regions related to character-to-phonological conversion processing were assessed by comparing pre- and post-tests of trained non-native phonograms with that of native phonograms and non-trained non-native phonograms. Significant differential activation post-relative to pre-training exclusively for the trained non-native phonograms was found in left angular gyrus. In addition, psychophysiologic interaction (PPI) analysis revealed greater integration of left angular gyrus with primary visual cortex as well as with superior temporal gyrus for the trained phonograms post-relative to pre-training. The results suggest that left angular gyrus is involved with character-to-phonological conversion in letter perception.

Perception of speech is improved when presentation of the audio signal is accompanied by concordant visual speech gesture information. This enhancement is most prevalent when the audio signal is degraded. One potential means by which the brain affords perceptual enhancement is thought to be through the integration of concordant information from multiple sensory channels in a common site of convergence, multisensory integration (MSI) sites. Some studies have identified potential sites in the superior temporal gyrus/sulcus (STG/S) that are responsive to multisensory information from the auditory speech signal and visual speech movement. One limitation of these studies is that they do not control for activity resulting from attentional modulation cued by such things as visual information signaling the onsets and offsets of the acoustic speech signal, as well as activity resulting from MSI of properties of the auditory speech signal with aspects of gross visual motion that are not specific to place of articulation information. This fMRI experiment uses spatial wavelet bandpass filtered Japanese sentences presented with background multispeaker audio noise to discern brain activity reflecting MSI induced by auditory and visual correspondence of place of articulation information that controls for activity resulting from the above-mentioned factors. The experiment consists of a low-frequency (LF) filtered condition containing gross visual motion of the lips, jaw, and head without specific place of articulation information, a midfrequency (MF) filtered condition containing place of articulation information, and an unfiltered (UF) condition. Sites of MSI selectively induced by auditory and visual correspondence of place of articulation information were determined by the presence of activity for both the MF and UF conditions relative to the LF condition. Based on these criteria, sites of MSI were found predominantly in the left middle temporal gyrus (MTG), and the left STG/S (including the auditory cortex). By controlling for additional factors that could also induce greater activity resulting from visual motion information, this study identifies potential MSI sites that we believe are involved with improved speech perception intelligibility.

This fMRI study explores brain regions involved with perceptual enhancement afforded by observation of visual speech gesture information. Subjects passively identified words presented in the following conditions: audio-only, audiovisual, audio-only with noise, audiovisual with noise, and visual only. The brain may use concordant audio and visual information to enhance perception by integrating the information in a converging multisensory site. Consistent with response properties of multisensory integration sites, enhanced activity in middle and superior temporal gyrus/sulcus was greatest when concordant audiovisual stimuli were presented with acoustic noise. Activity found in brain regions involved with planning and execution of speech production in response to visual speech presented with degraded or absent auditory stimulation, is consistent with the use of an additional pathway through which speech perception is facilitated by a process of internally simulating the intended speech act of the observed speaker.

The effects of attentional modulation on activity within the human visual cortex were investigated using magnetoencephalography. Chromatic sinusoidal stimuli were used to evoke activity from the occipital cortex, with attention directed either toward or away from the stimulus using a bar-orientation judgment task. For five observers, global magnetic field power was plotted as a function of time from stimulus onset. The major peak of each function occurred at about 120 ms latency and was well modeled by a current dipole near the calcarine sulcus. Independent component analysis (ICA) on the non-averaged data for each observer also revealed one component of calcarine origin, the location of which matched that of the dipolar source determined from the averaged data. For two observers, ICA revealed a second component near the parieto-occipital sulcus. Although no effects of attention were evident using standard averaging procedures, time-varying spectral analyses of single trials revealed that the main effect of attention was to alter the level of oscillatory activity. Most notably, a sustained increase in alpha-band (7-12 Hz) activity of both calcarine and parieto-occipital origin was evident. In addition, calcarine activity in the range of 13-21 Hz was enhanced, while calcarine activity in the range of 5-6 Hz was reduced. Our results are consistent with the hypothesis that attentional modulation affects neural processing within the calcarine and parieto-occipital cortex by altering the amplitude of alpha-band activity and other natural brain rhythms. © 2003 Elsevier Inc. All rights reserved.

fMRI was used to assess the relationship between brain activation and the degree of audiovisual integration of speech information during a phoneme categorization task. Twelve subjects heard a speaker say the syllable /aba/ paired either with video of the speaker saying the same consonant or a different one (/ava/). In order to manipulate the degree of audiovisual integration, the audio was either synchronous or +/- 400 ms out of phase with the visual stimulus. Subjects reported whether they heard the consonant /b/ or another consonant; fewer /b/ responses when the audio and visual stimuli were mismatched indicated higher levels of visual influence on speech perception (McGurk effect). Active brain regions during presentation of the incongruent stimuli included the superior temporal and inferior frontal gyrus, as well as extrastriate, premotor and posterior parietal cortex. A regression analysis related the strength of the McGurk effect to levels of brain activation. Paradoxically, higher numbers of /b/ responses were positively correlated with activation in the left occipito-temporal junction, an area often associated with processing visual motion. This activation suggests that auditory information modulates visual processing to affect perception.

In this single-sweep electroencephalographic case study, independent component analysis (ICA) was used to investigate multimodal processes underlying the enhancement of speech intelligibility in noise (for monosyllabic English words) by visualizing facial motion concordant with the audio speech signal. Wavelet analysis of the single-sweep IC activation waveforms revealed increased high-frequency energy for two ICs underlying the visual enhancement effect. For one IC, current source density analysis localized activity mainly to the superior temporal gyrus, consistent with principles of multimodal integration. For the other IC, activity was distributed across multiple cortical areas perhaps reflecting global mappings underlying the visual enhancement effect.

This single-sweep electroencephalographic study using independent component analysis was conducted to determine the neural processes underlying both speech perception and production of vowels. The same neural processes located in auditory and motor areas of the brain that significantly distinguish between a speech production and a control mental rehearsal task were found for both auditory evoked responses and speech planning responses. Thus identifying common task dependent neural processes underlying speech production and perception.

Methodologies have been developed, based on insights from signal detection theory, to evaluate quantitatively the diagnostic performance of tests. Several studies have demonstrated that, in fact, performance of a test battery can be inferior to the best of the tests it includes. These studies have been quite persuasive in damping enthusiasm for the test battery approach. Because the results of all tests in a battery were weighted equally in these studies, it is not surprising that an individual test with good sensitivity and specificity is more effective diagnostically than a combination of tests with poorer sensitivity and specificity. The authors of many of these studies were well aware of the limitations of this approach. In the present study, neural networks were applied to evaluate audiological tests used to predict retrocochlear pathology by differentially weighting the results of the tests in the battery. This technique avoids some of the limitations of previous approaches. Of the audiological tests evaluated in the present analysis, the superiority of the auditory brainstem evoked response (ABR) in predicting retrocochlear disease was again demonstrated. However, the results also demonstrated that identification accuracy could be improved by combining the ABR with other tests (in this case contralateral acoustic reflex at 2000 Hz, ipsilateral acoustic reflex at 2000 Hz, tone decay, and word recognition score). Further, it was demonstrated that performance could be improved over that obtained using dichotomous test measures (i.e., positive or negative presence of pathology) by using raw test measures in conjunction with ABR.

When we listen to sounds through headphones without utilizing special transforms, sound sources seem to be located inside our heads. The sound sources are said to be lateralized to one side or the other to varying degree. This internal lateralization is different than sound source localization in the natural environment in which the sound is localized distal to the head. We used fMRI to investigate difference in neural responses between lateralization and localization. Individualized binaural recordings were used as externalized auditory stimuli and stereo recordings were used as internalized auditory stimuli. Brain activity was measured while 14 participants performed an active auditory localization task and while 12 participants performed a stimulus type identification task. Irrespective of the task condition, we observed enhanced activity in the bilateral posterior temporal gyri (pSTG) for the externalized stimuli relative to the internalized stimuli. Region of interest analysis indicated that both left and right pSTG were more sensitive to sound sources in contra- than ipsilateral hemifields. Moreover, greater back than front activity was also found in the left pSTG. Compared to impoverished spatial auditory stimuli, realistic spatial auditory stimuli enhance neural responses in the pSTG. This may be why we could observe contralateral hemifield preference in bilateral pSTG that many previous studies have failed to observe. Overall, the results indicate the importance of using ecologically valid stimuli for investigating neural processes in human cortex.

Spaced presentations of to‐be‐learned items during encoding leads to superior long‐term retention over massed presentations. Despite over a century of research, the psychological and neural basis of this spacing effect however is still under investigation. To test the hypotheses that the spacing effect results either from reduction in encoding‐related verbal maintenance rehearsal in massed relative to spaced presentations (deficient processing hypothesis) or from greater encoding‐related elaborative rehearsal of relational information in spaced relative to massed presentations (encoding variability hypothesis), we designed a vocabulary learning experiment in which subjects encoded paired‐associates, each composed of a known word paired with a novel word, in both spaced and massed conditions during functional magnetic resonance imaging. As expected, recall performance in delayed cued‐recall tests was significantly better for spaced over massed conditions. Analysis of brain activity during encoding revealed that the left frontal operculum, known to be involved in encoding via verbal maintenance rehearsal, was associated with greater performance‐related increased activity in the spaced relative to massed condition. Consistent with the deficient processing hypothesis, a significant decrease in activity with subsequent episodes of presentation was found in the frontal operculum for the massed but not the spaced condition. Our results suggest that the spacing effect is mediated by activity in the frontal operculum, presumably by encoding‐related increased verbal maintenance rehearsal, which facilitates binding of phonological and word level verbal information for transfer into long‐term memory. Hum Brain Mapp, 2010. © 2009 Wiley‐Liss, Inc.

Viewing hand gestures during face-to-face communication affects speech perception and comprehension. Despite the visible role played by gesture in social interactions, relatively little is known about how the brain integrates hand gestures with co-occurring speech. Here we used functional magnetic resonance imaging (fMRI) and an ecologically valid paradigm to investigate how beat gesture – a fundamental type of hand gesture that marks speech prosody – might impact speech perception at the neural level. Subjects underwent fMRI while listening to spontaneously-produced speech accompanied by beat gesture, nonsense hand movement, or a still body; as additional control conditions, subjects also viewed beat gesture, nonsense hand movement, or a still body all presented without speech. Validating behavioral evidence that gesture affects speech perception, bilateral nonprimary auditory cortex showed greater activity when speech was accompanied by beat gesture than when speech was presented alone. Further, the left superior temporal gyrus/sulcus showed stronger activity when speech was accompanied by beat gesture than when speech was accompanied by nonsense hand movement. Finally, the right planum temporale was identified as a putative multisensory integration site for beat gesture and speech (i.e., here activity in response to speech accompanied by beat gesture was greater than the summed responses to speech alone and beat gesture alone), indicating that this area may be pivotally involved in synthesizing the rhythmic aspects of both speech and gesture. Taken together, these findings suggest a common neural substrate for processing speech and gesture, likely reflecting their joint communicative role in social interactions.

Neural processes underlying identification of durational contrasts were studied by comparing English and Japanese speakers for Japanese short/long vowel identification relative to consonant identification. Enhanced activities for non-native contrast (Japanese short/long vowel identification by English speakers) were observed in brain regions involved with articulatory-auditory mapping (Broca's area, superior temporal gyrus, planum temporale, and cerebellum), but not in the supramarginal gyrus. Greater activity in the supramarginal gyrus found for the consonant identification over short/long vowel identification by Japanese speakers implies that it is more important for phonetic contrasts differing in place of articulation than for vowel duration. These results support the hypothesis that neural processes used to facilitate perception depend on the relative contribution of information important for articulatory planning control.

This 3-T fMRI study investigates brain regions similarly and differentially involved with listening and covert production of singing relative to speech. Given the greater use of auditory–motor self-monitoring and imagery with respect to consonance in singing, brain regions involved with these processes are predicted to be differentially active for singing more than for speech. The stimuli consisted of six Japanese songs. A block design was employed in which the tasks for the subject were to listen passively to singing of the song lyrics, passively listen to speaking of the song lyrics, covertly sing the song lyrics visually presented, covertly speak the song lyrics visually presented, and to rest. The conjunction of passive listening and covert production tasks used in this study allow for general neural processes underlying both perception and production to be discerned that are not exclusively a result of stimulus induced auditory processing nor to low level articulatory motor control. Brain regions involved with both perception and production for singing as well as speech were found to include the left planum temporale/superior temporal parietal region, as well as left and right premotor cortex, lateral aspect of the VI lobule of posterior cerebellum, anterior superior temporal gyrus, and planum polare. Greater activity for the singing over the speech condition for both the listening and covert production tasks was found in the right planum temporale. Greater activity in brain regions involved with consonance, orbitofrontal cortex (listening task), subcallosal cingulate (covert production task) were also present for singing over speech. The results are consistent with the PT mediating representational transformation across auditory and motor domains in response to consonance for singing over that of speech. Hemispheric laterality was assessed by paired t tests between active voxels in the contrast of interest relative to the left–right flipped contrast of interest calculated from images normalized to the left–right reflected template. Consistent with some hypotheses regarding hemispheric specialization, a pattern of differential laterality for speech over singing (both covert production and listening tasks) occurs in the left temporal lobe, whereas, singing over speech (listening task only) occurs in right temporal lobe.

This experiment investigates neural processes underlying perceptual identification of the same phonemes for native- and second-language speakers. A model is proposed implicating the use of articulatory-auditory and articulatory-orosensory mappings to facilitate perceptual identification under conditions in which the phonetic contrast is ambiguous, as in the case of second-language speakers. In contrast, native-language speakers are predicted to use auditory-based phonetic representations to a greater extent for perceptual identification than second-language speakers. The English /r-l/ phonetic contrast, although easy for native English speakers, is extremely difficult for native Japanese speakers who learned English as a second language after childhood. Twenty-two native English and twenty-two native Japanese speakers participated in this study. While undergoing event-related fMRI, subjects were aurally presented with syllables starting with a /r/, /l/, or a vowel and were required to rapidly identify the phoneme perceived by pushing one of three buttons with the left thumb. Consistent with the proposed model, the results show greater activity for second- over native-language speakers during perceptual identification of /r/ and /l/ relative to vowels in brain regions implicated with instantiating forward and inverse articulatory-auditory articulatory-orosensory models [Broca's area, anterior insula, anterior superior temporal sulcus/gyrus (STS/G), planum temporale (PT), superior temporal parietal area (Stp), SMG, and cerebellum]. The results further show that activity in brain regions implicated with instantiating these internal models is correlated with better /r/ and /l/ identification performance for second-language speakers. Greater activity found for native-language speakers especially in the anterior STG/S for /r/ and /l/ perceptual identification is consistent with the hypothesis that native-language speakers use auditory phonetic representations more extensively than second-language speakers.

Chronic pain is one of the most prevalent health problems in the world today, yet neurological markers, critical to diagnosis of chronic pain, are still largely unknown. The ability to objectively identify individuals with chronic pain using functional magnetic resonance imaging (fMRI) data is important for the advancement of diagnosis, treatment, and theoretical knowledge of brain processes associated with chronic pain. The purpose of our research is to investigate specific neurological markers that could be used to diagnose individuals experiencing chronic pain by using multivariate pattern analysis with fMRI data. We hypothesize that individuals with chronic pain have different patterns of brain activity in response to induced pain. This pattern can be used to classify the presence or absence of chronic pain. The fMRI experiment consisted of alternating 14 seconds of painful electric stimulation (applied to the lower back) with 14 seconds of rest. We analyzed contrast fMRI images in stimulation versus rest in pain-related brain regions to distinguish between the groups of participants: 1) chronic pain and 2) normal controls. We employed supervised machine learning techniques, specifically sparse logistic regression, to train a classifier based on these contrast images using a leave-one-out cross-validation procedure. We correctly classified 92.3% of the chronic pain group (N = 13) and 92.3% of the normal control group (N = 13) by recognizing multivariate patterns of activity in the somatosensory and inferior parietal cortex. This technique demonstrates that differences in the pattern of brain activity to induced pain can be used as a neurological marker to distinguish between individuals with and without chronic pain. Medical, legal and business professionals have recognized the importance of this research topic and of developing objective measures of chronic pain. This method of data analysis was very successful in correctly classifying each of the two groups.

The goal of this research was to train a self-organizing map (SOM) on various acoustic measures (amplitude perturbation quotient, degree of voice breaks, rahmonic amplitude, soft phonation index, standard deviation of the fundamental frequency, and peak amplitude variation) of the sustained vowel /a/ to enhance visualization of the multidimensional nonlinear regularities inherent in the input data space. The SOM was trained using 30 spasmodic dysphonia exemplars, 30 pretreatment functional dysphonia exemplars, 30 post-treatment functional dysphonia exemplars, and 30 normal voice exemplars. After training, the classification performance of the SOM was evaluated. The results indicated that the SOM had better classification performance than that of a stepwise discriminant analysis over the original data. Analysis of the weight values across the SOM, by means of stepwise discriminant analysis, revealed the relative importance of the acoustic measures in classification of the various groups. The SOM provided both an easy way to visualize multidimensional data, and enhanced statistical predictability at distinguishing between the various groups (over that conducted on the original data set). We regard the results of this study as a promising initial step into the use of SOMs with multiple acoustic measures to assess phonatory function.