Search

Face-to-face communication challenges the human brain to integrate information from auditory and visual senses with linguistic representations. Yet the role of bottom-up physical (spectrotemporal structure) input and top-down linguistic constraints in shaping the neural mechanisms specialized for integrating audiovisual speech signals are currently unknown. Participants were presented with speech and sinewave speech analogs in visual, auditory, and audiovisual modalities. Before the fMRI study, they were trained to perceive physically identical sinewave speech analogs as speech (SWS-S) or nonspeech (SWS-N). Comparing audiovisual integration (interactions) of speech, SWS-S, and SWS-N revealed a posterior-anterior processing gradient within the left superior temporal sulcus/gyrus (STS/STG): Bilateral posterior STS/STG integrated audiovisual inputs regardless of spectrotemporal structure or speech percept; in left mid-STS, the integration profile was primarily determined by the spectrotemporal structure of the signals; more anterior STS regions discarded spectrotemporal structure and integrated audiovisual signals constrained by stimulus intelligibility and the availability of linguistic representations. In addition to this "ventral" processing stream, a "dorsal" circuitry encompassing posterior STS/STG and left inferior frontal gyrus differentially integrated audiovisual speech and SWS signals. Indeed, dynamic causal modeling and Bayesian model comparison provided strong evidence for a parallel processing structure encompassing a ventral and a dorsal stream with speech intelligibility training enhancing the connectivity between posterior and anterior STS/STG. In conclusion, audiovisual speech comprehension emerges in an interactive process with the integration of auditory and visual signals being progressively constrained by stimulus intelligibility along the STS and spectrotemporal structure in a dorsal fronto-temporal circuitry. [ABSTRACT FROM AUTHOR]

A surprising discovery in recent years is that the structure of the adult human brain changes when a new cognitive or motor skill is learned. This effect is seen as a change in local gray or white matter density that correlates with behavioral measures. Critically, however, the cognitive and anatomical mechanisms underlying these learning-related structural brain changes remain unknown. Here, we combined brain imaging, detailed behavioral analyses, and white matter tractography in English-speaking monolingual adolescents to show that a critical linguistic prerequisite (namely, knowledge of vocabulary) is proportionately related to relative gray matter density in bilateral posterior supramarginal gyri. The effect was specific to the number of words learned, regardless of verbal fluency or other cognitive abilities. The identified region was found to have direct connections to other inferior parietal areas that separately process either the sounds of words or their meanings, suggesting that the posterior supramarginal gyrus plays a role in linking the basic components of vocabulary knowledge. Together, these analyses highlight the cognitive and anatomical mechanisms that mediate an essential language skill. [ABSTRACT FROM AUTHOR]