Search

ObjectiveLipreading, which plays a major role in the communication of the hearing impaired, lacked a French standardised tool. Our aim was to create and validate an audio-visual (AV) version of the French Matrix Sentence Test (FrMST).DesignVideo recordings were created by dubbing the existing audio files.SampleThirty-five young, normal-hearing participants were tested in auditory and visual modalities alone (Ao, Vo) and in AV conditions, in quiet, noise, open and closed-set response formats.ResultsLipreading ability (Vo) varied from 1% to 77%-word comprehension. The absolute AV benefit was 9.25□dB SPL in quiet and 4.6□dB SNR in noise. The response format did not influence the results in the AV noise condition, except during the training phase. Lipreading ability and AV benefit were significantly correlated.ConclusionsThe French video material achieved similar AV benefits as those described in the literature for AV MST in other languages. For clinical purposes, we suggest targeting SRT80 to avoid ceiling effects, and performing two training lists in the AV condition in noise, followed by one AV list in noise, one Ao list in noise and one Vo list, in a randomised order, in open or close set-format.

International audience; Cultural artefacts, such as dance and music, are characterized by temporal properties, broadly referred to as rhythms. The temporal structures that emerge when individuals synchronize their movements provide a sense of togetherness and common fate, even if individuals can readily tune in and out of this shared temporal space. In this chapter, we concisely discuss the endogenous and exogenous factors contributing to the emergence of brain rhythms and rhythmic behaviors, and how their interplay contributes to sophisticated forms of expressions in humans. The capacity for coupling and uncoupling voluntarily from external rhythms creates a potential tension between our environment (exogenously driven) and our internal state (endogenously driven) that can be exploited for artistic benefit, in the form of surprisal.

Age-related hearing loss, presbycusis, is an unavoidable sensory degradation, often associated with the progressive decline of cognitive and social functions, and dementia. It is generally considered a natural consequence of the inner-ear deterioration. However, presbycusis arguably conflates a wide array of peripheral and central impairments. Although hearing rehabilitation maintains the integrity and activity of auditory networks and can prevent or revert maladaptive plasticity, the extent of such neural plastic changes in the aging brain is poorly appreciated. By reanalyzing a large-scale dataset of more than 2200 cochlear implant users (CI) and assessing the improvement in speech perception from 6 to 24 months of use, we show that, although rehabilitation improves speech understanding on average, age at implantation only minimally affects speech scores at 6 months but has a pejorative effect at 24 months post implantation. Furthermore, older subjects (>67 years old) were significantly more likely to degrade their performances after 2 years of CI use than the younger patients for each year increase in age. Secondary analysis reveals three possible plasticity trajectories after auditory rehabilitation to account for these disparities: Awakening, reversal of deafness-specific changes; Counteracting, stabilization of additional cognitive impairments; or Decline, independent pejorative processes that hearing rehabilitation cannot prevent. The role of complementary behavioral interventions needs to be considered to potentiate the (re)activation of auditory brain networks.

International audience; Categorising voices is crucial for auditory-based social interactions. A recent study by Rupp and colleagues in PLOS Biology capitalises on human intracranial recordings to describe the spatiotemporal pattern of neural activity leading to voice-selective responses in associative auditory cortex.

SummaryReconstructing intended speech from neural activity using brain-computer interfaces (BCIs) holds great promises for people with severe speech production deficits. While decoding overt speech has progressed, decoding imagined speech have met limited success, mainly because the associated neural signals are weak and variable hence difficult to decode by learning algorithms. Using three electrocorticography datasets totalizing 1444 electrodes from 13 patients who performed overt and imagined speech production tasks, and based on recent theories of speech neural processing, we extracted consistent and specific neural features usable for future BCIs, and assessed their performance to discriminate speech items in articulatory, phonetic, vocalic, and semantic representation spaces. While high-frequency activity provided the best signal for overt speech, both low- and higher-frequency power and local cross-frequency contributed to successful imagined speech decoding, in particular in phonetic and vocalic, i.e. perceptual, spaces. These findings demonstrate that low-frequency power and cross-frequency dynamics contain key information for imagined speech decoding, and that exploring perceptual spaces offers a promising avenue for future imagined speech BCIs.

One way music is thought to convey emotion is by mimicking acoustic features of affective human vocalizations [Juslin and Laukka (2003). Psychol. Bull. 129(5), 770–814]. Regarding fear, it has been informally noted that music for scary scenes in films frequently exhibits a “scream-like” character. Here, this proposition is formally tested. This paper reports acoustic analyses for four categories of audio stimuli: screams, non-screaming vocalizations, scream-like music, and non-scream-like music. Valence and arousal ratings were also collected. Results support the hypothesis that a key feature of human screams (roughness) is imitated by scream-like music and could potentially signal danger through both music and the voice.

In uncertain environments, accurate decision-making requires integrating ambiguous or conflicting signals – a cognitive inference process thought to require n-methyl-d-aspartate (NMDA) synaptic receptors. Here we characterized the causal impact of human NMDA receptor hypofunction on cognitive inference using placebo-controlled infusions of ketamine in a visual cue combination task. Participants tested under ketamine showed elevated uncertainty, together with impaired cognitive inference despite intact visual processing. This behavioral effect of ketamine was associated in patterns of electrical brain activity with degraded and unbalanced coding of presented cues in associative cortex, followed by premature response preparation in motor cortex. Through quantitative simulations, we propose that these cognitive alterations reflect an urge to explain away the elevated uncertainty triggered by ketamine. This compensatory mechanism may cause the emergence of psychotic symptoms observed under chronic NMDA receptor dysfunction, but also forge unusually strong beliefs when confronted with uncertainty in everyday life.

The phonological deficit in dyslexia is associated with altered low-gamma oscillatory function in left auditory cortex, but a causal relationship between oscillatory function and phonemic processing has never been established. After confirming a deficit at 30 Hz with electroencephalography (EEG), we applied 20 minutes of transcranial alternating current stimulation (tACS) to transiently restore this activity in adults with dyslexia. The intervention significantly improved phonological processing and reading accuracy as measured immediately after tACS. The effect occurred selectively for a 30-Hz stimulation in the dyslexia group. Importantly, we observed that the focal intervention over the left auditory cortex also decreased 30-Hz activity in the right superior temporal cortex, resulting in reinstating a left dominance for the oscillatory response. These findings establish a causal role of neural oscillations in phonological processing and offer solid neurophysiological grounds for a potential correction of low-gamma anomalies and for alleviating the phonological deficit in dyslexia., The phonological deficit in dyslexia is associated with altered low-gamma oscillatory function in left auditory cortex; this study shows that enhancing low-gamma neural oscillations by applying 30-Hz transcranial electrical stimulation to the left auditory cortex improves phonemic processing and reading accuracy in dyslexia.

Neuroprosthetic speech devices are an emerging technology that can offer the possibility of communication to those who are unable to speak. Patients with ‘locked in syndrome,’ aphasia, or other such pathologies can use covert speech—vividly imagining saying something without actual vocalization—to trigger neural controlled systems capable of synthesizing the speech they would have spoken, but for their impairment.We provide an analysis of the mechanisms and outputs involved in speech mediated by neuroprosthetic devices. This analysis provides a framework for accounting for the ethical significance of accuracy, control, and pragmatic dimensions of prosthesis-mediated speech. We first examine what it means for the output of the device to be accurate, drawing a distinction between technical accuracy on the one hand and semantic accuracy on the other. These are conceptual notions of accuracy.Both technical and semantic accuracy of the device will be necessary (but not yet sufficient) for the user to have sufficient control over the device. Sufficient control is an ethical consideration: we place high value on being able to express ourselves when we want and how we want. Sufficient control of a neural speech prosthesis requires that a speaker can reliably use their speech apparatus as they want to, and can expect their speech to authentically represent them. We draw a distinction between two relevant features which bear on the question of whether the user has sufficient control: voluntariness of the speech and the authenticity of the speech. These can come apart: the user might involuntarily produce an authentic output (perhaps revealing private thoughts) or might voluntarily produce an inauthentic output (e.g., when the output is not semantically accurate). Finally, we consider the role of the interlocutor in interpreting the content and purpose of the communication.These three ethical dimensions raise philosophical questions about the nature of speech, the level of control required for communicative accuracy, and the nature of ‘accuracy’ with respect to both natural and prosthesis-mediated speech.

International audience; In the motor cortex, beta oscillations (∼12-30 Hz) are generally considered a principal rhythm contributing to movement planning and execution. Beta oscillations cohabit and dynamically interact with slow delta oscillations (0.5-4 Hz), but the role of delta oscillations and the subordinate relationship between these rhythms in the perception-action loop remains unclear. Here, we review evidence that motor delta oscillations shape the dynamics of motor behaviors and sensorimotor processes, in particular during auditory perception. We describe the functional coupling between delta and beta oscillations in the motor cortex during spontaneous and planned motor acts. In an active sensing framework, perception is strongly shaped by motor activity, in particular in the delta band, which imposes temporal constraints on the sampling of sensory information. By encoding temporal contextual information, delta oscillations modulate auditory processing and impact behavioral outcomes. Finally, we consider the contribution of motor delta oscillations in the perceptual analysis of speech signals, providing a contextual temporal frame to optimize the parsing and processing of slow linguistic information.

Crying is the principal means by which newborn infants shape parental behavior to meet their needs. While this mechanism can be highly effective, infant crying can also be an aversive stimulus that leads to parental frustration and even abuse. Fathers have recently become more involved in direct caregiving activities in modern, developed nations, and fathers are more likely than mothers to physically abuse infants. In this study, we attempt to explain variation in the neural response to infant crying among human fathers, with the hope of identifying factors that are associated with a more or less sensitive response. We imaged brain function in 39 first-time fathers of newborn infants as they listened to both their own and a standardized unknown infant cry stimulus, as well as auditory control stimuli, and evaluated whether these neural responses were correlated with measured characteristics of fathers and infants that were hypothesized to modulate these responses. Fathers also provided subjective ratings of each cry stimulus on multiple dimensions. Fathers showed widespread activation to both own and unknown infant cries in neural systems involved in empathy and approach motivation. There was no significant difference in the neural response to the own vs. unknown infant cry, and many fathers were unable to distinguish between the two cries. Comparison of these results with previous studies in mothers revealed a high degree of similarity between first-time fathers and first-time mothers in the pattern of neural activation to newborn infant cries. Further comparisons suggested that younger infant age was associated with stronger paternal neural responses, perhaps due to hormonal or novelty effects. In our sample, older fathers found infant cries less aversive and had an attenuated response to infant crying in both the dorsal anterior cingulate cortex (dACC) and the anterior insula, suggesting that compared with younger fathers, older fathers may be better able to avoid the distress associated with empathic over-arousal in response to infant cries. A principal components analysis revealed that fathers with more negative emotional reactions to the unknown infant cry showed decreased activation in the thalamus and caudate nucleus, regions expected to promote positive parental behaviors, as well as increased activation in the hypothalamus and dorsal ACC, again suggesting that empathic over-arousal might result in negative emotional reactions to infant crying. In sum, our findings suggest that infant age, paternal age and paternal emotional reactions to infant crying all modulate the neural response of fathers to infant crying. By identifying neural correlates of variation in paternal subjective reactions to infant crying, these findings help lay the groundwork for evaluating the effectiveness of interventions designed to increase paternal sensitivity and compassion.

Predictive coding and neural oscillations are two descriptive levels of brain functioning whose overlap is not yet understood. Chao et al. (2018) now show that hierarchical predictive coding is instantiated by asymmetric information channeling in the γ and α/β oscillatory ranges.

The ability to precisely anticipate the timing of upcoming events at the time-scale of seconds is essential to predict objects' trajectories or to select relevant sensory information. What neurophysiological mechanism underlies the temporal precision in anticipating the occurrence of events? In a recent article,1 we demonstrated that the sensori-motor system predictively controls neural oscillations in time to optimize sensory selection. However, whether and how the same oscillatory processes can be used to keep track of elapsing time and evaluate short durations remains unclear. Here, we aim at testing the hypothesis that the brain tracks durations by converting (external, objective) elapsing time into an (internal, subjective) oscillatory phase-angle. To test this, we measured magnetoencephalographic oscillatory activity while participants performed a delayed-target detection task. In the delayed condition, we observe that trials that are perceived as longer are associated with faster delta-band oscillations. This suggests that the subjective indexing of time is reflected in the range of phase-angles covered by delta oscillations during the pre-stimulus period. This result provides new insights into how we predict and evaluate temporal structure and support models in which the active entrainment of sensori-motor oscillatory dynamics is exploited to track elapsing time.

SummaryScreaming is arguably one of the most relevant communication signals for survival in humans. Despite their practical relevance and their theoretical significance as innate [1] and virtually universal [2, 3] vocalizations, what makes screams a unique signal and how they are processed is not known. Here, we use acoustic analyses, psychophysical experiments, and neuroimaging to isolate those features that confer to screams their alarming nature, and we track their processing in the human brain. Using the modulation power spectrum (MPS [4, 5]), a recently developed, neurally informed characterization of sounds, we demonstrate that human screams cluster within restricted portion of the acoustic space (between ∼30 and 150 Hz modulation rates) that corresponds to a well-known perceptual attribute, roughness. In contrast to the received view that roughness is irrelevant for communication [6], our data reveal that the acoustic space occupied by the rough vocal regime is segregated from other signals, including speech, a pre-requisite to avoid false alarms in normal vocal communication. We show that roughness is present in natural alarm signals as well as in artificial alarms and that the presence of roughness in sounds boosts their detection in various tasks. Using fMRI, we show that acoustic roughness engages subcortical structures critical to rapidly appraise danger. Altogether, these data demonstrate that screams occupy a privileged acoustic niche that, being separated from other communication signals, ensures their biological and ultimately social efficiency.

Recent psychophysics data suggest that speech perception is not limited by the capacity of the auditory system to encode fast acoustic variations through neural γ activity, but rather by the time given to the brain to decode them. Whether the decoding process is bounded by the capacity of θ rhythm to follow syllabic rhythms in speech, or constrained by a more endogenous top-down mechanism, e.g., involving β activity, is unknown. We addressed the dynamics of auditory decoding in speech comprehension by challenging syllable tracking and speech decoding using comprehensible and incomprehensible time-compressed auditory sentences. We recorded EEGs in human participants and found that neural activity in both θ and γ ranges was sensitive to syllabic rate. Phase patterns of slow neural activity consistently followed the syllabic rate (4–14 Hz), even when this rate went beyond the classical θ range (4–8 Hz). The power of θ activity increased linearly with syllabic rate but showed no sensitivity to comprehension. Conversely, the power of β (14–21 Hz) activity was insensitive to the syllabic rate, yet reflected comprehension on a single-trial basis. We found different long-range dynamics for θ and β activity, with β activity building up in time while more contextual information becomes available. This is consistent with the roles of θ and β activity in stimulus-driven versus endogenous mechanisms. These data show that speech comprehension is constrained by concurrent stimulus-driven θ and low-γ activity, and by endogenous β activity, but not primarily by the capacity of θ activity to track the syllabic rhythm. SIGNIFICANCE STATEMENT Speech comprehension partly depends on the ability of the auditory cortex to track syllable boundaries with θ-range neural oscillations. The reason comprehension drops when speech is accelerated could hence be because θ oscillations can no longer follow the syllabic rate. Here, we presented subjects with comprehensible and incomprehensible accelerated speech, and show that neural phase patterns in the θ band consistently reflect the syllabic rate, even when speech becomes too fast to be intelligible. The drop in comprehension, however, is signaled by a significant decrease in the power of low-β oscillations (14–21 Hz). These data suggest that speech comprehension is not limited by the capacity of θ oscillations to adapt to syllabic rate, but by an endogenous decoding process.

The ability to generate temporal predictions is fundamental for adap-tive behavior. Precise timing at the time-scale of seconds is critical,for instance to predict trajectories or to select relevant information.What mechanisms form the basis for such accurate timing? Recentevidence suggests that (1) temporal predictions adjust sensoryselection by controlling neural oscillations in time and (2) the motorsystem plays an active role in inferring “when” events will happen.We hypothesized that oscillations in the delta and beta bands areinstrumental in predicting the occurrence of auditory targets. Partici-pants listened to brief rhythmic tone sequences and detected targetdelays while undergoing magnetoencephalography recording. Priorto target occurrence, we found that coupled delta (1–3 Hz) and beta(18–22 Hz) oscillations temporally align with upcoming targets andbias decisions towards correct responses, suggesting that delta–beta coupled oscillations underpin prediction accuracy. Subsequentto target occurrence, subjects update their decisions using the mag-nitude of the alpha-band (10–14 Hz) response as internal evidence oftarget timing. These data support a model in which the orchestrationof oscillatory dynamics between sensory and motor systems isexploited to accuratelyselect sensory information in time.Keywords: auditory, motor, neuronal oscillations, sensorimotor, timingIntroductionAccurately predicting when future events will occur facilitatessensory processing, speeds up behavior, and optimizes theallocation of attentional resources in time (Correa et al. 2005;Nobre et al. 2012). Predictive timing, by analogy to the notionof predictive coding (Knill and Richards 1996; Friston 2005)inthe time domain, requires the construction of an internalmodel of observed temporal regularities to infer precisely theoccurrence of future events. Because these regularities canhappen at different time-scales (seconds, hours, days…), dis-tinct neural systems and computations may be used to generatetemporally adaptive predictions (Ivry and Schlerf 2008; Moril-lon et al. 2009). The seconds time-scale, in particular, is highlyrelevant for online human behavior, as a large number of phe-nomena pertaining to perception and action (i.e., speech,movement etc.) occur at this scale. Here we investigate howthe brain extracts temporal regularities that emerge from theperception of isochronous beats at thistime-scale.The inclination to automaticallysynchronizeour movementsto external rhythms suggests that temporal regularities are par-ticularly relevant to the motor system (Schubotz et al. 2000;Grahn and Brett 2007; Bengtsson et al. 2009; Teki et al. 2011).This system is arguably at the origin of the contingent negativevariation (CNV), an anticipatory electrophysiological compo-nent that precedes relevant sensory or motor events (Walteret al. 1964; Pfeutyet al. 2003; Praamstra et al. 2006; Cravo et al.2011) and facilitates performance when task timing is predict-able (Hillyard 1973; Niemi and Naatanan 1981; Stefanics et al.2010). It is also involved in duration perception, in particularfor durations shorter than 2 s (Ivry and Schlerf 2008; Morillonet al. 2009). Recent considerations have suggested that themotor system internally simulates movement synchronizedwith future events to anticipate their occurrence and facilitatetheir processing (Schubotz 2007; Tian and Poeppel 2010;Arnal 2012; Arnal and Giraud 2012). According to this idea,corollary discharges that are contingent on movement simula-tion propagate to sensory areas to align ongoing activity withpredicted events. Here, we hypothesized that temporal predic-tions are instantiated through sensorimotor oscillatory interac-tions. Such a mechanism would arguably permit the extractionof temporal regularities in order to infer when an event shouldoccur.Cortical oscillations are usually seen as a means towardsflexibly communicating between distant neuronal populations(Engel et al. 2001; Fries 2005). Recent findings also suggestthat oscillations, which reflect fluctuations of neuronal excit-ability, can be temporally adjusted to optimize sensory selec-tion (Schroeder and Lakatos 2009). Accordingly, expectationsalign the phase of delta oscillations in time, which in turnaccelerates response timing (Lakatos et al. 2008; Stefanics et al.2010). Furthermore, ongoing delta phase modulates theweighting of sensory events in the decision-making processduring sequential information processing (Wyart et al. 2012;Cravo et al. 2013). Beta oscillations arguably play a comple-mentary function during temporal expectations and the accu-mulation of sensory evidence (Donner et al. 2009; Saleh et al.2011; Fujioka et al. 2012; de Lange et al. 2013).In sum, sensory selection (stimulus detection or sensoryweighting) can be passively or actively (through prediction)regulated through modulation of the prestimulus oscillatorystate. However, whether they govern subjects’ accuracy remainsunclear. That is, whether oscillations play an instrumental rolein determining whether an event occurs at the expected timehasnotbeenelucidated.This study aimed at determining the neurophysiologicalmechanisms underpinning (1) the generation of a temporalprediction and (2) the subsequent evaluation of this predic-tion. We used a delayed-target detection task in which subjectswererequiredtodetectwhetherthelasttoneofanisochronoussequence was delayed with regard to the beat (Fig. 1A). Ouranalysis design (Fig. 1B) allows us to distinguish how 2 crucialstages of the processing chain are implemented: (1) the pre-dictive stage, which reflects the neural activity patterns used topredict “when” and (2) the decisional stage, in which subjects’decisions (i.e., subjective reports) are made (see Materials andmethods and Fig. 1C).

Speech is a complex acoustic signal showing a quasiperiodic structure at several timescales. Integrated neural signals recorded in the cortex also show periodicity at different timescales. In this chapter we outline the neural mechanisms that potentially allow the auditory cortex to segment and encode continuous speech. This chapter focuses on how the human auditory cortex uses the temporal structure of the acoustic signal to extract phonemes and syllables, the two major constituents of connected speech. We argue that the quasiperiodic structure of collective neural activity in auditory cortex represents the ideal mechanical infrastructure to fractionate continuous speech into linguistic constituents of variable sizes.

A growing body of research suggests that intrinsic neuronal slow (< 10 Hz) oscillations in auditory cortex appear to track incoming speech and other spectro-temporally complex auditory signals. Within this framework, several recent studies have identified critical-band temporal envelopes as the specific acoustic feature being reflected by the phase of these oscillations. However, how this alignment between speech acoustics and neural oscillations might underpin intelligibility is unclear. Here we test the hypothesis that the ‘sharpness’ of temporal fluctuations in the critical band envelope acts as a temporal cue to speech syllabic rate, driving delta-theta rhythms to track the stimulus and facilitate intelligibility. We interpret our findings as evidence that sharp events in the stimulus cause cortical rhythms to re-align and parse the stimulus into syllable-sized chunks for further decoding. Using magnetoencephalographic recordings, we show that by removing temporal fluctuations that occur at the syllabic rate, envelope-tracking activity is reduced. By artificially reinstating these temporal fluctuations, envelope-tracking activity is regained. These changes in tracking correlate with intelligibility of the stimulus. Together, the results suggest that the sharpness of fluctuations in the stimulus, as reflected in the cochlear output, drive oscillatory activity to track and entrain to the stimulus, at its syllabic rate. This process likely facilitates parsing of the stimulus into meaningful chunks appropriate for subsequent decoding, enhancing perception and intelligibility.

International audience; Low-gamma (25-45 Hz) and theta (4-8 Hz) oscillations are proposed to underpin the integration of phonemic and syllabic information, respectively. How these two scales of analysis split functions across hemispheres is unclear. We analyzed cortical responses from an epileptic patient with a rare bilateral electrode implantation (stereotactic EEG) in primary (A1/BA41 and A2/BA42) and association auditory cortices (BA22). Using time-frequency analyses, we confirmed the dominance of a 5-6 Hz theta activity in right and of a low-gamma (25-45 Hz) activity in left primary auditory cortices (A1/A2), during both resting state and syllable processing. We further detected high-theta (7-8 Hz) resting activity in left primary, but also associative auditory regions. In left BA22, its phase correlated with high-gamma induced power. Such a hierarchical relationship across theta and gamma frequency bands (theta/gamma phase-amplitude coupling) could index the process by which the neural code shifts from stimulus feature-to phonological-encoding, and is associated with the transition from evoked to induced power responses.These data suggest that theta and gamma activity in right and left auditory cortices bear different functions. They support a scheme where slow parsing of the acoustic information dominates in right hemisphere at a syllabic (5-6 Hz) rate, and left auditory cortex exhibits a more complex cascade of oscillations , reflecting the possible extraction of transient acoustic cues at a fast (∼25-45 Hz) rate, subsequently integrated at a slower, e.g., syllabic one. Slow oscillations could functionally participate to speech processing by structuring gamma activity in left BA22, where abstract percepts emerge.

According to the predictive coding theory, top-down predictions are conveyed by backward connections and prediction errors are propagated forward across the cortical hierarchy. Using MEG in humans, we show that violating multisensory predictions causes a fundamental and qualitative change in both the frequency and spatial distribution of cortical activity. When visual speech input correctly predicted auditory speech signals, a slow delta regime (3-4 Hz) developed in higher-order speech areas. In contrast, when auditory signals invalidated predictions inferred from vision, a low-beta (14-15 Hz) / high-gamma (60-80 Hz) coupling regime appeared locally in a multisensory area (area STS). This frequency shift in oscillatory responses scaled with the degree of audio-visual congruence and was accompanied by increased gamma activity in lower sensory regions. These findings are consistent with the notion that bottom-up prediction errors are communicated in predominantly high (gamma) frequency ranges, whereas top-down predictions are mediated by slower (beta) frequencies.