Search

A shape-label matching task is commonly used to examine the self-advantage in motor reaction-time responses (the Self-Prioritization Effect; SPE). In the present study, auditory labels were introduced, and, for the first time, responses to unisensory auditory, unisensory visual, and multisensory object-label stimuli were compared across block-type (i.e., trials blocked by sensory modality type, and intermixed trials of unisensory and multisensory stimuli). Auditory stimulus intensity was presented at either 50 dB (Group 1) or 70 dB (Group 2). The participants in Group 2 also completed a multisensory detection task, making simple speeded motor responses to the shape and sound stimuli and their multisensory combinations. In the matching task, the SPE was diminished in intermixed trials, and in responses to the unisensory auditory stimuli as compared with the multisensory (visual shape+auditory label) stimuli. In contrast, the SPE did not differ in responses to the unisensory visual and multisensory (auditory object+visual label) stimuli. The matching task was associated with multisensory 'costs' rather than gains, but response times to self- versus stranger-associated stimuli were differentially affected by the type of multisensory stimulus (auditory object+visual label or visual shape+auditory label). The SPE was thus modulated both by block-type and the combination of object and label stimulus modalities. There was no SPE in the detection task. Taken together, these findings suggest that the SPE with unisensory and multisensory stimuli is modulated by both stimulus- and task-related parameters within the matching task. The SPE does not transfer to a significant motor speed gain when the self-associations are not task-relevant. [ABSTRACT FROM AUTHOR]

Successful navigation of information-rich, multimodal environments involves processing both auditory and visual information. The extent to which information within each modality is processed varies because of many factors, but the influence of auditory stimuli on the processing of visual stimuli in these multimodal environments is not well understood. Previous research has shown that a preceding sound leads to decreased reaction times in visual tasks (Bertelson, Quarterly Journal of Experimental Psychology 19(3), 272–279, 1967). The current study examines whether a nonspatial, task-irrelevant sound additionally alters processing of visual distractors that flank a central target. We used a version of a flanker task in which participants responded to a central letter surrounded by two irrelevant flanker letters. When these flankers are associated with a conflicting response, a congruency effect occurs such that reaction time to the target is slowed (Eriksen & Eriksen, Perception & Psychophysics, 16(1), 143–149, 1974). In two experiments using this task, results showed that a preceding tone caused general speeding of reaction time across flanker types, consistent with alerting. The tone also caused decreased variation in response time. Critically, the tone modulated the congruency effect, with a greater speeding for congruent flankers than for incongruent flankers. This suggests that the influence of flanker identity was more intense after tone presentation, consistent with a nonspatial sound increasing perceptual and/or response-association processing of flanking stimuli. [ABSTRACT FROM AUTHOR]

We often rely on our sense of vision for understanding the spatial location of objects around us. If vision cannot be used, one must rely on other senses, such as hearing and touch, in order to build spatial representations. Previous work has found evidence of a leftward spatial bias in visual and tactile tasks. In this study, we sought evidence of this leftward bias in a non-visual haptic object location memory task and assessed the influence of a task-irrelevant sound. In Experiment 1, blindfolded right-handed sighted participants used their non-dominant hand to haptically locate an object on the table, then used their dominant hand to place the object back in its original location. During placement, participants either heard nothing (no-sound condition) or a task-irrelevant repeating tone to the left, right, or front of the room. The results showed that participants exhibited a leftward placement bias on no-sound trials. On sound trials, this leftward bias was corrected; placements were faster and more accurate (regardless of the direction of the sound). One explanation for the leftward bias could be that participants were overcompensating their reach with the right hand during placement. Experiment 2 tested this explanation by switching the hands used for exploration and placement, but found similar results as Experiment 1. A third Experiment found evidence supporting the explanation that sound corrects the leftward bias by heightening attention. Together, these findings show that sound, even if task-irrelevant and semantically unrelated, can correct one's tendency to place objects too far to the left. [ABSTRACT FROM AUTHOR]

Peripersonal space (PPS) is created by a multisensory interaction between different sensory modalities and can be modified by experience. In this article, we investigated whether an auditory training, inside the peripersonal space area, can modify the PPS around the head in sighted participants. The auditory training was based on echolocation. We measured the participant's reaction times to a tactile stimulation on the neck, while task-irrelevant looming auditory stimuli were presented. Sounds more strongly affect tactile processing when located within a limited distance from the body. We measured spatially dependent audio-tactile interaction as a proxy of PPS representation before and after an echolocation training. We found a significant speeding effect on tactile RTs after echolocation, specifically when sounds where around the location where the echolocation task was performed. This effect could not be attributed to a task repetition effect nor to a shift of spatial attention, as no changes of PPS were found in two control groups of participants, who performed the PPS task after either a break or a temporal auditory task (with stimuli located at the same position of echolocation task). These findings show that echolocation affects multisensory processing inside PPS representation, likely to better represent the space where external stimuli, have to be localized. [ABSTRACT FROM AUTHOR]

Temporal and spatial characteristics of sensory inputs are fundamental to multisensory integration because they provide probabilistic information as to whether or not multiple sensory inputs belong to the same event. The multisensory temporal binding window defines the time range within which two stimuli of different sensory modalities are merged into one percept and has been shown to depend on training. The aim of the present study was to evaluate the role of the training procedure for improving multisensory temporal discrimination and to test for a possible transfer of training to other multisensory tasks. Participants were trained over five sessions in a two-alternative forced-choice simultaneity judgment task. The task difficulty of each trial was either at each participant’s threshold (adaptive group) or randomly chosen (control group). A possible transfer of improved multisensory temporal discrimination on multisensory binding was tested with a redundant signal paradigm in which the temporal alignment of auditory and visual stimuli was systematically varied. Moreover, the size of the spatial audio-visual ventriloquist effect was assessed. Adaptive training resulted in faster improvements compared to the control condition. Transfer effects were found for both tasks: The processing speed of auditory inputs and the size of the ventriloquist effect increased in the adaptive group following the training. We suggest that the relative precision of the temporal and spatial features of a cross-modal stimulus is weighted during multisensory integration. Thus, changes in the precision of temporal processing are expected to enhance the likelihood of multisensory integration for temporally aligned cross-modal stimuli. [ABSTRACT FROM AUTHOR]

A widely held view is that top-down modulation of sensory information relies on an amodal control network that acts through the thalamus to regulate incoming signals. Olfaction lacks a direct thalamic projection, which suggests that it may differ from other modalities in this regard. We investigated the late positive complex (LPC) amplitudes of event-related potentials (ERP) from 28 participants, elicited by intensity-matched olfactory, auditory and visual stimuli, during a condition of focused attention, a neutral condition, and a condition in which stimuli were to be actively ignored. Amplitudes were largest during the attend condition, lowest during the ignore condition, with the neutral condition in between. A Bayesian analysis resulted in strong evidence for similar effects of task across sensory modalities. We conclude that olfaction, despite its unique neural projections, does not differ from audition and vision in terms of task-dependent neural modulation of the LPC. [ABSTRACT FROM AUTHOR]

The space immediately surrounding the body, i.e. peripersonal space (PPS), is represented by populations of multisensory neurons, from a network of premotor and parietal areas, which integrate tactile stimuli from the body’s surface with visual or auditory stimuli presented within a limited distance from the body. Here we show that PPS boundaries extend while walking. We used an audio–tactile interaction task to identify the location in space where looming sounds affect reaction time to tactile stimuli on the chest, taken as a proxy of the PPS boundary. The task was administered while participants either stood still or walked on a treadmill. In addition, in two separate experiments, subjects either received or not additional visual inputs, i.e. optic flow, implying a translation congruent with the direction of their walking. Results revealed that when participants were standing still, sounds boosted tactile processing when located within 65–100 cm from the participants’ body, but not at farther distances. Instead, when participants were walking PPS expands as reflected in boosted tactile processing at ~1.66 m. This was found despite the fact the spatial relationship between the participant’s body and the sound’s source did not vary between the Standing and the Walking condition. This expansion effect on PPS boundaries due to walking was the same with or without optic flow, suggesting that kinematics and proprioceptive cues, rather than visual cues, are critical in triggering the effect. These results are the first to demonstrate an adaptation of the chest’s PPS representation due to whole body motion and are compatible with the view that PPS constitutes a dynamic sensory–motor interface between the individual and the environment. [ABSTRACT FROM AUTHOR]

Processing multiple complex features to create cohesive representations of objects is an essential aspect of both the visual and auditory systems. It is currently unclear whether these processes are entirely modality specific or whether there are amodal processes that contribute to complex object processing in both vision and audition. We investigated this using a dual-stream target detection task in which two concurrent streams of novel visual or auditory stimuli were presented. We manipulated the degree to which each stream taxed processing conjunctions of complex features. In two experiments, we found that concurrent visual tasks that both taxed conjunctive processing strongly interfered with each other but that concurrent auditory and visual tasks that both taxed conjunctive processing did not. These results suggest that resources for processing conjunctions of complex features within vision and audition are modality specific. [ABSTRACT FROM AUTHOR]

Flexibility in configuring task sets allows people to adequately respond to environmental stimuli in different contexts, such as in dual-task situations. In the present study, we examined to what extent response control is influenced by the modality of a concurrently executed response. In Experiment 1, participants responded to auditory stimuli with either vocal responses and/or saccades. In Experiment 2, vocal responses were combined with manual responses. In both experiments, we found asymmetric dual-response costs, that is, the response time difference between single- and dual-response conditions varied between response modalities. It is important to note that the same (vocal) response showed substantial dual-response costs when combined with saccades (Experiment 1) but no such costs when combined with manual responses (Experiment 2). Experiment 3, combining saccades with manual responses, revealed stronger dual-response costs for manual responses than for saccades. Together, these findings suggest an ordinal dominance pattern among response modalities, representing flexible, response-based resource scheduling during task-set configuration. [ABSTRACT FROM AUTHOR]

The interest in the influence of videogame experience in our daily life is constantly growing. 'First Person Shooter' (FPS) games require players to develop a flexible mindset to rapidly react and monitor fast moving visual and auditory stimuli, and to inhibit erroneous actions. This study investigated whether and to which degree experience with such videogames generalizes to other cognitive control tasks. Experienced video game players (VGPs) and individuals with little to no videogame experience (NVGPs) performed on a N-back task and a stop-signal paradigm that provide a relatively well-established diagnostic measure of the monitoring and updating of working memory (WM) and response inhibition (an index of behavioral impulsivity), respectively. VGPs were faster and more accurate in the monitoring and updating of WM than NVGPs, which were faster in reacting to go signals, but showed comparable stopping performance. Our findings support the idea that playing FPS games is associated with enhanced flexible updating of task-relevant information without affecting impulsivity. [ABSTRACT FROM AUTHOR]

When participants respond to auditory and visual stimuli, responses to audiovisual stimuli are substantially faster than to unimodal stimuli (redundant signals effect, RSE). In such tasks, the RSE is usually higher than probability summation predicts, suggestive of specific integration mechanisms underlying the RSE. We investigated the role of spatial and selective attention on the RSE in audiovisual redundant signals tasks. In Experiment 1, stimuli were presented either centrally (narrow attentional focus) or at 1 of 3 unpredictable locations (wide focus). The RSE was accurately described by a coactivation model assuming linear superposition of modality-specific activation. Effects of spatial attention were explained by a shift of the evidence criterion. In Experiment 2, stimuli were presented at 3 locations; participants had to respond either to all signals regardless of location (simple response task) or to central stimuli only (selective attention task). The RSE was consistent with task-specific coactivation models; accumulation of evidence, however, differed between the 2 tasks. [ABSTRACT FROM AUTHOR]

Abstract: Accurate timing performance during auditory–motor synchronization has been well documented for finger tapping tasks. It is believed that information pertaining to an event in movement production aids in detecting and correcting for errors between movement cycle completion and the metronome tone. Tasks with minimal event-related information exhibit more variable synchronization and less rapid error correction. Recent work from our laboratory has indicated that a task purportedly lacking an event structure (circle drawing) did not exhibit accurate synchronization or error correction (Studenka & Zelaznik, in press). In the present paper we report on two experiments examining synchronization in tapping and circle drawing tasks. In Experiment 1, error correction processes of an event-timed tapping timing task and an emergently timed circle drawing timing task were examined. Rapid and complete error correction was seen for the tapping, but not for the circle drawing task. In Experiment 2, a perceptual event was added to delineate a cycle in circle drawing, and the perceptual event of table contact was removed from the tapping task. The inclusion of an event produced a marked improvement in synchronization error correction for circle drawing, and the removal of tactile feedback (taking away an event) slightly reduced the error correction response of tapping. Furthermore, the task kinematics of circle drawing remained smooth providing evidence that event structure can be kinematic or perceptual in nature. Thus, synchronization and error correction, characteristic of event timing (Ivry, Spencer, Zelaznik, & Diedrichsen, 2002; Repp, 2005), depends upon the presence of a distinguishable source of sensory information at the timing goal. [Copyright &y& Elsevier]

Abstract: This study investigated the nature of resources involved in duration processing in 5- and 8-year-olds. The children were asked to reproduce the duration of a visual or auditory stimulus. They performed this task either alone or concurrently with an executive task (Experiment 1) or with a digit or visuospatial memory task (Experiment 2). The results showed that duration reproduction was systematically shorter in the dual-task condition than in the single-task one. Furthermore, timing an auditory stimulus decreased the proportion of accurate responses in the executive and digit memory tasks but not in the visuospatial memory task, whereas timing a visual stimulus decreased the proportion of accurate responses in the executive and visuospatial memory tasks but not in the digit memory task, at least to a lesser extent in the older children. This pattern of interference suggests that duration reproduction in children requires both the central executive and the slave memory system associated with the modality of the temporal stimulus. [Copyright &y& Elsevier]

Abstract: Functional neuroimaging studies carried out on healthy volunteers while performing different n-back tasks have shown a common pattern of bilateral frontoparietal activation, especially of the dorsolateral prefrontal cortex (DLPFC). Our objective was to use functional magnetic resonance imaging (fMRI) to compare the pattern of brain activation while performing two similar n-back tasks which differed in their presentation modality. Thirteen healthy volunteers completed a verbal 2-back task presenting auditory stimuli, and a similar 2-back task presenting visual stimuli. A conjunction analysis showed bilateral activation of frontoparietal areas including the DLPFC. The left DLPFC and the superior temporal gyrus showed a greater activation in the auditory than in the visual condition, whereas posterior brain regions and the anterior cingulate showed a greater activation during the visual than during the auditory task. Thus, brain areas involved in the visual and auditory versions of the n-back task showed an important overlap between them, reflecting the supramodal characteristics of working memory. However, the differences found between the two modalities should be considered in order to select the most appropriate task for future clinical studies. [Copyright &y& Elsevier]

Learning to recognize the contrasts of a language-specific phonemic repertoire can be viewed as forming categories in a multidimensional psychophysical space. Research on the learning of distributionally defined visual categories has shown that categories defined over 1 dimension are easy to learn and that learning multidimensional categories is more difficult but tractable under specific task conditions. In 2 experiments, adult participants learned either a unidimensional or a multidimensional category distinction with or without supervision (feedback) during learning. The unidimensional distinctions were readily learned and supervision proved beneficial, especially in maintaining category learning beyond the learning phase. Learning the multidimensional category distinction proved to be much more difficult and supervision was not nearly as beneficial as with unidimensionally defined categories. Maintaining a learned multidimensional category distinction was only possible when the distributional information that identified the categories remained present throughout the testing phase. We conclude that listeners are sensitive to both trial-by-trial feedback and the distributional information in the stimuli. Even given limited exposure, listeners learned to use 2 relevant dimensions, albeit with considerable difficulty. [ABSTRACT FROM AUTHOR]

Familiar and unfamiliar voice perception are often understood as being distinct from each other. For identity perception, theoretical work has proposed that listeners use acoustic information in different ways to perceive identity from familiar and unfamiliar voices: Unfamiliar voices are thought to be processed based on close comparisons of acoustic properties, while familiar voices are processed based on diagnostic acoustic features that activate a stored person-specific representation of that voice. To date no empirical study has directly examined whether and how familiar and unfamiliar listeners differ in their use of acoustic information for identity perception. Here, we tested this theoretical claim by linking listeners' judgements in voice identity tasks to complex acoustic representation - spectral similarity of the heard voice recordings. Participants (N = 177) who were either familiar or unfamiliar with a set of voices completed an identity discrimination task (Experiment 1) or an identity sorting task (Experiment 2). In both experiments, identity judgements for familiar and unfamiliar voices were guided by spectral similarity: Pairs of recordings with greater acoustic similarity were more likely to be perceived as belonging to the same voice identity. However, while there were no differences in how familiar and unfamiliar listeners used acoustic information for identity discrimination, differences were apparent for identity sorting. Our study therefore challenges proposals that view familiar and unfamiliar voice perception as being at all times distinct. Instead, our data suggest a critical role of the listening situation in which familiar and unfamiliar voices are evaluated, thus characterising voice identity perception as a highly dynamic process in which listeners opportunistically make use of any kind of information they can access. [ABSTRACT FROM AUTHOR]

• Auditory morphological processing is assessed in Spanish natives and anglophone L2 learners of Spanish. • Beginner L2 learners only decompose morphologically complex words with low surface frequency. • Advanced L2 learners and Spanish native speakers process words as wholes regardless of their surface frequency. • Working memory is not associated with decomposition in L2 learners or natives. Surface frequency and proficiency modulate visual morphological processing in second language (L2) learners, but less is known about auditory morphological processing. Moreover, working memory (WM) affects morphosyntactic processing, but it is unclear whether it also modulates word structure processing. In the present study, Spanish monolinguals and beginner and advanced L2 learners of Spanish completed an auditory lexical decision task in Spanish containing verbs varying in morphological complexity, an individual lexical frequency task, and a working memory task. Beginner L2 learners needed more time to process infrequent morphologically complex words, but monolinguals and advanced L2 learners were unaffected by morphological complexity or surface frequency. Also, WM did not modulate morphological processing. Taken together, the findings suggest a dual-route mechanism at initial stages of L2 acquisition and a whole-word route for Spanish monolinguals and advanced L2 learners. The findings also support the extension of dual-route models to L2 populations and suggest that the selection of a morphological processing route results from linguistic rather than cognitive reasons. [ABSTRACT FROM AUTHOR]

• The study of neural correlates of consciousness (NCC) focused mostly on vision, while audition has been largely overlooked. • We conducted an inattentional deafness study addressing the prevalent confound of conscious perception with reporting it. • Auditory awareness is associated with an anterior early negativity, while later effects reflect task relevance of stimuli. In recent years, several ERP components have been identified as potential neural correlates of consciousness (NCC), including early negativities and late positivities. Based on experiments in the visual modality, it has recently been shown that awareness is often confounded with reporting it, possibly overestimating the NCC. It is unknown whether similar constraints also exist in the auditory modality. In order to address this gap, we presented spoken words in a sustained inattentional deafness paradigm. Electrophysiological responses were obtained in three physically identical experimental conditions that differed only with respect to the participants' instructions. Participants were either left uninformed or informed about the presence of spoken words while confronted with an auditory distractor task (U/I condition), informed about the words while exposed to the same task as before (I condition), or requested to respond to the now task-relevant speech stimuli (TR condition). After completion of the U/I condition, only informed participants reported awareness of the words. In ERPs, awareness of words in the U/I and I condition was accompanied by an anterior auditory awareness negativity (AAN). Only when stimuli were task-relevant, i.e., during the TR condition, late positivities emerged. Taken together, these results indicate that early negativities but not late positivities index awareness across sensory modalities. Thus, they provide evidence for a recurrent processing framework, which highlights the importance of early sensory processing in conscious perception. [ABSTRACT FROM AUTHOR]

Identifying the plastic and stable components of the visual cortex after retinal loss is an important topic in visual neuroscience and neuro-ophthalmology. 1–5 Humans with juvenile macular degeneration (JMD) show significant blood-oxygen-level-dependent (BOLD) responses in the primary visual area (V1) lesion projection zone (LPZ), 6 despite the absence of the feedforward signals from the degenerated retina. Our previous study 7 reported that V1 LPZ responds to full-field visual stimuli during the one-back task (OBT), not during passive viewing, suggesting the involvement of task-related feedback signals. Aiming to clarify whether visual inputs to the intact retina are necessary for the LPZ responses, here, we measured BOLD responses to tactile and auditory stimuli for both JMD patients and control participants with and without OBT. Participants were instructed to close their eyes during the experiment for the purpose of eliminating retinal inputs. Without OBT, no V1 responses were detected in both groups of participants. With OBT, to the contrary, both stimuli caused substantial V1 responses in JMD patients, but not controls. Furthermore, we also found that the task-dependent activity in V1 LPZ became less pronounced when JMD patients opened their eyes, suggesting that task-related feedback signals can be partially suppressed by residual feedforward signals. Modality-independent V1 LPZ responses only in the task condition suggest that V1 LPZ responses reflect task-related feedback signals rather than reorganized feedforward visual inputs. • V1 LPZ responses to visual stimuli were found only in the task condition • V1 LPZ also responds to tactile and auditory stimuli only in the task condition • The task-dependent V1 LPZ responses are modality independent • V1 LPZ responses can be evoked by task-related feedback signals Masuda et al. show that V1 lesion projection zone of JMD patients responds to tactile and auditory stimuli only in the one-back memory task, not in the passive condition. The modality-independent, task-dependent V1 LPZ responses suggest that V1 LPZ responses reflect task-related feedback signals rather than reorganized feedforward signals. [ABSTRACT FROM AUTHOR]

• N-back task improved the force-control task performance under the dual-task setup. • N-back task enhanced an activity of the right dorsolateral prefrontal cortex. • The enhancement of brain activity was correlated with the task improvement. Dual-task performance often influences athletic competition results. Previous studies have suggested that cognitive tasks might improve dual-task performance. However, the factors that contribute to the manner in which cognitive tasks improve dual-task performance remain unknown. This study aimed to examine whether changes in brain activity induced by cognitive tasks are associated with improvement in dual-task performance. Nineteen young healthy adults performed an N-back and a reaction task on different days. A dual-task was constructed by combining a force-control and a calculation task. In the force-control task, participants adjusted their knee extension force according to target waves. In the calculation task, participants were required to subtract and respond to auditory stimuli delivered via earphones. We evaluated dual-task performance before and after performing each cognitive task. Additionally, we measured cerebral hemodynamic activity using near-infrared spectroscopy during the performance of each cognitive task. As a result, performing the N-back task improved performance in the force-control task under the dual-task setup. Furthermore, increase in oxyhemoglobin in a part of the right dorsolateral prefrontal cortex during the N-back task was positively correlated with improved force control during the subsequent dual-task. Cognitive tasks can be easily performed in a clinical field. Thus, cognitive tasks could be incorporated in traditional physical training. Future research should investigate whether the present findings can translate to improving performance in athletic competitions. [ABSTRACT FROM AUTHOR]

• Two latency windows emerged being sensitive to ISI change (150–170 and 210–230 ms). • TOJ thresholds correlated with amplitude change 210–230 ms post stimulus. • The "high-threshold" (low performance) group showed pronounced amplitude change. The study investigated auditory temporal processing on a tens of milliseconds scale that is the interval when two consecutive stimuli are processed either together or as distinct events. Distinctiveness is defined by one's ability to make correct order judgments of the presented sounds and is measured via the spatial temporal order judgement task (TOJ). The study aimed to identify electrophysiological indices of the TOJ performance. Tone pairs were presented with inter-stimulus intervals (ISI) varying between 25 and 75 ms while EEG was recorded. A pronounced amplitude change in the P2 interval was found between the event-related potential (ERP) of tone pairs having ISI = 55 and 65 ms, but it was a characteristic only of the group having poor behavioral thresholds. With the two groups combined, the amplitude change between these ERPs in the P2 interval showed a medium-size correlation with the behavioral threshold. [ABSTRACT FROM AUTHOR]