Search

Visual search is widely studied, with paradigms ranging from simple stimuli and tasks to complex scenes and real-world settings. Here, we investigated a real-world scenario, the search for fire sources with a novel augmented reality (AR) device: a firefighter’s helmet equipped with a heat sensor and an integrated display indicating the heat distribution in the sensor’s field of view. This was compared to the current state-of-the-art, a hand-held thermal imaging camera. Although both are actual devices, we used a high fidelity virtual-reality (VR) simulation to provide a safe and controlled, yet realistic, experimental setting. Detecting fire sources was faster with the thermal camera than with the helmet display. Responses in target-present trials were faster than in target-absent trials for both devices. Fire localization after detection was numerically faster and more accurate, in particular in the horizontal plane, for the helmet display than for the thermal camera. Search was strongly biased to start on the left-hand side of each room, reminiscent of pseudoneglect and similar biases in scene viewing. Our study exemplifies how VR can be used to study vision in realistic settings, to foster the development of AR devices, and to obtain results relevant to basic science and applications alike.

In multistability, perceptual interpretations (“percepts”) of ambiguous stimuli alternate over time. There is considerable debate as to whether similar regularities govern the first percept after stimulus onset and percepts during prolonged presentation. We address this question in a visual pattern-component rivalry paradigm by presenting two overlaid drifting gratings, which participants perceived as individual gratings passing in front of each other (“segregated”) or as a plaid (“integrated”). We varied the enclosed angle (“opening angle”) between the gratings (experiments 1 and 2) and stimulus orientation (experiment 2). The relative number of integrated percepts increased monotonically with opening angle. The point of equality, where half of the percepts were integrated, was at a smaller opening angle at onset than during prolonged viewing. The functional dependence of the relative number of integrated percepts on opening angle showed a steeper curve at onset than during prolonged viewing. Dominance durations of integrated percepts were longer at onset than during prolonged viewing and increased with opening angle. The general pattern persisted when stimuli were rotated (experiment 2), despite some perceptual preference for cardinal motion directions over oblique directions. Analysis of eye movements, specifically the slow phase of the optokinetic nystagmus (OKN), confirmed the veridicality of participants’ reports and provided a temporal characterization of percept formation after stimulus onset. Together, our results show that the first percept after stimulus onset exhibits a different dependence on stimulus parameters than percepts during prolonged viewing. This underlines the distinct role of the first percept in multistability.

Purpose For elderly listeners, it is more challenging to listen to 1 voice surrounded by other voices than for young listeners. This could be caused by a reduced ability to use acoustic cues—such as slight differences in onset time—for the segregation of concurrent speech signals. Here, we study whether the ability to benefit from onset asynchrony differs between young (18–33 years) and elderly (55–74 years) listeners. Method We investigated young (normal hearing, N = 20) and elderly (mildly hearing impaired, N = 26) listeners' ability to segregate 2 vowels with onset asynchronies ranging from 20 to 100 ms. Behavioral measures were complemented by a specific event-related brain potential component, the object-related negativity, indicating the perception of 2 distinct auditory objects. Results Elderly listeners' behavioral performance (identification accuracy of the 2 vowels) was considerably poorer than young listeners'. However, both age groups showed the same amount of improvement with increasing onset asynchrony. Object-related negativity amplitude also increased similarly in both age groups. Conclusion Both age groups benefit to a similar extent from onset asynchrony as a cue for concurrent speech segregation during active (behavioral measurement) and during passive (electroencephalographic measurement) listening.

A listener who focusses on a sound source of interest must continuously integrate the sounds emitted by the attended source and ignore the sounds emitted by the remaining sources in the auditory scene. Little is known about how the ignored sound sources in the background are mentally represented after the source of interest has formed the perceptual foreground. This is due to a key methodological challenge: the background representation is by definition not overtly reportable. Here we developed a paradigm based on event-related brain potentials (ERPs) to assess the mental representation of background sounds. Participants listened to sequences of three repeatedly presented tones arranged in an ascending order (low, middle, high frequency). They were instructed to detect intensity deviants in one of the tones, creating the perceptual foreground. The remaining two background tones contained timing and location deviants. Those deviants were set up such that mismatch negativity (MMN) components would be elicited in distinct ways if the background was decomposed into two separate sound streams (background segregation) or if it was not further decomposed (background integration). Results provide MMN-based evidence for background segregation and integration in parallel. This suggests that mental representations of background integration and segregation can be concurrently available, and that collecting empirical evidence for only one of these background organization alternatives might lead to erroneous conclusions.

In everyday listening environments, a main task for our auditory system is to follow one out of multiple speakers talking simultaneously. The present study was designed to find electrophysiological indicators of two central processes involved - segregating the speech mixture into distinct speech sequences corresponding to the two speakers, and then attending to one of the speech sequences. We generated multistable speech stimuli that were set up to create ambiguity as to whether only one or two speakers are talking. Thereby we were able to investigate three perceptual alternatives (no segregation, segregated - speaker A in the foreground, segregated - speaker B in the foreground) without any confounding stimulus changes. Participants listened to a continuously repeating sequence of syllables, which were uttered alternately by two human speakers, and indicated whether they perceived the sequence as an inseparable mixture or as originating from two separate speakers. In the latter case, they distinguished which speaker was in their attentional foreground. Our data show a long-lasting event-related potential (ERP) modulation starting at 130ms after stimulus onset, which can be explained by the perceptual organization of the two speech sequences into attended foreground and ignored background streams. Our paradigm extends previous work with pure-tone sequences toward speech stimuli and adds the possibility to obtain neural correlates of the difficulty to segregate a speech mixture into distinct streams.

The auditory environment typically comprises several simultaneously active sound sources. In contrast to the perceptual segregation of two concurrent sounds, the perception of three simultaneous sound objects has not yet been studied systematically. We conducted two experiments in which participants were presented with complex sounds containing sound segregation cues (mistuning, onset asynchrony, differences in frequency or amplitude modulation or in sound location), which were set up to promote the perceptual organization of the tonal elements into one, two, or three concurrent sounds. In Experiment 1, listeners indicated whether they heard one, two, or three concurrent sounds. In Experiment 2, participants watched a silent subtitled movie while EEG was recorded to extract the object-related negativity (ORN) component of the event-related potential. Listeners predominantly reported hearing two sounds when the segregation promoting manipulations were applied to the same tonal element. When two different tonal elements received manipulations promoting them to be heard as separate auditory objects, participants reported hearing two and three concurrent sounds objects with equal probability. The ORN was elicited in most conditions; sounds that included the amplitude- or the frequency-modulation cue generated the smallest ORN amplitudes. Manipulating two different tonal elements yielded numerically and often significantly smaller ORNs than the sum of the ORNs elicited when the same cues were applied on a single tonal element. These results suggest that ORN reflects the presence of multiple concurrent sounds, but not their number. The ORN results are compatible with the horse-race principle of combining different cues of concurrent sound segregation.

Human brain function draws on predictive mechanisms that exploit higher-level context during lower-level perception. These mechanisms are particularly relevant for situations in which sensory information is compromised or incomplete, as for example in natural speech where speech segments may be omitted due to sluggish articulation. Here, we investigate which brain areas support the processing of incomplete words that were predictable from semantic context, compared with incomplete words that were unpredictable. During functional magnetic resonance imaging (fMRI), participants heard sentences that orthogonally varied in predictability (semantically predictable vs. unpredictable) and completeness (complete vs. incomplete, i.e. missing their final consonant cluster). The effects of predictability and completeness interacted in heteromodal semantic processing areas, including left angular gyrus and left precuneus, where activity did not differ between complete and incomplete words when they were predictable. The same regions showed stronger activity for incomplete than for complete words when they were unpredictable. The interaction pattern suggests that for highly predictable words, the speech signal does not need to be complete for neural processing in semantic processing areas. Hum Brain Mapp 37:704-716, 2016. © 2015 Wiley Periodicals, Inc.

By encoding acoustic regularities present in the environment, the human brain can generate predictions of what is likely to occur next. Recent studies suggest that deviations from encoded regularities are detected within 10–50 ms after stimulus onset, as indicated by electrophysiological effects in the middle latency response (MLR) range. This is upstream of previously known long-latency (LLR) signatures of deviance detection such as the mismatch negativity (MMN) component. In the present study, we created predictable and unpredictable contexts to investigate MLR and LLR signatures of the encoding of spatial auditory regularities and the generation of predictions from these regularities. Chirps were monaurally delivered in an either regular (predictable: left–right–left–right) or a random (unpredictable left/right alternation or repetition) manner. Occasional stimulus omissions occurred in both types of sequences. Results showed that the Na component (peaking at 34 ms after stimulus onset) was attenuated for regular relative to random chirps, albeit no differences were observed for stimulus omission responses in the same latency range. In the LLR range, larger chirp-and omission-evoked responses were elicited for the regular than for the random condition, and predictability effects were more prominent over the right hemisphere. We discuss our findings in the framework of a hierarchical organization of spatial regularity encoding. This article is part of a Special Issue entitled SI: Prediction and Attention.

Recent electrophysiological studies have provided evidence that changes in multisensory processing in auditory cortex cannot only be observed following extensive hearing loss, but also in moderately hearing-impaired subjects. How the reduced auditory input affects audio-visual interactions is however largely unknown. Here we used a cross-modal distraction paradigm to investigate multisensory processing in elderly participants with an age-related high-frequency hearing loss as compared to young and elderly subjects with normal hearing. During the experiment, participants were simultaneously presented with independent streams of auditory and visual input and were asked to categorize either the auditory or visual information while ignoring the other modality. Unisensory sequences without any cross-modal input served as control conditions to assure that all participants were able to perform the task. While all groups performed similarly in these unisensory conditions, hearing-impaired participants showed significantly increased error rates when confronted with distracting cross-modal stimulation. This effect could be observed in both the auditory and the visual task. Supporting these findings, an additional regression analysis indicted that the degree of high-frequency hearing loss significantly modulates cross-modal visual distractibility in the auditory task. These findings provide new evidence that already a moderate sub-clinical hearing loss, a common phenomenon in the elderly population, affects the processing of audio-visual information.

Many sound sources emit series of discrete sounds. Auditory perception must bind these sounds together (stream integration) while separating them from sounds emitted by other sources (stream segregation). One cue for identifying successive sounds that belong together is the predictability between their feature values. Previous studies have demonstrated that independent predictable patterns appearing separately in two interleaved sound sequences support perceptual segregation. The converse case, whether a joint predictable pattern in a mixture of interleaved sequences supports perceptual integration, has not yet been put to a rigorous empirical test. This was mainly due to difficulties in manipulating the predictability of the full sequence independently of the predictability of the interleaved subsequences. The present study implemented such an independent manipulation. Listeners continuously indicated whether they perceived a tone sequence as integrated or segregated, while predictable patterns set up to support one or the other percept were manipulated without the participants’ knowledge. Perceptual reports demonstrate that predictability supports stream segregation or integration depending on the type of predictable pattern that is present in the sequence. The effects of predictability were so pronounced as to qualitatively flip perception from predominantly (62%) integrated to predominantly (73%) segregated. These results suggest that auditory perception flexibly responds to encountered regular patterns, favoring predictable perceptual organizations over unpredictable ones. Besides underlining the role of predictability as a cue within auditory scene analysis, the present design also provides a general framework that accommodates previous investigations focusing on sub-comparisons within the present set of experimental manipulations. Results of intermediate conditions shed light on why some previous studies have obtained little to no effects of predictability on auditory scene analysis.

Speech signals are often compromised by disruptions originating from external (e.g., masking noise) or internal (e.g., inaccurate articulation) sources. Speech comprehension thus entails detecting and replacing missing information based on predictive and restorative neural mechanisms. The present study targets predictive mechanisms by investigating the influence of a speech segment's predictability on early, modality-specific electrophysiological responses to this segment's omission. Predictability was manipulated in simple physical terms in a single-word framework (Experiment 1) or in more complex semantic terms in a sentence framework (Experiment 2). In both experiments, final consonants of the German words Lachs ([laks], salmon) or Latz ([lats], bib) were occasionally omitted, resulting in the syllable La ([la], no semantic meaning), while brain responses were measured with multi-channel electroencephalography (EEG). In both experiments, the occasional presentation of the fragment La elicited a larger omission response when the final speech segment had been predictable. The omission response occurred ∼125–165 msec after the expected onset of the final segment and showed characteristics of the omission mismatch negativity (MMN), with generators in auditory cortical areas. Suggestive of a general auditory predictive mechanism at work, this main observation was robust against varying source of predictive information or attentional allocation, differing between the two experiments. Source localization further suggested the omission response enhancement by predictability to emerge from left superior temporal gyrus and left angular gyrus in both experiments, with additional experiment-specific contributions. These results are consistent with the existence of predictive coding mechanisms in the central auditory system, and suggestive of the general predictive properties of the auditory system to support spoken word recognition.

For studying multistable auditory perception, we propose a paradigm that evokes integrated or segregated perception of a sound sequence, and permits decomposition of the segregated grouping into foreground and background sounds. The paradigm combines 3-tone pitch patterns with alternating timbres, resulting in a repeating 6-tone structure that can be perceived as rising based on temporal proximity, or as falling based on timbre similarity. Listeners continuously report their percept while EEG is recorded. Results show an ERP modulation starting at ∼70 ms after sound onset that can be explained by whether a sound belongs to perceived foreground or background, with no additional effect of integrated versus segregated grouping. Auditory grouping as indexed by the mismatch negativity did not correspond with reported sound grouping. The paradigm offers a new possibility for investigating effects of conscious perceptual organization on sound processing.

In our surrounding acoustic world sounds are produced by different sources and interfere with each other before arriving to the ears. A key function of the auditory system is to provide consistent and robust descriptions of the coherent sound groupings and sequences (auditory objects), which likely correspond to the various sound sources in the environment. This function has been termed auditory stream segregation. In the current study we tested the effects of separation in the frequency of amplitude modulation on the segregation of concurrent sound sequences in the auditory stream–segregation paradigm (van Noorden 1975). The aim of the study was to assess 1) whether differential amplitude modulation would help in separating concurrent sound sequences and 2) whether this cue would interact with previously studied static cues (carrier frequency and location difference) in segregating concurrent streams of sound. We found that amplitude modulation difference is utilized as a primary cue for the stream segre...

Sound sources often emit trains of discrete sounds, such as a series of footsteps. Previously, two different principles have been suggested for how the human auditory system binds discrete sounds together into perceptual units. The feature similarity principle is based on linking sounds with similar characteristics over time. The predictability principle is based on linking sounds that follow each other in a predictable manner. The present study compared the effects of these two principles. Participants were presented with tone sequences and instructed to continuously indicate whether they perceived a single coherent sequence or two concurrent streams of sound. We investigated the influence of separate manipulations of similarity and predictability on these perceptual reports. Both grouping principles affected perception of the tone sequences, albeit with different characteristics. In particular, results suggest that whereas predictability is only analyzed for the currently perceived sound organization, f...

The remarkable capabilities displayed by humans in making sense of an overwhelming amount of sensory information cannot be explained easily if perception is viewed as a passive process. Current theoretical and computational models assume that to achieve meaningful and coherent perception, the human brain must anticipate upcoming stimulation. But how are upcoming stimuli predicted in the brain? We unmasked the neural representation of a prediction by omitting the predicted sensory input. Electrophysiological brain signals showed that when a clear prediction can be formulated, the brain activates a template of its response to the predicted stimulus before it arrives to our senses.

Empirical research on the sequential decomposition of an auditory scene primarily relies on interleaved sound mixtures of only two tone sequences (e.g., ABAB…). This oversimplifies the sound decomposition problem by limiting the number of putative perceptual organizations. The current study used a sound mixture composed of three different tones (ABCABC…) that could be perceptually organized in many different ways. Participants listened to these sequences and reported their subjective perception by continuously choosing one out of 12 visually presented perceptual organization alternatives. Different levels of frequency and spatial separation were implemented to check whether participants' perceptual reports would be systematic and plausible. As hypothesized, while perception switched back and forth in each condition between various perceptual alternatives (multistability), spatial as well as frequency separation generally raised the proportion of segregated and reduced the proportion of integrated alternatives. During segregated percepts, in contrast to the hypothesis, many participants had a tendency to perceive two streams in the foreground, rather than reporting alternatives with a clear foreground-background differentiation. Finally, participants perceived the organization with intermediate feature values (e.g., middle tones of the pattern) segregated in the foreground slightly less often than similar alternatives with outer feature values (e.g., higher tones).

In binocular rivalry, paradigms have been proposed for unobtrusive moment-by-moment readout of observers' perceptual experience ("no-report paradigms"). Here, we take a first step to extend this concept to auditory multistability. Observers continuously reported which of two concurrent tone sequences they perceived in the foreground: high-pitch (1008 Hz) or low-pitch (400 Hz) tones. Interstimulus intervals were either fixed per sequence (Experiments 1 and 2) or random with tones alternating (Experiment 3). A horizontally drifting grating was presented to each eye; to induce binocular rivalry, gratings had distinct colors and motion directions. To associate each grating with one tone sequence, a pattern on the grating jumped vertically whenever the respective tone occurred. We found that the direction of the optokinetic nystagmus (OKN)-induced by the visually dominant grating-could be used to decode the tone (high/low) that was perceived in the foreground well above chance. This OKN-based readout improved after observers had gained experience with the auditory task (Experiments 1 and 2) and for simpler auditory tasks (Experiment 3). We found no evidence that the visual stimulus affected auditory multistability. Although decoding performance is still far from perfect, our paradigm may eventually provide a continuous estimate of the currently dominant percept in auditory multistability.

This study applied an auditory distraction paradigm to investigate involuntary attention effects of unexpected deviations in speech and non-speech sounds on behavior (increase in response time and error rate) and event-related brain potentials (ΔN1/MMN and P3a). Our aim was to systematically compare identical speech sounds with physical vs. linguistic deviations and identical deviations (pitch) with speech vs. non-speech sounds in the same set of healthy volunteers. Sine tones and bi-syllabic pseudo-words were presented in a 2-alternative forced-choice paradigm with occasional phoneme deviants in pseudo-words, pitch deviants in pseudo-words, or pitch deviants in tones. Deviance-related ERP components were elicited in all conditions. Deviance-related negativities (ΔN1/MMN) differed in scalp distribution between phoneme and pitch deviants within phonemes, indicating that auditory deviance-detection partly operates in a deviance-specific manner. P3a as an indicator of attentional orienting was similar in all conditions, and was accompanied by behavioral indicators of distraction. Yet smaller behavioral effects and prolonged relative MMN-P3a latency were observed for pitch deviants within phonemes relative to the other two conditions. This suggests that the similarity and separability of task-relevant and task-irrelevant information is essential for the extent of attentional capture and distraction.

When distinct stimuli are presented to the two eyes, their mental representations alternate in awareness. Here, such "binocular rivalry" was used to investigate whether audio-visual associations bias visual perception. To induce two arbitrary associations, each between a tone and a grating of a specific color and motion direction, observers were required to respond whenever this combination was presented, but not for other tone-grating combinations. After about 20min of this induction phase, each of the gratings was presented to one eye to induce rivalry, while either of the two tones or no tone was played. Observers were asked to watch the rivaling stimuli and listen to the tones. The observer's dominant percept was assessed throughout by measuring the optokinetic nystagmus (OKN), whose slow phase follows the direction of the currently dominant grating. We found that perception in rivalry was affected by the concurrently played tone. Results suggest a bias towards the grating that had been associated with the concurrently presented tone and prolonged dominance durations for this grating compared to the other. Numerically, conditions without tone fell in-between for measures of bias and dominance duration. Our data show that a rapidly acquired arbitrary audio-visual association biases visual perception. Unlike previously reported cross-modal interactions in rivalry, this effect can neither be explained by a pure attentional (dual-task) effect, nor does it require a fixed physical or semantic relation between the auditory and visual stimulus. This suggests that audio-visual associations that are quickly formed by associative learning may affect visual representations directly.

While subjective reports provide a direct measure of perception, their validity is not self-evident. Here, the authors tested three possible biasing effects on perceptual reports in the auditory streaming paradigm: errors due to imperfect understanding of the instructions, voluntary perceptual biasing, and susceptibility to implicit expectations. (1) Analysis of the responses to catch trials separately promoting each of the possible percepts allowed the authors to exclude participants who likely have not fully understood the instructions. (2) Explicit biasing instructions led to markedly different behavior than the conventional neutral-instruction condition, suggesting that listeners did not voluntarily bias their perception in a systematic way under the neutral instructions. Comparison with a random response condition further supported this conclusion. (3) No significant relationship was found between social desirability, a scale-based measure of susceptibility to implicit social expectations, and any of the perceptual measures extracted from the subjective reports. This suggests that listeners did not significantly bias their perceptual reports due to possible implicit expectations present in the experimental context. In sum, these results suggest that valid perceptual data can be obtained from subjective reports in the auditory streaming paradigm.

Auditory transients (such as sound onset or a frequency transition within a continuous sound) are assumed to parse the auditory input into smaller units enabling the formation of unitary sound representations separately for each segment. This was discovered by using the mismatch negativity (MMN) component of the event-related potential (ERP) that taps into auditory sensory memory representations. For unstructured sounds, MMN amplitude decreased or even vanished with increasing the temporal distance of an irregular feature (deviance, e.g. duration decrement) relative to the onset of an otherwise regularly occurring sound, whereas for sounds that were segmented by a transient, MMN persisted. It has been speculated that the P1–N1–P2 complex, indexing the sensory encoding of the transient, determines the temporal units of the acoustic input that are represented by the information processing system. To test this hypothesis, we utilized a previously reported asymmetry in the sensory encoding of physically identical but time-reversed transitions between segments of constant and gliding frequency. In separate blocks, we regularly presented 1400-ms sounds with a centered constant-to-glide or glide-to-constant transition. Occasionally and unpredictably, one of the regularly occurring sounds was shortened in duration to 910 ms. We found larger transition-related P1–N1–P2 potentials accompanied by larger deviance-related MMN amplitudes for sounds with constant-to-glide transition than for sounds with glide-to-constant transition. This provides evidence that it is the precise sensory encoding of the transition which is crucial for automatically parsing the auditory input into smaller units, thus enabling the formation of unitary sound representations even for late segments.

Auditory stream segregation involves linking temporally separate acoustic events into one or more coherent sequences. For any non-trivial sequence of sounds, many alternative descriptions can be formed, only one or very few of which emerge in awareness at any time. Evidence from studies showing bi-/multistability in auditory streaming suggest that some, perhaps many of the alternative descriptions are represented in the brain in parallel and that they continuously vie for conscious perception. Here, based on a predictive coding view, we consider the nature of these sound representations and how they compete with each other. Predictive processing helps to maintain perceptual stability by signalling the continuation of previously established patterns as well as the emergence of new sound sources. It also provides a measure of how well each of the competing representations describes the current acoustic scene. This account of auditory stream segregation has been tested on perceptual data obtained in the auditory streaming paradigm.

The auditory system continuously parses the acoustic environment into auditory objects, usually representing separate sound sources. Sound sources typically show characteristic emission patterns. These regular temporal sound patterns are possible cues for distinguishing sound sources. The present study was designed to test whether regular patterns are used as cues for source distinction and to specify the role that detecting these regularities may play in the process of auditory stream segregation. Participants were presented with tone sequences, and they were asked to continuously indicate whether they perceived the tones in terms of a single coherent sequence of sounds (integrated) or as two concurrent sound streams (segregated). Unknown to the participant, in some stimulus conditions, regular patterns were present in one or both putative streams. In all stimulus conditions, participants' perception switched back and forth between the two sound organizations. Importantly, regular patterns occurring in either one or both streams prolonged the mean duration of two-stream percepts, whereas the duration of one-stream percepts was unaffected. These results suggest that temporal regularities are utilized in auditory scene analysis. It appears that the role of this cue lies in stabilizing streams once they have been formed on the basis of simpler acoustic cues.

Objective Music perception with a cochlear implant (CI) can be unsatisfactory because current-day implants are primarily designed to enable speech discrimination. The present study aimed at evaluating electrophysiological correlates of musical sound perception in CI users to help achieve the long-term goal of improved restoration of hearing in those individuals. Methods Auditory discrimination accuracy in adult CI users ( n =12) and matched normal-hearing controls ( n =12) was measured by behavioral discrimination tasks and mismatch negativity (MMN) recordings. Discrimination profiles were obtained by using a set of clarinet sounds (original/vocoded) varying along different acoustic dimensions (frequency/intensity/duration) and deviation magnitudes (four levels). Results Behavioral results and MMN recordings revealed reduced auditory discrimination accuracy in CI users. An inverse relationship was found between MMN amplitudes and duration of profound deafness. Conclusions CI users have difficulties in discriminating small changes in the acoustic properties of musical sounds. The recently developed multi-feature MMN paradigm (Pakarinen et al., 2007) can be used to objectively evaluate discrimination abilities of CI users for musical sounds. Significance Measuring auditory discrimination functions by means of a multi-feature MMN paradigm could be of substantial clinical value by providing a comprehensive profile of the extent of restored hearing in CI users.

Identifying novel or unexpected events which violate predictions based on the regularities extracted from our environment is crucially important for adaptive behavior. However, the exact dynamics of processing such events is not well understood. Furthermore, it is not known in which degree the process of deviant detection differs across contexts and how much it depends on the characteristics of deviant events. This issue was addressed by the present study which used event-related potentials (ERPs) in order to investigate the dynamics of identifying two types of deviants presented within the same visual setting. These events violated expectations based on two different types of information contained within each trial, either temporal order of stimulus presentation (sequential deviant) or physical attributes shared by the majority of individual stimuli (feature deviant). The obtained results indicate a certain degree of similarity in detecting two deviant types which, when task-relevant, both elicited N2 and P3b event-related potential components. However, significant differences across different stages of their processing were also identified. First, only feature, but not sequential deviants elicited an N1 enhancement. Furthermore, N2 and P3b responses elicited by sequential and feature deviants differed in their latency and topography and, in case of P3b, amplitude. Taken together, these results suggest that the dynamics of detecting different types of deviants strongly depends on the specific characteristics of such events. Furthermore, the identified differences in the topography of N2 and P3b indicate distinct mechanisms underlying several stages of their processing.

The present study aimed at investigating visual distraction in a serial, multi-deviant oddball paradigm with deviant stimuli occurring regularly (every third trial), having a larger overall probability (1/3), and low dimension-specific probability (1/9). Participants performed a categorization task (odd/even) on centrally presented digits. Task-irrelevant geometrical forms were presented concurrently in the left and right periphery of the target. These forms were green triangles that, in every third trial, contained a deviancy either in location, color, or shape at the left or right peripheral position. Behavioral performance and event-related potentials (ERPs) were measured during the multi-deviant blocks and during corresponding control blocks to compensate for physical differences. Results revealed prolonged reaction times for the categorization task in trials containing a deviant feature relative to the respective control condition. Furthermore, two negative shifts were observed in the ERPs for deviant compared to control stimuli, the early one at the ascending part of the N1 component, and the later one at the onset latency of the N2 component. Deviant displays violating a sequential regularity on one of the dimensions thus elicit respective posterior ERP components of change detection and a deterioration in task performance even when they occur as frequently as in every third trial of a sequence. In analogy to findings in audition, these results reveal the importance of regularity processing and its immediate consequences for adaptive behavior also in vision.

Abstract: By means of behavioral data and electrophysiological recordings, we investigated the relation between the subjective duration of stimuli in the millisecond range and the moments of their perceived onset and offset. In three consecutive tasks, subjects (1) judged the duration of auditory stimuli and performed simple reaction time tasks to (2) onset and (3) offset of the same tones. All stimuli were presented with variable response-stimulus-intervals (RSI). To a certain extent, this manipulation was shown to affect onset, offset, and duration perception in a similar way. However, more profound analyses revealed dissociations between the tasks. Consequently, there seems to be no simple relation between perceived duration and the moments of onset and offset perception, but duration judgments seem to be based on more complex processes.