Search

Abstract We can often anticipate the precise moment when a stimulus will be relevant for our behavioral goals. Voluntary temporal attention, the prioritization of sensory information at task-relevant time points, enhances visual perception. However, the neural mechanisms of voluntary temporal attention have not been isolated from those of temporal expectation, which reflects timing predictability rather than relevance. Here we use time-resolved steady-state visual evoked responses (SSVER) to investigate how temporal attention dynamically modulates visual activity when temporal expectation is controlled. We recorded magnetoencephalography while participants directed temporal attention to one of two sequential grating targets with predictable timing. Meanwhile, a co-localized SSVER probe continuously tracked visual cortical modulations both before and after the target stimuli. We find that in the pre-target period, the SSVER gradually ramps up as the targets approach, reflecting temporal expectation. Furthermore, we find a low-frequency modulation of the SSVER, which shifts approximately half a cycle in phase according to which target is attended. In the post-target period, temporal attention to the first target transiently modulates the SSVER shortly after target onset. Thus, temporal attention dynamically modulates visual cortical responses via both periodic pre-target and transient post-target mechanisms to prioritize sensory information at precise moments.

Summary: Transcranial magnetic stimulation (TMS) to early visual cortex modulates the effect of adaptation and eliminates the effect of exogenous (involuntary) attention on contrast sensitivity. Here, we investigated whether adaptation modulates exogenous attention under TMS to V1/V2. Observers performed an orientation discrimination task while attending to one of two stimuli, with or without adaptation. Following an attentional cue, two stimuli were presented in the stimulated region and its contralateral symmetric region. A response cue indicated the stimulus whose orientation observers had to discriminate. Without adaptation, in the distractor-stimulated condition, contrast sensitivity increased at the attended location and decreased at the unattended location via response gain—but these effects were eliminated in the target-stimulated condition. Critically, after adaptation, exogenous attention altered performance similarly in both distractor-stimulated and target-stimulated conditions. These results reveal that (1) adaptation and attention interact in the early visual cortex, and (2) adaptation shields exogenous attention from TMS effects.

Abstract Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d′) and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d′) and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

Abstract The McGurk effect refers to an audiovisual speech illusion where the discrepant auditory and visual syllables produce a fused percept between the visual and auditory component. However, little is known about how individual differences contribute to the McGurk effect. Here, we examined whether music training experience—which involves audiovisual integration—can modulate the McGurk effect. Seventy-three participants completed the Goldsmiths Musical Sophistication Index (Gold-MSI) questionnaire to evaluate their music expertise on a continuous scale. Gold-MSI considers participants’ daily-life exposure to music learning experiences (formal and informal), instead of merely classifying people into different groups according to how many years they have been trained in music. Participants were instructed to report, via a 3-alternative forced choice task, “what a person said”: /Ba/, /Ga/ or /Da/. The experiment consisted of 96 audiovisual congruent trials and 96 audiovisual incongruent (McGurk) trials. We observed no significant correlations between the susceptibility of the McGurk effect and the different subscales of the Gold-MSI (active engagement, perceptual abilities, music training, singing abilities, emotion) or the general musical sophistication composite score. Together, these findings suggest that music training experience does not modulate audiovisual integration in speech as reflected by the McGurk effect.

Abstract Temporal attention is voluntarily deployed at specific moments, whereas temporal expectation is deployed according to timing probabilities. When the target appears at an expected moment in a sequence, temporal attention improves performance at the attended moments, but the timing and the precision of the attentional window remain unknown. Here we independently and concurrently manipulated temporal attention–via behavioral relevance–and temporal expectation–via session-wise precision and trial-wise hazard rate–to investigate whether and how these mechanisms interact to improve perception. Our results reveal that temporal attention interacts with temporal expectation–the higher the precision, the stronger the attention benefit, but surprisingly this benefit decreased with delayed onset despite the increasing probability of stimulus appearance. When attention was suboptimally deployed to earlier than expected moments, it could not be reoriented to a later time point. These findings provide evidence that temporal attention and temporal expectation are different mechanisms, and highlight their interplay in optimizing visual performance.

Abstract Microsaccades, incessant “fixational eye movements” (

Abstract Shortly before saccadic eye movements, visual sensitivity at the saccade target is enhanced, at the expense of sensitivity elsewhere. Some behavioral and neural correlates of this presaccadic shift of attention resemble those of covert attention, deployed during fixation. Microstimulation in non-human primates has shown that presaccadic attention modulates perception via feedback from oculomotor to visual areas. This mechanism also seems plausible in humans, as both oculomotor and visual areas are active during saccade planning. We investigated this hypothesis by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show their causal and differential roles in contralateral presaccadic attention effects: Whereas rFEF+ stimulation enhanced sensitivity opposite the saccade target throughout saccade preparation, V1/V2 stimulation reduced sensitivity at the saccade target only shortly before saccade onset. These findings are consistent with presaccadic attention modulating perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

Many properties of human primary visual cortex (V1) are ‘adult-like’ by childhood. Here, using fMRI, the authors show that V1 of children and adults differentially sample the visual field, indicating a late-stage change in cortical organization.

Abstract Visual perception is limited by spatial resolution, the ability to discriminate fine details. Spatial resolution not only declines with eccentricity but also differs for polar angle locations around the visual field, also known as ‘performance fields'. To compensate for poor peripheral resolution, we make rapid eye movements—saccades—to bring peripheral objects into high-acuity foveal vision. Already before saccade onset, visual attention shifts to the saccade target location and prioritizes visual processing. This presaccadic shift of attention improves performance in many visual tasks, but whether it changes resolution is unknown. Here, we investigated whether presaccadic attention sharpens peripheral spatial resolution; and if so, whether such effect interacts with performance fields asymmetries. We measured acuity thresholds in an orientation discrimination task during fixation and saccade preparation around the visual field. The results revealed that presaccadic attention sharpens acuity, which can facilitate a smooth transition from peripheral to foveal representation. This acuity enhancement is similar across the four cardinal locations; thus, the typically robust effect of presaccadic attention does not change polar angle differences in resolution.

Organization of cortical maps contributes to perception. Here the authors show that across observers, the size of primary visual cortex and localized cortical magnification correlate with contrast sensitivity.

Human visual performance changes dramatically both across (eccentricity) and around (polar angle) the visual field. Performance is better at the fovea, decreases with eccentricity, and is better along the horizontal than vertical meridian and along the lower than the upper vertical meridian. However, all neurophysiological and virtually all behavioral studies of cortical magnification have investigated eccentricity effects without considering polar angle. Most performance differences due to eccentricity are eliminated when stimulus size is cortically magnified (M-scaled) to equate the size of its cortical representation in primary visual cortex (V1). But does cortical magnification underlie performance differences around the visual field? Here, to assess contrast sensitivity, human adult observers performed an orientation discrimination task with constant stimulus size at different locations as well as when stimulus size was M-scaled according to stimulus eccentricity and polar angle location. We found that although M-scaling stimulus size eliminates differences across eccentricity, it does not eliminate differences around the polar angle. This finding indicates that limits in contrast sensitivity across eccentricity and around polar angle of the visual field are mediated by different anatomical and computational constraints.

Abstract Parieto-occipital alpha rhythms (8–12 Hz) underlie cortical excitability and influence visual performance. Whether the synchrony of intrinsic alpha rhythms in the occipital cortex can be entrained by transcranial magnetic stimulation (TMS) is an open question. We applied 4-pulse, 10-Hz rhythmic TMS to entrain intrinsic alpha oscillators targeting right V1/V2, and tested four predictions with concurrent electroencephalogram (EEG): (1) progressive enhancement of entrainment across time windows, (2) output frequency specificity, (3) dependence on the intrinsic oscillation phase, and (4) input frequency specificity to individual alpha frequency (IAF) in the neural signatures. Two control conditions with an equal number of pulses and duration were arrhythmic-active and rhythmic-sham stimulation. The results confirmed the first three predictions. Rhythmic TMS bursts significantly entrained local neural activity. Near the stimulation site, evoked oscillation amplitude and inter-trial phase coherence (ITPC) were increased for 2 and 3 cycles, respectively, after the last TMS pulse. Critically, ITPC following entrainment positively correlated with IAF rather than with the degree of similarity between IAF and the input frequency (10 Hz). Thus, we entrained alpha-band activity in occipital cortex for ~ 3 cycles (~ 300 ms), and IAF predicts the strength of entrained occipital alpha phase synchrony indexed by ITPC.

Abstract Visual perceptual learning (VPL) is typically specific to the trained location and feature. However, the degree of specificity depends upon particular training protocols. Manipulating covert spatial attention during training facilitates learning transfer to other locations. Here we investigated whether feature-based attention (FBA), which enhances the representation of particular features throughout the visual field, facilitates VPL transfer, and how long such an effect would last. To do so, we implemented a novel task in which observers discriminated a stimulus orientation relative to two reference angles presented simultaneously before each block. We found that training with FBA enabled remarkable location transfer, reminiscent of its global effect across the visual field, but preserved orientation specificity in VPL. Critically, both the perceptual improvement and location transfer persisted after 1 year. Our results reveal robust, long-lasting benefits induced by FBA in VPL, and have translational implications for improving generalization of training protocols in visual rehabilitation.

Recovery of visual discrimination thresholds inside cortically-blinded (CB) fields is most commonly attained at a single, trained location at a time, with iterative progress deeper into the blind field as performance improves over several months. As such, training is slow, inefficient, burdensome, and often frustrating for patients. Here, we investigated whether double-location training, coupled with a covert spatial-attention (SA) pre-cue, could improve the efficiency of training. Nine CB participants completed a randomized, training assignment with either a spatial attention or neutral pre-cue. All trained for a similar length of time on a fine direction discrimination task at two blind field locations simultaneously. Training stimuli and tasks for both cohorts were identical, save for the presence of a central pre-cue, to manipulate endogenous (voluntary) SA, or a Neutral pre-cue. Participants in the SA training cohort demonstrated marked improvements in direction discrimination thresholds, albeit not to normal/intact-field levels; participants in the Neutral training cohort remained impaired. Thus, double-training within cortically blind fields, when coupled with SA pre-cues can significantly improve direction discrimination thresholds at two locations simultaneously, offering a new method to improve performance and reduce the training burden for CB patients. Double-training without SA pre-cues revealed a hitherto unrecognized limitation of cortically-blind visual systems’ ability to improve while processing two stimuli simultaneously. These data could potentially explain why exposure to the typically complex visual environments encountered in everyday life is insufficient to induce visual recovery in CB patients. It is hoped that these new insights will direct both research and therapeutic developments toward methods that can attain better, faster recovery of vision in CB fields.

The oculomotor system keeps the eyes steady in expectation of visual events, inhibiting small fixational eye movements. Here, the authors reveal that this oculomotor freezing reflects tactile temporal expectations and aids tactile perception.

Eye movements are inhibited prior to the occurrence of predictable visual events. Here the authors show that this inhibition is also found in the auditory domain, thus revealing a multimodal perception action coupling.

Summary: Visual perceptual learning (VPL) is a behavioral manifestation of brain neuroplasticity. However, its practical effectiveness is limited because improvements are often specific to the trained conditions and require significant time and effort. It is critical to understand the conditions that promote learning and transfer. Covert endogenous (voluntary) and exogenous (involuntary) spatial attention help overcome VPL location specificity in neurotypical adults, but whether they also do so for people with atypical visual development is unknown. This study investigates the role of exogenous attention during VPL in adults with amblyopia, an ideal population given their asymmetrically developed, but highly plastic, visual cortex. Here we show that training on a discrimination task leads to improvements in foveal contrast sensitivity, acuity, and stereoacuity. Notably, exogenous attention helps generalize learning beyond trained spatial locations. Future large-scale studies can verify the extent to which attention enhances the effectiveness of perceptual learning during rehabilitation of visual disorders.

Summary: Visual performance has striking polar performance asymmetries: At a fixed eccentricity, it is better along the horizontal than vertical meridian and the lower than upper vertical meridian. These asymmetries are not alleviated by covert exogenous or endogenous attention, but have been studied exclusively during eye fixation. However, a major driver of everyday attentional orienting is saccade preparation, during which attention automatically shifts to the future eye fixation. This presaccadic attention shift is considered strong and compulsory, and relies on different neural computations and substrates than covert attention. Thus, we asked: Can presaccadic attention compensate for the ubiquitous performance asymmetries observed during eye fixation? Our data replicate polar performance asymmetries during fixation and document the same asymmetries during saccade preparation. Crucially, however, presaccadic attention enhanced contrast sensitivity at the horizontal and lower vertical meridian, but not at the upper vertical meridian. Thus, instead of attenuating performance asymmetries, presaccadic attention exacerbates them.

Visual performance varies around the visual field. It is best near the fovea compared to the periphery, and at iso-eccentric locations it is best on the horizontal, intermediate on the lower, and poorest on the upper meridian. The fovea-to-periphery performance decline is linked to the decreases in cone density, retinal ganglion cell (RGC) density, and V1 cortical magnification factor (CMF) as eccentricity increases. The origins of polar angle asymmetries are not well understood. Optical quality and cone density vary across the retina, but recent computational modeling has shown that these factors can only account for a small percentage of behavior. Here, we investigate how visual processing beyond the cone photon absorptions contributes to polar angle asymmetries in performance. First, we quantify the extent of asymmetries in cone density, midget RGC density, and V1 CMF. We find that both polar angle asymmetries and eccentricity gradients increase from cones to mRGCs, and from mRGCs to cortex. Second, we extend our previously published computational observer model to quantify the contribution of phototransduction by the cones and spatial filtering by mRGCs to behavioral asymmetries. Starting with photons emitted by a visual display, the model simulates the effect of human optics, cone isomerizations, phototransduction, and mRGC spatial filtering. The model performs a forced choice orientation discrimination task on mRGC responses using a linear support vector machine classifier. The model shows that asymmetries in a decision maker's performance across polar angle are greater when assessing the photocurrents than when assessing isomerizations and are greater still when assessing mRGC signals. Nonetheless, the polar angle asymmetries of the mRGC outputs are still considerably smaller than those observed from human performance. We conclude that cone isomerizations, phototransduction, and the spatial filtering properties of mRGCs contribute to polar angle performance differences, but that a full account of these differences will entail additional contribution from cortical representations.

Population receptive field (pRF) models fit to fMRI data are used to non-invasively measure retinotopic maps in human visual cortex, and these maps are a fundamental component of visual neuroscience experiments. Here, we examined the reproducibility of retinotopic maps across two datasets: a newly acquired retinotopy dataset from New York University (NYU) (n = 44) and a public dataset from the Human Connectome Project (HCP) (n = 181). Our goal was to assess the degree to which pRF properties are similar across datasets, despite substantial differences in their experimental protocols. The two datasets simultaneously differ in their stimulus apertures, participant pool, fMRI protocol, MRI field strength, and preprocessing pipeline. We assessed the cross-dataset reproducibility of the two datasets in terms of the similarity of vertex-wise pRF estimates and in terms of large-scale polar angle asymmetries in cortical magnification. Within V1, V2, V3, and hV4, the group-median NYU and HCP vertex-wise polar angle estimates were nearly identical. Both eccentricity and pRF size estimates were also strongly correlated between the two datasets, but with a slope different from 1; the eccentricity and pRF size estimates were systematically greater in the NYU data. Next, to compare large-scale map properties, we quantified two polar angle asymmetries in V1 cortical magnification previously identified in the HCP data. The NYU dataset confirms earlier reports that more cortical surface area represents horizontal than vertical visual field meridian, and lower than upper vertical visual field meridian. Together, our findings show that the retinotopic properties of V1, V2, V3, and hV4 can be reliably measured across two datasets, despite numerous differences in their experimental design. fMRI-derived retinotopic maps are reproducible because they rely on an explicit computational model of the fMRI response. In the case of pRF mapping, the model is grounded in physiological evidence of how visual receptive fields are organized, allowing one to quantitatively characterize the BOLD signal in terms of stimulus properties (i.e., location and size). The new NYU Retinotopy Dataset will serve as a useful benchmark for testing hypotheses about the organization of visual areas and for comparison to the HCP 7T Retinotopy Dataset.

Human vision has striking radial asymmetries, with performance on many tasks varying sharply with stimulus polar angle. Performance is generally better on the horizontal than vertical meridian, and on the lower than upper vertical meridian, and these asymmetries decrease gradually with deviation from the vertical meridian. Here, we report cortical magnification at a fine angular resolution around the visual field. This precision enables comparisons between cortical magnification and behavior, between cortical magnification and retinal cell densities, and between cortical magnification in twin pairs. We show that cortical magnification in the human primary visual cortex, measured in 163 subjects, varies substantially around the visual field, with a pattern similar to behavior. These radial asymmetries in the cortex are larger than those found in the retina, and they are correlated between monozygotic twin pairs. These findings indicate a tight link between cortical topography and behavior, and suggest that visual field asymmetries are partly heritable.

Radiologists rely principally on visual inspection to detect, describe, and classify findings in medical images. As most interpretive errors in radiology are perceptual in nature, understanding the path to radiologic expertise during image analysis is essential to educate future generations of radiologists. We review the perceptual tasks and challenges in radiologic diagnosis, discuss models of radiologic image perception, consider the application of perceptual learning methods in medical training, and suggest a new approach to understanding perceptional expertise. Specific principled enhancements to educational practices in radiology promise to deepen perceptual expertise among radiologists with the goal of improving training and reducing medical error.

Visual performance depends on polar angle, even when eccentricity is held constant; on many psychophysical tasks observers perform best when stimuli are presented on the horizontal meridian, worst on the upper vertical, and intermediate on the lower vertical meridian. This variation in performance 'around' the visual field can be as pronounced as that of doubling the stimulus eccentricity. The causes of these asymmetries in performance are largely unknown. Some factors in the eye, e.g. cone density, are positively correlated with the reported variations in visual performance with polar angle. However, the question remains whether these correlations can quantitatively explain the perceptual differences observed 'around' the visual field. To investigate the extent to which the earliest stages of vision-optical quality and cone density-contribute to performance differences with polar angle, we created a computational observer model. The model uses the open-source software package ISETBIO to simulate an orientation discrimination task for which visual performance differs with polar angle. The model starts from the photons emitted by a display, which pass through simulated human optics with fixational eye movements, followed by cone isomerizations in the retina. Finally, we classify stimulus orientation using a support vector machine to learn a linear classifier on the photon absorptions. To account for the 30% increase in contrast thresholds for upper vertical compared to horizontal meridian, as observed psychophysically on the same task, our computational observer model would require either an increase of ~7 diopters of defocus or a reduction of 500% in cone density. These values far exceed the actual variations as a function of polar angle observed in human eyes. Therefore, we conclude that these factors in the eye only account for a small fraction of differences in visual performance with polar angle. Substantial additional asymmetries must arise in later retinal and/or cortical processing.

The ability to act quickly to a threat is a key skill for survival. Under awareness, threat-related emotional information, such as an angry or fearful face, has not only perceptual advantages but also guides rapid actions such as eye movements. Emotional information that is suppressed from awareness still confers perceptual and attentional benefits. However, it is unknown whether suppressed emotional information can directly guide actions, or whether emotional information has to enter awareness to do so. We suppressed emotional faces from awareness using continuous flash suppression and tracked eye gaze position. Under successful suppression, as indicated by objective and subjective measures, gaze moved towards fearful faces, but away from angry faces. Our findings reveal that: (1) threat-related emotional stimuli can guide eye movements in the absence of visual awareness; (2) threat-related emotional face information guides distinct oculomotor actions depending on the type of threat conveyed by the emotional expression.

In interocular suppression, a suprathreshold monocular target can be rendered invisible by a salient competitor stimulus presented in the other eye. Despite decades of research on interocular suppression and related phenomena (e.g., binocular rivalry, flash suppression, continuous flash suppression), the neural processing underlying interocular suppression is still unknown. We developed and tested a computational model of interocular suppression. The model included two processes that contributed to the strength of interocular suppression: divisive normalization and attentional modulation. According to the model, the salient competitor induced a stimulus-driven attentional modulation selective for the location and orientation of the competitor, thereby increasing the gain of neural responses to the competitor and reducing the gain of neural responses to the target. Additional suppression was induced by divisive normalization in the model, similar to other forms of visual masking. To test the model, we conducted psychophysics experiments in which both the size and the eye-of-origin of the competitor were manipulated. For small and medium competitors, behavioral performance was consonant with a change in the response gain of neurons that responded to the target. But large competitors induced a contrast-gain change, even when the competitor was split between the two eyes. The model correctly predicted these results and outperformed an alternative model in which the attentional modulation was eye specific. We conclude that both stimulus-driven attention (selective for location and feature) and divisive normalization contribute to interocular suppression.

Performance in most visual discrimination tasks is better along the horizontal than the vertical meridian (Horizontal-Vertical Anisotropy, HVA), and along the lower than the upper vertical meridian (Vertical Meridian Asymmetry, VMA), with intermediate performance at intercardinal locations. As these inhomogeneities are prevalent throughout visual tasks, it is important to understand the perceptual consequences of dissociating spatial reference frames. In all studies of performance fields so far, allocentric environmental references and egocentric observer reference frames were aligned. Here we quantified the effects of manipulating head-centric and retinotopic coordinates on the shape of visual performance fields. When observers viewed briefly presented radial arrays of Gabors and discriminated the tilt of a target relative to homogeneously oriented distractors, performance fields shifted with head tilt (Experiment 1), and fixation (Experiment 2). These results show that performance fields shift in-line with egocentric referents, corresponding to the retinal location of the stimulus.