Search

Any visual system, biological or artificial, must make a trade-off between the number of units used to represent the visual environment and the spatial resolution of the sampling array. Humans and some other animals are able to allocate attention to spatial locations to reconfigure the sampling array of receptive fields (RFs), thereby enhancing the spatial resolution of representations without changing the overall number of sampling units. Here, we examine how representations of visual features in a fully convolutional neural network interact and interfere with each other in an eccentricity-dependent RF pooling array and how these interactions are influenced by dynamic changes in spatial resolution across the array. We study these feature interactions within the framework of visual crowding, a well-characterized perceptual phenomenon in which target objects in the visual periphery that are easily identified in isolation are much more difficult to identify when flanked by similar nearby objects. By separately simulating effects of spatial attention on RF size and on the density of the pooling array, we demonstrate that the increase in RF density due to attention is more beneficial than changes in RF size for enhancing target classification for crowded stimuli. Furthermore, by varying target/flanker spacing, as well as the spatial extent of attention, we find that feature redundancy across RFs has more influence on target classification than the fidelity of the feature representations themselves. Based on these findings, we propose a candidate mechanism by which spatial attention relieves visual crowding through enhanced feature redundancy that is mostly due to increased RF density.

Optical control of neural ensemble activity is crucial for understanding brain function and disease, yet no technology can achieve optogenetic control of very large numbers of neurons at an extremely fast rate over a large volume. State-of-the-art multiphoton holographic optogenetics requires high-power illumination that only addresses relatively small populations of neurons in parallel. Conversely, one-photon holographic techniques can stimulate more neurons with two to three orders lower power, but with limited resolution or addressable volume. Perhaps most problematically, two-photon holographic optogenetic systems are extremely expensive and sophisticated which has precluded their broader adoption in the neuroscience community. To address this technical gap, we introduce a new one-photon light sculpting technique, three-dimensional multi-site random access photostimulation (3D-MAP), that overcomes these limitations by modulating light dynamically, both in the spatial and in the angular domain at multi-kHz rates. We use 3D-MAP to interrogate neural circuits in 3D and demonstrate simultaneous photostimulation and imaging of dozens of user-selected neurons in the intact mouse brain in vivo with high spatio-temporal resolution. 3D-MAP can be broadly adopted for high-throughput all-optical interrogation of brain circuits owing to its powerful combination of scale, speed, simplicity, and cost.

In higher mammals, thalamic afferents to primary visual cortex (area V1) segregate according to their responses to increases (ON) or decreases (OFF) in luminance. This organization induces columnar, ON/OFF domains postulated to provide a scaffold for the emergence of orientation tuning. To further test this idea, we asked whether ON/OFF domains exist in mouse V1. Here we show that mouse V1 is indeed parceled into ON/OFF domains. Interestingly, fluctuations in the relative density of ON/OFF neurons on the cortical surface mirror fluctuations in the relative density of ON/OFF receptive field centers on the visual field. Moreover, the local diversity of cortical receptive fields is explained by a model in which neurons linearly combine a small number of ON and OFF signals available in their cortical neighborhoods. These findings suggest that ON/OFF domains originate in fluctuations of the balance between ON/OFF responses across the visual field which, in turn, shapes the structure of cortical receptive fields.

Microglia contain multiple mechanisms that shape the synaptic landscape during postnatal development. Whether the synaptic changes mediated by microglia reflect the developmental refinement of neuronal responses in sensory cortices, however, remains poorly understood. In postnatal life, the development of increased orientation and spatial frequency selectivity of neuronal responses in primary visual cortex (V1) supports the emergence of high visual acuity. Here, we used the colony-stimulating factor 1 receptor (CSF1R) inhibitor PLX5622 to rapidly and durably deplete microglia in mice during the juvenile period in which increased orientation and spatial frequency selectivity emerge. Excitatory and inhibitory tuning properties were measured simultaneously using multi-photon calcium imaging in layer II/III of mouse V1. We found that microglia depletion generally increased evoked activity which, in turn, reduced orientation selectivity. Surprisingly, microglia were not required for the emergence of high spatial frequency tuned responses. In addition, microglia depletion did not perturb cortical binocularity, suggesting normal depth processing. Together, our finding that orientation and high spatial frequency selectivity in V1 are differentially supported by microglia reveal that microglia are required normal sensory processing, albeit selectively.

Sensory information from different modalities is processed in parallel, and then integrated in associative brain areas to improve object identification and the interpretation of sensory experiences. The Superior Colliculus (SC) is a midbrain structure that plays a critical role in integrating visual, auditory, and somatosensory input to assess saliency and promote action. Although the response properties of the individual SC neurons to visuoauditory stimuli have been characterized, little is known about the spatial and temporal dynamics of the integration at the population level. Here we recorded the response properties of SC neurons to spatially restricted visual and auditory stimuli using large-scale electrophysiology. We then created a general, population-level model that explains the spatial, temporal, and intensity requirements of stimuli needed for sensory integration. We found that the mouse SC contains topographically organized visual and auditory neurons that exhibit nonlinear multisensory integration. We show that nonlinear integration depends on properties of auditory but not visual stimuli. We also find that a heuristically derived nonlinear modulation function reveals conditions required for sensory integration that are consistent with previously proposed models of sensory integration such as spatial matching and the principle of inverse effectiveness.

Humans have an impressive ability to rapidly process global information in natural scenes to infer their category. Yet, it remains unclear whether and how scene categories observed dynamically in the natural world are represented in cerebral cortex beyond few canonical scene-selective areas. To address this question, here we examined the representation of dynamic visual scenes by recording whole-brain blood oxygenation level-dependent (BOLD) responses while subjects viewed natural movies. We fit voxelwise encoding models to estimate tuning for scene categories that reflect statistical ensembles of objects and actions in the natural world. We find that this scene-category model explains a significant portion of the response variance broadly across cerebral cortex. Cluster analysis of scene-category tuning profiles across cortex reveals nine spatially-segregated networks of brain regions consistently across subjects. These networks show heterogeneous tuning for a diverse set of dynamic scene categories related to navigation, human activity, social interaction, civilization, natural environment, non-human animals, motion-energy, and texture, suggesting that the organization of scene category representation is quite complex.

Optogenetics ushered in a revolution in how neuroscientists interrogate brain function. Because of technical limitations, the majority of optogenetic studies have used low spatial resolution activation schemes that limit the types of perturbations that can be made. However, neural activity manipulations at finer spatial scales are likely to be important to more fully understand neural computation. Spatially precise multiphoton holographic optogenetics promises to address this challenge and opens up many new classes of experiments that were not previously possible. More specifically, by offering the ability to recreate extremely specific neural activity patterns in both space and time in functionally defined ensembles of neurons, multiphoton holographic optogenetics could allow neuroscientists to reveal fundamental aspects of the neural codes for sensation, cognition and behavior that have been beyond reach. This Review summarizes recent advances in multiphoton holographic optogenetics that substantially expand its capabilities, highlights outstanding technical challenges and provides an overview of the classes of experiments it can execute to test and validate key theoretical models of brain function. Multiphoton holographic optogenetics could substantially accelerate the pace of neuroscience discovery by helping to close the loop between experimental and theoretical neuroscience, leading to fundamental new insights into nervous system function and disorder.

Depth perception emerges from the development of binocular neurons in primary visual cortex. Vision is required for these neurons to acquire their mature responses to visual stimuli. The prevailing view is that vision does not influence binocular circuitry until the onset of the critical period, about a week after eye opening, and that plasticity of visual responses is triggered by increased inhibition. Here, we show that vision is required to form binocular neurons and to improve binocular tuning and matching from eye opening until critical period closure. Enhancing inhibition does not accelerate this process. Vision soon after eye opening improves the tuning properties of binocular neurons by strengthening and sharpening ipsilateral eye cortical responses. This progressively changes the population of neurons in the binocular pool, and this plasticity is sensitive to interocular differences prior to critical period onset. Thus, vision establishes binocular circuitry and guides binocular plasticity from eye opening.

Cone photoreceptors provide the foundation of most of human visual experience, but because they are smaller and less numerous than rods in most mammalian retinas, much less is known about their physiology. We describe new techniques and approaches which are helping to provide a better understanding of cone function. We focus on several outstanding issues, including the identification of the features of the phototransduction cascade that are responsible for the more rapid kinetics and decreased sensitivity of the cone response, the roles of inner-segment voltage-gated and Ca2+-activated channels, the means by which cones remain responsive even in the brightest illumination, mechanisms of cone visual pigment regeneration in constant light, and energy consumption of cones in comparison to that of rods.

Studying states and state transitions in the brain is challenging due to nonlinear, complex dynamics. In this research, we analyze the brain's response to non-invasive perturbations. Perturbation techniques offer a powerful method for studying complex dynamics, though their translation to human brain data is under-explored. This method involves applying small inputs, in this case via photic stimulation, to a system and measuring its response. Sensitivity to perturbations can forewarn a state transition. Therefore, biomarkers of the brain's perturbation response or “cortical excitability” could be used to indicate seizure transitions. However, perturbing the brain often involves invasive intracranial surgeries or expensive equipment such as transcranial magnetic stimulation (TMS) which is only accessible to a minority of patient groups, or animal model studies. Photic stimulation is a widely used diagnostic technique in epilepsy that can be used as a non-invasive perturbation paradigm to probe brain dynamics during routine electroencephalography (EEG) studies in humans. This involves changing the frequency of strobing light, sometimes triggering a photo-paroxysmal response (PPR), which is an electrographic event that can be studied as a state transition to a seizure state. We investigate alterations in the response to these perturbations in patients with genetic generalized epilepsy (GGE), with (n = 10) and without (n = 10) PPR, and patients with psychogenic non-epileptic seizures (PNES; n = 10), compared to resting controls (n = 10). Metrics of EEG time-series data were evaluated as biomarkers of the perturbation response including variance, autocorrelation, and phase-based synchrony measures. We observed considerable differences in all group biomarker distributions during stimulation compared to controls. In particular, variance and autocorrelation demonstrated greater changes in epochs close to PPR transitions compared to earlier stimulation epochs. Comparison of PPR and spontaneous seizure morphology found them indistinguishable, suggesting PPR is a valid proxy for seizure dynamics. Also, as expected, posterior channels demonstrated the greatest change in synchrony measures, possibly reflecting underlying PPR pathophysiologic mechanisms. We clearly demonstrate observable changes at a group level in cortical excitability in epilepsy patients as a response to perturbation in EEG data. Our work re-frames photic stimulation as a non-invasive perturbation paradigm capable of inducing measurable changes to brain dynamics.

The mouse, as a model organism to study the brain, gives us unprecedented experimental access to the mammalian cerebral cortex. By determining the cortex's cellular composition, revealing the interaction between its different components, and systematically perturbing these components, we are obtaining mechanistic insight into some of the most basic properties of cortical function. In this review, we describe recent advances in our understanding of how circuits of cortical neurons implement computations, as revealed by the study of mouse primary visual cortex. Further, we discuss how studying the mouse has broadened our understanding of the range of computations performed by visual cortex. Finally, we address how future approaches will fulfill the promise of the mouse in elucidating fundamental operations of cortex.

Participants with autism spectrum disorder (ASD) (n = 121, mean [SD] age: 14.6 [8.0] years) and typically developing (TD) controls (n = 40, 16.4 [13.3] years) were presented with a series of videos representing biological motion on one side of a computer monitor screen and non-biological motion on the other, while their eye movements were recorded. As predicted, participants with ASD spent less overall time looking at presented stimuli than TD participants (P

CB-5083 is an inhibitor of p97/valosin-containing protein (VCP), for which phase I trials for cancer were terminated because of adverse effects on vision, such as photophobia and dyschromatopsia. Lower dose CB-5083 could combat inclusion body myopathy with early-onset Paget disease and frontotemporal dementia or multisystem proteinopathy caused by gain-of-function mutations in VCP. We hypothesized that the visual impairment in the cancer trial was due to CB-5083's inhibition of phosphodiesterase (PDE)-6, which mediates signal transduction in photoreceptors. To test our hypothesis, we used in vivo and ex vivo electroretinography (ERG) in mice and a PDE6 activity assay of bovine rod outer segment (ROS) extracts. Additionally, histology and optical coherence tomography were used to assess CB-5083's long-term ocular toxicity. A single administration of CB-5083 led to robust ERG signal deterioration, specifically in photoresponse kinetics. Similar recordings with known PDE inhibitors sildenafil, tadalafil, vardenafil, and zaprinast showed that only vardenafil had as strong an effect on the ERG signal in vivo as did CB-5083. In the biochemical assay, CB-5083 inhibited PDE6 activity with a potency higher than sildenafil but lower than that of vardenafil. Ex vivo ERG revealed a PDE6 inhibition constant of 80 nM for CB-5083, which is 7-fold smaller than that for sildenafil. Finally, we showed that the inhibitory effect of CB-5083 on visual function is reversible, and its chronic administration does not cause permanent retinal anomalies in aged VCP-disease model mice. Our results warrant re-evaluation of CB-5083 as a clinical therapeutic agent. We recommend preclinical ERG recordings as a routine drug safety screen. SIGNIFICANCE STATEMENT: This report supports the use of a valosin-containing protein (VCP) inhibitor drug, CB-5083, for the treatment of neuromuscular VCP disease despite CB-5083's initial clinical failure for cancer treatment due to side effects on vision. The data show that CB-5083 displays a dose-dependent but reversible inhibitory action on phosphodiesterase-6, an essential enzyme in retinal photoreceptor function, but no long-term consequences on retinal function or structure.

Loneliness and wisdom have opposing impacts on health and well-being, yet their neuro-cognitive bases have never been simultaneously investigated. In this study of 147 healthy human subjects sampled across the adult lifespan, we simultaneously studied the cognitive and neural correlates of loneliness and wisdom in the context of an emotion bias task. Aligned with the social threat framework of loneliness, we found that loneliness was associated with reduced speed of processing when angry emotional stimuli were presented to bias cognition. In contrast, we found that wisdom was associated with greater speed of processing when happy emotions biased cognition. Source models of electroencephalographic data showed that loneliness was specifically associated with enhanced angry stimulus-driven theta activity in the left transverse temporal region of interest, which is located in the area of the temporoparietal junction (TPJ), while wisdom was specifically related to increased TPJ theta activity during happy stimulus processing. Additionally, enhanced attentiveness to threatening stimuli for lonelier individuals was observed as greater beta activity in left superior parietal cortex, while wisdom significantly related to enhanced happy stimulus-evoked alpha activity in the left insula. Our results demonstrate emotion-context driven modulations in cognitive neural circuits by loneliness versus wisdom.

Neurons have recently emerged as essential cellular constituents of the tumour microenvironment, and their activity has been shown to increase the growth of a diverse number of solid tumours1. Although the role of neurons in tumour progression has previously been demonstrated2, the importance of neuronal activity to tumour initiation is less clear-particularly in the setting of cancer predisposition syndromes. Fifteen per cent of individuals with the neurofibromatosis 1 (NF1) cancer predisposition syndrome (in which tumours arise in close association with nerves) develop low-grade neoplasms of the optic pathway (known as optic pathway gliomas (OPGs)) during early childhood3,4, raising  the possibility that postnatal light-induced activity of the optic nerve drives tumour initiation. Here we use an authenticated mouse model of OPG driven by mutations in the neurofibromatosis 1 tumour suppressor gene (Nf1)5 to demonstrate that stimulation of optic nerve activity increases optic glioma growth, and that decreasing visual experience via light deprivation prevents tumour formation and maintenance. We show that the initiation of Nf1-driven OPGs (Nf1-OPGs) depends on visual experience during a developmental period in which Nf1-mutant mice are susceptible to tumorigenesis. Germline Nf1 mutation in retinal neurons results in aberrantly increased shedding of neuroligin 3 (NLGN3) within the optic nerve in response to retinal neuronal activity. Moreover, genetic Nlgn3 loss or pharmacological inhibition of NLGN3 shedding blocks the formation and progression of Nf1-OPGs. Collectively, our studies establish an obligate role for neuronal activity in the development of some types of brain tumours, elucidate a therapeutic strategy to reduce OPG incidence or mitigate tumour progression, and underscore the role of Nf1mutation-mediated dysregulation of neuronal signalling pathways in mouse models of the NF1 cancer predisposition syndrome.

Learning about temporal structure is adaptive because it enables the generation of expectations. We examined how the brain uses experience in structured environments to anticipate upcoming events. During fMRI (functional magnetic resonance imaging), individuals watched a 90 s movie clip six times. Using a hidden Markov model applied to searchlights across the whole brain, we identified temporal shifts between activity patterns evoked by the first vs. repeated viewings of the movie clip. In many regions throughout the cortex, neural activity patterns for repeated viewings shifted to precede those of initial viewing by up to 15 s. This anticipation varied hierarchically in a posterior (less anticipation) to anterior (more anticipation) fashion. We also identified specific regions in which the timing of the brain's event boundaries was related to those of human-labeled event boundaries, with the timing of this relationship shifting on repeated viewings. With repeated viewing, the brain's event boundaries came to precede human-annotated boundaries by 1-4 s on average. Together, these results demonstrate a hierarchy of anticipatory signals in the human brain and link them to subjective experiences of events.

Feature-based attention is the ability to selectively attend to a particular feature (e.g., attend to red but not green items while looking for the ketchup bottle in your refrigerator), and steady-state visually evoked potentials (SSVEPs) measured from the human EEG signal have been used to track the neural deployment of feature-based attention. Although many published studies suggest that we can use trial-by-trial cues to enhance relevant feature information (i.e., greater SSVEP response to the cued color), there is ongoing debate about whether participants may likewise use trial-by-trial cues to voluntarily ignore a particular feature. Here, we report the results of a preregistered study in which participants either were cued to attend or to ignore a color. Counter to prior work, we found no attention-related modulation of the SSVEP response in either cue condition. However, positive control analyses revealed that participants paid some degree of attention to the cued color (i.e., we observed a greater P300 component to targets in the attended vs. the unattended color). In light of these unexpected null results, we conducted a focused review of methodological considerations for studies of feature-based attention using SSVEPs. In the review, we quantify potentially important stimulus parameters that have been used in the past (e.g., stimulation frequency, trial counts) and we discuss the potential importance of these and other task factors (e.g., feature-based priming) for SSVEP studies.

The current study evaluated retinal function using electroretinography (ERG) in cognitively healthy (CH) participants with preclinical Alzheimers disease (AD), as classified by cerebral spinal fluid (CSF) Aβ42/Tau ratio. Individuals with normal retinal morphology ascertained by spectral-domain optical coherence tomography were enrolled. Full-field ERG, pattern PERG, and photopic negative response (PhNR) were performed in 29 adult participants (58 eyes). Amplitude and implicit times of the ERG wave components were analyzed. Preclinical AD participants showed marked retinal ganglion cell dysfunction relative to controls. The PhNR was significantly diminished in preclinical AD relative to controls. PhNR amplitude and N95 implicit time differentiated CH individuals with CSF biomarkers of AD pathology with 87% sensitivity and 82% specificity. These quantitative electrophysiologic findings expand our understanding of early retinal functional changes that precede cognitive decline in AD. Retinal ganglion cell dysfunction, as detected by ERG, may be a clinically useful, non-invasive in vivo biomarker for early disease detection, which is necessary for ultimately pursuing early intervention.

How do children allocate their attention? There is too much information in the world to encode it all, so children must pick and choose. How do they organize their sampling to make the most of the learning opportunities that surround them? Previous work shows infants actively seek intermediately predictable information. Here we employ eye-tracking and computational modeling to examine the impact of stimulus predictability across early childhood (ages 3-6 years, n = 72, predominantly Non-Hispanic White, middle- to upper-middle-income), by chronological age and cognitive ability. Results indicated that children prefer attending to stimuli of intermediate predictability, with no differences in this pattern based on age or cognitive ability. The consistency may suggest a robust general information-processing mechanism that operates across the lifespan.

Covert spatial attention has a variety of effects on the responses of individual neurons. However, relatively little is known about the net effect of these changes on sensory population codes, even though perception ultimately depends on population activity. Here, we measured the EEG in human observers (male and female), and isolated stimulus-evoked activity that was phase-locked to the onset of attended and ignored visual stimuli. Using an encoding model, we reconstructed spatially selective population tuning functions from the pattern of stimulus-evoked activity across the scalp. Our EEG-based approach allowed us to measure very early visually evoked responses occurring ∼100 ms after stimulus onset. In Experiment 1, we found that covert attention increased the amplitude of spatially tuned population responses at this early stage of sensory processing. In Experiment 2, we parametrically varied stimulus contrast to test how this effect scaled with stimulus contrast. We found that the effect of attention on the amplitude of spatially tuned responses increased with stimulus contrast, and was well described by an increase in response gain (i.e., a multiplicative scaling of the population response). Together, our results show that attention increases the gain of spatial population codes during the first wave of visual processing.SIGNIFICANCE STATEMENT We know relatively little about how attention improves population codes, even though perception is thought to critically depend on population activity. In this study, we used an encoding-model approach to test how attention modulates the spatial tuning of stimulus-evoked population responses measured with EEG. We found that attention multiplicatively scales the amplitude of spatially tuned population responses. Furthermore, this effect was present within 100 ms of stimulus onset. Thus, our results show that attention improves spatial population codes by increasing their gain at this early stage of processing.

The mammalian visual cortex contains multiple retinotopically defined areas that process distinct features of the visual scene. Little is known about what guides the functional differentiation of visual cortical areas during development. Recent studies in mice have revealed that visual input from the two eyes provides spatiotemporally distinct signals to primary visual cortex (V1), such that contralateral eye-dominated V1 neurons respond to higher spatial frequencies than ipsilateral eye-dominated neurons. To test whether binocular visual input drives the differentiation of visual cortical areas, we used two-photon calcium imaging to characterize the effects of juvenile monocular deprivation (MD) on the responses of neurons in V1 and two higher visual areas, LM (lateromedial) and PM (posteromedial). In adult mice of either sex, we find that MD prevents the emergence of distinct spatiotemporal tuning in V1, LM, and PM. We also find that, within each of these areas, MD reorganizes the distinct spatiotemporal tuning properties driven by the two eyes. Moreover, we find a relationship between speed tuning and ocular dominance in all three areas that MD preferentially disrupts in V1, but not in LM or PM. Together, these results reveal that balanced binocular vision during development is essential for driving the functional differentiation of visual cortical areas. The higher visual areas of mouse visual cortex may provide a useful platform for investigating the experience-dependent mechanisms that set up the specialized processing within neocortical areas during postnatal development.SIGNIFICANCE STATEMENT Little is known about the factors guiding the emergence of functionally distinct areas in the brain. Using in vivo Ca2+ imaging, we recorded visually evoked activity from cells in V1 and higher visual areas LM (lateromedial) and PM (posteromedial) of mice. Neurons in these areas normally display distinct spatiotemporal tuning properties. We found that depriving one eye of normal input during development prevents the functional differentiation of visual areas. Deprivation did not disrupt the degree of speed tuning, a property thought to emerge in higher visual areas. Thus, some properties of visual cortical neurons are shaped by binocular experience, while others are resistant. Our study uncovers the fundamental role of binocular experience in the formation of distinct areas in visual cortex.

Microglia have crucial roles in sculpting synapses and maintaining neural circuits during development. To test the hypothesis that microglia continue to regulate neural circuit connectivity in adult brain, we have investigated the effects of chronic microglial depletion, via CSF1R inhibition, on synaptic connectivity in the visual cortex in adult mice of both sexes. We find that the absence of microglia dramatically increases both excitatory and inhibitory synaptic connections to excitatory cortical neurons assessed with functional circuit mapping experiments in acutely prepared adult brain slices. Microglia depletion leads to increased densities and intensities of perineuronal nets. Furthermore, in vivo calcium imaging across large populations of visual cortical neurons reveals enhanced neural activities of both excitatory neurons and parvalbumin-expressing interneurons in the visual cortex following microglia depletion. These changes recover following adult microglia repopulation. In summary, our new results demonstrate a prominent role of microglia in sculpting neuronal circuit connectivity and regulating subsequent functional activity in adult cortex.SIGNIFICANCE STATEMENT Microglia are the primary immune cell of the brain, but recent evidence supports that microglia play an important role in synaptic sculpting during development. However, it remains unknown whether and how microglia regulate synaptic connectivity in adult brain. Our present work shows chronic microglia depletion in adult visual cortex induces robust increases in perineuronal nets, and enhances local excitatory and inhibitory circuit connectivity to excitatory neurons. Microglia depletion increases in vivo neural activities of both excitatory neurons and parvalbumin inhibitory neurons. Our new results reveal new potential avenues to modulate adult neural plasticity by microglia manipulation to better treat brain disorders, such as Alzheimer's disease.

Retinal ganglion cells (RGCs) form an array of feature detectors, which convey visual information to central brain regions. Characterizing RGC diversity is required to understand the logic of the underlying functional segregation. Using single-cell transcriptomics, we systematically classified RGCs in adult and larval zebrafish, thereby identifying marker genes for >30 mature types and several developmental intermediates. We used this dataset to engineer transgenic driver lines, enabling specific experimental access to a subset of RGC types. Expression of one or few transcription factors often predicts dendrite morphologies and axonal projections to specific tectal layers and extratectal targets. In vivo calcium imaging revealed that molecularly defined RGCs exhibit specific functional tuning. Finally, chemogenetic ablation of eomesa+ RGCs, which comprise melanopsin-expressing types with projections to a small subset of central targets, selectively impaired phototaxis. Together, our study establishes a framework for systematically studying the functional architecture of the visual system.

Escape from threats has paramount importance for survival. However, it is unknown if a single circuit controls escape vigor from innate and conditioned threats. Cholecystokinin (cck)-expressing cells in the hypothalamic dorsal premammillary nucleus (PMd) are necessary for initiating escape from innate threats via a projection to the dorsolateral periaqueductal gray (dlPAG). We now show that in mice PMd-cck cells are activated during escape, but not other defensive behaviors. PMd-cck ensemble activity can also predict future escape. Furthermore, PMd inhibition decreases escape speed from both innate and conditioned threats. Inhibition of the PMd-cck projection to the dlPAG also decreased escape speed. Intriguingly, PMd-cck and dlPAG activity in mice showed higher mutual information during exposure to innate and conditioned threats. In parallel, human functional magnetic resonance imaging data show that a posterior hypothalamic-to-dlPAG pathway increased activity during exposure to aversive images, indicating that a similar pathway may possibly have a related role in humans. Our data identify the PMd-dlPAG circuit as a central node, controlling escape vigor elicited by both innate and conditioned threats.

To produce consistent sensory perception, neurons must maintain stable representations of sensory input. However, neurons in many regions exhibit progressive drift across days. Longitudinal studies have found stable responses to artificial stimuli across sessions in visual areas, but it is unclear whether this stability extends to naturalistic stimuli. We performed chronic 2-photon imaging of mouse V1 populations to directly compare the representational stability of artificial versus naturalistic visual stimuli over weeks. Responses to gratings were highly stable across sessions. However, neural responses to naturalistic movies exhibited progressive representational drift across sessions. Differential drift was present across cortical layers, in inhibitory interneurons, and could not be explained by differential response strength or higher order stimulus statistics. However, representational drift was accompanied by similar differential changes in local population correlation structure. These results suggest representational stability in V1 is stimulus-dependent and may relate to differences in preexisting circuit architecture of co-tuned neurons.

Visual cortical responses are known to be highly variable across trials within an experimental session. However, the long-term stability of visual cortical responses is poorly understood. Here using chronic imaging of V1 in mice we show that neural responses to repeated natural movie clips are unstable across weeks. Individual neuronal responses consist of sparse episodic activity which are stable in time but unstable in gain across weeks. Further, we find that the individual episode, instead of neuron, serves as the basic unit of the week-to-week fluctuation. To investigate how population activity encodes the stimulus, we extract a stable one-dimensional representation of the time in the natural movie, using an unsupervised method. Most week-to-week fluctuation is perpendicular to the stimulus encoding direction, thus leaving the stimulus representation largely unaffected. We propose that precise episodic activity with coordinated gain changes are keys to maintain a stable stimulus representation in V1.

Progress in science requires standardized assays whose results can be readily shared, compared, and reproduced across laboratories. Reproducibility, however, has been a concern in neuroscience, particularly for measurements of mouse behavior. Here, we show that a standardized task to probe decision-making in mice produces reproducible results across multiple laboratories. We adopted a task for head-fixed mice that assays perceptual and value-based decision making, and we standardized training protocol and experimental hardware, software, and procedures. We trained 140 mice across seven laboratories in three countries, and we collected 5 million mouse choices into a publicly available database. Learning speed was variable across mice and laboratories, but once training was complete there were no significant differences in behavior across laboratories. Mice in different laboratories adopted similar reliance on visual stimuli, on past successes and failures, and on estimates of stimulus prior probability to guide their choices. These results reveal that a complex mouse behavior can be reproduced across multiple laboratories. They establish a standard for reproducible rodent behavior, and provide an unprecedented dataset and open-access tools to study decision-making in mice. More generally, they indicate a path toward achieving reproducibility in neuroscience through collaborative open-science approaches.

Retinal rod and cone photoreceptors mediate vision in dim and bright light, respectively, by transducing absorbed photons into neural electrical signals. Their phototransduction mechanisms are essentially identical. However, one difference is that, whereas a rod visual pigment remains stable in darkness, a cone pigment has some tendency to dissociate spontaneously into apo-opsin and retinal (the chromophore) without isomerization. This cone-pigment property is long known but has mostly been overlooked. Importantly, because apo-opsin has weak constitutive activity, it triggers transduction to produce electrical noise even in darkness. Currently, the precise dark apo-opsin contents across cone subtypes are mostly unknown, as are their dark activities. We report here a study of goldfish red (L), green (M), and blue (S) cones, finding with microspectrophotometry widely different apo-opsin percentages in darkness, being ∼30% in L cones, ∼3% in M cones, and negligible in S cones. L and M cones also had higher dark apo-opsin noise than holo-pigment thermal isomerization activity. As such, given the most likely low signal amplification at the pigment-to-transducin/phosphodiesterase phototransduction step, especially in L cones, apo-opsin noise may not be easily distinguishable from light responses and thus may affect cone vision near threshold.

Myopia is induced when a growing eye wears a diffuser that deprives it of detailed spatial vision (form deprivation, FD). In chickens with optic nerve section (ONS), FD myopia still occurs, suggesting that the signals underlying myopia reside within the eye. As avian eyes differ from mammals, we asked whether local mechanisms also underlie FD myopia in a mammalian model. Young guinea pigs underwent either sham surgery followed by FD (SHAM + FD, n = 7); or ONS followed by FD (ONS + FD, n = 7); or ONS without FD (ONS, n = 9). FD was initiated 3 days after surgery with a diffuser that was worn on the surgically treated eye for 14 days. Animals with ONS + FD developed -8.9 D of relative myopia and elongated by 135 μm more than in their untreated eyes after 2 weeks of FD. These changes were significantly greater than those in SHAM + FD animals (-5.5 D and 40 μm of elongation after 14 days of FD), and reflected exaggerated elongation of the posterior vitreous chamber. The myopia reversed when FD was discontinued, despite ONS, but eyes did not recover back to normal (30 days after surgery, ONS + FD eyes still retained -3 D of relative myopia when SHAM+FD animals had returned to normal). No long-term residual myopia was present after ONS alone, ruling out a surgical artifact. Although the gross mechanism signaling myopic ocular growth and its recovery in the young mammalian eye does not require an intact optic nerve, its fine-tuning is disrupted by ONS.

BackgroundReduction or differences in facial expression are a core diagnostic feature of autism spectrum disorder (ASD), yet evidence regarding the extent of this discrepancy is limited and inconsistent. Use of automated facial expression detection technology enables accurate and efficient tracking of facial expressions that has potential to identify individual response differences.MethodsChildren and adults with ASD (N = 124) and typically developing (TD, N = 41) were shown short clips of "funny videos." Using automated facial analysis software, we investigated differences between ASD and TD groups and within the ASD group in evidence of facial action unit (AU) activation related to the expression of positive facial expression, in particular, a smile.ResultsIndividuals with ASD on average showed less evidence of facial AUs (AU12, AU6) relating to positive facial expression, compared to the TD group (p < .05, r = - 0.17). Using Gaussian mixture model for clustering, we identified two distinct distributions within the ASD group, which were then compared to the TD group. One subgroup (n = 35), termed "over-responsive," expressed more intense positive facial expressions in response to the videos than the TD group (p < .001, r = 0.31). The second subgroup (n = 89), ("under-responsive"), displayed fewer, less intense positive facial expressions in response to videos than the TD group (p < .001; r = - 0.36). The over-responsive subgroup differed from the under-responsive subgroup in age and caregiver-reported impulsivity (p < .05, r = 0.21). Reduced expression in the under-responsive, but not the over-responsive group, was related to caregiver-reported social withdrawal (p < .01, r = - 0.3).LimitationsThis exploratory study does not account for multiple comparisons, and future work will have to ascertain the strength and reproducibility of all results. Reduced displays of positive facial expressions do not mean individuals with ASD do not experience positive emotions.ConclusionsIndividuals with ASD differed from the TD group in their facial expressions of positive emotion in response to "funny videos." Identification of subgroups based on response may help in parsing heterogeneity in ASD and enable targeting of treatment based on subtypes.Trial registrationClinicalTrials.gov, NCT02299700. Registration date: November 24, 2014.

Context guides perception by influencing stimulus saliency. Accordingly, in visual cortex, responses to a stimulus are modulated by context, the visual scene surrounding the stimulus. Responses are suppressed when stimulus and surround are similar but not when they differ. The underlying mechanisms remain unclear. Here, we use optical recordings, manipulations, and computational modeling to show that disinhibitory circuits consisting of vasoactive intestinal peptide (VIP)-expressing and somatostatin (SOM)-expressing inhibitory neurons modulate responses in mouse visual cortex depending on similarity between stimulus and surround, primarily by modulating recurrent excitation. When stimulus and surround are similar, VIP neurons are inactive, and activity of SOM neurons leads to suppression of excitatory neurons. However, when stimulus and surround differ, VIP neurons are active, inhibiting SOM neurons, which leads to relief of excitatory neurons from suppression. We have identified a canonical cortical disinhibitory circuit that contributes to contextual modulation and may regulate perceptual saliency.

BackgroundDiminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator ("biomarker") of ASD. We investigated differences in visual attention during activity monitoring in children and adult participants with autism compared to a control group of participants without autism.MethodsEye movements of participants with autism (n = 122; mean age [SD] = 14.5 [8.0] years) and typically developing (TD) controls (n = 40, age = 16.4 [13.3] years) were recorded while they viewed a series of videos depicting two female actors conversing while interacting with their hands over a shared task. Actors either continuously focused their gaze on each other's face (mutual gaze) or on the shared activity area (shared focus). Mean percentage looking time was computed for the activity area, actors' heads, and their bodies.ResultsCompared to TD participants, participants with ASD looked longer at the activity area (mean % looking time: 58.5% vs. 53.8%, p  60] limited the ability to include individuals with substantial intellectual disability.ConclusionsDifferences in attention to faces could constitute a feature discriminative between individuals with and without ASD across the lifespan, whereas between-group differences in looking at activities may shift with development. These findings may have applications in the search for underlying biological indicators specific to ASD. Trial registration ClinicalTrials.gov identifier NCT02668991.

Both experimenter-controlled stimuli and stimulus-independent variables impact cortical neural activity. A major hurdle to understanding neural representation is distinguishing between qualitatively different causes of the fluctuating population activity. We applied an unsupervised low-rank tensor decomposition analysis to the recorded population activity in the visual cortex of awake mice in response to repeated presentations of naturalistic visual stimuli. We found that neurons covaried largely independently of individual neuron stimulus response reliability and thus encoded both stimulus-driven and stimulus-independent variables. Importantly, a neuron's response reliability and the neuronal coactivation patterns substantially reorganized for different external visual inputs. Analysis of recurrent balanced neural network models revealed that both the stimulus specificity and the mixed encoding of qualitatively different variables can arise from clustered external inputs. These results establish that coactive neurons with diverse response reliability mediate a mixed representation of stimulus-driven and stimulus-independent variables in the visual cortex.NEW & NOTEWORTHY V1 neurons covary largely independently of individual neuron's response reliability. A single neuron's response reliability imposes only a weak constraint on its encoding capabilities. Visual stimulus instructs a neuron's reliability and coactivation pattern. Network models revealed using clustered external inputs.

The vestibular system broadcasts head-movement-related signals to sensory areas throughout the brain, including visual cortex. These signals are crucial for the brain's ability to assess whether motion of the visual scene results from the animal's head movements. However, how head movements affect visual cortical circuits remains poorly understood. Here, we discover that ambient luminance profoundly transforms how mouse primary visual cortex (V1) processes head movements. While in darkness, head movements result in overall suppression of neuronal activity; in ambient light, the same head movements trigger excitation across all cortical layers. This light-dependent switch in how V1 processes head movements is controlled by somatostatin-expressing (SOM) inhibitory neurons, which are excited by head movements in dark, but not in light. This study thus reveals a light-dependent switch in the response of V1 to head movements and identifies a circuit in which SOM cells are key integrators of vestibular and luminance signals.

The memories we form are determined by what we attend to, and conversely, what we attend to is influenced by our memory for past experiences. Although we know that shifts of attention via eye movements are related to memory during encoding and retrieval, the role of specific memory processes in this relationship is unclear. There is evidence that attention may be especially important for some forms of memory (i.e., conscious recollection), and less so for others (i.e., familiarity-based recognition and unconscious influences of memory), but results are conflicting with respect to both the memory processes and eye movement patterns involved. To address this, we used a confidence-based method of isolating eye movement indices of spatial attention that are related to different memory processes (i.e., recollection, familiarity strength, and unconscious memory) during encoding and retrieval of real-world scenes. We also developed a new method of measuring the dispersion of eye movements, which proved to be more sensitive to memory processing than previously used measures. Specifically, in 2 studies, we found that familiarity strength-that is, changes in subjective reports of memory confidence-increased with (a) more dispersed patterns of viewing during encoding, (b) less dispersed viewing during retrieval, and (c) greater overlap in regions viewed between encoding and retrieval (i.e., resampling). Recollection was also related to these eye movements in a similar manner, though the associations with recollection were less consistent across experiments. Furthermore, we found no evidence for effects related to unconscious influences of memory. These findings indicate that attentional processes during viewing may not preferentially relate to recollection, and that the spatial distribution of eye movements is directly related to familiarity-based memory during encoding and retrieval. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Processing of low-level visual information shows robust developmental gains through childhood and adolescence. However, it is unknown whether low-level visual processing in the occipital cortex supports age-related gains in memory for complex visual stimuli. Here, we examined occipital alpha activity during visual scene encoding in 24 children and adolescents, aged 6.2-20.5 years, who performed a subsequent memory task while undergoing electrocorticographic recording. Scenes were classified as high- or low-complexity by the number of unique object categories depicted. We found that recognition of high-complexity, but not low-complexity, scenes increased with age. Age was associated with decreased alpha power and increased instantaneous alpha frequency during the encoding of subsequently recognized high- compared to low-complexity scenes. Critically, decreased alpha power predicted improved recognition of high-complexity scenes in adolescents. These findings demonstrate how the functional maturation of the occipital cortex supports the development of memory for complex visual scenes.

Studies have revealed that rewards promote long-term memory, even in an incidental way. However, most previous studies using the incidental paradigm have included two reward levels, and it is still not clear how the reward magnitude influences memory. Adopting the incidental paradigm and three reward levels, the current study revealed that the reward magnitude impacted 1-d delayed episodic memory in a nonlinear, inverted U-shaped pattern. An additional experiment showed that there was no reward effect in immediate episodic memory. Our results support the dopaminergic memory consolidation theory and further imply that the reward magnitude needs to be considered in the theory.

High acuity stereopsis emerges during an early postnatal critical period when binocular neurons in the primary visual cortex sharpen their receptive field tuning properties. We find that this sharpening is achieved by dismantling the binocular circuit present at critical period onset and building it anew. Longitudinal imaging of receptive field tuning (e.g., orientation selectivity) of thousands of neurons reveals that most binocular neurons present in layer 2/3 at critical period onset are poorly tuned and are rendered monocular. In parallel, new binocular neurons are established by conversion of well-tuned monocular neurons as they gain matched input from the other eye. These improvements in binocular tuning in layer 2/3 are not inherited from layer 4 but are driven by the experience-dependent sharpening of ipsilateral eye responses. Thus, vision builds a new and more sharply tuned binocular circuit in layer 2/3 by cellular exchange and not by refining the original circuit.

When extreme, anxiety-a state of distress and arousal prototypically evoked by uncertain danger-can be debilitating. Uncertain anticipation is a shared feature of situations that elicit signs and symptoms of anxiety across psychiatric disorders, species, and assays. Despite the profound significance of anxiety for human health and wellbeing, the neurobiology of uncertain-threat anticipation remains unsettled. Leveraging a paradigm adapted from animal research and optimized for fMRI signal decomposition, we examined the neural circuits engaged during the anticipation of temporally uncertain and certain threat in 99 men and women. Results revealed that the neural systems recruited by uncertain and certain threat anticipation are anatomically colocalized in frontocortical regions, extended amygdala, and periaqueductal gray. Comparison of the threat conditions demonstrated that this circuitry can be fractionated, with frontocortical regions showing relatively stronger engagement during the anticipation of uncertain threat, and the extended amygdala showing the reverse pattern. Although there is widespread agreement that the bed nucleus of the stria terminalis and dorsal amygdala-the two major subdivisions of the extended amygdala-play a critical role in orchestrating adaptive responses to potential danger, their precise contributions to human anxiety have remained contentious. Follow-up analyses demonstrated that these regions show statistically indistinguishable responses to temporally uncertain and certain threat anticipation. These observations provide a framework for conceptualizing anxiety and fear, for understanding the functional neuroanatomy of threat anticipation in humans, and for accelerating the development of more effective intervention strategies for pathological anxiety.SIGNIFICANCE STATEMENT Anxiety-an emotion prototypically associated with the anticipation of uncertain harm-has profound significance for public health, yet the underlying neurobiology remains unclear. Leveraging a novel neuroimaging paradigm in a relatively large sample, we identify a core circuit responsive to both uncertain and certain threat anticipation, and show that this circuitry can be fractionated into subdivisions with a bias for one kind of threat or the other. The extended amygdala occupies center stage in neuropsychiatric models of anxiety, but its functional architecture has remained contentious. Here we demonstrate that its major subdivisions show statistically indistinguishable responses to temporally uncertain and certain threat. Collectively, these observations indicate the need to revise how we think about the neurobiology of anxiety and fear.

Distractions are ubiquitous in our sensory environments. How do we keep them from capturing attention? Existing research has focused primarily on mechanisms of strategic control or statistical learning, both of which require knowledge (explicit or implicit) of what features belong to distractors before suppression occurs. Here, we test the hypothesis that task-free exposure to stimuli is sufficient to attenuate their effect as distractors later on. In 3 experiments, subjects were exposed to either colored or achromatic circles on "circle displays" interleaved with "target search displays." Later, new distractors were introduced into the search displays using colors from the circle displays. We consistently found that passively viewed colors produced less interference when introduced as new visual search distractors. We conclude that learning during passive exposure was due to habituation mechanisms that attenuate sensory responsivity to recurring stimuli, allowing attention to operate more efficiently to select task-relevant targets or novel stimuli. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The pulvinar is a higher-order thalamic relay and a central component of the extrageniculate visual pathway, with input from the superior colliculus and visual cortex and output to all of visual cortex. Rodent pulvinar, more commonly called the lateral posterior nucleus (LP), consists of three highly-conserved subdivisions, and offers the advantage of simplicity in its study compared to more subdivided primate pulvinar. Little is known about receptive field properties of LP, let alone whether functional differences exist between different LP subdivisions, making it difficult to understand what visual information is relayed and what kinds of computations the pulvinar might support. Here, we characterized single-cell response properties in two V1 recipient subdivisions of rat pulvinar, the rostromedial (LPrm) and lateral (LPl), and found that a fourth of the cells were selective for orientation, compared to half in V1, and that LP tuning widths were significantly broader. Response latencies were also significantly longer and preferred size more than three times larger on average than in V1; the latter suggesting pulvinar as a source of spatial context to V1. Between subdivisons, LPl cells preferred higher temporal frequencies, whereas LPrm showed a greater degree of direction selectivity and pattern motion detection. Taken together with known differences in connectivity patterns, these results suggest two separate visual feature processing channels in the pulvinar, one in LPl related to higher speed processing which likely derives from superior colliculus input, and the other in LPrm for motion processing derived through input from visual cortex. SIGNIFICANCE STATEMENT: The pulvinar has a perplexing role in visual cognition as no clear link has been found between the functional properties of its neurons and behavioral deficits that arise when it is damaged. The pulvinar, called the lateral posterior nucleus (LP) in rats, is a higher order thalamic relay with input from the superior colliculus and visual cortex and output to all of visual cortex. By characterizing single-cell response properties in anatomically distinct subdivisions we found two separate visual feature processing channels in the pulvinar, one in lateral LP related to higher speed processing which likely derives from superior colliculus input, and the other in rostromedial LP for motion processing derived through input from visual cortex.

Perception of visual motion is important for a range of ethological behaviors in mammals. In primates, specific visual cortical regions are specialized for processing of coherent visual motion. However, whether mouse visual cortex has a similar organization remains unclear, despite powerful genetic tools available for measuring population neural activity. Here, we use widefield and 2-photon calcium imaging of transgenic mice to measure mesoscale and cellular responses to coherent motion. Imaging of primary visual cortex (V1) and higher visual areas (HVAs) during presentation of natural movies and random dot kinematograms (RDKs) reveals varied responsiveness to coherent motion, with stronger responses in dorsal stream areas compared to ventral stream areas. Moreover, there is considerable anisotropy within visual areas, such that neurons representing the lower visual field are more responsive to coherent motion. These results indicate that processing of visual motion in mouse cortex is distributed heterogeneously both across and within visual areas.

PURPOSE: To examine whether perceptual learning can improve face discrimination and recognition in older adults with central vision loss. METHODS: Ten participants with age-related macular degeneration (ARMD) received 5 days of training on a face discrimination task (mean age, 78 ± 10 years). We measured the magnitude of improvements (i.e., a reduction in threshold size at which faces were able to be discriminated) and whether they generalized to an untrained face recognition task. Measurements of visual acuity, fixation stability, and preferred retinal locus were taken before and after training to contextualize learning-related effects. The performance of the ARMD training group was compared to nine untrained age-matched controls (8 = ARMD, 1 = juvenile macular degeneration; mean age, 77 ± 10 years). RESULTS: Perceptual learning on the face discrimination task reduced the threshold size for face discrimination performance in the trained group, with a mean change (SD) of -32.7% (+15.9%). The threshold for performance on the face recognition task was also reduced, with a mean change (SD) of -22.4% (+2.31%). These changes were independent of changes in visual acuity, fixation stability, or preferred retinal locus. Untrained participants showed no statistically significant reduction in threshold size for face discrimination, with a mean change (SD) of -8.3% (+10.1%), or face recognition, with a mean change (SD) of +2.36% (-5.12%). CONCLUSIONS: This study shows that face discrimination and recognition can be reliably improved in ARMD using perceptual learning. The benefits point to considerable perceptual plasticity in higher-level cortical areas involved in face-processing. This novel finding highlights that a key visual difficulty in those suffering from ARMD is readily amenable to rehabilitation.

Several fundamental aspects of motion vision circuitry are prevalent across flies and mice. Both taxa segregate ON and OFF signals. For any given spatial pattern, motion detectors in both taxa are tuned to speed, selective for one of four cardinal directions, and modulated by catecholamine neurotransmitters. These similarities represent conserved, canonical properties of the functional circuits and computational algorithms for motion vision. Less is known about feature detectors, including how receptive field properties differ from the motion pathway or whether they are under neuromodulatory control to impart functional plasticity for the detection of salient objects from a moving background. Here, we investigated 19 types of putative feature selective lobula columnar (LC) neurons in the optic lobe of the fruit fly Drosophila melanogaster to characterize divergent properties of feature selection. We identified LC12 and LC15 as feature detectors. LC15 encodes moving bars, whereas LC12 is selective for the motion of discrete objects, mostly independent of size. Neither is selective for contrast polarity, speed, or direction, highlighting key differences in the underlying algorithms for feature detection and motion vision. We show that the onset of background motion suppresses object responses by LC12 and LC15. Surprisingly, the application of octopamine, which is released during flight, reverses the suppressive influence of background motion, rendering both LCs able to track moving objects superimposed against background motion. Our results provide a comparative framework for the function and modulation of feature detectors and new insights into the underlying neuronal mechanisms involved in visual feature detection.

Animals sense the environment through pathways that link sensory organs to the brain. In the visual system, these feedforward pathways define the classical feedforward receptive field (ffRF), the area in space in which visual stimuli excite a neuron1. The visual system also uses visual context-the visual scene surrounding a stimulus-to predict the content of the stimulus2, and accordingly, neurons have been identified that are excited by stimuli outside their ffRF3-8. However, the mechanisms that generate excitation to stimuli outside the ffRF are unclear. Here we show that feedback projections onto excitatory neurons in the mouse primary visual cortex generate a second receptive field that is driven by stimuli outside the ffRF. The stimulation of this feedback receptive field (fbRF) elicits responses that are slower and are delayed in comparison with those resulting from the stimulation of the ffRF. These responses are preferentially reduced by anaesthesia and by silencing higher visual areas. Feedback inputs from higher visual areas have scattered receptive fields relative to their putative targets in the primary visual cortex, which enables the generation of the fbRF. Neurons with fbRFs are located in cortical layers that receive strong feedback projections and are absent in the main input layer, which is consistent with a laminar processing hierarchy. The observation that large, uniform stimuli-which cover both the fbRF and the ffRF-suppress these responses indicates that the fbRF and the ffRF are mutually antagonistic. Whereas somatostatin-expressing inhibitory neurons are driven by these large stimuli, inhibitory neurons that express parvalbumin and vasoactive intestinal peptide have mutually antagonistic fbRF and ffRF, similar to excitatory neurons. Feedback projections may therefore enable neurons to use context to estimate information that is missing from the ffRF and to report differences in stimulus features across visual space, regardless of whether excitation occurs inside or outside the ffRF. By complementing the ffRF, the fbRF that we identify here could contribute to predictive processing.

When learning about events through visual experience, one must not only identify which events are visually similar but also retrieve those events associates-which may be visually dissimilar-and recognize when different events have similar predictive relations. How are these demands balanced? To address this question, we taught participants the predictive structures among four events, which appeared in four different sequences, each cued by a distinct object. In each, one event (cause) was predictably followed by another (effect). Sequences in the same relational category had similar predictive structure, while across categories, the effect and cause events were reversed. Using functional magnetic resonance imaging data, we measured associative coding, indicated by correlated responses between effect and cause events; perceptual coding, indicated by correlated responses to visually similar events; and relational category coding, indicated by correlated responses to sequences in the same relational category. All three models characterized responses within the right middle temporal gyrus (MTG), but in different ways: Perceptual and associative coding diverged along the posterior to anterior axis, while relational categories emerged anteriorly in tandem with associative coding. Thus, along the posterior-anterior axis of MTG, the representation of the visual attributes of events is transformed to a representation of both specific and generalizable relational attributes.

Unique stimuli stand out. Despite an abundance of competing sensory stimuli, the detection of the most salient ones occurs without effort, and that detection contributes to the guidance of adaptive behavior. Neurons sensitive to the salience of visual stimuli are widespread throughout the primate visual system and are thought to shape the selection of visual targets. However, a neural source of salience remains elusive. In an attempt to identify a source of visual salience, we reversibly inactivated parietal cortex and simultaneously recorded salience signals in prefrontal cortex. Inactivation of parietal cortex not only caused pronounced and selective reductions of salience signals in prefrontal cortex but also diminished the influence of salience on visually guided behavior. These observations demonstrate a causal role of parietal cortex in regulating salience signals within the brain and in controlling salience-driven behavior.

BackgroundWorking memory (WM) deficits are seen as a core deficit in schizophrenia, implicated in the broad cognitive impairment seen in the illness. Here we examine the impact of WM storage of a single item on the operation of other cognitive systems.MethodsWe studied 37 healthy controls (HCS) and 43 people with schizophrenia (PSZ). Each trial consisted of a sequence of two potential target stimuli, T1 and T2. T1 was a letter presented for 100 ms. After delays of 100-800 ms, T2 was presented. T2 was a 1 or a 2 and required a speeded response. In one condition, subjects were instructed to ignore T1 but respond to T2. In another condition, they were required to report T1 after making their speeded response to T2 (i.e. to make a speeded T2 response while holding T1 in WM).ResultsPSZ were dramatically slowed at responding to T2 when T1 was held in WM. A repeated measures ANOVA yielded main effects of group, delay, and condition with a group by condition interaction (p's < 0.001). Across delays, the slowing of the T2 response when required to hold T1 in memory, relative to ignoring T1, was nearly 3 times higher in PSZ than HCS (633 v. 219 ms).ConclusionsWhereas previous studies have focused on reduced storage capacity, the present study found that PSZ are impaired at performing tasks while they are successfully maintaining a single item in WM. This may play a role in the broad cognitive impairment seen in PSZ.

Emotions involve response synchronization across experiential, physiological, and behavioral systems, referred to as concordance or coherence. Women are thought to be more emotionally aware and expressive than men and may therefore display stronger response concordance; however, research on this topic is scant. Using a random-order film-average design, we assessed concordance among experiential (arousal, valence), autonomic (electrodermal activity, heart rate, preejection period, respiratory sinus arrhythmia), respiratory (respiratory rate), and behavioral (corrugator and zygomatic electromyography) responses to 15 two-minute films varying in valence and arousal. We then calculated for each participant and pair of measures a within-subject correlation index using averages from the 15 films. Pronounced individual concordance of up to 0.9 was observed. Arousal-physiology and valence-behavior concordances were particularly pronounced. Women displayed higher concordance than men for almost all pairs of measures. Findings indicate stronger psychophysiological response coupling in women than men and provide novel insights into affective differences between the sexes.

Drawing is a powerful tool that can be used to convey rich perceptual information about objects in the world. What are the neural mechanisms that enable us to produce a recognizable drawing of an object, and how does this visual production experience influence how this object is represented in the brain? Here we evaluate the hypothesis that producing and recognizing an object recruit a shared neural representation, such that repeatedly drawing the object can enhance its perceptual discriminability in the brain. We scanned human participants (N = 31; 11 male) using fMRI across three phases of a training study: during training, participants repeatedly drew two objects in an alternating sequence on an MR-compatible tablet; before and after training, they viewed these and two other control objects, allowing us to measure the neural representation of each object in visual cortex. We found that: (1) stimulus-evoked representations of objects in visual cortex are recruited during visually cued production of drawings of these objects, even throughout the period when the object cue is no longer present; (2) the object currently being drawn is prioritized in visual cortex during drawing production, while other repeatedly drawn objects are suppressed; and (3) patterns of connectivity between regions in occipital and parietal cortex supported enhanced decoding of the currently drawn object across the training phase, suggesting a potential neural substrate for learning how to transform perceptual representations into representational actions. Together, our study provides novel insight into the functional relationship between visual production and recognition in the brain.SIGNIFICANCE STATEMENT Humans can produce simple line drawings that capture rich information about their perceptual experiences. However, the mechanisms that support this behavior are not well understood. Here we investigate how regions in visual cortex participate in the recognition of an object and the production of a drawing of it. We find that these regions carry diagnostic information about an object in a similar format both during recognition and production, and that practice drawing an object enhances transmission of information about it to downstream regions. Together, our study provides novel insight into the functional relationship between visual production and recognition in the brain.