Search

For millennia, people have used “averted vision” to improve their detection of faint celestial objects, a technique first documented around 325 BCE. Yet, no studies have assessed gaze location during averted vision to determine what pattern best facilitates perception. Here, we characterized averted vision while recording eye-positions of dark-adapted human participants, for the first time. We simulated stars of apparent magnitudes 3.3 and 3.5, matching their brightness to Megrez (the dimmest star in the Big Dipper) and Tau Ceti. Participants indicated whether each star was visible from a series of fixation locations, providing a comprehensive map of detection performance in all directions. Contrary to prior predictions, maximum detection was first achieved at ~8° from the star, much closer to the fovea than expected from rod-cone distributions alone. These findings challenge the assumption of optimal detection at the rod density peak and provide the first systematic assessment of an age-old facet of human vision.

The integration of synaptic inputs onto dendrites provides the basis for neuronal computation. Whereas recent studies have begun to outline the spatial organization of synaptic inputs on individual neurons, the underlying principles related to the specific neural functions are not well understood. Here we perform two-photon dendritic imaging with a genetically-encoded glutamate sensor in awake monkeys, and map the excitatory synaptic inputs on dendrites of individual V1 superficial layer neurons with high spatial and temporal resolution. We find a functional integration and trade-off between orientation-selective and color-selective inputs in basal dendrites of individual V1 neurons. Synaptic inputs on dendrites are spatially clustered by stimulus feature, but functionally scattered in multidimensional feature space, providing a potential substrate of local feature integration on dendritic branches. Furthermore, apical dendrite inputs have larger receptive fields and longer response latencies than basal dendrite inputs, suggesting a dominant role for apical dendrites in integrating feedback in visual information processing., The integration of synaptic inputs onto dendrites provides the basis for neuronal computation. Here the authors perform two-photon dendritic imaging with a genetically-encoded glutamate sensor in awake monkeys, and map the excitatory synaptic inputs on dendrites of individual V1 superficial layer neurons with high spatial and temporal resolution.

As the first step in image interpretation is detection, an error in perception can prematurely end the diagnostic process leading to missed diagnoses. Because perceptual errors of this sort-"failure to detect"-are the most common interpretive error (and cause of litigation) in radiology, understanding the nature of perceptual expertise is essential in decreasing radiology's long-standing error rates. In this article, we review what constitutes a perceptual error, the existing models of radiologic image perception, the development of perceptual expertise and how it can be tested, perceptual learning methods in training radiologists, and why understanding perceptual expertise is still relevant in the era of artificial intelligence. Adding targeted interventions, such as perceptual learning, to existing teaching practices, has the potential to enhance expertise and reduce medical error.

The methods of magicians provide powerful tools for enhancing the ecological validity of laboratory studies of attention. The current research borrows a technique from magic to explore the relationship between microsaccades and covert attention under near-natural viewing conditions. We monitored participants’ eye movements as they viewed a magic trick where a coin placed beneath a napkin vanishes and reappears beneath another napkin. Many participants fail to see the coin move from one location to the other the first time around, thanks to the magician’s misdirection. However, previous research was unable to distinguish whether or not participants were fooled based on their eye movements. Here, we set out to determine if microsaccades may provide a window into the efficacy of the magician’s misdirection. In a multi-trial setting, participants monitored the location of the coin (which changed positions in half of the trials), while engaging in a delayed match-to-sample task at a different spatial location. Microsaccades onset times varied with task difficulty, and microsaccade directions indexed the locus of covert attention. Our com-bined results indicate that microsaccades may be a useful metric of covert attentional processes in applied and ecologically valid settings.

Troxler fading, the perceptual disappearance of stationary images upon sustained fixation, is common for objects with equivalent luminance to that of the background. Previous work showed that variations in microsaccadic rates underlie the perceptual vanishing and intensification of simple stimuli, such as Gabor patches. Here, we demonstrate that microsaccade dynamics also contribute to Troxler fading and intensification during the viewing of representational art. Participants fixated a small spot while viewing either a Gabor patch on a blank background, or Monet’s painting “Impression, Sunrise.” They continuously reported, via button press/release, whether the Gabor patch, or the sun in Monet’s painting, was fading versus intensifying, while their eye movements were recorded with high precision. Microsaccade rates peaked before reports of increased visibility, and dropped before reports of decreased visibility or fading, both when viewing Gabor patches and Monet’s sun. These results reveal that the relationship between microsaccade production and the reversal and prevention of Troxler fading applies not only to the viewing of contrived stimuli, but also to the observation of “Impression, Sunrise.” Whether or not perceptual fading was consciously intended by Monet, our findings indicate that observers’ oculomotor dynamics are a contributor to the cornerstone of Impressionism.

In this paper, we outline a method for surgical preparation that allows for the practical planning of a variety of neurosurgeries in NHPs solely using data extracted from magnetic resonance imaging (MRI). This protocol allows for the generation of 3D printed anatomically accurate physical models of the brain and skull, as well as an agarose gel model of the brain modeling some of the mechanical properties of the brain. These models can be extracted from MRI using brain extraction software for the model of the brain, and custom code for the model of the skull. The preparation protocol takes advantage of state-of-the-art 3D printing technology to make interfacing brains, skulls, and molds for gel brain models. The skull and brain models can be used to visualize brain tissue inside the skull with the addition of a craniotomy in the custom code, allowing for better preparation for surgeries directly involving the brain. The applications of these methods are designed for surgeries involved in neurological stimulation and recording as well as injection, but the versatility of the system allows for future expansion of the protocol, extraction techniques, and models to a wider scope of surgeries.

Visual scene characteristics can affect various aspects of saccade and microsaccade dynamics. For example, blank visual scenes are known to elicit diminished saccade and microsaccade production, compared to natural scenes. Similarly, microsaccades are less frequent in the dark. Yet, the extent to which foveal versus peripheral visual information contribute to microsaccade production remains unclear: because microsaccade directions are biased towards covert attention locations, it follows that peripheral visual stimulation could suffice to produce regular microsaccade dynamics, even without foveal stimulation being present. Here we determined the characteristics of microsaccades as a function of foveal and/or peripheral visual stimulation, while human subjects conducted four types of oculomotor tasks (fixation, free viewing, guided viewing and passive viewing). Foveal information was either available, or made unavailable, by the presentation of simulated scotomas. We found foveal stimulation to be critical for microsaccade production, and peripheral stimulation, by itself, to be insufficient to yield normal microsaccades. In each oculomotor task, microsaccade production decreased when scotomas blocked foveal stimulation. Across comparable foveal stimulation conditions, the type of peripheral stimulation (static versus dynamic) moreover affected microsaccade production, with dynamic backgrounds resulting in lower microsaccadic rates than static backgrounds. These results indicate that a foveal visual anchor is necessary for normal microsaccade generation. Whereas peripheral visual stimulation, on its own, does not suffice for normal microsaccade production, it can nevertheless modulate microsaccadic characteristics. These findings extend our current understanding of the links between visual input and ocular motor control, and may therefore help improve the diagnosis and treatment of ophthalmic conditions that degrade central vision, such as age-related macular degeneration.

Across a wide variety of research environments, the recording of microsaccades and other fixational eye movements has provided insight and solutions into practical problems. Here we review the literature on fixational eye movements—especially microsaccades—in applied and ecologically-valid scenarios. Recent technical advances allow noninvasive fixational eye movement recordings in real-world contexts, while observers perform a variety of tasks. Thus, fixational eye movement measures have been obtained in a host of real-world scenarios, such as in connection with driver fatigue, vestibular sensory deprivation in astronauts, and elite athletic training, among others. Here we present the state of the art in the practical applications of fixational eye movement research, examine its potential future uses, and discuss the benefits of including microsaccade measures in existing eye movement detection technologies. Current evidence supports the inclusion of fixational eye movement measures in real-world contexts, as part of the development of new or improved oculomotor assessment tools. The real-world applications of fixational eye movement measurements will only grow larger and wider as affordable high-speed and high-spatial resolution eye trackers become increasingly prevalent.

Commonly conflated with sleepiness, fatigue is a distinct multidimensional condition with physical and mental effects. Fatigue in health care providers and any secondary effects on patient care are an important societal concern. As medical image interpretation is highly dependent on visual input, visual fatigue is of particular interest to radiologists. Humans analyze their surroundings with rapid eye movements called saccades, and fatigue decreases saccadic velocity. Oculomotor parameters may, therefore, be an objective and reproducible metric of fatigue and eye movement analysis can provide valuable insight into the etiology of fatigue-related error.

Fixational eye movements (FEMs), including microsaccades, drift, and tremor, shift our eye position during ocular fixation, producing retinal motion that is thought to help visibility by counteracting neural adaptation to unchanging stimulation. Yet, how each FEM type influences this process is still debated. Recent studies found little to no relationship between microsaccades and visual perception of spatial frequencies (SF). However, these conclusions were based on coarse analyses that make it hard to appreciate the actual effects of microsaccades on target visibility as a function of SF. Thus, how microsaccades contribute to the visibility of stimuli of different SFs remains unclear. Here, we asked how the visibility of targets of various SFs changed over time, in relationship with concurrent microsaccade production. Participants continuously reported on changes in target visibility, allowing us to time-lock ongoing changes in microsaccade parameters to perceptual transitions in visibility. Microsaccades restored/increased the visibility of low SF targets more efficiently than that of high SF targets. Yet, microsaccade rates rose before periods of increased visibility, and dropped before periods of diminished visibility, for all the SFs tested, suggesting that microsaccades boosted target visibility across a wide range of SFs. Our data also indicate that visual stimuli fade/become harder to see less often in the presence of microsaccades. In addition, larger microsaccades restored/increased target visibility more effectively than smaller microsaccades. These combined results support the proposal that microsaccades enhance visibility across a broad variety of SFs.

Novel genetically encoded tools and advanced microscopy methods have revolutionized neural circuit analyses in insects and rodents over the last two decades. Whereas numerous technical hurdles originally barred these methodologies from success in nonhuman primates (NHPs), current research has started to overcome those barriers. In some cases, methodological advances developed with NHPs have even surpassed their precursors. One such advance includes new ultra-large imaging windows on NHP cortex, which are larger than the entire rodent brain and allow analysis unprecedented ultra-large-scale circuits. NHP imaging chambers now remain patent for periods longer than a mouse's lifespan, allowing for long-term all-optical interrogation of identified circuits and neurons over timeframes that are relevant to human cognitive development. Here we present some recent imaging advances brought forth by research teams using macaques and marmosets. These include technical developments in optogenetics; voltage-, calcium- and glutamate-sensitive dye imaging; two-photon and wide-field optical imaging; viral delivery; and genetic expression of indicators and light-activated proteins that result in the visualization of tens of thousands of identified cortical neurons in NHPs. We describe a subset of the many recent advances in circuit and cellular imaging tools in NHPs focusing here primarily on the research presented during the corresponding mini-symposium at the 2019 Society for Neuroscience annual meeting.

Active communication between researchers and society is necessary for the scientific community's involvement in developing science-based policies. This need is recognized by governmental and funding agencies that compel scientists to increase their public engagement and disseminate research findings in an accessible fashion. Storytelling techniques can help convey science by engaging people's imagination and emotions. Yet, many researchers are uncertain about how to approach scientific storytelling, or feel they lack the tools to undertake it. Here we explore some of the techniques intrinsic to crafting scientific narratives, as well as the reasons why scientific storytelling may be an optimal way of communicating research to nonspecialists. We also point out current communication gaps between science and society, particularly in the context of neurodiverse audiences and those that include neurological and psychiatric patients. Present shortcomings may turn into areas of synergy with the potential to link neuroscience education, research, and advocacy.

Scientific research on consciousness is critical to multiple scientific, clinical, and ethical issues. The growth of the field could also be beneficial to several areas including neurology and mental health research. To achieve this goal, we need to set funding priorities carefully and address problems such as job creation and potential media misrepresentation., SCOPUS: no.j, info:eu-repo/semantics/published

Vasarely’s nested squares illusion shows that the corners of concentric squares, arranged in a gradient of increasing or decreasing luminance, generate illusory “corner-folds,” which appear more salient (either brighter or darker) than the adjacent flat (non- corner) regions of each individual square. The Alternating Brightness Star (ABS) illusion, based on Vasarely’s classic nested squares, further shows that the strength of these corner-folds depends on corner angle. Previous psychophysical studies showed the relationship between corner angle and perceived contrast in the ABS illusion to be linear, with sharp angles looking higher in contrast, and shallow angles lower in contrast. Center-surround difference-of-Gaussians (DOG) modeling did not replicate this linear relationship, however, suggesting that a full neural explanation of the nested squares and ABS illusions might be found in the visual cortex, rather than at subcortical stages. Here we recorded the responses from single area V1 neurons in the awake primate, during the presentation of visual stimuli containing illusory corner-folds of various angles. Our results showed stronger neural responses for illusory corner-folds made from sharper than from shallower corners, consistent with predictions from the previous psychophysical work. The relationship between corner angle and strength of the neuronal responses, albeit parametric, was apparently non-linear. This finding was in line with the previous DOG data, but not with the psychophysical data. Our combined results suggest that, whereas corner-fold illusions likely originate from center-surround retinogeniculate processes, their complete neural explanation may be found in extrastriate visual cortical areas.

The article reports on how active scientists who serve as speakers, blog writers or authors faced professional blowback over their outreach efforts and under what circumstances. Topics include the role of social media in breaking down the barriers between researchers and the community at large, the criticisms faced by these scientists for their outreach efforts, and the benefits offered to a scientist's career by engaging with the rest of society.

Like the proverbial tree falling in a forest with no one around to hear it, science discoveries cannot have an impact unless people learn about them. The act of communication is part and parcel of doing research. And in an era increasingly defined by open access, crowdfunding, and citizen science endeavors, there is a growing demand for researchers to communicate their findings not just within their field—via institutional seminars, conference presentations, and peer-reviewed publications—but to general audiences as well. One of our main endeavors as scientists then, must be to present discoveries about which the public will care. Storytelling and narrative can help communicate science to nonexperts and improve the odds of science communication success. Image courtesy of Dave Cutler (artist). Borrowing communication strategies from the arts and humanities can help, and scientists would be wise to do so more often. As recent scholarship in science communications has suggested, an “information deficit” is not, by itself, the root cause of a poor understanding of science among portions of the lay public (1). Simply providing more information about a given issue won’t necessarily change minds or prompt, for example, a skeptical audience to accept the science of climate change. Recent work indicates that storytelling and narrative can help communicate science to nonexperts (2), within the wider context of “framing” as an important feature of public outreach. Creative writing—and fictional storytelling—offer clues on how to improve our odds of science communication success. Pursuing such strategies can help tackle what continues to be a monumental science communications challenge. As noted in a recent National Academy of Sciences (NAS) report on the state-of-the-art of science communication, the complexities that stand in the way of effective science communication are many, varied, and very often interdependent (3). They are not limited to the difficulties posed by … [↵][1]1To whom correspondence should be addressed. Email: smart{at}neuralcorrelate.com. [1]: #xref-corresp-1-1

Supported by guidance from training during residency programs, radiologists learn clinically relevant visual features by viewing thousands of medical images. Yet the precise visual features that expert radiologists use in their clinical practice remain unknown. Identifying such features would allow the development of perceptual learning training methods targeted to the optimization of radiology training and the reduction of medical error. Here we review attempts to bridge current gaps in understanding with a focus on computational saliency models that characterize and predict gaze behavior in radiologists. There have been great strides toward the accurate prediction of relevant medical information within images, thereby facilitating the development of novel computer-aided detection and diagnostic tools. In some cases, computational models have achieved equivalent sensitivity to that of radiologists, suggesting that we may be close to identifying the underlying visual representations that radiologists use. However, because the relevant bottom-up features vary across task context and imaging modalities, it will also be necessary to identify relevant top-down factors before perceptual expertise in radiology can be fully understood. Progress along these dimensions will improve the tools available for educating new generations of radiologists, and aid in the detection of medically relevant information, ultimately improving patient health.

Whereas optogenetic techniques have proven successful in their ability to manipulate neuronal populations—with high spatial and temporal fidelity—in species ranging from insects to rodents, significant obstacles remain in their application to nonhuman primates (NHPs). Robust optogenetics-activated behavior and long-term monitoring of target neurons have been challenging in NHPs. Here, we present a method for all-optical interrogation (AOI), integrating optical stimulation and simultaneous two-photon (2P) imaging of neuronal populations in the primary visual cortex (V1) of awake rhesus macaques. A red-shifted channel-rhodopsin transgene (ChR1/VChR1 [C1V1]) and genetically encoded calcium indicators (genetically encoded calmodulin protein [GCaMP]5 or GCaMP6s) were delivered by adeno-associated viruses (AAVs) and subsequently expressed in V1 neuronal populations for months. We achieved optogenetic stimulation using both single-photon (1P) activation of neuronal populations and 2P activation of single cells, while simultaneously recording 2P calcium imaging in awake NHPs. Optogenetic manipulations of V1 neuronal populations produced reliable artificial visual percepts. Together, our advances show the feasibility of precise and stable AOI of cortical neurons in awake NHPs, which may lead to broad applications in high-level cognition and preclinical testing studies., Author summary This report details the first successful application of long-term all-optical interrogation techniques in monkeys. We have overcome obstacles that prevented the combination of single- and two-photon (1P and 2P) optogenetic stimulation with 2P imaging in awake-behaving monkeys, retesting targeted individual cells and neuronal ensembles over periods that extended beyond 6 months. Our strategy results in repeatable primary visual cortex (V1) neuronal stimulation of the same neurons and produces reliable visual percepts, which monkeys report behaviorally in a visual–motor task. The animals’ behavioral responses to their optogenetic-induced perceptions are comparable to their responses to real visual stimulation. These technical advances establish the feasibility of combined long-term optogenetic manipulation and 2P imaging of neocortical neurons in awake-behaving monkeys. Our approach may be applied to investigate the molecular and circuit-level mechanistic pathways that are unique to primate neural function. These methods also provide a roadmap for preclinical testing of human optogenetic therapies and may serve as the basis for optogenetic studies involving sensorimotor functions relevant to human perception, cognition, behavior, and neurological/psychiatric disorders.

Whereas optogenetic techniques have proven successful in their ability to manipulate neuronal populations in species ranging from insects to rodents—with high spatial and temporal fidelity—significant obstacles remain in their application to non-human primates (NHPs). Robust optogenetics-activated behavior and long-term noninvasive monitoring of target neurons, have been challenging in NHPs. Here we present a method for all-optical interrogation (AOI), integrating optical stimulation and simultaneous two-photon imaging of neuronal populations in the primary visual cortex (V1) of awake rhesus macaques. A red-shifted channel-rhodopsin transgene (C1V1) and genetically-encoded calcium indicators (GCaMP5 or GCaMP6s) were delivered by AAVs, and subsequently expressed in V1 neuronal populations for months with high stability. We achieved optogenetic stimulation using both single-photon (1P) activation of neuronal populations and two-photon (2P) activation of single-cells, while simultaneously recording 2P calcium imaging in awake monkeys. Optogenetic manipulations of V1 neuronal populations produced reliable artificial visual percepts. Together, our advances show the feasibility of precise and stable all-optical interrogation of cortical neurons in awake NHPs, which may facilitate broad applications in high-level cognition and pre-clinical testing studies.

In the late 1970s, key discoveries in neurophysiology, psychophysics, computer vision, and image processing had reached a tipping point that would shape visual science for decades to come. David Marr and Ellen Hildreth's 'Theory of edge detection', published in 1980, set out to integrate the newly available wealth of data from behavioral, physiological, and computational approaches in a unifying theory. Although their work had wide and enduring ramifications, their most important contribution may have been to consolidate the foundations of the ongoing dialogue between theoretical and empirical vision science.

Alfred Lukyanovich Yarbus (1914–1986) pioneered the study of stabilized retinal images, miniature eye movements, and the cognitive influences that act on visual scanning. Yarbus’s studies of these different topics have remained fundamentally disconnected and independent of each other, however. In this review, we propose that Yarbus’s various research lines are instead deeply and intrinsically interconnected, as are the small eye movements produced during visual fixation and the large-scale scanning patterns associated with visual exploration of objects and scenes. Such apparently disparate viewing behaviors may represent the extremes of a single continuum of oculomotor performance that operates across spatial scales when we search the visual world.

The arts sometimes precede the sciences in the discovery of fundamental visual principles. Victor Vasarely’s “Nested Squares” show an illusory effect in which corners look brighter and more salient than straight edges, despite having equivalent luminance. This chapter summarizes recent research, originally based on Victor Vasarely’s Nested Squares illusion, to discover the related perceptual and underlying physiological principles. The results offer significant insights into how corners, angles, curves, and line endings affect the appearance of brightness, shape, salience, depth, and color in our brains. Concepts covered include the alternating brightness star illusion, center-surround simulations, brain activation, corner perception, and the redundancy-reducing hypothesis.

Seizure-driven brain damage in epilepsy accumulates over time, especially in the hippocampus, which can lead to sclerosis, cognitive decline, and death. Excitotoxicity is the prevalent model to explain ictal neurodegeneration. Current labeling technologies cannot distinguish between excitotoxicity and hypoxia, however, because they share common molecular mechanisms. This leaves open the possibility that undetected ischemic hypoxia, due to ictal blood flow restriction, could contribute to neurodegeneration previously ascribed to excitotoxicity. We tested this possibility with Confocal Laser Endomicroscopy (CLE) and novel stereological analyses in several models of epileptic mice. We found a higher number and magnitude of NG2+ mural-cell mediated capillary constrictions in the hippocampus of epileptic mice than in that of normal mice, in addition to spatial coupling between capillary constrictions and oxidative stressed neurons and neurodegeneration. These results reveal a role for hypoxia driven by capillary blood flow restriction in ictal neurodegeneration.

Fixational eye movements (FEMs; including microsaccades, drift and tremor) are thought to improve visibility during fixation by thwarting neural adaptation to unchanging stimuli, but how the different FEM types influence this process is a matter of debate. Attempts to answer this question have been hampered by the failure to distinguish between the prevention of fading (where fading is blocked before it happens in the first place) and the reversal of fading (where vision is restored after fading has already occurred). Because fading during fixation is a detriment to clear vision, the prevention of fading, which avoids visual degradation before it happens, is a more desirable scenario than improving visibility after fading has occurred. Yet previous studies have not examined the role of FEMs in the prevention of fading, but have focused on visual restoration instead. Here we set out to determine the differential contributions and efficacies of microsaccades and drift to preventing fading in human vision. Our results indicate that both microsaccades and drift mediate the prevention of visual fading. We also found that drift is a potentially larger contributor to preventing fading than microsaccades, although microsaccades are more effective than drift. Microsaccades moreover prevented foveal and peripheral fading in an equivalent fashion, and their efficacy was independent of their size, number, and direction. Our data also suggest that faster drift may prevent fading better than slower drift. These findings may help to reconcile the long-standing controversy concerning the comparative roles of microsaccades and drift in visibility during fixation.