Search

A fundamental principle of biological motor control is that the neural commands driving movement must conform to the response properties of the motor plants they control. In the oculomotor system, characterizations of oculomotor plant dynamics traditionally supported models in which the plant responds to neural drive to extraocular muscles on exclusively short, subsecond timescales. These models predict that the stabilization of gaze during fixations between saccades requires neural drive that approximates eye position on longer timescales and is generated through the temporal integration of brief eye velocity-encoding signals that cause saccades. However, recent measurements of oculomotor plant behaviour have revealed responses on longer timescales. Furthermore, measurements of firing patterns in the oculomotor integrator have revealed a more complex encoding of eye movement dynamics. Yet, the link between these observations has remained unclear. Here we use measurements from the larval zebrafish to link dynamics in the oculomotor plant to dynamics in the neural integrator. The oculomotor plant in both anaesthetized and awake larval zebrafish was characterized by a broad distribution of response timescales, including those much longer than 1 s. Analysis of the firing patterns of oculomotor integrator neurons, which exhibited a broadly distributed range of decay time constants, demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with distributed response timescales. This work suggests that leaky integration on multiple, distributed timescales by the oculomotor integrator reflects an inverse model for generating oculomotor commands, and that multi-timescale dynamics may be a general feature of motor circuitry. KEY POINTS: Recent observations of oculomotor plant response properties and neural activity across the oculomotor system have called into question classical formulations of both the oculomotor plant and the oculomotor integrator. Here we use measurements from new and published experiments in the larval zebrafish together with modelling to reconcile recent oculomotor plant observations with oculomotor integrator function. We developed computational techniques to characterize oculomotor plant responses over several seconds in awake animals, demonstrating that long timescale responses seen in anaesthetized animals extend to the awake state. Analysis of firing patterns of oculomotor integrator neurons demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with multiple, distributed response timescales. Our results support a formulation of gaze stabilization by the oculomotor system in which commands for stabilizing gaze are generated through integration on multiple, distributed timescales.

We have achieved a three fold increase in the speed of transmission electron microscopy by using a beam deflecting mechanism to enable highly efficient acquisition of multiple image tiles for each motion of the mechanical stage. For millimeter-scale areas, the duty cycle of imaging doubles and exceeds 30%, yielding a net average imaging rate of 0.3 gigapixels per second.

Cortical areas seem to form a hierarchy of intrinsic timescales, but the relevance of this organization for cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of all tested areas affected the evidence-accumulation computation. Specifically, we observed distinct changes in the weighting of sensory evidence occurring during and before silencing, such that frontal inactivations led to stronger deficits on long timescales than posterior cortical ones. Inactivation of a subset of frontal areas also led to moderate effects on behavioral processes beyond evidence accumulation. Moreover, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows. Our findings suggest that the intrinsic timescale hierarchy of distributed cortical areas is an important component of evidence-accumulation mechanisms.

To explore how neural circuits represent novel versus familiar inputs, we presented mice with repeated sets of images with novel images sparsely substituted. Using two-photon calcium imaging to record from layer 2/3 neurons in the mouse primary visual cortex, we found that novel images evoked excess activity in the majority of neurons. This novelty response rapidly emerged, arising with a time constant of 2.6 ± 0.9 s. When a new image set was repeatedly presented, a majority of neurons had similarly elevated activity for the first few presentations, which decayed to steady state with a time constant of 1.4 ± 0.4 s. When we increased the number of images in the set, the novelty response's amplitude decreased, defining a capacity to store ∼15 familiar images under our conditions. These results could be explained quantitatively using an adaptive subunit model in which presynaptic neurons have individual tuning and gain control. This result shows that local neural circuits can create different representations for novel versus familiar inputs using generic, widely available mechanisms.

A notable feature of neural activity is sparseness – namely, that only a small fraction of neurons in a local circuit have high activity at any moment. Not only is sparse neural activity observed experimentally in most areas of the brain, but sparseness has been proposed as an optimization or design principle for neural circuits. Sparseness can increase the energy efficiency of the neural code as well as allow for beneficial computations to be carried out. But how does the brain achieve sparse-ness? Here, we found that when neurons in the primary visual cortex were passively exposed to a set of images over several days, neural responses became more sparse. Sparsification was driven by a decrease in the response of neurons with low or moderate activity, while highly active neurons retained similar responses. We also observed a net decorrelation of neural activity. These changes sculpt neural activity for greater coding efficiency.

There is increased appreciation that dopamine neurons in the midbrain respond not only to reward1 and reward-predicting cues1,2, but also to other variables such as the distance to reward3, movements4-9 and behavioural choices10,11. An important question is how the responses to these diverse variables are organized across the population of dopamine neurons. Whether individual dopamine neurons multiplex several variables, or whether there are subsets of neurons that are specialized in encoding specific behavioural variables remains unclear. This fundamental question has been difficult to resolve because recordings from large populations of individual dopamine neurons have not been performed in a behavioural task with sufficient complexity to examine these diverse variables simultaneously. Here, to address this gap, we used two-photon calcium imaging through an implanted lens to record the activity of more than 300 dopamine neurons from the ventral tegmental area of the mouse midbrain during a complex decision-making task. As mice navigated in a virtual-reality environment, dopamine neurons encoded an array of sensory, motor and cognitive variables. These responses were functionally clustered, such that subpopulations of neurons transmitted information about a subset of behavioural variables, in addition to encoding reward. These functional clusters were spatially organized, with neighbouring neurons more likely to be part of the same cluster. Together with the topography between dopamine neurons and their projections, this specialization and anatomical organization may aid downstream circuits in correctly interpreting the wide range of signals transmitted by dopamine neurons.

A fundamental principle of biological motor control is that the neural commands driving movement must conform to the response properties of the motor plants they control. In the oculomotor system, characterizations of oculomotor plant dynamics traditionally supported models in which the plant responds to neural drive to extraocular muscles on exclusively short, subsecond timescales. These models predict that the stabilization of gaze during fixations between saccades requires neural drive that approximates eye position on longer timescales and is generated through the temporal integration of brief eye velocity-encoding signals that cause saccades. However, recent measurements of oculomotor plant behaviour have revealed responses on longer timescales. Furthermore, measurements of firing patterns in the oculomotor integrator have revealed a more complex encoding of eye movement dynamics. Yet, the link between these observations has remained unclear. Here we use measurements from the larval zebrafish to link dynamics in the oculomotor plant to dynamics in the neural integrator. The oculomotor plant in both anaesthetized and awake larval zebrafish was characterized by a broad distribution of response timescales, including those much longer than one second. Analysis of the firing patterns of oculomotor integrator neurons, which exhibited a broadly distributed range of decay time constants, demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with distributed response timescales. This work suggests that leaky integration on multiple, distributed timescales by the oculomotor integrator reflects an inverse model for generating oculomotor commands, and that multi-timescale dynamics may be a general feature of motor circuitry.KEY POINTSRecent observations of oculomotor plant response properties and neural activity across the oculomotor system have called into question classical formulations of both the oculomotor plant and the oculomotor integrator.Here we use measurements from new and published experiments in the larval zebrafish together with modelling to reconcile recent oculomotor plant observations with oculomotor integrator function.We developed computational techniques to characterize oculomotor plant responses over several seconds in awake animals, demonstrating that long timescale responses seen in anesthetized animals extend to the awake state.Analysis of firing patterns of oculomotor integrator neurons demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with multiple, distributed response timescales.Our results support a formulation of gaze stabilization by the oculomotor system in which commands for stabilizing gaze are generated through integration on multiple, distributed timescales.

Electron microscopy of biological tissue has recently seen an unprecedented increase in imaging throughput moving the ultrastructural analysis of large tissue blocks such as whole brains into the realm of the feasible. However, homogeneous, high quality electron microscopy staining of large biological samples is still a major challenge. To date, assessing the staining quality in electron microscopy requires running a sample through the entire staining protocol end-to-end, which can take weeks or even months for large samples, rendering protocol optimization for such samples to be inefficient.Here we present an in situ time-lapsed X-ray assisted staining procedure that opens the “black box” of electron microscopy staining and allows observation of individual staining steps in real time. Using this novel method we measured the accumulation of heavy metals in large tissue samples immersed in different staining solutions. We show that the measured accumulation of osmium in fixed tissue obeys empirically a quadratic dependence between the incubation time and sample size. We found that potassium ferrocyanide, a classic reducing agent for osmium tetroxide, clears the tissue after osmium staining and that the tissue expands in osmium tetroxide solution, but shrinks in reduced osmium solution.X-ray assisted staining gave access to the in situ staining kinetics and allowed us to develop a diffusion-reaction-advection model that accurately simulates the measured accumulation of osmium in tissue. These are first steps towards in silico staining experiments and simulation-guided optimization of staining protocols for large samples. Hence, X-ray assisted staining will be a useful tool for the development of reliable staining procedures for large samples such as entire brains of mice, monkeys or humans.

Cortical areas seem to form a hierarchy of intrinsic timescales, but whether this is causal to cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we causally tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality, and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of different areas primarily affected the evidence-accumulation computation per se, rather than other decision-related processes. Specifically, we observed selective changes in the weighting of evidence over time, such that frontal inactivations led to deficits on longer timescales than posterior cortical ones. Likewise, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows matching the effects of inactivation. Our findings suggest that distributed cortical areas accumulate evidence by leveraging their hierarchy of intrinsic timescales.

How does the brain internally represent a sequence of sensory information that jointly drives a decision-making behavior? Studies of perceptual decision-making have often assumed that sensory cortices provide noisy but otherwise veridical sensory inputs to downstream processes that accumulate and drive decisions. However, sensory processing in even the earliest sensory cortices can be systematically modified by various external and internal contexts. We recorded from neuronal populations across posterior cortex as mice performed a navigational decision-making task based on accumulating randomly timed pulses of visual evidence. Even in V1, only a small fraction of active neurons had sensory-like responses time-locked to each pulse. Here, we focus on how these ‘cue-locked’ neurons exhibited a variety of amplitude modulations from sensory to cognitive, notably by choice and accumulated evidence. These task-related modulations affected a large fraction of cue-locked neurons across posterior cortex, suggesting that future models of behavior should account for such influences.

Background The past decade has seen a multitude of new in vivo functional imaging methodologies. However, the lack of ground-truth comparisons or evaluation metrics makes the large-scale, systematic validation vital to the continued development and use of optical microscopy impossible. New-method We provide a new framework for evaluating two-photon microscopy methods via in silico Neural Anatomy and Optical Microscopy (NAOMi) simulation. Our computationally efficient model generates large anatomical volumes of mouse cortex, simulates neural activity, and incorporates optical propagation and scanning to create realistic calcium imaging datasets. Results We verify NAOMi simulations against in vivo two-photon recordings from mouse cortex. We leverage this in silico ground truth to directly compare different segmentation algorithms and optical designs. We find modern segmentation algorithms extract strong neural time-courses comparable to estimation using oracle spatial information, but with an increase in the false positive rate. Comparison between optical setups demonstrate improved resilience to motion artifacts in sparsely labeled samples using Bessel beams, increased signal-to-noise ratio and cell-count using low numerical aperture Gaussian beams and nuclear GCaMP, and more uniform spatial sampling with temporal focusing versus multi-plane imaging. Comparison with existing methods NAOMi is a first-of-its kind framework for assessing optical imaging modalities. Existing methods are either anatomical simulations or do not address functional imaging. Thus there is no competing method for simulating realistic functional optical microscopy data. Conclusions By leveraging the rich accumulated knowledge of neural anatomy and optical physics, we provide a powerful new tool to assess and develop important methods in neural imaging.

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

How do animals make behavioral decisions based on noisy sensory signals, which are moreover a tiny fraction of ongoing activity in the brain? Some theories suggest that sensory responses should be accumulated through time to reduce noise. Others suggest that feedback-based gain control of sensory responses allow small signals to be selectively amplified to drive behavior. We recorded from neuronal populations across posterior cortex as mice performed a decision-making task based on accumulating randomly timed pulses of visual evidence. Here we focus on a subset of neurons, with putative sensory responses that were time-locked to each pulse. These neurons exhibited a variety of amplitude (gain-like) modulations, notably by choice and accumulated evidence. These neural data inspired a hypothetical accumulation circuit with a multiplicative feedback-loop architecture, which parsimoniously explains deviations in perceptual discrimination from Weber-Fechner Law. Our neural observations thus led to a model that synthesizes both accumulation and feedback hypotheses.

During spatial navigation, animals use self-motion to estimate positions through path integration. However, estimation errors accumulate over time and it is unclear how they are corrected. Here we report a new cell class (“cue cell”) in mouse medial entorhinal cortex (MEC) that encoded visual cue information that could be used to correct errors in path integration. Cue cells accounted for a large fraction of unidentified MEC cells. They exhibited firing fields only near visual cues during virtual navigation and spatially stable activity during navigation in a real arena. Cue cells’ responses occurred in sequences repeated at each cue and were likely driven by visual inputs. In layers 2/3 of the MEC, cue cells formed clusters. Anatomically adjacent cue cells responded similarly to cues. These cue cell properties demonstrate that the MEC circuits contain a code representing spatial landmarks that could play a significant role in error correction during path integration.

Hippocampal neurons encode physical variables1–7 such as space1 or auditory frequency6 in cognitive maps8. In addition, functional magnetic resonance imaging studies in humans have shown that the hippocampus can also encode more abstract, learned variables9–11. However, their integration into existing neural representations of physical variables12,13 is unknown. Here, using two-photon calcium imaging, we show that individual neurons in the dorsal hippocampus jointly encode accumulated evidence with spatial position in mice performing a decision-making task in virtual reality14–16. Nonlinear dimensionality reduction13 showed that population activity was well-described by approximately four to six latent variables, which suggests that neural activity is constrained to a low-dimensional manifold. Within this low-dimensional space, both physical and abstract variables were jointly mapped in an orderly manner, creating a geometric representation that we show is similar across mice. The existence of conjoined cognitive maps suggests that the hippocampus performs a general computation—the creation of task-specific low-dimensional manifolds that contain a geometric representation of learned knowledge. The hippocampus geometrically represents both physical location and abstract variables on a neural manifold in mice performing a decision-making task in virtual reality.

Recent work has highlighted that many types of variables are represented in each neocortical area. How can these many neural representations be organized together without interference and coherently maintained/updated through time? We recorded from excitatory neural populations in posterior cortices as mice performed a complex, dynamic task involving multiple interrelated variables. The neural encoding implied that highly correlated task variables were represented by less-correlated neural population modes, while pairs of neurons exhibited a spectrum of signal correlations. This finding relates to principles of efficient coding, but notably utilizes neural population modes as the encoding unit and suggests partial whitening of task-specific information where different variables are represented with different signal-to-noise levels. Remarkably, this encoding function was multiplexed with sequential neural dynamics yet reliably followed changes in task-variable correlations throughout the trial. We suggest that neural circuits can implement time-dependent encodings in a simple way using random sequential dynamics as a temporal scaffold.

SummaryRecent work has highlighted that many types of variables are represented in each neocortical area. How can these many neural representations be organized together without interference, and coherently maintained/updated through time? We recorded from large neural populations in posterior cortices as mice performed a complex, dynamic task involving multiple interrelated variables. The neural encoding implied that correlated task variables were represented by uncorrelated neural-population modes, while pairs of neurons exhibited a variety of signal correlations. This finding relates to principles of efficient coding for task-specific information, with neural-population modes as the encoding unit, and applied across posterior cortical regions and layers 2/3 and 5. Remarkably, this encoding function was multiplexed with sequential neural dynamics as well as reliably followed changes in task-variable correlations through time. We suggest that neural circuits can implement time-dependent encoding in a simple way by using random sequential dynamics as a temporal scaffold.

SummaryStudies of perceptual decision-making have often assumed that the main role of sensory cortices is to provide sensory input to downstream processes that accumulate and drive behavioral decisions. We performed a systematic comparison of neural activity in primary visual (V1) to secondary visual and retrosplenial cortices, as mice performed a task where they should accumulate pulsatile visual cues through time to inform a navigational decision. Even in V1, only a small fraction of neurons had sensory-like responses to cues. Instead, in all areas neurons were sequentially active, and contained information ranging from sensory to cognitive, including cue timings, evidence, place/time, decision and reward outcome. Per-cue sensory responses were amplitude-modulated by various cognitive quantities, notably accumulated evidence. This inspired a multiplicative feedback-loop circuit hypothesis that proposes a more intricate role of sensory areas in the accumulation process, and furthermore explains a surprising observation that perceptual discrimination deviates from Weber-Fechner Law.Highlights / eTOC BlurbMice made navigational decisions based on accumulating pulsatile visual cuesThe bulk of neural activity in visual cortices was sequential and beyond-sensoryAccumulated pulse-counts modulated sensory (cue) responses, suggesting feedbackA feedback-loop neural circuit explains behavioral deviations from Weber’s LawIn a task where navigation was informed by accumulated pulsatile visual evidence, neural activity in visual cortices predominantly coded for cognitive variables across multiple timescales, including outside of a visual processing context. Even sensory responses to visual pulses were amplitude-modulated by accumulated pulse counts and other variables, inspiring a multiplicative feedback-loop circuit hypothesis that in turn explained behavioral deviations from Weber-Fechner Law.

Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in which a principled mechanism is pre-wired into their connectivity. Here we demonstrate that, starting from random connectivity and modifying a small fraction of connections, a largely disordered recur- rent network can produce sequences and implement working memory efficiently. We use this process, called Partial In-Network Training (PINning), to model and match cellular resolution imaging data from the posterior parietal cortex during a virtual memory- guided two-alternative forced-choice task. Analysis of the connectivity reveals that sequences propagate by the cooperation between recurrent synaptic interactions and external inputs, rather than through feedforward or asymmetric connections. Together our results suggest that neural sequences may emerge through learning from largely unstructured network architectures., Comment: 60 pages, 6 figures

Grid cells, defined by their striking periodic spatial responses in open 2D arenas, appear to respond differently on 1D tracks: the multiple response fields are not periodically arranged, peak amplitudes vary across fields, and the mean spacing between fields is larger than in 2D environments. We ask whether such 1D responses are consistent with the system’s 2D dynamics. Combining analytical and numerical methods, we show that the 1D responses of grid cells with stable 1D fields are consistent with a linear slice through a 2D triangular lattice. Further, the 1D responses of comodular cells are well described by parallel slices, and the offsets in the starting points of the 1D slices can predict the measured 2D relative spatial phase between the cells. From these results, we conclude that the 2D dynamics of these cells is preserved in 1D, suggesting a common computation during both types of navigation behavior.

Advances in fluorescence microscopy enable monitoring larger brain areas in-vivo with finer time resolution. The resulting data rates require reproducible analysis pipelines that are reliable, fully automated, and scalable to datasets generated over the course of months. We present CaImAn, an open-source library for calcium imaging data analysis. CaImAn provides automatic and scalable methods to address problems common to pre-processing, including motion correction, neural activity identification, and registration across different sessions of data collection. It does this while requiring minimal user intervention, with good scalability on computers ranging from laptops to high-performance computing clusters. CaImAn is suitable for two-photon and one-photon imaging, and also enables real-time analysis on streaming data. To benchmark the performance of CaImAn we collected and combined a corpus of manual annotations from multiple labelers on nine mouse two-photon datasets. We demonstrate that CaImAn achieves near-human performance in detecting locations of active neurons., eLife digest The human brain contains billions of cells called neurons that rapidly carry information from one part of the brain to another. Progress in medical research and healthcare is hindered by the difficulty in understanding precisely which neurons are active at any given time. New brain imaging techniques and genetic tools allow researchers to track the activity of thousands of neurons in living animals over many months. However, these experiments produce large volumes of data that researchers currently have to analyze manually, which can take a long time and generate irreproducible results. There is a need to develop new computational tools to analyze such data. The new tools should be able to operate on standard computers rather than just specialist equipment as this would limit the use of the solutions to particularly well-funded research teams. Ideally, the tools should also be able to operate in real-time as several experimental and therapeutic scenarios, like the control of robotic limbs, require this. To address this need, Giovannucci et al. developed a new software package called CaImAn to analyze brain images on a large scale. Firstly, the team developed algorithms that are suitable to analyze large sets of data on laptops and other standard computing equipment. These algorithms were then adapted to operate online in real-time. To test how well the new software performs against manual analysis by human researchers, Giovannucci et al. asked several trained human annotators to identify active neurons that were round or donut-shaped in several sets of imaging data from mouse brains. Each set of data was independently analyzed by three or four researchers who then discussed any neurons they disagreed on to generate a ‘consensus annotation’. Giovannucci et al. then used CaImAn to analyze the same sets of data and compared the results to the consensus annotations. This demonstrated that CaImAn is nearly as good as human researchers at identifying active neurons in brain images. CaImAn provides a quicker method to analyze large sets of brain imaging data and is currently used by over a hundred laboratories across the world. The software is open source, meaning that it is freely-available and that users are encouraged to customize it and collaborate with other users to develop it further.

To select actions based on sensory evidence, animals must create and manipulate representations of stimulus information in memory. Here we report that during accumulation of somatosensory evidence, optogenetic manipulation of cerebellar Purkinje cells reduces the accuracy of subsequent memory-guided decisions and causes mice to downweight prior information. Behavioral deficits are consistent with the addition of noise and leak to the evidence accumulation process. We conclude that the cerebellum can influence the accurate maintenance of working memory., Disruption of cerebellar activity impairs working memory during evidence accumulation in mice. Here, the authors show that optogenetic perturbation of Purkinje cell activity disrupts the accurate accumulation of somatosensory information in working memory during perceptual decision-making.

Population recordings of calcium activity are a major source of insight into neural function. Large datasets require automated processing, but this can introduce errors that are difficult to detect. Here we show that popular time course-estimation algorithms often contain substantial misattribution errors affecting 10-20% of transients. Misattribution, in which fluorescence is ascribed to the wrong cell, arises when overlapping cells and processes are imperfectly defined or not identified. To diagnose misattribution, we develop metrics and visualization tools for evaluating large datasets. To correct time courses, we introduce a robust estimator that explicitly accounts for contaminating signals. In one hippocampal dataset, removing contamination reduced the number of place cells by 15%, and 19% of place fields shifted by over 10 cm. Our methods are compatible with other cell-finding techniques, empowering users to diagnose and correct a potentially widespread problem that could alter scientific conclusions.

Population recordings of calcium activity are a major source of insight into neural function. Large dataset sizes often require automated methods, but automation can introduce errors that are difficult to detect. Here we show that automatic time course estimation can sometimes lead to significant misattribution errors, in which fluorescence is ascribed to the wrong cell. Misattribution arises when the shapes of overlapping cells are imperfectly defined, or when entire cells or processes are not identified, and misattribution can even be produced by methods specifically designed to handle overlap. To diagnose this problem, we develop a transient-by-transient metric and a visualization tool that allow users to quickly assess the degree of misattribution in large populations. To filter out misattribution, we also design a robust estimator that explicitly accounts for contaminating signals in a generative model. Our methods can be combined with essentially any cell finding technique, empowering users to diagnose and correct at large scale a problem that has the potential to significantly alter scientific conclusions.

Neural activity throughout the cortex is correlated with perceptual decisions, but inactivation studies suggest that only a small number of areas are necessary for these behaviors. Here we show that the number of required cortical areas, and their dynamics, vary across related tasks with different cognitive computations. In a visually-guided virtual T-maze task, bilateral inactivation of only a few dorsal cortical regions impaired performance. In contrast, in tasks requiring evidence accumulation and/or post-stimulus memory, performance was impaired by inactivation of widespread cortical areas, with diverse patterns of behavioral deficits across areas and tasks. Widefield imaging revealed widespread ramps of Ca(2+) activity during the accumulation and visually-guided tasks. Additionally, during accumulation different regions had more diverse activity profiles, leading to reduced inter-area correlations. Using a modular recurrent neural network model trained to perform analogous tasks, we argue that differences in computational strategies alone could explain these findings.

There is increased appreciation that dopamine (DA) neurons in the midbrain respond not only to reward 1,2 and reward-predicting cues 1,3,4, but also to other variables such as distance to reward 5, movements 6–11 and behavioral choices 12–15. Based on these findings, a major open question is how the responses to these diverse variables are organized across the population of DA neurons. In other words, do individual DA neurons multiplex multiple variables, or are subsets of neurons specialized in encoding specific behavioral variables? The reason that this fundamental question has been difficult to resolve is that recordings from large populations of individual DA neurons have not been performed in a behavioral task with sufficient complexity to examine these diverse variables simultaneously. To address this gap, we used 2-photon calcium imaging through an implanted lens to record activity of >300 midbrain DA neurons in the VTA during a complex decision-making task. As mice navigated in a virtual reality (VR) environment, DA neurons encoded an array of sensory, motor, and cognitive variables. These responses were functionally clustered, such that subpopulations of neurons transmitted information about a subset of behavioral variables, in addition to encoding reward. These functional clusters were spatially organized, such that neighboring neurons were more likely to be part of the same cluster. Taken together with the topography between DA neurons and their projections, this specialization and anatomical organization may aid downstream circuits in correctly interpreting the wide range of signals transmitted by DA neurons.

Hippocampal neurons fire selectively in local behavioral contexts such as the position in an environment or phase of a task,1-3and are thought to form a cognitive map of task-relevant variables.1,4,5However, their activity varies over repeated behavioral conditions,6such as different runs through the same position or repeated trials. Although widely observed across the brain,7-10such variability is not well understood, and could reflect noise or structure, such as the encoding of additional cognitive information.6,11-13Here, we introduce a conceptual model to explain variability in terms of underlying, population-level structure in single-trial neural activity. To test this model, we developed a novel unsupervised learning algorithm incorporating temporal dynamics, in order to characterize population activity as a trajectory on a nonlinear manifold—a space of possible network states. The manifold’s structure captures correlations between neurons and temporal relationships between states, constraints arising from underlying network architecture and inputs. Using measurements of activity over time but no information about exogenous behavioral variables, we recovered hippocampal activity manifolds during spatial and non-spatial cognitive tasks in rats. Manifolds were low-dimensional and smoothly encoded task-related variables, but contained an extra dimension reflecting information beyond the measured behavioral variables. Consistent with our model, neurons fired as a function of overall network state, and fluctuations in their activity across trials corresponded to variation in the underlying trajectory on the manifold. In particular, the extra dimension allowed the system to take different trajectories despite repeated behavioral conditions. Furthermore, the trajectory could temporarily decouple from current behavioral conditions and traverse neighboring manifold points corresponding to past, future, or nearby behavioral states. Our results suggest that trial-to-trial variability in the hippocampus is structured, and may reflect the operation of internal cognitive processes. The manifold structure of population activity is well-suited for organizing information to support memory,1,5,14planning,12,15,16and reinforcement learning.17,18In general, our approach could find broader use in probing the organization and computational role of circuit dynamics in other brain regions.

Advances in fluorescence microscopy enable monitoring larger brain areasin-vivowith finer time resolution. The resulting data rates require reproducible analysis pipelines that are reliable, fully automated, and scalable to datasets generated over the course of months. Here we present CaImAn, an open-source library for calcium imaging data analysis. CaImAn provides automatic and scalable methods to address problems common to pre-processing, including motion correction, neural activity identification, and registration across different sessions of data collection. It does this while requiring minimal user intervention, with good performance on computers ranging from laptops to high-performance computing clusters. CaImAn is suitable for two-photon and one-photon imaging, and also enables real-time analysis on streaming data. To benchmark the performance of CaImAn we collected a corpus of ground truth annotations from multiple labelers on nine mouse two-photon datasets. We demonstrate that CaImAn achieves near-human performance in detecting locations of active neurons.

We develop a phenomenological coarse--graining procedure for activity in a large network of neurons, and apply this to recordings from a population of 1000+ cells in the hippocampus. Distributions of coarse--grained variables seem to approach a fixed non--Gaussian form, and we see evidence of scaling in both static and dynamic quantities. These results suggest that the collective behavior of the network is described by a non--trivial fixed point.

The hippocampus plays a critical role in goal-directed navigation. Across different environments, however, hippocampal maps are randomized, making it unclear how goal locations could be encoded consistently. To address this question, we developed a virtual reality task with shifting reward contingencies to distinguish place versus reward encoding. In mice performing the task, large-scale recordings in CA1 and subiculum revealed a small, specialized cell population that was only active near reward yet whose activity could not be explained by sensory cues or stereotyped reward anticipation behavior. Across different virtual environments, most cells remapped randomly, but reward encoding consistently arose from a single pool of cells, suggesting that they formed a dedicated channel for reward. These observations represent a significant departure from the current understanding of CA1 as a relatively homogeneous ensemble without fixed coding properties and provide a new candidate for the cellular basis of goal memory in the hippocampus.

The gradual accumulation of sensory evidence is a crucial component of perceptual decision making, but its neural mechanisms are still poorly understood. Given the wide availability of genetic and optical tools for mice, they can be useful model organisms for the study of these phenomena; however, behavioral tools are largely lacking. Here, we describe a new evidence-accumulation task for head-fixed mice navigating in a virtual reality environment. As they navigate down the stem of a virtual T-maze, they see brief pulses of visual evidence on either side, and retrieve a reward on the arm with the highest number of pulses. The pulses occur randomly with Poisson statistics, yielding a diverse yet well-controlled stimulus set, making the data conducive to a variety of computational approaches. A large number of mice of different genotypes were able to learn and consistently perform the task, at levels similar to rats in analogous tasks. They are sensitive to side differences of a single pulse, and their memory of the cues is stable over time. Moreover, using non-parametric as well as modeling approaches, we show that the mice indeed accumulate evidence: they use multiple pulses of evidence from throughout the cue region of the maze to make their decision, albeit with a small overweighting of earlier cues, and their performance is affected by the magnitude but not the duration of evidence. Additionally, analysis of the mice's running patterns revealed that trajectories are fairly stereotyped yet modulated by the amount of sensory evidence, suggesting that the navigational component of this task may provide a continuous readout correlated to the underlying cognitive variables. Our task, which can be readily integrated with state-of-the-art techniques, is thus a valuable tool to study the circuit mechanisms and dynamics underlying perceptual decision making, particularly under more complex behavioral contexts.

The hippocampus plays a critical role in goal-directed navigation. Across different environments, however, the hippocampal map seems to be randomized, making it unclear how goal locations might be encoded. To address this question, we trained mice to seek reward at several locations on virtual linear tracks, and optical recordings of calcium activity were made at cellular resolution from two major hippocampal output structures, CA1 and the subiculum. These experiments revealed a population of neurons that were consistently active near reward locations. Their pattern of activity sharply contrasted with simultaneously-recorded place cells and even persisted across environments, when other cells remapped randomly. Their timing was closely correlated with reward anticipation behaviors, yet could not be explained by the behaviors themselves, raising the possibility that reward-associated cell signals were used by mice to identify the reward location. These results demonstrate that the hippocampus employs a context-invariant marker of goal locations, and reveal a novel target for studying how the hippocampus contributes to navigation.

To explore theories of predictive coding, we presented mice with repeated sequences of images with novel images sparsely substituted. Under these conditions, mice could be rapidly trained to lick in response to a novel image, demonstrating a high level of performance on the first day of testing. Using 2-photon calcium imaging to record from layer 2/3 neurons in the primary visual cortex, we found that novel images evoked excess activity in the majority of neurons. When a new stimulus sequence was repeatedly presented, a majority of neurons had similarly elevated activity for the first few presentations, which then decayed to almost zero activity. The decay time of these transient responses was not fixed, but instead scaled with the length of the stimulus sequence. However, at the same time, we also found a small fraction of the neurons within the population (∼2%) that continued to respond strongly and periodically to the repeated stimulus. Decoding analysis demonstrated that both the transient and sustained responses encoded information about stimulus identity. We conclude that the layer 2/3 population uses a two-channel predictive code: a dense transient code for novel stimuli and a sparse sustained code for familiar stimuli. These results extend and unify existing theories about the nature of predictive neural codes.

Two-photon (TP) calcium imaging is an important imaging modality in neuroscience, allowing for large-scale recording of neural activity in awake, behaving animals at behavior-relevant timescales. Interpretation of TP data requires the accurate extraction of temporal neural activity traces, which can be accomplished via manual or automated methods. In this work we seek to improve the accuracy of both manual and automated TP microscopy demixing methods by introducing a denoising algorithm based on a statistical model of TP data which includes spatial contiguity, sparse activity and Poisson observations. Our method leverages recent developments in stochastic filtering of structured signals based on Laplacian-scale mixture models (LSMs) to model the neural activity in TP data as a set of spatially correlated sparse variables. We apply our method on TP images taken from the visual cortex of an awake, behaving mouse, and demonstrate improved neural activity demixing over current pre-processing techniques.

Linking neural microcircuit function to emergent properties of the mammalian brain requires fine-scale manipulation and measurement of neural activity during behavior, where each neuron’s coding and dynamics can be characterized. We developed an optical method for simultaneous cellular-resolution stimulation and large-scale recording of neuronal activity in behaving mice. Dual-wavelength two-photon excitation allowed largely independent functional imaging with a green fluorescent calcium sensor (GCaMP3, λ = 920 ± 6 nm) and single-neuron photostimulation with a red-shifted optogenetic probe (C1V1, λ = 1,064 ± 6 nm) in neurons coexpressing the two proteins. We manipulated task-modulated activity in individual hippocampal CA1 place cells during spatial navigation in a virtual reality environment, mimicking natural place-field activity, or ‘biasing’, to reveal subthreshold dynamics. Notably, manipulating single place-cell activity also affected activity in small groups of other place cells that were active around the same time in the task, suggesting a functional role for local place cell interactions in shaping firing fields.

Summary Virtual reality (VR) enables precise control of an animal's environment and otherwise impossible experimental manipulations. Neural activity in rodents has been studied on virtual 1D tracks. However, 2D navigation imposes additional requirements, such as the processing of head direction and environment boundaries, and it is unknown whether the neural circuits underlying 2D representations can be sufficiently engaged in VR. We implemented a VR setup for rats, including software and large-scale electrophysiology, that supports 2D navigation by allowing rotation and walking in any direction. The entorhinal-hippocampal circuit, including place, head direction, and grid cells, showed 2D activity patterns similar to those in the real world. Furthermore, border cells were observed, and hippocampal remapping was driven by environment shape, suggesting functional processing of virtual boundaries. These results illustrate that 2D spatial representations can be engaged by visual and rotational vestibular stimuli alone and suggest a novel VR tool for studying rat navigation.

During navigation, grid cells increase their spike rates in firing fields arranged on a markedly regular triangular lattice, whereas their spike timing is often modulated by theta oscillations. Oscillatory interference models of grid cells predict theta amplitude modulations of membrane potential during firing field traversals, whereas competing attractor network models predict slow depolarizing ramps. Here, using in vivo whole-cell recordings, we tested these models by directly measuring grid cell intracellular potentials in mice running along linear tracks in virtual reality. Grid cells had large and reproducible ramps of membrane potential depolarization that were the characteristic signature tightly correlated with firing fields. Grid cells also demonstrated intracellular theta oscillations that influenced their spike timing. However, the properties of theta amplitude modulations were not consistent with the view that they determine firing field locations. Our results support cellular and network mechanisms in which grid fields are produced by slow ramps, as in attractor models, whereas theta oscillations control spike timing.

Discussions of the hippocampus often focus on place cells, but many neurons are not place cells in any given environment. Here we describe the collective activity in such mixed populations, treating place and non-place cells on the same footing. We start with optical imaging experiments on CA1 in mice as they run along a virtual linear track, and use maximum entropy methods to approximate the distribution of patterns of activity in the population, matching the correlations between pairs of cells but otherwise assuming as little structure as possible. We find that these simple models accurately predict the activity of each neuron from the state of all the other neurons in the network, regardless of how well that neuron codes for position. Our results suggest that understanding the neural activity may require not only knowledge of the external variables modulating it, but also of the internal network state.

Two-photon laser scanning microscopy of calcium dynamics using fluorescent indicators is a widely used imaging method for large scale recording of neural activity in vivo. Here we introduce volumetric Two-photon Imaging of Neurons using Stereoscopy (vTwINS), a volumetric calcium imaging method that employs an elongated, V-shaped point spread function to image a 3D brain volume. Single neurons project to spatially displaced image pairs in the resulting 2D image, and the separation distance between images is proportional to depth in the volume. To demix the fluorescence time series of individual neurons, we introduce a novel orthogonal matching pursuit algorithm that also infers source locations within the 3D volume. We illustrate vTwINS by imaging neural population activity in mouse primary visual cortex and hippocampus. Our results demonstrate that vTwINS provides an effective method for volumetric two-photon calcium imaging that increases the number of neurons recorded while maintaining a high frame-rate.

The posterior parietal cortex (PPC) has an important role in many cognitive behaviours; however, the neural circuit dynamics underlying PPC function are not well understood. Here we optically imaged the spatial and temporal activity patterns of neuronal populations in mice performing a PPC-dependent task that combined a perceptual decision and memory-guided navigation in a virtual environment. Individual neurons had transient activation staggered relative to one another in time, forming a sequence of neuronal activation spanning the entire length of a task trial. Distinct sequences of neurons were triggered on trials with opposite behavioural choices and defined divergent, choice-specific trajectories through a state space of neuronal population activity. Cells participating in the different sequences and at distinct time points in the task were anatomically intermixed over microcircuit length scales (

The authors measure the time constant of decay of persistent firing (persistence time) across a population of larval zebrafish oculomotor velocity-to-position neural integrator neurons. They find that persistence times are heterogeneous and topographically organized. This could arise from a circuit architecture in which nearby neurons are more strongly interconnected than distant ones. In a neural integrator, the variability and topographical organization of neuronal firing-rate persistence can provide information about the circuit's functional architecture. We used optical recording to measure the time constant of decay of persistent firing (persistence time) across a population of neurons comprising the larval zebrafish oculomotor velocity-to-position neural integrator. We found extensive persistence time variation (tenfold; coefficients of variation = 0.58–1.20) across cells in individual larvae. We also found that the similarity in firing between two neurons decreased as the distance between them increased and that a gradient in persistence time was mapped along the rostrocaudal and dorsoventral axes. This topography is consistent with the emergence of persistence time heterogeneity from a circuit architecture in which nearby neurons are more strongly interconnected than distant ones. Integrator circuit models characterized by multiple dimensions of slow firing-rate dynamics can account for our results.

Summary Widefield imaging of calcium dynamics is an emerging method for mapping regional neural activity but is currently limited to restrained animals. Here we describe cScope, a head-mounted widefield macroscope developed to image large-scale cortical dynamics in rats during natural behavior. cScope provides a 7.8 × 4 mm field of view and dual illumination paths for both fluorescence and hemodynamic correction and can be fabricated at low cost using readily attainable components. We also report the development of Thy-1 transgenic rat strains with widespread neuronal expression of the calcium indicator GCaMP6f. We combined these two technologies to image large-scale calcium dynamics in the dorsal neocortex during a visual evidence accumulation task. Quantitative analysis of task-related dynamics revealed multiple regions having neural signals that encode behavioral choice and sensory evidence. Our results provide a new transgenic resource for calcium imaging in rats and extend the domain of head-mounted microscopes to larger-scale cortical dynamics. Video Abstract Download : Download video (63MB)

Spatial navigation is often used as a behavioral task in studies of the neuronal circuits that underlie cognition, learning and memory in rodents. The combination of in vivo microscopy with genetically encoded indicators has provided an important new tool for studying neuronal circuits, but has been technically difficult to apply during navigation. Here we describe methods for imaging the activity of neurons in the CA1 region of the hippocampus with subcellular resolution in behaving mice. Neurons that expressed the genetically encoded calcium indicator GCaMP3 were imaged through a chronic hippocampal window. Head-restrained mice performed spatial behaviors in a setup combining a virtual reality system and a custom-built two-photon microscope. We optically identified populations of place cells and determined the correlation between the location of their place fields in the virtual environment and their anatomical location in the local circuit. The combination of virtual reality and high-resolution functional imaging should allow a new generation of studies to investigate neuronal circuit dynamics during behavior.

Macroscopic (millimeter scale) functional clustering is a hallmark characteristic of motor cortex spatial organization in awake behaving mammals; however, almost no information is known about the functional micro-organization (approximately 100 microm scale). Here, we optically recorded intracellular calcium transients of layer 2/3 neurons with cellular resolution over approximately 200-microm-diameter fields in the forelimb motor cortex of mobile, head-restrained mice during two distinct movements (running and grooming). We showed that the temporal correlation between neurons was statistically larger the closer the neurons were to each other. We further explored this correlation by using two separate methods to spatially segment the neurons within each imaging field: K-means clustering and correlations between single neuron activity and mouse movements. The two methods segmented the neurons similarly and led to the conclusion that the origin of the inverse relationship between correlation and distance seen statistically was twofold: clusters of highly temporally correlated neurons were often spatially distinct from one another, and (even when the clusters were spatially intermingled) within the clusters, the more correlated the neurons were to each other, the shorter the distance between them. Our results represent a direct observation of functional clustering within the microcircuitry of the awake mouse motor cortex.