Search

A fundamental principle of biological motor control is that the neural commands driving movement must conform to the response properties of the motor plants they control. In the oculomotor system, characterizations of oculomotor plant dynamics traditionally supported models in which the plant responds to neural drive to extraocular muscles on exclusively short, subsecond timescales. These models predict that the stabilization of gaze during fixations between saccades requires neural drive that approximates eye position on longer timescales and is generated through the temporal integration of brief eye velocity-encoding signals that cause saccades. However, recent measurements of oculomotor plant behaviour have revealed responses on longer timescales. Furthermore, measurements of firing patterns in the oculomotor integrator have revealed a more complex encoding of eye movement dynamics. Yet, the link between these observations has remained unclear. Here we use measurements from the larval zebrafish to link dynamics in the oculomotor plant to dynamics in the neural integrator. The oculomotor plant in both anaesthetized and awake larval zebrafish was characterized by a broad distribution of response timescales, including those much longer than 1 s. Analysis of the firing patterns of oculomotor integrator neurons, which exhibited a broadly distributed range of decay time constants, demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with distributed response timescales. This work suggests that leaky integration on multiple, distributed timescales by the oculomotor integrator reflects an inverse model for generating oculomotor commands, and that multi-timescale dynamics may be a general feature of motor circuitry. KEY POINTS: Recent observations of oculomotor plant response properties and neural activity across the oculomotor system have called into question classical formulations of both the oculomotor plant and the oculomotor integrator. Here we use measurements from new and published experiments in the larval zebrafish together with modelling to reconcile recent oculomotor plant observations with oculomotor integrator function. We developed computational techniques to characterize oculomotor plant responses over several seconds in awake animals, demonstrating that long timescale responses seen in anaesthetized animals extend to the awake state. Analysis of firing patterns of oculomotor integrator neurons demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with multiple, distributed response timescales. Our results support a formulation of gaze stabilization by the oculomotor system in which commands for stabilizing gaze are generated through integration on multiple, distributed timescales.

We have achieved a three fold increase in the speed of transmission electron microscopy by using a beam deflecting mechanism to enable highly efficient acquisition of multiple image tiles for each motion of the mechanical stage. For millimeter-scale areas, the duty cycle of imaging doubles and exceeds 30%, yielding a net average imaging rate of 0.3 gigapixels per second.

To explore how neural circuits represent novel versus familiar inputs, we presented mice with repeated sets of images with novel images sparsely substituted. Using two-photon calcium imaging to record from layer 2/3 neurons in the mouse primary visual cortex, we found that novel images evoked excess activity in the majority of neurons. This novelty response rapidly emerged, arising with a time constant of 2.6 ± 0.9 s. When a new image set was repeatedly presented, a majority of neurons had similarly elevated activity for the first few presentations, which decayed to steady state with a time constant of 1.4 ± 0.4 s. When we increased the number of images in the set, the novelty response's amplitude decreased, defining a capacity to store ∼15 familiar images under our conditions. These results could be explained quantitatively using an adaptive subunit model in which presynaptic neurons have individual tuning and gain control. This result shows that local neural circuits can create different representations for novel versus familiar inputs using generic, widely available mechanisms.

A notable feature of neural activity is sparseness – namely, that only a small fraction of neurons in a local circuit have high activity at any moment. Not only is sparse neural activity observed experimentally in most areas of the brain, but sparseness has been proposed as an optimization or design principle for neural circuits. Sparseness can increase the energy efficiency of the neural code as well as allow for beneficial computations to be carried out. But how does the brain achieve sparse-ness? Here, we found that when neurons in the primary visual cortex were passively exposed to a set of images over several days, neural responses became more sparse. Sparsification was driven by a decrease in the response of neurons with low or moderate activity, while highly active neurons retained similar responses. We also observed a net decorrelation of neural activity. These changes sculpt neural activity for greater coding efficiency.

There is increased appreciation that dopamine neurons in the midbrain respond not only to reward1 and reward-predicting cues1,2, but also to other variables such as the distance to reward3, movements4-9 and behavioural choices10,11. An important question is how the responses to these diverse variables are organized across the population of dopamine neurons. Whether individual dopamine neurons multiplex several variables, or whether there are subsets of neurons that are specialized in encoding specific behavioural variables remains unclear. This fundamental question has been difficult to resolve because recordings from large populations of individual dopamine neurons have not been performed in a behavioural task with sufficient complexity to examine these diverse variables simultaneously. Here, to address this gap, we used two-photon calcium imaging through an implanted lens to record the activity of more than 300 dopamine neurons from the ventral tegmental area of the mouse midbrain during a complex decision-making task. As mice navigated in a virtual-reality environment, dopamine neurons encoded an array of sensory, motor and cognitive variables. These responses were functionally clustered, such that subpopulations of neurons transmitted information about a subset of behavioural variables, in addition to encoding reward. These functional clusters were spatially organized, with neighbouring neurons more likely to be part of the same cluster. Together with the topography between dopamine neurons and their projections, this specialization and anatomical organization may aid downstream circuits in correctly interpreting the wide range of signals transmitted by dopamine neurons.

A fundamental principle of biological motor control is that the neural commands driving movement must conform to the response properties of the motor plants they control. In the oculomotor system, characterizations of oculomotor plant dynamics traditionally supported models in which the plant responds to neural drive to extraocular muscles on exclusively short, subsecond timescales. These models predict that the stabilization of gaze during fixations between saccades requires neural drive that approximates eye position on longer timescales and is generated through the temporal integration of brief eye velocity-encoding signals that cause saccades. However, recent measurements of oculomotor plant behaviour have revealed responses on longer timescales. Furthermore, measurements of firing patterns in the oculomotor integrator have revealed a more complex encoding of eye movement dynamics. Yet, the link between these observations has remained unclear. Here we use measurements from the larval zebrafish to link dynamics in the oculomotor plant to dynamics in the neural integrator. The oculomotor plant in both anaesthetized and awake larval zebrafish was characterized by a broad distribution of response timescales, including those much longer than one second. Analysis of the firing patterns of oculomotor integrator neurons, which exhibited a broadly distributed range of decay time constants, demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with distributed response timescales. This work suggests that leaky integration on multiple, distributed timescales by the oculomotor integrator reflects an inverse model for generating oculomotor commands, and that multi-timescale dynamics may be a general feature of motor circuitry.KEY POINTSRecent observations of oculomotor plant response properties and neural activity across the oculomotor system have called into question classical formulations of both the oculomotor plant and the oculomotor integrator.Here we use measurements from new and published experiments in the larval zebrafish together with modelling to reconcile recent oculomotor plant observations with oculomotor integrator function.We developed computational techniques to characterize oculomotor plant responses over several seconds in awake animals, demonstrating that long timescale responses seen in anesthetized animals extend to the awake state.Analysis of firing patterns of oculomotor integrator neurons demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with multiple, distributed response timescales.Our results support a formulation of gaze stabilization by the oculomotor system in which commands for stabilizing gaze are generated through integration on multiple, distributed timescales.

Electron microscopy of biological tissue has recently seen an unprecedented increase in imaging throughput moving the ultrastructural analysis of large tissue blocks such as whole brains into the realm of the feasible. However, homogeneous, high quality electron microscopy staining of large biological samples is still a major challenge. To date, assessing the staining quality in electron microscopy requires running a sample through the entire staining protocol end-to-end, which can take weeks or even months for large samples, rendering protocol optimization for such samples to be inefficient.Here we present an in situ time-lapsed X-ray assisted staining procedure that opens the “black box” of electron microscopy staining and allows observation of individual staining steps in real time. Using this novel method we measured the accumulation of heavy metals in large tissue samples immersed in different staining solutions. We show that the measured accumulation of osmium in fixed tissue obeys empirically a quadratic dependence between the incubation time and sample size. We found that potassium ferrocyanide, a classic reducing agent for osmium tetroxide, clears the tissue after osmium staining and that the tissue expands in osmium tetroxide solution, but shrinks in reduced osmium solution.X-ray assisted staining gave access to the in situ staining kinetics and allowed us to develop a diffusion-reaction-advection model that accurately simulates the measured accumulation of osmium in tissue. These are first steps towards in silico staining experiments and simulation-guided optimization of staining protocols for large samples. Hence, X-ray assisted staining will be a useful tool for the development of reliable staining procedures for large samples such as entire brains of mice, monkeys or humans.

Cortical areas seem to form a hierarchy of intrinsic timescales, but whether this is causal to cognitive behavior remains unknown. In particular, decisions requiring the gradual accrual of sensory evidence over time recruit widespread areas across this hierarchy. Here, we causally tested the hypothesis that this recruitment is related to the intrinsic integration timescales of these widespread areas. We trained mice to accumulate evidence over seconds while navigating in virtual reality, and optogenetically silenced the activity of many cortical areas during different brief trial epochs. We found that the inactivation of different areas primarily affected the evidence-accumulation computation per se, rather than other decision-related processes. Specifically, we observed selective changes in the weighting of evidence over time, such that frontal inactivations led to deficits on longer timescales than posterior cortical ones. Likewise, large-scale cortical Ca2+ activity during task performance displayed different temporal integration windows matching the effects of inactivation. Our findings suggest that distributed cortical areas accumulate evidence by leveraging their hierarchy of intrinsic timescales.

How does the brain internally represent a sequence of sensory information that jointly drives a decision-making behavior? Studies of perceptual decision-making have often assumed that sensory cortices provide noisy but otherwise veridical sensory inputs to downstream processes that accumulate and drive decisions. However, sensory processing in even the earliest sensory cortices can be systematically modified by various external and internal contexts. We recorded from neuronal populations across posterior cortex as mice performed a navigational decision-making task based on accumulating randomly timed pulses of visual evidence. Even in V1, only a small fraction of active neurons had sensory-like responses time-locked to each pulse. Here, we focus on how these ‘cue-locked’ neurons exhibited a variety of amplitude modulations from sensory to cognitive, notably by choice and accumulated evidence. These task-related modulations affected a large fraction of cue-locked neurons across posterior cortex, suggesting that future models of behavior should account for such influences.

Background The past decade has seen a multitude of new in vivo functional imaging methodologies. However, the lack of ground-truth comparisons or evaluation metrics makes the large-scale, systematic validation vital to the continued development and use of optical microscopy impossible. New-method We provide a new framework for evaluating two-photon microscopy methods via in silico Neural Anatomy and Optical Microscopy (NAOMi) simulation. Our computationally efficient model generates large anatomical volumes of mouse cortex, simulates neural activity, and incorporates optical propagation and scanning to create realistic calcium imaging datasets. Results We verify NAOMi simulations against in vivo two-photon recordings from mouse cortex. We leverage this in silico ground truth to directly compare different segmentation algorithms and optical designs. We find modern segmentation algorithms extract strong neural time-courses comparable to estimation using oracle spatial information, but with an increase in the false positive rate. Comparison between optical setups demonstrate improved resilience to motion artifacts in sparsely labeled samples using Bessel beams, increased signal-to-noise ratio and cell-count using low numerical aperture Gaussian beams and nuclear GCaMP, and more uniform spatial sampling with temporal focusing versus multi-plane imaging. Comparison with existing methods NAOMi is a first-of-its kind framework for assessing optical imaging modalities. Existing methods are either anatomical simulations or do not address functional imaging. Thus there is no competing method for simulating realistic functional optical microscopy data. Conclusions By leveraging the rich accumulated knowledge of neural anatomy and optical physics, we provide a powerful new tool to assess and develop important methods in neural imaging.

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

How do animals make behavioral decisions based on noisy sensory signals, which are moreover a tiny fraction of ongoing activity in the brain? Some theories suggest that sensory responses should be accumulated through time to reduce noise. Others suggest that feedback-based gain control of sensory responses allow small signals to be selectively amplified to drive behavior. We recorded from neuronal populations across posterior cortex as mice performed a decision-making task based on accumulating randomly timed pulses of visual evidence. Here we focus on a subset of neurons, with putative sensory responses that were time-locked to each pulse. These neurons exhibited a variety of amplitude (gain-like) modulations, notably by choice and accumulated evidence. These neural data inspired a hypothetical accumulation circuit with a multiplicative feedback-loop architecture, which parsimoniously explains deviations in perceptual discrimination from Weber-Fechner Law. Our neural observations thus led to a model that synthesizes both accumulation and feedback hypotheses.

During spatial navigation, animals use self-motion to estimate positions through path integration. However, estimation errors accumulate over time and it is unclear how they are corrected. Here we report a new cell class (“cue cell”) in mouse medial entorhinal cortex (MEC) that encoded visual cue information that could be used to correct errors in path integration. Cue cells accounted for a large fraction of unidentified MEC cells. They exhibited firing fields only near visual cues during virtual navigation and spatially stable activity during navigation in a real arena. Cue cells’ responses occurred in sequences repeated at each cue and were likely driven by visual inputs. In layers 2/3 of the MEC, cue cells formed clusters. Anatomically adjacent cue cells responded similarly to cues. These cue cell properties demonstrate that the MEC circuits contain a code representing spatial landmarks that could play a significant role in error correction during path integration.

Hippocampal neurons encode physical variables1–7 such as space1 or auditory frequency6 in cognitive maps8. In addition, functional magnetic resonance imaging studies in humans have shown that the hippocampus can also encode more abstract, learned variables9–11. However, their integration into existing neural representations of physical variables12,13 is unknown. Here, using two-photon calcium imaging, we show that individual neurons in the dorsal hippocampus jointly encode accumulated evidence with spatial position in mice performing a decision-making task in virtual reality14–16. Nonlinear dimensionality reduction13 showed that population activity was well-described by approximately four to six latent variables, which suggests that neural activity is constrained to a low-dimensional manifold. Within this low-dimensional space, both physical and abstract variables were jointly mapped in an orderly manner, creating a geometric representation that we show is similar across mice. The existence of conjoined cognitive maps suggests that the hippocampus performs a general computation—the creation of task-specific low-dimensional manifolds that contain a geometric representation of learned knowledge. The hippocampus geometrically represents both physical location and abstract variables on a neural manifold in mice performing a decision-making task in virtual reality.

Recent work has highlighted that many types of variables are represented in each neocortical area. How can these many neural representations be organized together without interference and coherently maintained/updated through time? We recorded from excitatory neural populations in posterior cortices as mice performed a complex, dynamic task involving multiple interrelated variables. The neural encoding implied that highly correlated task variables were represented by less-correlated neural population modes, while pairs of neurons exhibited a spectrum of signal correlations. This finding relates to principles of efficient coding, but notably utilizes neural population modes as the encoding unit and suggests partial whitening of task-specific information where different variables are represented with different signal-to-noise levels. Remarkably, this encoding function was multiplexed with sequential neural dynamics yet reliably followed changes in task-variable correlations throughout the trial. We suggest that neural circuits can implement time-dependent encodings in a simple way using random sequential dynamics as a temporal scaffold.

SummaryRecent work has highlighted that many types of variables are represented in each neocortical area. How can these many neural representations be organized together without interference, and coherently maintained/updated through time? We recorded from large neural populations in posterior cortices as mice performed a complex, dynamic task involving multiple interrelated variables. The neural encoding implied that correlated task variables were represented by uncorrelated neural-population modes, while pairs of neurons exhibited a variety of signal correlations. This finding relates to principles of efficient coding for task-specific information, with neural-population modes as the encoding unit, and applied across posterior cortical regions and layers 2/3 and 5. Remarkably, this encoding function was multiplexed with sequential neural dynamics as well as reliably followed changes in task-variable correlations through time. We suggest that neural circuits can implement time-dependent encoding in a simple way by using random sequential dynamics as a temporal scaffold.

SummaryStudies of perceptual decision-making have often assumed that the main role of sensory cortices is to provide sensory input to downstream processes that accumulate and drive behavioral decisions. We performed a systematic comparison of neural activity in primary visual (V1) to secondary visual and retrosplenial cortices, as mice performed a task where they should accumulate pulsatile visual cues through time to inform a navigational decision. Even in V1, only a small fraction of neurons had sensory-like responses to cues. Instead, in all areas neurons were sequentially active, and contained information ranging from sensory to cognitive, including cue timings, evidence, place/time, decision and reward outcome. Per-cue sensory responses were amplitude-modulated by various cognitive quantities, notably accumulated evidence. This inspired a multiplicative feedback-loop circuit hypothesis that proposes a more intricate role of sensory areas in the accumulation process, and furthermore explains a surprising observation that perceptual discrimination deviates from Weber-Fechner Law.Highlights / eTOC BlurbMice made navigational decisions based on accumulating pulsatile visual cuesThe bulk of neural activity in visual cortices was sequential and beyond-sensoryAccumulated pulse-counts modulated sensory (cue) responses, suggesting feedbackA feedback-loop neural circuit explains behavioral deviations from Weber’s LawIn a task where navigation was informed by accumulated pulsatile visual evidence, neural activity in visual cortices predominantly coded for cognitive variables across multiple timescales, including outside of a visual processing context. Even sensory responses to visual pulses were amplitude-modulated by accumulated pulse counts and other variables, inspiring a multiplicative feedback-loop circuit hypothesis that in turn explained behavioral deviations from Weber-Fechner Law.

Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in which a principled mechanism is pre-wired into their connectivity. Here we demonstrate that, starting from random connectivity and modifying a small fraction of connections, a largely disordered recur- rent network can produce sequences and implement working memory efficiently. We use this process, called Partial In-Network Training (PINning), to model and match cellular resolution imaging data from the posterior parietal cortex during a virtual memory- guided two-alternative forced-choice task. Analysis of the connectivity reveals that sequences propagate by the cooperation between recurrent synaptic interactions and external inputs, rather than through feedforward or asymmetric connections. Together our results suggest that neural sequences may emerge through learning from largely unstructured network architectures., Comment: 60 pages, 6 figures

Grid cells, defined by their striking periodic spatial responses in open 2D arenas, appear to respond differently on 1D tracks: the multiple response fields are not periodically arranged, peak amplitudes vary across fields, and the mean spacing between fields is larger than in 2D environments. We ask whether such 1D responses are consistent with the system’s 2D dynamics. Combining analytical and numerical methods, we show that the 1D responses of grid cells with stable 1D fields are consistent with a linear slice through a 2D triangular lattice. Further, the 1D responses of comodular cells are well described by parallel slices, and the offsets in the starting points of the 1D slices can predict the measured 2D relative spatial phase between the cells. From these results, we conclude that the 2D dynamics of these cells is preserved in 1D, suggesting a common computation during both types of navigation behavior.

Advances in fluorescence microscopy enable monitoring larger brain areas in-vivo with finer time resolution. The resulting data rates require reproducible analysis pipelines that are reliable, fully automated, and scalable to datasets generated over the course of months. We present CaImAn, an open-source library for calcium imaging data analysis. CaImAn provides automatic and scalable methods to address problems common to pre-processing, including motion correction, neural activity identification, and registration across different sessions of data collection. It does this while requiring minimal user intervention, with good scalability on computers ranging from laptops to high-performance computing clusters. CaImAn is suitable for two-photon and one-photon imaging, and also enables real-time analysis on streaming data. To benchmark the performance of CaImAn we collected and combined a corpus of manual annotations from multiple labelers on nine mouse two-photon datasets. We demonstrate that CaImAn achieves near-human performance in detecting locations of active neurons., eLife digest The human brain contains billions of cells called neurons that rapidly carry information from one part of the brain to another. Progress in medical research and healthcare is hindered by the difficulty in understanding precisely which neurons are active at any given time. New brain imaging techniques and genetic tools allow researchers to track the activity of thousands of neurons in living animals over many months. However, these experiments produce large volumes of data that researchers currently have to analyze manually, which can take a long time and generate irreproducible results. There is a need to develop new computational tools to analyze such data. The new tools should be able to operate on standard computers rather than just specialist equipment as this would limit the use of the solutions to particularly well-funded research teams. Ideally, the tools should also be able to operate in real-time as several experimental and therapeutic scenarios, like the control of robotic limbs, require this. To address this need, Giovannucci et al. developed a new software package called CaImAn to analyze brain images on a large scale. Firstly, the team developed algorithms that are suitable to analyze large sets of data on laptops and other standard computing equipment. These algorithms were then adapted to operate online in real-time. To test how well the new software performs against manual analysis by human researchers, Giovannucci et al. asked several trained human annotators to identify active neurons that were round or donut-shaped in several sets of imaging data from mouse brains. Each set of data was independently analyzed by three or four researchers who then discussed any neurons they disagreed on to generate a ‘consensus annotation’. Giovannucci et al. then used CaImAn to analyze the same sets of data and compared the results to the consensus annotations. This demonstrated that CaImAn is nearly as good as human researchers at identifying active neurons in brain images. CaImAn provides a quicker method to analyze large sets of brain imaging data and is currently used by over a hundred laboratories across the world. The software is open source, meaning that it is freely-available and that users are encouraged to customize it and collaborate with other users to develop it further.

To select actions based on sensory evidence, animals must create and manipulate representations of stimulus information in memory. Here we report that during accumulation of somatosensory evidence, optogenetic manipulation of cerebellar Purkinje cells reduces the accuracy of subsequent memory-guided decisions and causes mice to downweight prior information. Behavioral deficits are consistent with the addition of noise and leak to the evidence accumulation process. We conclude that the cerebellum can influence the accurate maintenance of working memory., Disruption of cerebellar activity impairs working memory during evidence accumulation in mice. Here, the authors show that optogenetic perturbation of Purkinje cell activity disrupts the accurate accumulation of somatosensory information in working memory during perceptual decision-making.

Population recordings of calcium activity are a major source of insight into neural function. Large datasets require automated processing, but this can introduce errors that are difficult to detect. Here we show that popular time course-estimation algorithms often contain substantial misattribution errors affecting 10-20% of transients. Misattribution, in which fluorescence is ascribed to the wrong cell, arises when overlapping cells and processes are imperfectly defined or not identified. To diagnose misattribution, we develop metrics and visualization tools for evaluating large datasets. To correct time courses, we introduce a robust estimator that explicitly accounts for contaminating signals. In one hippocampal dataset, removing contamination reduced the number of place cells by 15%, and 19% of place fields shifted by over 10 cm. Our methods are compatible with other cell-finding techniques, empowering users to diagnose and correct a potentially widespread problem that could alter scientific conclusions.

Population recordings of calcium activity are a major source of insight into neural function. Large dataset sizes often require automated methods, but automation can introduce errors that are difficult to detect. Here we show that automatic time course estimation can sometimes lead to significant misattribution errors, in which fluorescence is ascribed to the wrong cell. Misattribution arises when the shapes of overlapping cells are imperfectly defined, or when entire cells or processes are not identified, and misattribution can even be produced by methods specifically designed to handle overlap. To diagnose this problem, we develop a transient-by-transient metric and a visualization tool that allow users to quickly assess the degree of misattribution in large populations. To filter out misattribution, we also design a robust estimator that explicitly accounts for contaminating signals in a generative model. Our methods can be combined with essentially any cell finding technique, empowering users to diagnose and correct at large scale a problem that has the potential to significantly alter scientific conclusions.

Neural activity throughout the cortex is correlated with perceptual decisions, but inactivation studies suggest that only a small number of areas are necessary for these behaviors. Here we show that the number of required cortical areas, and their dynamics, vary across related tasks with different cognitive computations. In a visually-guided virtual T-maze task, bilateral inactivation of only a few dorsal cortical regions impaired performance. In contrast, in tasks requiring evidence accumulation and/or post-stimulus memory, performance was impaired by inactivation of widespread cortical areas, with diverse patterns of behavioral deficits across areas and tasks. Widefield imaging revealed widespread ramps of Ca(2+) activity during the accumulation and visually-guided tasks. Additionally, during accumulation different regions had more diverse activity profiles, leading to reduced inter-area correlations. Using a modular recurrent neural network model trained to perform analogous tasks, we argue that differences in computational strategies alone could explain these findings.

There is increased appreciation that dopamine (DA) neurons in the midbrain respond not only to reward 1,2 and reward-predicting cues 1,3,4, but also to other variables such as distance to reward 5, movements 6–11 and behavioral choices 12–15. Based on these findings, a major open question is how the responses to these diverse variables are organized across the population of DA neurons. In other words, do individual DA neurons multiplex multiple variables, or are subsets of neurons specialized in encoding specific behavioral variables? The reason that this fundamental question has been difficult to resolve is that recordings from large populations of individual DA neurons have not been performed in a behavioral task with sufficient complexity to examine these diverse variables simultaneously. To address this gap, we used 2-photon calcium imaging through an implanted lens to record activity of >300 midbrain DA neurons in the VTA during a complex decision-making task. As mice navigated in a virtual reality (VR) environment, DA neurons encoded an array of sensory, motor, and cognitive variables. These responses were functionally clustered, such that subpopulations of neurons transmitted information about a subset of behavioral variables, in addition to encoding reward. These functional clusters were spatially organized, such that neighboring neurons were more likely to be part of the same cluster. Taken together with the topography between DA neurons and their projections, this specialization and anatomical organization may aid downstream circuits in correctly interpreting the wide range of signals transmitted by DA neurons.

Hippocampal neurons fire selectively in local behavioral contexts such as the position in an environment or phase of a task,1-3and are thought to form a cognitive map of task-relevant variables.1,4,5However, their activity varies over repeated behavioral conditions,6such as different runs through the same position or repeated trials. Although widely observed across the brain,7-10such variability is not well understood, and could reflect noise or structure, such as the encoding of additional cognitive information.6,11-13Here, we introduce a conceptual model to explain variability in terms of underlying, population-level structure in single-trial neural activity. To test this model, we developed a novel unsupervised learning algorithm incorporating temporal dynamics, in order to characterize population activity as a trajectory on a nonlinear manifold—a space of possible network states. The manifold’s structure captures correlations between neurons and temporal relationships between states, constraints arising from underlying network architecture and inputs. Using measurements of activity over time but no information about exogenous behavioral variables, we recovered hippocampal activity manifolds during spatial and non-spatial cognitive tasks in rats. Manifolds were low-dimensional and smoothly encoded task-related variables, but contained an extra dimension reflecting information beyond the measured behavioral variables. Consistent with our model, neurons fired as a function of overall network state, and fluctuations in their activity across trials corresponded to variation in the underlying trajectory on the manifold. In particular, the extra dimension allowed the system to take different trajectories despite repeated behavioral conditions. Furthermore, the trajectory could temporarily decouple from current behavioral conditions and traverse neighboring manifold points corresponding to past, future, or nearby behavioral states. Our results suggest that trial-to-trial variability in the hippocampus is structured, and may reflect the operation of internal cognitive processes. The manifold structure of population activity is well-suited for organizing information to support memory,1,5,14planning,12,15,16and reinforcement learning.17,18In general, our approach could find broader use in probing the organization and computational role of circuit dynamics in other brain regions.

Advances in fluorescence microscopy enable monitoring larger brain areasin-vivowith finer time resolution. The resulting data rates require reproducible analysis pipelines that are reliable, fully automated, and scalable to datasets generated over the course of months. Here we present CaImAn, an open-source library for calcium imaging data analysis. CaImAn provides automatic and scalable methods to address problems common to pre-processing, including motion correction, neural activity identification, and registration across different sessions of data collection. It does this while requiring minimal user intervention, with good performance on computers ranging from laptops to high-performance computing clusters. CaImAn is suitable for two-photon and one-photon imaging, and also enables real-time analysis on streaming data. To benchmark the performance of CaImAn we collected a corpus of ground truth annotations from multiple labelers on nine mouse two-photon datasets. We demonstrate that CaImAn achieves near-human performance in detecting locations of active neurons.